US20040158412A1 - System and an associated method for operating and monitoring an automation system by means of virtual installation models - Google Patents
System and an associated method for operating and monitoring an automation system by means of virtual installation models Download PDFInfo
- Publication number
- US20040158412A1 US20040158412A1 US10/769,716 US76971604A US2004158412A1 US 20040158412 A1 US20040158412 A1 US 20040158412A1 US 76971604 A US76971604 A US 76971604A US 2004158412 A1 US2004158412 A1 US 2004158412A1
- Authority
- US
- United States
- Prior art keywords
- installation
- virtual
- real
- models
- display unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 91
- 238000012544 monitoring process Methods 0.000 title claims abstract description 17
- 230000008569 process Effects 0.000 claims abstract description 71
- 238000009434 installation Methods 0.000 claims abstract description 60
- 238000010168 coupling process Methods 0.000 claims description 17
- 238000005859 coupling reaction Methods 0.000 claims description 17
- 230000008878 coupling Effects 0.000 claims description 15
- 230000002452 interceptive effect Effects 0.000 claims description 8
- 230000003993 interaction Effects 0.000 description 13
- 230000008859 change Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000001419 dependent effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 230000007257 malfunction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000009828 non-uniform distribution Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/41885—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by modeling, simulation of the manufacturing system
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S715/00—Data processing: presentation processing of document, operator interface processing, and screen saver display processing
- Y10S715/961—Operator interface with visual structure or function dictated by intended use
- Y10S715/965—Operator interface with visual structure or function dictated by intended use for process control and configuration
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S715/00—Data processing: presentation processing of document, operator interface processing, and screen saver display processing
- Y10S715/961—Operator interface with visual structure or function dictated by intended use
- Y10S715/965—Operator interface with visual structure or function dictated by intended use for process control and configuration
- Y10S715/966—Computer process, e.g. operation of computer
Definitions
- the present invention relates to a system for operating and monitoring a real process of a real (i.e. actual) installation, in particular an automation system.
- the invention also relates to a method for operating and monitoring a real (i.e. actual) process of a real installation, in particular an automation system.
- Such an operating and monitoring system is used, for example, in the field of automation technology and forms a so-called HMI (Human Machine Interface).
- HMI Human Machine Interface
- WO 00/07079 which is incorporated herein by reference
- the information data are information sources of a virtual device.
- the virtual device is the representation of a real device, such as an industrial installation.
- a comprehensive overview of the entire device as well as a targeted look at components of the device is achieved in that the virtual components are embedded in a networked frame structure as programs, in accordance with the technological structures of the device.
- the reference WO 00/02162 (corresponding to U.S. application Ser. No. 09/750,673 and incorporated herein by reference as well) describes a method and a device for creating a virtual installation model as an representation of a real installation.
- digital image data which represent a real installation, and installation components of a component library serve as a database.
- the generated virtual representation of the real installation serves as documentation of the actual structure of the installation.
- the virtual representation of the real installation allows for a simplified analysis of malfunctions.
- the use of the virtual installation model for operating and monitoring systems is described.
- European Patent Application EP 0 782 100 A2 teaches a device for determining the spatial expansion of an object.
- the spatial expansion of the object is determined based on a plurality of images taken from various spatial directions and based on of information obtained from the position of the camera being used.
- the thus obtained 3D model can be two-dimensionally displayed on a monitor.
- European Patent Application EP 0 285 506 A2 teaches a system for controlling processes, wherein the system includes a server computer and a client computer, which are coupled via a network, such as the Internet or an Intranet.
- the server is linked to a real process via interface components.
- the client is designed in such a way that a process is operated and monitored by communications via the network and via the server.
- a further, related object is to ensure an error-free operation of the real processes.
- the system includes a storage device for storing virtual installation models, which represent the real installation components. Furthermore, the system includes a display unit for displaying the virtual installation models and interactive interfaces that are included in at least one of the virtual installation models and the display unit.
- a coupler includes a first connection for coupling the interactive interfaces with process data of the real installation components. Therein, the first connection includes a process coupling forward channel as an output of the display unit.
- the coupler also includes a second connection for coupling the virtual installation models with the process data of the real installation components. Therein, the second connection comprises a process coupling backward channel as an input of the display unit.
- the invention is based, among other things, on the recognition that an operation of an automation system in a manner that is as realistic as possible and, therefore, an error-free operation of the automation system can be ensured in that the HMI (Human Machine Interface) includes virtual installation models that represent the real installation components.
- HMI Human Machine Interface
- These virtual installation models are displayed to a user by means of a display unit, for example, wherein, depending on the requirements of the individual installation model, the virtual installation models can be represented as a 2D and/or a 3D representation.
- the real installation components i.e., the real processes including their current process data
- the display unit includes, for example, certain screen sections for interactive purposes, via which the real process can be operated.
- the overall result is a system for displaying processes by means of virtual reality models (VR models). Through this system, the conditions of the real process are continually displayed according to pre-specified criteria. Therein, the conditions are mapped on an animated, representative virtual installation model.
- VR models virtual reality models
- German Laid-Open Publication DE 198 32 974.1 also hereby incorporated herein by reference, teaches one example for creating virtual installation models.
- the system includes a control device for updating the display of the virtual installation models, wherein the respective displays depend on the current position of a virtual camera.
- control device controls the process display in such a way that, depending on the distance of the observer, more or less information about the virtual installation model is displayed.
- the interior of the installation components can be viewed by designing the virtual installation models in such a manner that they are transparent and that they allow for viewing component parts that are covered in the real installation components. Therein, the envelope of the transparent installation model is still displayed so that the spatial context can still be recognized.
- FIG. 1 shows a block diagram of a preferred embodiment of an operating and monitoring system that is capable of displaying a process.
- FIG. 1 shows a block diagram of a preferred embodiment of an operating and monitoring system that is capable of displaying a process.
- the operating and monitoring system includes primarily a data processing device.
- the data processing device includes, among other things, a storage device 9 for storing virtual installation models 1 and a display unit 2 for displaying the virtual installation models 1 .
- the display unit 2 includes interaction interfaces 4 , 14 provided next to the displayed virtual installation models 1 .
- the interaction interfaces 4 include individual screen sections 4 a , 4 b , 4 c , to which certain functions with regard to a displayed installation component are assigned.
- interaction fields 14 a , 14 b By means of interaction fields 14 a , 14 b , a virtual camera position can be varied so that the installation parts displayed in the middle area of the screen of the display unit 2 can be changed. Furthermore, further interaction fields 13 a , 13 b are provided in the area of the virtual installation model 8 itself. By clicking on these interaction fields 13 a , 13 b , for example by means of a “mouse”, corresponding valves of virtual pipes, which are arranged at the virtual tank 8 , can be opened or closed.
- the signal processing parts of the display unit 2 are linked to a real process 3 of an actual automation system 11 via a coupling device 10 , wherein the real process 3 includes partial processes 3 a . 3 d .
- the virtual installation models 8 are enriched with actual process signals by means of the coupling device 10 and the connections 5 , 6 .
- This enrichment of the virtual installation models 8 with process data and process signals makes it possible to dynamically reflect the current condition of a real process 3 in a virtual installation model by means the display unit 2 and in the form of the associated display of the process.
- process values can be interactively changed via the virtual installation model 8 . This can be achieved with the aid of the interaction interfaces 4 a , 4 b , 4 c , for example. For instance, a real process 3 can be started by the interaction interface 4 a or stopped by the interaction interface 4 b .
- the virtual tank 8 and a real tank 7 can be filled, for example.
- the respective resulting current fluid level in the tank 8 is indicated by an arrow 12 in the area of the virtual tank model, for example.
- the condition of the processes or of a virtual model can be shown in a wide variety of forms, for example through color changes, position changes, etc.
- the system shown in FIG. 1 thus enables a user to navigate in virtual reality models, which are enriched by or supplemented with signals from, and which reflect the current status of, a real process 3 to be monitored.
- the current display of a virtual installation model 8 is dependent on the current position of a virtual camera, for example. Therein, the user sees only the current camera section in the process display.
- the camera position can be controlled, for example, by the interaction interfaces 14 a , 14 b .
- navigation is understood to be a dynamic and interactive change of the camera position by the user.
- the user can choose a process view that is currently relevant to him or her.
- This utility can be improved by using virtual reality techniques such as “level of details”, transparency, and various abstract representations for an installation component.
- the “level of detail” technique allows for displaying more or less information about a component in the virtual installation model 8 .
- the “transparency” technique allows for looking into the interior of an installation component, for example, or for looking at covered or obstructed installation components, without the user losing his or her spatial orientation.
- the coverings or outlines of the virtual components can remain slightly visible to aid in the spatial orientation.
- the virtual installation models are shown in perspective, i.e., in such a way that they can be easily interpreted by a human being because they look natural. In this way, even installations with large dimensions can be displayed on the screen in a compact manner, without danger of the user losing the overview over the installation.
- a combination of 2D and 3D images is especially well suited for displaying the virtual installation models 1 , 8 .
- the 3D image allows for an overview of the installation, while, in contrast thereto, the 2D image displays process values and operating elements very compactly. This is independent of the current view at the installation components.
- 2D elements can be combined with VR views (virtual reality) into an installation display image so as to form a virtual reality model.
- the component to be viewed or to be operated is selected, for example, in the virtual reality model by displaying or changing the respective process values, for example with the help of the 2D elements.
- the spatial arrangement of the display unit 2 i.e., of the operating and monitoring system, can be completely remote and independent of the real installation 11 .
- the coupling between the display unit 2 and the real installation 11 i.e., the forward channel 6 and backward channel 5 , is realized, for example, as an Ethernet, Intranet or Internet connection.
- the real installation 7 , 11 can be realistically operated independent of the actual location of the real installation 7 , 11 .
- the display unit 2 is responsible for reading in a virtual installation model 1 , 8 ; for assigning current process values to input and output signals of the virtual installation model 8 and the interaction interfaces 4 , 14 ; for providing the input signals of the virtual installation model 8 with the real process values; for providing the interaction means 4 , 14 with the real process 3 ; for transmitting the output signals 6 from the virtual installation model 8 to the real process 3 ; for displaying, e.g., superimposing, the current process condition onto the basic version of the virtual installation model 8 ; for displaying additional 2D elements 4 , 14 , for example in the form of text and/or graphics; and for setting up images for the process display 2 , which include 2D elements and 3D views, i.e., representative views.
- the process display unit 2 thus forms a system that includes hardware and software components.
- the hardware components include the usual components found in a computer system, in particular a so-called CPU (Central Processor Unit); a primary storage; a secondary storage, such as hard disk; input devices, such as a keyboard; pointing devices (e.g., mouse, 3D mouse); output devices, such as a graphic card, a screen, a video projector, 3D projectors, etc.; and communication devices, such as an Ethernet network card.
- CPU Central Processor Unit
- a primary storage such as hard disk
- input devices such as a keyboard
- pointing devices e.g., mouse, 3D mouse
- output devices such as a graphic card, a screen, a video projector, 3D projectors, etc.
- communication devices such as an Ethernet network card.
- the process display unit 2 includes a so-called virtual reality import, which reads in a virtual reality model, for example in VRML format.
- the virtual reality import also provides for conversion into the internal representation of the component displays.
- the component display which includes 2D elements and 3D views, is capable of displaying images on a projection system, for example a computer screen, and is capable of updating the images based on events and changes of the process values of the real process. Furthermore, the component display is capable of evaluating information inputs via the interaction interfaces 4 , 13 , 14 , and of sending the information inputs to the 2D elements or the 3D views.
- an event is understood to be a value, which can be sent to components that have an event interface. The value is sent to these components via the operating system, for example via a mouse click or via the process coupling.
- the 2D elements are typical elements of a computer graphic, such as lines, curves, rectangles, text, etc. Therein, the 2D elements can also include a grouping of other 2D elements.
- the 2D elements and the 3D views of the operating and monitoring system shown in FIG. 1 have an interface, via which the events can be sent or received. Therein, incoming events can lead to a change in the internal condition or state of a 2D element or a 3D view, i.e., for example to a change in the display or representation, such as a change of color, position, or size.
- a display or representation of the virtual installation models 1 , 8 is achieved.
- All image information, the construction of the images, the interconnection of the 2D elements and the 3D views with the process values or the interconnection between the 2D elements and the 3D views, the list of the available process values, and the communication information required for exchanging the process values with the real process are held by means of a data storage or data buffering.
- the present invention relates to a system and a method for operating and monitoring an automation system, in which, via the virtual installation models 1 , the processes of the automation system are, by means of the display unit 2 , displayed or represented as a representation of the real installation components 7 .
- the display unit 2 includes the input screen sections 4 a , 4 b , 4 c , 13 a , 13 b , 14 a , and 14 b in order to allow a user to interactively operate and monitor the displayed installation components 8 .
- the inventive method allows the user to navigate in the virtual installation models 8 , which reflect essentially exactly the real conditions and the current conditions of the automation system.
- 2D and 3D displays or representations the user can choose the most appropriate form of representation for the individual case at hand.
- the invention thus facilitates a reality-based representation of the automation system, which makes it possible to intuitively operate and monitor even complex processes.
Landscapes
- Engineering & Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- General Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
- Testing And Monitoring For Control Systems (AREA)
- Processing Or Creating Images (AREA)
- Selective Calling Equipment (AREA)
Abstract
A system and a method for operating and monitoring an automation system, in which, via virtual installation models (1), processes of the automation system are, by means of a display unit (2), displayed or represented as a representation of real installation components (7). The display unit 2 includes input screen sections (4 a, 4 b, 4 c) in order to allow a user to interactively operate displayed installation components 8. The method allows the user to navigate in the virtual installation models 8, which exactly reflect the real conditions and the current conditions of the automation system. By combining 2D and 3D displays or representations, the user can choose the most appropriate form of representation for the individual case at hand. The invention thus facilitates a reality-based representation of the automation system, which makes it possible to intuitively operate and monitor even complex processes.
Description
- This is a Continuation of International Application PCT/DE00/00033, with an international filing date of Jan. 4, 2000, which was published under PCT Article 21(2) in German, and the complete disclosure of which is incorporated into this application by reference.
- The present invention relates to a system for operating and monitoring a real process of a real (i.e. actual) installation, in particular an automation system. The invention also relates to a method for operating and monitoring a real (i.e. actual) process of a real installation, in particular an automation system.
- Such an operating and monitoring system is used, for example, in the field of automation technology and forms a so-called HMI (Human Machine Interface).
- In the reference WO 00/07079 (which is incorporated herein by reference), a system and a method for dynamic administration of information data is described, in which the information data are information sources of a virtual device. The virtual device is the representation of a real device, such as an industrial installation. A comprehensive overview of the entire device as well as a targeted look at components of the device is achieved in that the virtual components are embedded in a networked frame structure as programs, in accordance with the technological structures of the device.
- The reference WO 00/02162 (corresponding to U.S. application Ser. No. 09/750,673 and incorporated herein by reference as well) describes a method and a device for creating a virtual installation model as an representation of a real installation. Therein, digital image data, which represent a real installation, and installation components of a component library serve as a database. The generated virtual representation of the real installation serves as documentation of the actual structure of the installation. Furthermore, the virtual representation of the real installation allows for a simplified analysis of malfunctions. In addition, the use of the virtual installation model for operating and monitoring systems is described.
- European Patent Application EP 0 782 100 A2 teaches a device for determining the spatial expansion of an object. The spatial expansion of the object is determined based on a plurality of images taken from various spatial directions and based on of information obtained from the position of the camera being used. The thus obtained 3D model can be two-dimensionally displayed on a monitor.
- European Patent Application EP 0 285 506 A2 teaches a system for controlling processes, wherein the system includes a server computer and a client computer, which are coupled via a network, such as the Internet or an Intranet. In addition, the server is linked to a real process via interface components. The client is designed in such a way that a process is operated and monitored by communications via the network and via the server. The disclosure of both of the above European Patent Applications are incorporated herein by reference.
- It is an object of the present invention to provide a system and a method for operating and monitoring real processes, wherein the system and the method allow for a display and an assessment of process conditions in a manner that is as realistic as possible. A further, related object is to ensure an error-free operation of the real processes.
- According to one formulation of the present invention, these and other objects are achieved by a system for operating and monitoring real processes of a real installation that has real installation components. Therein, the system includes a storage device for storing virtual installation models, which represent the real installation components. Furthermore, the system includes a display unit for displaying the virtual installation models and interactive interfaces that are included in at least one of the virtual installation models and the display unit. A coupler includes a first connection for coupling the interactive interfaces with process data of the real installation components. Therein, the first connection includes a process coupling forward channel as an output of the display unit. The coupler also includes a second connection for coupling the virtual installation models with the process data of the real installation components. Therein, the second connection comprises a process coupling backward channel as an input of the display unit.
- The invention is based, among other things, on the recognition that an operation of an automation system in a manner that is as realistic as possible and, therefore, an error-free operation of the automation system can be ensured in that the HMI (Human Machine Interface) includes virtual installation models that represent the real installation components.
- These virtual installation models are displayed to a user by means of a display unit, for example, wherein, depending on the requirements of the individual installation model, the virtual installation models can be represented as a 2D and/or a 3D representation. It is one distinguishing feature of the method and the system in accordance with the present invention that the real installation components, i.e., the real processes including their current process data, are integrated into the display of the virtual installation models. This is achieved by a coupling, which couples the virtual installation models to the process data of the real installation components. In addition, the display unit includes, for example, certain screen sections for interactive purposes, via which the real process can be operated. The overall result is a system for displaying processes by means of virtual reality models (VR models). Through this system, the conditions of the real process are continually displayed according to pre-specified criteria. Therein, the conditions are mapped on an animated, representative virtual installation model.
- By interacting with the virtual installation model, a user is able to change process values. German Laid-Open Publication DE 198 32 974.1, also hereby incorporated herein by reference, teaches one example for creating virtual installation models.
- To ensure user navigation that is as realistic as possible, the system includes a control device for updating the display of the virtual installation models, wherein the respective displays depend on the current position of a virtual camera.
- To further improve the overview of even complex installations and processes, the control device controls the process display in such a way that, depending on the distance of the observer, more or less information about the virtual installation model is displayed.
- The interior of the installation components can be viewed by designing the virtual installation models in such a manner that they are transparent and that they allow for viewing component parts that are covered in the real installation components. Therein, the envelope of the transparent installation model is still displayed so that the spatial context can still be recognized.
- The invention and further advantageous refinements of the invention according to the features of the dependent claims are explained in more detail below with the aid of diagrammatic, exemplary embodiments in the drawing, in which:
- FIG. 1 shows a block diagram of a preferred embodiment of an operating and monitoring system that is capable of displaying a process.
- FIG. 1 shows a block diagram of a preferred embodiment of an operating and monitoring system that is capable of displaying a process. The operating and monitoring system includes primarily a data processing device. The data processing device includes, among other things, a
storage device 9 for storingvirtual installation models 1 and adisplay unit 2 for displaying thevirtual installation models 1. Furthermore, thedisplay unit 2 includesinteraction interfaces 4, 14 provided next to the displayedvirtual installation models 1. Theinteraction interfaces 4 includeindividual screen sections interaction fields display unit 2 can be changed. Furthermore,further interaction fields virtual installation model 8 itself. By clicking on theseinteraction fields virtual tank 8, can be opened or closed. The signal processing parts of thedisplay unit 2 are linked to a real process 3 of anactual automation system 11 via acoupling device 10, wherein the real process 3 includespartial processes 3 a. 3 d. Therein, a first connection 6 (=process-coupling forward channel) serves as an output channel from thedisplay unit 2, while a second connection 5 (=process-coupling backward channel) is designed as an input channel to thedisplay unit 2. - It is one distinguishing characteristic of the system shown in FIG. 1 that the
virtual installation models 8 are enriched with actual process signals by means of thecoupling device 10 and theconnections virtual installation models 8 with process data and process signals makes it possible to dynamically reflect the current condition of a real process 3 in a virtual installation model by means thedisplay unit 2 and in the form of the associated display of the process. Furthermore, process values can be interactively changed via thevirtual installation model 8. This can be achieved with the aid of theinteraction interfaces interaction interface 4 a or stopped by theinteraction interface 4 b. By means of thethird interaction interface 4 c, thevirtual tank 8 and areal tank 7 can be filled, for example. Preferably, the respective resulting current fluid level in thetank 8 is indicated by anarrow 12 in the area of the virtual tank model, for example. In addition or alternatively, the condition of the processes or of a virtual model can be shown in a wide variety of forms, for example through color changes, position changes, etc. - The system shown in FIG. 1 thus enables a user to navigate in virtual reality models, which are enriched by or supplemented with signals from, and which reflect the current status of, a real process3 to be monitored. The current display of a
virtual installation model 8 is dependent on the current position of a virtual camera, for example. Therein, the user sees only the current camera section in the process display. The camera position can be controlled, for example, by the interaction interfaces 14 a, 14 b. In this context, navigation is understood to be a dynamic and interactive change of the camera position by the user. The user can choose a process view that is currently relevant to him or her. For example, the user can navigate from a general overview to a malfunctioning part of the installation, without losing his or her spatial orientation (=camera movement). This utility can be improved by using virtual reality techniques such as “level of details”, transparency, and various abstract representations for an installation component. Depending on the distance of the observer from the installation, the “level of detail” technique allows for displaying more or less information about a component in thevirtual installation model 8. The “transparency” technique allows for looking into the interior of an installation component, for example, or for looking at covered or obstructed installation components, without the user losing his or her spatial orientation. For example, the coverings or outlines of the virtual components can remain slightly visible to aid in the spatial orientation. - In the preferred embodiment shown in FIG. 1, the virtual installation models are shown in perspective, i.e., in such a way that they can be easily interpreted by a human being because they look natural. In this way, even installations with large dimensions can be displayed on the screen in a compact manner, without danger of the user losing the overview over the installation. A combination of 2D and 3D images is especially well suited for displaying the
virtual installation models process display unit 2, wherein 2D elements can be combined with VR views (virtual reality) into an installation display image so as to form a virtual reality model. The component to be viewed or to be operated is selected, for example, in the virtual reality model by displaying or changing the respective process values, for example with the help of the 2D elements. - Through a realistic display of the process status based on the
virtual installation model 8, the knowledge of the user, such as the knowledge about critical conditions, can be incorporated into operating and monitoring the real installation. As a result, for example, malfunctions can be intuitively recognized in time. For instance, a non-uniform distribution of containers in a block warehouse or a high rack warehouse can be recognized and conclusions with respect to irregular distributions can be drawn. Because of the realistic display of the real installation, the user can react “on the spot”, as he or she is normally used to. This results in a more intuitive and therefore more reliable operation of thereal installation 11. The step of switching from the real representation to an abstract representation is eliminated. The spatial arrangement of thedisplay unit 2, i.e., of the operating and monitoring system, can be completely remote and independent of thereal installation 11. The coupling between thedisplay unit 2 and thereal installation 11, i.e., theforward channel 6 andbackward channel 5, is realized, for example, as an Ethernet, Intranet or Internet connection. Thus, thereal installation real installation - In the following, the essential responsibilities of the
display unit 2 are described and explained. Thedisplay unit 2 is responsible for reading in avirtual installation model virtual installation model 8 and theinteraction interfaces 4, 14; for providing the input signals of thevirtual installation model 8 with the real process values; for providing the interaction means 4, 14 with the real process 3; for transmitting theoutput signals 6 from thevirtual installation model 8 to the real process 3; for displaying, e.g., superimposing, the current process condition onto the basic version of thevirtual installation model 8; for displayingadditional 2D elements 4, 14, for example in the form of text and/or graphics; and for setting up images for theprocess display 2, which include 2D elements and 3D views, i.e., representative views. - The
process display unit 2 thus forms a system that includes hardware and software components. The hardware components include the usual components found in a computer system, in particular a so-called CPU (Central Processor Unit); a primary storage; a secondary storage, such as hard disk; input devices, such as a keyboard; pointing devices (e.g., mouse, 3D mouse); output devices, such as a graphic card, a screen, a video projector, 3D projectors, etc.; and communication devices, such as an Ethernet network card. Therein, the use of the hardware and the coordination of the software modules is supported by an operating system. - The
process display unit 2 includes a so-called virtual reality import, which reads in a virtual reality model, for example in VRML format. The virtual reality import also provides for conversion into the internal representation of the component displays. The component display, which includes 2D elements and 3D views, is capable of displaying images on a projection system, for example a computer screen, and is capable of updating the images based on events and changes of the process values of the real process. Furthermore, the component display is capable of evaluating information inputs via theinteraction interfaces 4, 13, 14, and of sending the information inputs to the 2D elements or the 3D views. Therein, an event is understood to be a value, which can be sent to components that have an event interface. The value is sent to these components via the operating system, for example via a mouse click or via the process coupling. - The 2D elements are typical elements of a computer graphic, such as lines, curves, rectangles, text, etc. Therein, the 2D elements can also include a grouping of other 2D elements. The 2D elements and the 3D views of the operating and monitoring system shown in FIG. 1 have an interface, via which the events can be sent or received. Therein, incoming events can lead to a change in the internal condition or state of a 2D element or a 3D view, i.e., for example to a change in the display or representation, such as a change of color, position, or size. By means of the 3D views, a display or representation of the
virtual installation models - In summary, the present invention relates to a system and a method for operating and monitoring an automation system, in which, via the
virtual installation models 1, the processes of the automation system are, by means of thedisplay unit 2, displayed or represented as a representation of thereal installation components 7. Thedisplay unit 2 includes theinput screen sections installation components 8. The inventive method allows the user to navigate in thevirtual installation models 8, which reflect essentially exactly the real conditions and the current conditions of the automation system. By combining 2D and 3D displays or representations, the user can choose the most appropriate form of representation for the individual case at hand. The invention thus facilitates a reality-based representation of the automation system, which makes it possible to intuitively operate and monitor even complex processes. - The above description of the preferred embodiments has been given by way of example. From the disclosure given, those skilled in the art will not only understand the present invention and its attendant advantages, but will also find apparent various changes and modifications to the structures and methods disclosed. It is sought, therefore, to cover all such changes and modifications as fall within the spirit and scope of the invention, as defined by the appended claims, and equivalents thereof.
Claims (11)
1. A system for operating and monitoring real processes of a real installation having real installation components, comprising:
a storage device for storing virtual installation models, which represent the real installation components;
a display unit for displaying the virtual installation models;
interactive interfaces that are included in at least one of i) the virtual installation models and ii) the display unit; and
a coupler, comprising:
a first connection for coupling the interactive interfaces with process data of the real installation components, wherein the first connection comprises a process coupling forward channel as an output of the display unit; and
a second connection for coupling the virtual installation models with the process data of the real installation components, wherein the second connection comprises a process coupling backward channel as an input of the display unit.
2. The system as claimed in claim 1 , wherein the real installation comprises an automation system.
3. The system as claimed in claim 1 , wherein the display unit displays the virtual installation models as at least one of i) two-dimensional objects and ii) three-dimensional objects.
4. The system as claimed in claim 1 , further comprising:
a virtual camera; and
a control device to control updated displays of the virtual installation models in accordance with a respective current position of the virtual camera.
5. The system as claimed in claim 4 ,
wherein the control device comprises a controller for controlling displays of the real processes such that an amount of information displayed in the virtual installation models is a function of a viewing distance from the real installation.
6. The system as claimed in claim 1 ,
wherein the virtual installation models include transparent portions allowing a view at component parts that are covered in the real installation components; and
wherein respective outlines of the transparent portions are displayed to ensure spatial orientation within the virtual installation models.
7. A method for operating and monitoring a real process of a real installation having real installation components, comprising:
storing virtual installation models in a storage device, wherein the virtual installation models represent the real installation components;
displaying the virtual installation models by means of a display unit;
operating the real installation via interactive interfaces and via a first connection that is designed as a process coupling forward channel as an output of the display unit, wherein the interactive interfaces are included in at least one of i) the virtual installation models and ii) the display unit; and
feeding the virtual installation models with process data from the real installation components via a second connection that is designed as a process coupling backward channel as an input of the display unit.
8. The method as claimed in claim 7 , wherein the virtual installation models are displayed as at least one of i) two-dimensional objects and ii) three-dimensional objects.
9. The method as claimed in claim 7 , wherein the virtual installation models are displayed in accordance with a current position of at least one virtual camera.
10. The method as claimed in claim 7 , wherein an amount of information displayed in the virtual installation models is a function of a viewing distance from the real installation.
11. The method as claimed in claim 7 ,
wherein the virtual installation models include transparent portions allowing a view at component parts that are covered in the real installation components; and
wherein respective outlines of the transparent portions are displayed to ensure spatial orientation within the virtual installation models.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/769,716 US20040158412A1 (en) | 1999-01-12 | 2004-02-02 | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE19900884A DE19900884A1 (en) | 1999-01-12 | 1999-01-12 | System and method for operating and observing an automation system with process visualization and process control using virtual plant models as an image of a real plant |
DE19900884.1 | 1999-01-12 | ||
PCT/DE2000/000033 WO2000042481A1 (en) | 1999-01-12 | 2000-01-04 | System and method for operating and monitoring an automation system |
US09/902,575 US6718215B2 (en) | 1999-01-12 | 2001-07-12 | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
US10/769,716 US20040158412A1 (en) | 1999-01-12 | 2004-02-02 | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/902,575 Continuation US6718215B2 (en) | 1999-01-12 | 2001-07-12 | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040158412A1 true US20040158412A1 (en) | 2004-08-12 |
Family
ID=7894045
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/902,575 Expired - Lifetime US6718215B2 (en) | 1999-01-12 | 2001-07-12 | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
US10/769,716 Abandoned US20040158412A1 (en) | 1999-01-12 | 2004-02-02 | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/902,575 Expired - Lifetime US6718215B2 (en) | 1999-01-12 | 2001-07-12 | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
Country Status (7)
Country | Link |
---|---|
US (2) | US6718215B2 (en) |
EP (1) | EP1141799B1 (en) |
CN (1) | CN1156737C (en) |
AT (1) | ATE241817T1 (en) |
DE (2) | DE19900884A1 (en) |
ES (1) | ES2199773T3 (en) |
WO (1) | WO2000042481A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080201113A1 (en) * | 2005-03-14 | 2008-08-21 | Holomar, Inc. | Methods and Systems for Combining Models of Goods and Services |
US20110001751A1 (en) * | 2009-04-23 | 2011-01-06 | Stefan Carlsson | Providing navigation instructions |
Families Citing this family (50)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0825506B1 (en) | 1996-08-20 | 2013-03-06 | Invensys Systems, Inc. | Methods and apparatus for remote process control |
DE19832974A1 (en) * | 1998-07-22 | 2000-01-27 | Siemens Ag | Arrangement for generating virtual industrial system model compares system component information with real system image data to identify components in image data |
DE19900884A1 (en) * | 1999-01-12 | 2000-07-20 | Siemens Ag | System and method for operating and observing an automation system with process visualization and process control using virtual plant models as an image of a real plant |
US7089530B1 (en) * | 1999-05-17 | 2006-08-08 | Invensys Systems, Inc. | Process control configuration system with connection validation and configuration |
WO2000070417A1 (en) | 1999-05-17 | 2000-11-23 | The Foxboro Company | Process control configuration system with parameterized objects |
US6788980B1 (en) | 1999-06-11 | 2004-09-07 | Invensys Systems, Inc. | Methods and apparatus for control using control devices that provide a virtual machine environment and that communicate via an IP network |
WO2002033603A2 (en) | 2000-10-20 | 2002-04-25 | Siemens Aktiengesellschaft | System and method for managing software applications, especially manufacturing execution system (mes) applications |
DE10134940B4 (en) * | 2001-07-23 | 2004-08-19 | Kuka Schweissanlagen Gmbh | Development system and development process for a real control system |
DE10141521C1 (en) * | 2001-08-24 | 2003-01-09 | Siemens Ag | User information representation system has specific user information assigned to calculated position coordinates of image of environment provided by camera |
EP1380911A1 (en) * | 2002-07-12 | 2004-01-14 | Inter-Technology Crystal N.V. | System for gaining access to information relating to industrial sites with a substantial complexity |
DE10353051A1 (en) * | 2003-11-13 | 2005-06-09 | Siemens Ag | Method for simulating an automation system |
US7877158B2 (en) * | 2003-11-21 | 2011-01-25 | Siemens Aktiengesellschaft | Method for operating industrial installations |
DE102006014634B4 (en) * | 2005-04-01 | 2014-01-30 | Abb Research Ltd. | Human machine interface for a control system |
DE102005045855A1 (en) * | 2005-09-26 | 2007-03-29 | Siemens Ag | Method and apparatus for facilitating the adjustment of systems in which objects are moved |
US7817150B2 (en) * | 2005-09-30 | 2010-10-19 | Rockwell Automation Technologies, Inc. | Three-dimensional immersive system for representing an automation control environment |
CN100450178C (en) * | 2005-12-14 | 2009-01-07 | 浙江工业大学 | Universal automation equipment Long-distance monitoring system based on screen simulating technique |
US8823751B2 (en) | 2006-01-26 | 2014-09-02 | Autodesk, Inc. | Size based display of piping systems |
US7644363B2 (en) * | 2006-04-10 | 2010-01-05 | Autodesk, Inc. | “For-each” label components in CAD drawings |
DE102006049981A1 (en) * | 2006-10-24 | 2008-04-30 | Krones Ag | Container handling device e.g. labeling machine, for use in beverage manufacturing industry, has monitoring unit with manipulation unit providing image sequence in response to output signals based on data |
SI2080073T1 (en) | 2006-10-24 | 2011-10-28 | Krones Ag | Manipulation aid for a device for manipulating containers |
RU2495476C2 (en) | 2008-06-20 | 2013-10-10 | Инвенсис Системз, Инк. | Systems and methods for immersive interaction with actual and/or simulated facilities for process, environmental and industrial control |
CN102428418B (en) * | 2009-05-08 | 2015-02-25 | 皇家飞利浦电子股份有限公司 | Interactive device adapted to interactively communicate with remote device |
US8127060B2 (en) | 2009-05-29 | 2012-02-28 | Invensys Systems, Inc | Methods and apparatus for control configuration with control objects that are fieldbus protocol-aware |
US8463964B2 (en) | 2009-05-29 | 2013-06-11 | Invensys Systems, Inc. | Methods and apparatus for control configuration with enhanced change-tracking |
US8503381B2 (en) * | 2009-08-03 | 2013-08-06 | Lg Electronics Inc. | Apparatus and method for configuring radio connection in multiple component carrier system |
JP5343781B2 (en) * | 2009-09-15 | 2013-11-13 | 株式会社リコー | Information processing apparatus and program |
NO20100339A1 (en) * | 2010-03-10 | 2011-05-23 | Seabed Rig As | Procedure and device for ensuring the operation of automatic or autonomous equipment |
CN101790105A (en) * | 2010-03-22 | 2010-07-28 | 上海复翔信息科技有限公司 | Holographic interaction system and construction method thereof |
DE102011107228A1 (en) | 2011-07-13 | 2013-01-17 | Volkswagen Aktiengesellschaft | Method for detecting collision of e.g., outer side mirror of motor vehicle i.e. motor car, with tool of assembly line, involves viewing collision for set of positions along production line by analysis of chamber profile with hull profile |
CN102929592B (en) * | 2011-08-08 | 2017-08-15 | 霍尼韦尔国际公司 | The method and device of the three-dimension interaction of equipment based on monitoring system |
US8660830B2 (en) | 2011-09-13 | 2014-02-25 | The Procter & Gamble Company | Machine emulator methods |
US8600715B2 (en) | 2011-09-13 | 2013-12-03 | The Procter & Gamble Company | Methods for machine emulation and process response prediction |
US8600714B2 (en) | 2011-09-13 | 2013-12-03 | The Procter & Gamble Company | Systems for machine emulation and process response prediction |
US8670965B2 (en) | 2011-09-13 | 2014-03-11 | The Procter & Gamble Company | Machine emulator products |
US8660829B2 (en) | 2011-09-13 | 2014-02-25 | The Procter & Gamble Company | Machine emulator machines |
US10289108B2 (en) * | 2012-03-15 | 2019-05-14 | General Electric Company | Methods and apparatus for monitoring operation of a system asset |
US8868384B2 (en) * | 2012-03-15 | 2014-10-21 | General Electric Company | Methods and apparatus for monitoring operation of a system asset |
US20130246037A1 (en) * | 2012-03-15 | 2013-09-19 | Kenneth Paul Ceglia | Methods and apparatus for monitoring operation of a system asset |
US10055512B2 (en) * | 2012-07-16 | 2018-08-21 | Omc2 Llc | System and method for CNC machines and software |
DE102013111052A1 (en) * | 2013-10-07 | 2015-04-23 | Endress + Hauser Gmbh + Co. Kg | System for flexible operation of an automation system |
US20150196363A1 (en) | 2013-12-07 | 2015-07-16 | Insurgical Inc. | Limited-use tool disposable enclosure |
HUE037927T2 (en) | 2016-02-02 | 2018-09-28 | Grieshaber Vega Kg | Proactive transmission of values to mobile terminals |
US10838583B2 (en) | 2016-05-17 | 2020-11-17 | General Electric Company | Systems and methods for prioritizing and monitoring device status in a condition monitoring software application |
US20180357922A1 (en) | 2017-06-08 | 2018-12-13 | Honeywell International Inc. | Apparatus and method for assessing and tracking user competency in augmented/virtual reality-based training in industrial automation systems and other systems |
DE102018205007A1 (en) | 2018-04-04 | 2019-10-10 | Volkswagen Aktiengesellschaft | Method, apparatus and computer readable storage medium with instructions for creating a virtual reality application |
CN109120441B (en) * | 2018-08-15 | 2021-07-20 | 亚信科技(中国)有限公司 | Remote regulation and control method and device and electronic equipment |
CN109636923A (en) * | 2018-12-20 | 2019-04-16 | 深圳瑞和建筑装饰股份有限公司 | Prefabricated member based on VR installs Visualization Demo method and system |
AT524984A1 (en) * | 2021-05-12 | 2022-11-15 | Marwin Solutions Gmbh | METHOD OF OPERATING AN INDUSTRIAL PLANT |
CA3240692A1 (en) * | 2022-01-04 | 2023-07-13 | Saad AZHAR | Operator assistance in an automation system |
CN115881291B (en) * | 2023-02-28 | 2023-06-02 | 苏州阿基米德网络科技有限公司 | Operation and maintenance training system and method for medical equipment |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5647009A (en) * | 1992-10-20 | 1997-07-08 | Hitachi, Ltd. | Computer aided work support system and method |
US5956665A (en) * | 1996-11-15 | 1999-09-21 | Digital Equipment Corporation | Automatic mapping, monitoring, and control of computer room components |
US6282455B1 (en) * | 1998-10-19 | 2001-08-28 | Rockwell Technologies, Llc | Walk-through human/machine interface for industrial control |
US6292712B1 (en) * | 1998-01-29 | 2001-09-18 | Northrop Grumman Corporation | Computer interface system for a robotic system |
US6380949B2 (en) * | 1998-09-17 | 2002-04-30 | General Electric Company | Man-machine interface for a virtual annunciator panel display |
US6718215B2 (en) * | 1999-01-12 | 2004-04-06 | Siemens Aktiengesellschaft | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH05224963A (en) * | 1991-09-10 | 1993-09-03 | Internatl Business Mach Corp <Ibm> | Process control system for real-time system |
DE4411314C2 (en) * | 1994-03-26 | 1997-12-04 | Daimler Benz Ag | Arrangement for process-oriented animation of a hierarchical simulation model true to the structure |
DE19549306A1 (en) * | 1995-12-22 | 1997-07-03 | Art & Com Medientechnologie Un | Method and device for the visual representation of spatial data |
JPH09187038A (en) * | 1995-12-27 | 1997-07-15 | Canon Inc | Three-dimensional shape extract device |
EP0825506B1 (en) * | 1996-08-20 | 2013-03-06 | Invensys Systems, Inc. | Methods and apparatus for remote process control |
DE19814407B4 (en) * | 1997-05-09 | 2007-04-19 | Siemens Ag | Method and device for neural modeling of a paper winding device |
US6034739A (en) * | 1997-06-09 | 2000-03-07 | Evans & Sutherland Computer Corporation | System for establishing a three-dimensional garbage matte which enables simplified adjusting of spatial relationships between physical and virtual scene elements |
ATE215246T1 (en) * | 1998-06-30 | 2002-04-15 | Siemens Ag | DEVICE AND METHOD FOR CREATING A VIRTUAL SYSTEM MODEL |
DE19834456A1 (en) * | 1998-07-30 | 2000-02-03 | Siemens Ag | Information, control and / or observation system with model-based user interface and method for model-based control and / or observation |
-
1999
- 1999-01-12 DE DE19900884A patent/DE19900884A1/en not_active Withdrawn
-
2000
- 2000-01-04 EP EP00904830A patent/EP1141799B1/en not_active Revoked
- 2000-01-04 CN CNB008049076A patent/CN1156737C/en not_active Expired - Lifetime
- 2000-01-04 DE DE50002341T patent/DE50002341D1/en not_active Revoked
- 2000-01-04 AT AT00904830T patent/ATE241817T1/en not_active IP Right Cessation
- 2000-01-04 WO PCT/DE2000/000033 patent/WO2000042481A1/en active IP Right Grant
- 2000-01-04 ES ES00904830T patent/ES2199773T3/en not_active Expired - Lifetime
-
2001
- 2001-07-12 US US09/902,575 patent/US6718215B2/en not_active Expired - Lifetime
-
2004
- 2004-02-02 US US10/769,716 patent/US20040158412A1/en not_active Abandoned
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5647009A (en) * | 1992-10-20 | 1997-07-08 | Hitachi, Ltd. | Computer aided work support system and method |
US5956665A (en) * | 1996-11-15 | 1999-09-21 | Digital Equipment Corporation | Automatic mapping, monitoring, and control of computer room components |
US6292712B1 (en) * | 1998-01-29 | 2001-09-18 | Northrop Grumman Corporation | Computer interface system for a robotic system |
US6380949B2 (en) * | 1998-09-17 | 2002-04-30 | General Electric Company | Man-machine interface for a virtual annunciator panel display |
US6282455B1 (en) * | 1998-10-19 | 2001-08-28 | Rockwell Technologies, Llc | Walk-through human/machine interface for industrial control |
US6718215B2 (en) * | 1999-01-12 | 2004-04-06 | Siemens Aktiengesellschaft | System and an associated method for operating and monitoring an automation system by means of virtual installation models |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080201113A1 (en) * | 2005-03-14 | 2008-08-21 | Holomar, Inc. | Methods and Systems for Combining Models of Goods and Services |
US8150666B2 (en) * | 2005-03-14 | 2012-04-03 | Holomar, Inc. | Methods and systems for combining models of goods and services |
US20110001751A1 (en) * | 2009-04-23 | 2011-01-06 | Stefan Carlsson | Providing navigation instructions |
US9214098B2 (en) * | 2009-04-23 | 2015-12-15 | Vodafone Group Services Limited | Providing navigation instructions in a three-dimension map environment having settable object transparency levels |
Also Published As
Publication number | Publication date |
---|---|
EP1141799A1 (en) | 2001-10-10 |
ES2199773T3 (en) | 2004-03-01 |
CN1156737C (en) | 2004-07-07 |
ATE241817T1 (en) | 2003-06-15 |
WO2000042481A1 (en) | 2000-07-20 |
EP1141799B1 (en) | 2003-05-28 |
CN1360686A (en) | 2002-07-24 |
DE19900884A1 (en) | 2000-07-20 |
US6718215B2 (en) | 2004-04-06 |
DE50002341D1 (en) | 2003-07-03 |
US20020029134A1 (en) | 2002-03-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6718215B2 (en) | System and an associated method for operating and monitoring an automation system by means of virtual installation models | |
CN1093659C (en) | Method for displaying information in virtual reality environment | |
Klinker et al. | Confluence of computer vision and interactive graphies for augmented reality | |
US5684943A (en) | Method and apparatus for creating virtual worlds | |
CN101095110B (en) | A system for distributed information presentation and interaction | |
US7475356B2 (en) | System utilizing mixed resolution displays | |
US7546540B2 (en) | Methods of using mixed resolution displays | |
WO1999015959A1 (en) | Real-time multimedia visual programming system | |
US7333071B2 (en) | Methods of using mixed resolution displays | |
Kirner et al. | Virtual reality and augmented reality applied to simulation visualization | |
Bishop | Planning support: hardware and software in search of a system | |
Fuhrmann et al. | Collaborative augmented reality: Exploring dynamical systems | |
Smith | Cooperative Virtual Environments: lessons from 2D multi user interfaces | |
US7030876B2 (en) | System and method for three-dimensional imaging | |
CA2385906C (en) | Mixed resolution displays | |
US20030090487A1 (en) | System and method for providing a virtual tour | |
Valkov et al. | Viargo-a generic virtual reality interaction library | |
Phillips | Jack user's guide | |
Haffegee et al. | Tools for collaborative vr application development | |
Maekawa et al. | MADO interface: A window like a tangible user interface to look into the virtual world | |
GB2340329A (en) | Display techniques for three-dimensional virtual reality | |
KR20240079241A (en) | Remote XR collaboration system using a metaverse of workspace | |
Bethel | Modular Virtual Reality Visualization Tools | |
van Liere et al. | Virtual reality on a Linux desktop | |
Gomes et al. | Visorama: A Complete Virtual Panorama System |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |