EP2479734A1 - Method for monitoring and controlling of parameters of industrial process - Google Patents
Method for monitoring and controlling of parameters of industrial process Download PDFInfo
- Publication number
- EP2479734A1 EP2479734A1 EP11461522A EP11461522A EP2479734A1 EP 2479734 A1 EP2479734 A1 EP 2479734A1 EP 11461522 A EP11461522 A EP 11461522A EP 11461522 A EP11461522 A EP 11461522A EP 2479734 A1 EP2479734 A1 EP 2479734A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- installation
- portable device
- data
- communication server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
Definitions
- the sole invention relates to the method for monitoring and controlling parameters of industrial process creating a mobile system HMI (Human Machine Interface). This process is realized through the mobile device.
- HMI Human Machine Interface
- HMI / SCADA Supervisory Control And Data Acquisition
- HMI / SCADA systems today available on the market allow only for the construction of pre-defined synoptic screens, making the way (automation) of preparation easier at most.
- applications like CIMPLICITY HMI Plant Edition Thin View from GE Fanuc Runtime run versions for Windows CE InTouch applications from Wonderware and portable applications from Atvise.
- the method for monitoring and controlling parameters of the process of industrial technical installation using a portable module in the sense that it makes the identification of the controlled area of technical installation. Then it downloads the data from the communication server and controls the area of installation.
- the essence of the invention is that it defines a device-specific surveillance system through a unique graphical markers, while the image of these markers loads along with the assigned groups of process variables to a portable device, and then when the system identifies them by examining the image from a camera built in the module in the form of a portable device. For identification it is used the standard image analysis techniques used for pattern recognition. With each device, the marker binds to a list of process variables read by the programmable controllers and made available in the communication server.
- the assigned data is taken from the communication server and displays data on a regular basis by plotting them on the camera image on the portable device. Person controlling the image of the monitored device has it displayed in the form of the parameters of this device.
- This data is transmitted using a known technology from the communication server, which is connected to the drivers of technical installation devices.
- Devices are identified by a universal marker defined for each device. Universal markers can take the form of an image of the device or bar code. It may also have any form of graphics, assigned to the device.
- the proposed solution allows the use of functional capabilities of a portable device such as an integrated camera for acquisition and data analysis and / or navigation in the visualization application and not, as yet only use the option to display the prepared data.
- the solution eliminates the necessity to create a large number of synoptic screens for a multitude of necessary parameters to present.
- the proposed solution allows for efficient, quick application navigation with clear presentation of the process data of different devices.
- the method for identification with universal markers according to the invention allows the small screens of mobile devices to deploy elements of navigation and visualization of industrial values in a logical, legible and in easy to use manner.
- the proposed solution allows for quick, smooth transition to the next presentation of the process parameters and it is particularly important when the direct inspection of the various devices of the technological process, carried out in an emergency, riots, or exemption of equipment or whole lines, as well as during the current equipment diagnostics.
- the described method allows quick switch between displayed parameters of various process of the devices.
- Figure 1 shows a diagram of a portable system for visualization process data
- Figure 2 shows the method of presentation of process data for an object A.
- the technological installation consists of devices U1 ... Un, whose work was controlled by programmable drivers S1 ... Sm connected to the comminication server SK.
- the SK communication server task is to exchange process data with individual drivers.
- the SK communication server communicates with the drivers S1 ... Sm using different communication protocols such as Modbus, Profibus, EtherCAT, EthernetPowerlink, CAN, OPC and other.
- the SK communication server is connected to a portable device PU equipped with a camera and screen.
- the SK communication server reads the values of various process data and makes them available at the user's request to read on-screen of portable module PM.
- the data on a server SK are organized into groups relating to particular logical and / or functionally separated from each devices U1 ... Un.
- Each of the devices U1 ... Un has an individual universal marker in graphics representing the following letters. These markers are placed in a location to be visible during the identification.
- a portable device PU a combination of markings to the various devices U1 ... Un is uploaded and their assigned list of controlled process variables.
- the configuration file is loaded into the SK communication server and portable communication device PU. It may also be modified during the time of its operation.
- Such prepared system allows the controlling and monitoring the installation person to point the camera of the portable device PU at individual device U1 ... Un. Then, in the on-line screenshot image taken from the camera E of a portable device PU, using the known methods of the image analysis performing the function of pattern search, predefined universal markers are searched.
- Detection of a universal marker A of a device Un sends to SK communication server a request to transmit to a portable device the variables values assigned to that process.
- the sets of process data sent from the SK communication server are continuously displayed on the camera screen of portable device PU in augmented reality technology (called augmented reality) by depositing them on the camera image on the screen of portable device PU (as shown in Figure 2 ).
- augmented reality augmented reality technology
- the operator directs the camera of the portable device PU to another device U1 ... Un and the data identified by the above process is presented on the screen E of the portable device PU. If none of the device markers U1 ... Un is not in the area of the analyzed image E then the unmodified image captured by the camera device is presented on the screen of portable device PU.
- Example 1 Same way as in Example 1, but it controls and monitors the installation consisting of three devices U1, U2, U3 and as for universal markers the image of the device itself or its characteristic components in the form of pictures are used.
- each device has a distinctly different shape, as in the situation shown in Figure 3 , which shows an example of the installation of three tanks U1, U2, U3.
- Each tank has a different shape, so as universal markers shall be pictures of each tank.
- Pictures taken by the user of the system is downloaded into the portable device PU and assigned uniquely to individual devices U1 ... U3. Identification of the device U1 ... U3 is then a direct search on the discharge of the camera image E image from a photo of the item.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Testing And Monitoring For Control Systems (AREA)
- General Factory Administration (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The method for monitoring and controlling of the parameters of industrial process in technical installation by a portable module in the sense that the identification of the controlled area of technical installation is made and then retrieval of the data from the communication server and controls the installation area, characterized in that it identifies a particular installation device (U1 ... Un) by analyzing the image from the camera built-in portable device (PU), and then the data retrieved from the communication server (SK) is displayed on a regular basis by plotting them on the camera image on the portable device (PU).
Description
- The sole invention relates to the method for monitoring and controlling parameters of industrial process creating a mobile system HMI (Human Machine Interface). This process is realized through the mobile device.
- The dynamic development of equipment, functional capacity and computing power of portable devices allows the realization of ever more sophisticated tasks and applications. This development can also be harnessed to build a mobile industrial HMI / SCADA (Supervisory Control And Data Acquisition). HMI / SCADA systems today available on the market allow only for the construction of pre-defined synoptic screens, making the way (automation) of preparation easier at most. These applications increasingly often allow to work on portable devices, but all this type of tools currently offered on the market require predefining of synoptic screens and require the manual navigation. As for the examples of such solutions we can take applications like CIMPLICITY HMI Plant Edition Thin View from GE Fanuc, Runtime run versions for Windows CE InTouch applications from Wonderware and portable applications from Atvise. The most advanced tools for process visualization use the virtual reality technique for modeling (www.vrt.com.au). In this solution the data is displayed on the background of a virtual three-dimensional image which reflects the actual process. From
U.S. patent 7444188 a way is known that through the universal portable control and monitoring module for control and monitoring of technical installations. installation is assigned to at least one regionally controlled subdivision within the controlled area. The method consists of identifying the current position of the portable module by means of the positioning signal, and then assign the module to be installed if it is in the region of subdivision of installations. After that the data from the HMI user interface is sent and loaded into the module. Installation is controlled using the data from the interface downloaded to the portable module. Loading interface data to the installation control is monitored as a function of distance from the installation to the module. - The method for monitoring and controlling parameters of the process of industrial technical installation according to the invention, using a portable module in the sense that it makes the identification of the controlled area of technical installation. Then it downloads the data from the communication server and controls the area of installation. The essence of the invention is that it defines a device-specific surveillance system through a unique graphical markers, while the image of these markers loads along with the assigned groups of process variables to a portable device, and then when the system identifies them by examining the image from a camera built in the module in the form of a portable device. For identification it is used the standard image analysis techniques used for pattern recognition. With each device, the marker binds to a list of process variables read by the programmable controllers and made available in the communication server. For such identified device the assigned data is taken from the communication server and displays data on a regular basis by plotting them on the camera image on the portable device. Person controlling the image of the monitored device has it displayed in the form of the parameters of this device. This data is transmitted using a known technology from the communication server, which is connected to the drivers of technical installation devices. Devices are identified by a universal marker defined for each device. Universal markers can take the form of an image of the device or bar code. It may also have any form of graphics, assigned to the device.
- The proposed solution allows the use of functional capabilities of a portable device such as an integrated camera for acquisition and data analysis and / or navigation in the visualization application and not, as yet only use the option to display the prepared data. The solution eliminates the necessity to create a large number of synoptic screens for a multitude of necessary parameters to present. The proposed solution allows for efficient, quick application navigation with clear presentation of the process data of different devices. The method for identification with universal markers according to the invention allows the small screens of mobile devices to deploy elements of navigation and visualization of industrial values in a logical, legible and in easy to use manner. The proposed solution allows for quick, smooth transition to the next presentation of the process parameters and it is particularly important when the direct inspection of the various devices of the technological process, carried out in an emergency, riots, or exemption of equipment or whole lines, as well as during the current equipment diagnostics. The described method allows quick switch between displayed parameters of various process of the devices.
- The invention is better shown in the drawings, in which
Figure 1 shows a diagram of a portable system for visualization process data,Figure 2 shows the method of presentation of process data for an object A. - The technological installation consists of devices U1 ... Un, whose work was controlled by programmable drivers S1 ... Sm connected to the comminication server SK. The SK communication server task is to exchange process data with individual drivers. The SK communication server communicates with the drivers S1 ... Sm using different communication protocols such as Modbus, Profibus, EtherCAT, EthernetPowerlink, CAN, OPC and other. The SK communication server is connected to a portable device PU equipped with a camera and screen. The SK communication server reads the values of various process data and makes them available at the user's request to read on-screen of portable module PM. The data on a server SK are organized into groups relating to particular logical and / or functionally separated from each devices U1 ... Un. Each of the devices U1 ... Un has an individual universal marker in graphics representing the following letters. These markers are placed in a location to be visible during the identification. At the same time to a portable device PU a combination of markings to the various devices U1 ... Un is uploaded and their assigned list of controlled process variables. The configuration file is loaded into the SK communication server and portable communication device PU. It may also be modified during the time of its operation. Such prepared system allows the controlling and monitoring the installation person to point the camera of the portable device PU at individual device U1 ... Un. Then, in the on-line screenshot image taken from the camera E of a portable device PU, using the known methods of the image analysis performing the function of pattern search, predefined universal markers are searched. Detection of a universal marker A of a device Un (as shown in
Figure 1 ) sends to SK communication server a request to transmit to a portable device the variables values assigned to that process. The sets of process data sent from the SK communication server are continuously displayed on the camera screen of portable device PU in augmented reality technology (called augmented reality) by depositing them on the camera image on the screen of portable device PU (as shown inFigure 2 ). After validating the process parameters the operator directs the camera of the portable device PU to another device U1 ... Un and the data identified by the above process is presented on the screen E of the portable device PU. If none of the device markers U1 ... Un is not in the area of the analyzed image E then the unmodified image captured by the camera device is presented on the screen of portable device PU. - Same way as in Example 1, but it controls and monitors the installation consisting of three devices U1, U2, U3 and as for universal markers the image of the device itself or its characteristic components in the form of pictures are used. Such a solution is possible to achieve in the case of the installations, in which each device has a distinctly different shape, as in the situation shown in
Figure 3 , which shows an example of the installation of three tanks U1, U2, U3. Each tank has a different shape, so as universal markers shall be pictures of each tank. Pictures taken by the user of the system is downloaded into the portable device PU and assigned uniquely to individual devices U1 ... U3. Identification of the device U1 ... U3 is then a direct search on the discharge of the camera image E image from a photo of the item. - Same way as in Example 2, but as universal marker an user-defined outline of the device or its characteristic components are used. The installation of three tanks U1, U2, U3 (
Fig. 3 ), each of the tank has a different shape, U1 is a trapezoid, U2 is a rectangle, and U3 is a slice of circle. These shapes the user of the system inputs into a portable device PU and assigns them unambiguously to individual devices U1, U2, U3. Identification of the device lies in the fact that it detects the edges of the tank located in the camera E view and adapts them to the defined shapes for each tank U1, U2, U3. In case the use of this method for installation with devices U1 ... Un with recurring shapes the final decision of device identification is to take by the system user.
Claims (2)
- The method for monitoring and controlling of parameters of industrial process of technical installation by a portable device in the sense that it makes the identification of the controlled area of technical installation, and then retrieves the data from the communication server and controls the installation area, characterized that it identifies the particular devices of the monitored process (U1 ... Un) through a universal image markers and the image of these markers is uploaded along with their assigned groups of process variables to a portable device (PU), and then using an image analysis method to scan the image from the camera E of portable device (PU) in order to detect the universal marker of individual devices (U1 ... Un) of installation and then the data retrieved from the communication server (SK) is displayed on a regular basis by plotting them on the camera image on the portable device (PU).
- The method according to claim 1 characterized that it is identified on the basis of a universal marker, which is in any device (Un), in the form of the bar code or graphics or image of the device itself (Un).
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PL393704A PL227296B1 (en) | 2011-01-24 | 2011-01-24 | Method for monitoring and controlling industrial process parameters |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2479734A1 true EP2479734A1 (en) | 2012-07-25 |
Family
ID=44280774
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11461522A Withdrawn EP2479734A1 (en) | 2011-01-24 | 2011-06-22 | Method for monitoring and controlling of parameters of industrial process |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2479734A1 (en) |
PL (1) | PL227296B1 (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007048823A1 (en) * | 2005-10-27 | 2007-05-03 | Sony Ericsson Mobile Communications Ab | Configuration of an electronic device |
US7444188B2 (en) | 2003-07-22 | 2008-10-28 | Siemens Ag | Method and human-machine-interface (HMI) system for controlling and monitoring a technical installation |
WO2009025499A1 (en) * | 2007-08-20 | 2009-02-26 | Gwangju Institute Of Science And Technology | Remote control system using natural view user interface, remote control device, and method therefor |
-
2011
- 2011-01-24 PL PL393704A patent/PL227296B1/en unknown
- 2011-06-22 EP EP11461522A patent/EP2479734A1/en not_active Withdrawn
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7444188B2 (en) | 2003-07-22 | 2008-10-28 | Siemens Ag | Method and human-machine-interface (HMI) system for controlling and monitoring a technical installation |
WO2007048823A1 (en) * | 2005-10-27 | 2007-05-03 | Sony Ericsson Mobile Communications Ab | Configuration of an electronic device |
WO2009025499A1 (en) * | 2007-08-20 | 2009-02-26 | Gwangju Institute Of Science And Technology | Remote control system using natural view user interface, remote control device, and method therefor |
Also Published As
Publication number | Publication date |
---|---|
PL227296B1 (en) | 2017-11-30 |
PL393704A1 (en) | 2012-07-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3642680B1 (en) | Augmented reality user interface on mobile device for presentation of information related to industrial process, control and automation system, or other system | |
US11349901B1 (en) | Automated network discovery for industrial controller systems | |
CN108089696B (en) | Virtual reality and augmented reality for industrial automation | |
EP2966617B1 (en) | System comprising image data generating device and portable terminal device | |
EP3076253B1 (en) | Systems and methods for presenting an augmented reality | |
KR20190056935A (en) | Mobile terminal providing augmented reality based maintenance guidance, remote managing apparatus and method for remote guidance using the same | |
US20150296324A1 (en) | Method and Apparatus for Interacting Between Equipment and Mobile Devices | |
CN109753029B (en) | Method for identifying and displaying operator access process objects and operator system | |
KR102391207B1 (en) | 3D modeling based worker location management system | |
US9805477B2 (en) | Display management method and associated computer program product and electronic device | |
CN103097973A (en) | Method and viewer for a cause and effect matrix in a safety system | |
US20120290969A1 (en) | Multi-stage method and apparatus for interactively locating device data of an automation system | |
WO2016005121A2 (en) | Method for monitoring and/or controlling and/or servicing field devices | |
KR20210062156A (en) | System for maintenance of facilities on site | |
US10372096B2 (en) | Use of a live video stream in a process control system | |
EP2479734A1 (en) | Method for monitoring and controlling of parameters of industrial process | |
EP3361342A1 (en) | Programmable display, display control method, and display control program | |
AU2016100737A4 (en) | A maintenance management system | |
KR20200014574A (en) | Vision-based Monitoring Device and System for CNC Machine Tools | |
EP2959346B1 (en) | Method and device for monitoring and controlling an industrial process | |
JP7347409B2 (en) | Apparatus, method and program | |
CN112215977B (en) | Process industrial equipment inspection data processing method, inspection system, device and medium | |
EP2515554A2 (en) | Method for visualising status data of a machine in an assembly and device for same | |
KR20180067883A (en) | Method for managing a monitoring apparatus | |
EP3367197B1 (en) | A method and system for monitoring an industrial equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20110630 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20170103 |