EP2479734A1 - Method for monitoring and controlling of parameters of industrial process - Google Patents

Method for monitoring and controlling of parameters of industrial process Download PDF

Info

Publication number
EP2479734A1
EP2479734A1 EP11461522A EP11461522A EP2479734A1 EP 2479734 A1 EP2479734 A1 EP 2479734A1 EP 11461522 A EP11461522 A EP 11461522A EP 11461522 A EP11461522 A EP 11461522A EP 2479734 A1 EP2479734 A1 EP 2479734A1
Authority
EP
European Patent Office
Prior art keywords
image
installation
portable device
data
communication server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11461522A
Other languages
German (de)
French (fr)
Inventor
Pawel Dworak
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zachodniopomorski Uniwersytet Technologiczny w Szczecinie
Original Assignee
Zachodniopomorski Uniwersytet Technologiczny w Szczecinie
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zachodniopomorski Uniwersytet Technologiczny w Szczecinie filed Critical Zachodniopomorski Uniwersytet Technologiczny w Szczecinie
Publication of EP2479734A1 publication Critical patent/EP2479734A1/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link

Definitions

  • the sole invention relates to the method for monitoring and controlling parameters of industrial process creating a mobile system HMI (Human Machine Interface). This process is realized through the mobile device.
  • HMI Human Machine Interface
  • HMI / SCADA Supervisory Control And Data Acquisition
  • HMI / SCADA systems today available on the market allow only for the construction of pre-defined synoptic screens, making the way (automation) of preparation easier at most.
  • applications like CIMPLICITY HMI Plant Edition Thin View from GE Fanuc Runtime run versions for Windows CE InTouch applications from Wonderware and portable applications from Atvise.
  • the method for monitoring and controlling parameters of the process of industrial technical installation using a portable module in the sense that it makes the identification of the controlled area of technical installation. Then it downloads the data from the communication server and controls the area of installation.
  • the essence of the invention is that it defines a device-specific surveillance system through a unique graphical markers, while the image of these markers loads along with the assigned groups of process variables to a portable device, and then when the system identifies them by examining the image from a camera built in the module in the form of a portable device. For identification it is used the standard image analysis techniques used for pattern recognition. With each device, the marker binds to a list of process variables read by the programmable controllers and made available in the communication server.
  • the assigned data is taken from the communication server and displays data on a regular basis by plotting them on the camera image on the portable device. Person controlling the image of the monitored device has it displayed in the form of the parameters of this device.
  • This data is transmitted using a known technology from the communication server, which is connected to the drivers of technical installation devices.
  • Devices are identified by a universal marker defined for each device. Universal markers can take the form of an image of the device or bar code. It may also have any form of graphics, assigned to the device.
  • the proposed solution allows the use of functional capabilities of a portable device such as an integrated camera for acquisition and data analysis and / or navigation in the visualization application and not, as yet only use the option to display the prepared data.
  • the solution eliminates the necessity to create a large number of synoptic screens for a multitude of necessary parameters to present.
  • the proposed solution allows for efficient, quick application navigation with clear presentation of the process data of different devices.
  • the method for identification with universal markers according to the invention allows the small screens of mobile devices to deploy elements of navigation and visualization of industrial values in a logical, legible and in easy to use manner.
  • the proposed solution allows for quick, smooth transition to the next presentation of the process parameters and it is particularly important when the direct inspection of the various devices of the technological process, carried out in an emergency, riots, or exemption of equipment or whole lines, as well as during the current equipment diagnostics.
  • the described method allows quick switch between displayed parameters of various process of the devices.
  • Figure 1 shows a diagram of a portable system for visualization process data
  • Figure 2 shows the method of presentation of process data for an object A.
  • the technological installation consists of devices U1 ... Un, whose work was controlled by programmable drivers S1 ... Sm connected to the comminication server SK.
  • the SK communication server task is to exchange process data with individual drivers.
  • the SK communication server communicates with the drivers S1 ... Sm using different communication protocols such as Modbus, Profibus, EtherCAT, EthernetPowerlink, CAN, OPC and other.
  • the SK communication server is connected to a portable device PU equipped with a camera and screen.
  • the SK communication server reads the values of various process data and makes them available at the user's request to read on-screen of portable module PM.
  • the data on a server SK are organized into groups relating to particular logical and / or functionally separated from each devices U1 ... Un.
  • Each of the devices U1 ... Un has an individual universal marker in graphics representing the following letters. These markers are placed in a location to be visible during the identification.
  • a portable device PU a combination of markings to the various devices U1 ... Un is uploaded and their assigned list of controlled process variables.
  • the configuration file is loaded into the SK communication server and portable communication device PU. It may also be modified during the time of its operation.
  • Such prepared system allows the controlling and monitoring the installation person to point the camera of the portable device PU at individual device U1 ... Un. Then, in the on-line screenshot image taken from the camera E of a portable device PU, using the known methods of the image analysis performing the function of pattern search, predefined universal markers are searched.
  • Detection of a universal marker A of a device Un sends to SK communication server a request to transmit to a portable device the variables values assigned to that process.
  • the sets of process data sent from the SK communication server are continuously displayed on the camera screen of portable device PU in augmented reality technology (called augmented reality) by depositing them on the camera image on the screen of portable device PU (as shown in Figure 2 ).
  • augmented reality augmented reality technology
  • the operator directs the camera of the portable device PU to another device U1 ... Un and the data identified by the above process is presented on the screen E of the portable device PU. If none of the device markers U1 ... Un is not in the area of the analyzed image E then the unmodified image captured by the camera device is presented on the screen of portable device PU.
  • Example 1 Same way as in Example 1, but it controls and monitors the installation consisting of three devices U1, U2, U3 and as for universal markers the image of the device itself or its characteristic components in the form of pictures are used.
  • each device has a distinctly different shape, as in the situation shown in Figure 3 , which shows an example of the installation of three tanks U1, U2, U3.
  • Each tank has a different shape, so as universal markers shall be pictures of each tank.
  • Pictures taken by the user of the system is downloaded into the portable device PU and assigned uniquely to individual devices U1 ... U3. Identification of the device U1 ... U3 is then a direct search on the discharge of the camera image E image from a photo of the item.

Abstract

The method for monitoring and controlling of the parameters of industrial process in technical installation by a portable module in the sense that the identification of the controlled area of technical installation is made and then retrieval of the data from the communication server and controls the installation area, characterized in that it identifies a particular installation device (U1 ... Un) by analyzing the image from the camera built-in portable device (PU), and then the data retrieved from the communication server (SK) is displayed on a regular basis by plotting them on the camera image on the portable device (PU).

Description

  • The sole invention relates to the method for monitoring and controlling parameters of industrial process creating a mobile system HMI (Human Machine Interface). This process is realized through the mobile device.
  • The dynamic development of equipment, functional capacity and computing power of portable devices allows the realization of ever more sophisticated tasks and applications. This development can also be harnessed to build a mobile industrial HMI / SCADA (Supervisory Control And Data Acquisition). HMI / SCADA systems today available on the market allow only for the construction of pre-defined synoptic screens, making the way (automation) of preparation easier at most. These applications increasingly often allow to work on portable devices, but all this type of tools currently offered on the market require predefining of synoptic screens and require the manual navigation. As for the examples of such solutions we can take applications like CIMPLICITY HMI Plant Edition Thin View from GE Fanuc, Runtime run versions for Windows CE InTouch applications from Wonderware and portable applications from Atvise. The most advanced tools for process visualization use the virtual reality technique for modeling (www.vrt.com.au). In this solution the data is displayed on the background of a virtual three-dimensional image which reflects the actual process. From U.S. patent 7444188 a way is known that through the universal portable control and monitoring module for control and monitoring of technical installations. installation is assigned to at least one regionally controlled subdivision within the controlled area. The method consists of identifying the current position of the portable module by means of the positioning signal, and then assign the module to be installed if it is in the region of subdivision of installations. After that the data from the HMI user interface is sent and loaded into the module. Installation is controlled using the data from the interface downloaded to the portable module. Loading interface data to the installation control is monitored as a function of distance from the installation to the module.
  • The method for monitoring and controlling parameters of the process of industrial technical installation according to the invention, using a portable module in the sense that it makes the identification of the controlled area of technical installation. Then it downloads the data from the communication server and controls the area of installation. The essence of the invention is that it defines a device-specific surveillance system through a unique graphical markers, while the image of these markers loads along with the assigned groups of process variables to a portable device, and then when the system identifies them by examining the image from a camera built in the module in the form of a portable device. For identification it is used the standard image analysis techniques used for pattern recognition. With each device, the marker binds to a list of process variables read by the programmable controllers and made available in the communication server. For such identified device the assigned data is taken from the communication server and displays data on a regular basis by plotting them on the camera image on the portable device. Person controlling the image of the monitored device has it displayed in the form of the parameters of this device. This data is transmitted using a known technology from the communication server, which is connected to the drivers of technical installation devices. Devices are identified by a universal marker defined for each device. Universal markers can take the form of an image of the device or bar code. It may also have any form of graphics, assigned to the device.
  • The proposed solution allows the use of functional capabilities of a portable device such as an integrated camera for acquisition and data analysis and / or navigation in the visualization application and not, as yet only use the option to display the prepared data. The solution eliminates the necessity to create a large number of synoptic screens for a multitude of necessary parameters to present. The proposed solution allows for efficient, quick application navigation with clear presentation of the process data of different devices. The method for identification with universal markers according to the invention allows the small screens of mobile devices to deploy elements of navigation and visualization of industrial values in a logical, legible and in easy to use manner. The proposed solution allows for quick, smooth transition to the next presentation of the process parameters and it is particularly important when the direct inspection of the various devices of the technological process, carried out in an emergency, riots, or exemption of equipment or whole lines, as well as during the current equipment diagnostics. The described method allows quick switch between displayed parameters of various process of the devices.
  • The invention is better shown in the drawings, in which Figure 1 shows a diagram of a portable system for visualization process data, Figure 2 shows the method of presentation of process data for an object A.
  • Example 1
  • The technological installation consists of devices U1 ... Un, whose work was controlled by programmable drivers S1 ... Sm connected to the comminication server SK. The SK communication server task is to exchange process data with individual drivers. The SK communication server communicates with the drivers S1 ... Sm using different communication protocols such as Modbus, Profibus, EtherCAT, EthernetPowerlink, CAN, OPC and other. The SK communication server is connected to a portable device PU equipped with a camera and screen. The SK communication server reads the values of various process data and makes them available at the user's request to read on-screen of portable module PM. The data on a server SK are organized into groups relating to particular logical and / or functionally separated from each devices U1 ... Un. Each of the devices U1 ... Un has an individual universal marker in graphics representing the following letters. These markers are placed in a location to be visible during the identification. At the same time to a portable device PU a combination of markings to the various devices U1 ... Un is uploaded and their assigned list of controlled process variables. The configuration file is loaded into the SK communication server and portable communication device PU. It may also be modified during the time of its operation. Such prepared system allows the controlling and monitoring the installation person to point the camera of the portable device PU at individual device U1 ... Un. Then, in the on-line screenshot image taken from the camera E of a portable device PU, using the known methods of the image analysis performing the function of pattern search, predefined universal markers are searched. Detection of a universal marker A of a device Un (as shown in Figure 1) sends to SK communication server a request to transmit to a portable device the variables values assigned to that process. The sets of process data sent from the SK communication server are continuously displayed on the camera screen of portable device PU in augmented reality technology (called augmented reality) by depositing them on the camera image on the screen of portable device PU (as shown in Figure 2). After validating the process parameters the operator directs the camera of the portable device PU to another device U1 ... Un and the data identified by the above process is presented on the screen E of the portable device PU. If none of the device markers U1 ... Un is not in the area of the analyzed image E then the unmodified image captured by the camera device is presented on the screen of portable device PU.
  • Example 2
  • Same way as in Example 1, but it controls and monitors the installation consisting of three devices U1, U2, U3 and as for universal markers the image of the device itself or its characteristic components in the form of pictures are used. Such a solution is possible to achieve in the case of the installations, in which each device has a distinctly different shape, as in the situation shown in Figure 3, which shows an example of the installation of three tanks U1, U2, U3. Each tank has a different shape, so as universal markers shall be pictures of each tank. Pictures taken by the user of the system is downloaded into the portable device PU and assigned uniquely to individual devices U1 ... U3. Identification of the device U1 ... U3 is then a direct search on the discharge of the camera image E image from a photo of the item.
  • Example 3
  • Same way as in Example 2, but as universal marker an user-defined outline of the device or its characteristic components are used. The installation of three tanks U1, U2, U3 (Fig. 3), each of the tank has a different shape, U1 is a trapezoid, U2 is a rectangle, and U3 is a slice of circle. These shapes the user of the system inputs into a portable device PU and assigns them unambiguously to individual devices U1, U2, U3. Identification of the device lies in the fact that it detects the edges of the tank located in the camera E view and adapts them to the defined shapes for each tank U1, U2, U3. In case the use of this method for installation with devices U1 ... Un with recurring shapes the final decision of device identification is to take by the system user.

Claims (2)

  1. The method for monitoring and controlling of parameters of industrial process of technical installation by a portable device in the sense that it makes the identification of the controlled area of technical installation, and then retrieves the data from the communication server and controls the installation area, characterized that it identifies the particular devices of the monitored process (U1 ... Un) through a universal image markers and the image of these markers is uploaded along with their assigned groups of process variables to a portable device (PU), and then using an image analysis method to scan the image from the camera E of portable device (PU) in order to detect the universal marker of individual devices (U1 ... Un) of installation and then the data retrieved from the communication server (SK) is displayed on a regular basis by plotting them on the camera image on the portable device (PU).
  2. The method according to claim 1 characterized that it is identified on the basis of a universal marker, which is in any device (Un), in the form of the bar code or graphics or image of the device itself (Un).
EP11461522A 2011-01-24 2011-06-22 Method for monitoring and controlling of parameters of industrial process Withdrawn EP2479734A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PL393704A PL227296B1 (en) 2011-01-24 2011-01-24 Method for monitoring and controlling industrial process parameters

Publications (1)

Publication Number Publication Date
EP2479734A1 true EP2479734A1 (en) 2012-07-25

Family

ID=44280774

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11461522A Withdrawn EP2479734A1 (en) 2011-01-24 2011-06-22 Method for monitoring and controlling of parameters of industrial process

Country Status (2)

Country Link
EP (1) EP2479734A1 (en)
PL (1) PL227296B1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007048823A1 (en) * 2005-10-27 2007-05-03 Sony Ericsson Mobile Communications Ab Configuration of an electronic device
US7444188B2 (en) 2003-07-22 2008-10-28 Siemens Ag Method and human-machine-interface (HMI) system for controlling and monitoring a technical installation
WO2009025499A1 (en) * 2007-08-20 2009-02-26 Gwangju Institute Of Science And Technology Remote control system using natural view user interface, remote control device, and method therefor

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7444188B2 (en) 2003-07-22 2008-10-28 Siemens Ag Method and human-machine-interface (HMI) system for controlling and monitoring a technical installation
WO2007048823A1 (en) * 2005-10-27 2007-05-03 Sony Ericsson Mobile Communications Ab Configuration of an electronic device
WO2009025499A1 (en) * 2007-08-20 2009-02-26 Gwangju Institute Of Science And Technology Remote control system using natural view user interface, remote control device, and method therefor

Also Published As

Publication number Publication date
PL227296B1 (en) 2017-11-30
PL393704A1 (en) 2012-07-30

Similar Documents

Publication Publication Date Title
AU2018288650B2 (en) Augmented reality user interface on mobile device for presentation of information related to industrial process, control and automation system, or other system
US11349901B1 (en) Automated network discovery for industrial controller systems
CN108089696B (en) Virtual reality and augmented reality for industrial automation
EP2966617B1 (en) System comprising image data generating device and portable terminal device
EP3076253B1 (en) Systems and methods for presenting an augmented reality
KR20190056935A (en) Mobile terminal providing augmented reality based maintenance guidance, remote managing apparatus and method for remote guidance using the same
US20150296324A1 (en) Method and Apparatus for Interacting Between Equipment and Mobile Devices
KR102391207B1 (en) 3D modeling based worker location management system
CN103097973A (en) Method and viewer for a cause and effect matrix in a safety system
CN109753029B (en) Method for identifying and displaying operator access process objects and operator system
JP6896364B2 (en) Display management methods and related computer program products and electronic devices
US20120290969A1 (en) Multi-stage method and apparatus for interactively locating device data of an automation system
US11340693B2 (en) Augmented reality interactive messages and instructions for batch manufacturing and procedural operations
WO2016005121A2 (en) Method for monitoring and/or controlling and/or servicing field devices
CN112016645A (en) Data collection setting device for industrial machine
US10372096B2 (en) Use of a live video stream in a process control system
EP3361342B1 (en) Programmable display, display control method, and display control program
EP2479734A1 (en) Method for monitoring and controlling of parameters of industrial process
KR20200014574A (en) Vision-based Monitoring Device and System for CNC Machine Tools
EP2959346B1 (en) Method and device for monitoring and controlling an industrial process
KR20210062156A (en) System for maintenance of facilities on site
AU2016100737A4 (en) A maintenance management system
EP2515554A2 (en) Method for visualising status data of a machine in an assembly and device for same
KR20180067883A (en) Method for managing a monitoring apparatus
EP3367197B1 (en) A method and system for monitoring an industrial equipment

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110630

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20170103