WO2003032141A2 - Procede de commande a deux mains d'une unite d'affichage et de commande plate, ecran tactile, appareil hmi, systeme d'automatisation et produit programme d'ordinateur pour la mise en oeuvre dudit procede - Google Patents

Procede de commande a deux mains d'une unite d'affichage et de commande plate, ecran tactile, appareil hmi, systeme d'automatisation et produit programme d'ordinateur pour la mise en oeuvre dudit procede Download PDF

Info

Publication number
WO2003032141A2
WO2003032141A2 PCT/DE2002/003439 DE0203439W WO03032141A2 WO 2003032141 A2 WO2003032141 A2 WO 2003032141A2 DE 0203439 W DE0203439 W DE 0203439W WO 03032141 A2 WO03032141 A2 WO 03032141A2
Authority
WO
WIPO (PCT)
Prior art keywords
activity area
display
vly
real
virtual
Prior art date
Application number
PCT/DE2002/003439
Other languages
German (de)
English (en)
Other versions
WO2003032141A3 (fr
Inventor
Roland Melzer
Original Assignee
Siemens Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE10161924A external-priority patent/DE10161924A1/de
Application filed by Siemens Aktiengesellschaft filed Critical Siemens Aktiengesellschaft
Publication of WO2003032141A2 publication Critical patent/WO2003032141A2/fr
Publication of WO2003032141A3 publication Critical patent/WO2003032141A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/23—Pc programming
    • G05B2219/23082—Enter parameters with two hands, dead man knob, switch, pedal
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/23—Pc programming
    • G05B2219/23377—Touch screen, with representation of buttons, machine on screen

Definitions

  • the invention relates to a method for two-hand operation of a flat display and operating unit, in particular for operating a technical device.
  • Technical devices are increasingly being operated with the aid of programmable devices, which in many cases can represent an automation system or can be a component of such.
  • Technical equipment includes all types of technical devices and systems, both individually and in e.g. Understand data-interconnected arrangement via a fieldbus.
  • a fieldbus For example, under technical facilities to understand individual equipment in the context of an industrial application, e.g. Drives, processing machines.
  • an entire production facility is also considered to be a technical facility. an entire technical process with locally distributed resources, e.g. in a chemical plant, a manufacturing plant or a processing plant.
  • the programmable devices used for the management of technical facilities have a constantly increasing range of functions.
  • the operability of the devices is becoming increasingly important.
  • distributed automation systems can have special devices that form the interface between an operator and the automation system.
  • HMI devices Such devices are referred to as HMI devices, the term “human machine interface” being abbreviated to HMI.
  • this device class is referred to as devices for “operating and observing technical equipment, abbreviated as“ B + B devices *.
  • These devices which are often upstream of the devices used for direct control of a technical device, have an increasing functionality.
  • An overview of HMI devices can be obtained e.g. by viewing Internet representations from Siemens AG, Automation & Drives division at http: // www. ad. siemens, de / simatic / html_76 / intro / hmi.htm or http://www.ad.siemens.de/hmi/html_00/index.htm.
  • a conventional internet search engine e.g. GOOGLE at the address http://www.google.de, e.g. can be found by entering a search query such as “Human Machine Interface * product information on HMI devices.
  • HMI device is to be understood as a generic term and includes all components belonging to this device group, for example “operator panels *”, which are often also abbreviated as “OP *”.
  • HMI devices have increasing functionality and take over, for example, in a networked car. sation system functions that can generally be viewed as pre- and post-processing of data of the technical equipment to be controlled. This not only relieves an additional central control device, for example a programmable logic controller PLC. Rather, HMI devices enable functions that significantly improve the comfort and quality of operation by an operator, ie in particular the overview of the device to be operated and the error-free operation.
  • HMI devices with flat display and operating units play a special role here. These are combination devices that not only enable the display of current statuses of the technical equipment, that is, they provide the "observe" function. Rather, it is possible to also perform operating actions via the display area and thus to activate triggering actions in the technical device. This not only has the advantage that separate keypads can be omitted. Rather, display content and operating options can be combined. For example, Interactive process images are generated, which enable the triggering of operator actions at selected points in the process image. In practice, in particular touch-sensitive displays are used as flat display and operating units. As an example of this, so-called “touchscreens *” should be mentioned, in particular analog touchscreens.
  • Such combined, flat display and control units can, however, cause difficulties when performing the two-hand controls described above.
  • the reason for this is that the position of an operator on the flat display and control unit, ie whose coordinate value in the x and y direction is transmitted in the form of a resistance value.
  • the position of the operator can be determined via these resistance values, ie a triggering action assigned to this position can be recognized and activated.
  • This problem occurs, for example, particularly with analog touch screens, where the X and Y positions are returned as analog values on the associated display and control surface. It is therefore not easily possible to distinguish between 'two-button operation' and 'one-button operation'.
  • the invention is based on the object of specifying a method for two-hand operation of a flat display device and for carrying out the method a touch-sensitive display, an HMI device, an automation system and a computer program product.
  • the method according to the invention for two-hand operation of a flat display and control unit has the following steps:
  • the position of at least one virtual activity area on the display and control unit is therefore first defined. and at least one triggering action is assigned to this virtual activity area.
  • the assigned triggering action would then be activated if the position belonging to the virtual activity area would be recognized as active on the basis of a virtual operation.
  • the positions of a first and second real activity area are then detected on the display and control unit, and the position of an averaged activity area on the display and control unit is determined by geometrically linking the positions of the first and second real activity areas ,
  • the position of an averaged activity area on the display and control unit is then formed by a geometric link between the position of a first real activity area and the position of a second real activity area.
  • the two real activity areas would be triggered by two-handed operation.
  • the particular advantage of the invention is that the locations of the two real activity areas do not have to be explicitly available individually. Rather, according to the invention, instead of the pair of layers of the two real activity areas, a single geometric position replacement value is formed.
  • the geometric linkage as a substitute position value forms an active activity area that lies spatially between the two real activity areas. This can lie, for example, in the middle of the connecting line between the real activity areas.
  • a "one-button operation" of a virtual center point ie the averaged activity area, is used for the detection of a "two-button operation".
  • Such a device can be implemented particularly advantageously with an analog touchscreen, since such a device generally reacts when two points are operated at the same time as if operation on a there is a point exactly halfway between these two points.
  • the method according to the invention then checks whether the position of the averaged activity area matches the position of the virtual activity area. If the positions match, the associated triggering action is then activated.
  • the method according to the invention makes it possible to provide a “two-hand operation” that meets the requirements, also on a flat display and operating unit, in particular a touch-sensitive display or an analog touchscreen.
  • the method according to the invention is thus particularly suitable for use for two-hand operation of a technical device.
  • the touch-sensitive display, in particular the touchscreen is advantageously part of an HMI device used for monitoring and operating a technical device.
  • the HMI device can be an integral or a connected component of an automation system that acts on a technical device.
  • a display image which can be in the form of a control button, is advantageously stored on the flat display and control unit, at least in the real activity areas.
  • the real activity areas actually provided for carrying out a “two-hand operation *” can thus be made visible in a simple manner.
  • the execution of a “two-hand operation *” can be further facilitated if an acknowledgment function is assigned to the first real activity area and a trigger function is assigned to the second real activity area.
  • the operational safety can advantageously be further increased in that the triggering action is only activated when the two following additional conditions are met without interruption.
  • the location of the first real activity area is recorded. If it is then additionally possible to detect a correspondence between the position of an averaged activity area and the position of a virtual activity area without an interruption in the position detection of the first real activity area, then the requirements for the existence of two-hand operation can be regarded as fulfilled.
  • an operator in this case first operates the first activity area with one hand and then additionally operates the second activity area with the addition of the second hand.
  • a further increase in operating safety can be achieved by activating the triggering action only when the following additional conditions are met.
  • the end of the correspondence between the position of the averaged activity area and the position of the virtual activity area is detected. Is the end of the detection of the position of the first or second real activity recognized area, this combination can be viewed as an alternative or cumulative indication of the existence of two-hand operation.
  • the method according to the invention can advantageously be embodied in practice in the form of a computer program product.
  • This contains one or more computer programs with software means for performing the method when the computer program is executed in a touch-sensitive display, an HMI device or an automation system.
  • the computer program product according to the invention is a commercial manifestation of the computer program which has software means for carrying out a method according to the invention when the computer program is executed in an HMI device or an automation system.
  • These can be fixations on common data media such as floppy disks, CD, DVD, hard drives, emory sticks, tapes and much more.
  • files that are in a com Computer servers are stored, for example downloaded with the help of the Internet and then loaded into an HMI device or an automation system, represent computer program products in the sense of the invention.
  • the figure shows a flat display and operating unit D.
  • a touch-sensitive display this has, for example, a display field F in the form of a touchscreen TS.
  • the display and operating unit D can be part of an HMI device, which in turn is connected to an automation system used to control a technical device or is integrated into such.
  • Tripping actions can be activated when the display field F is touched at predefined locations.
  • An operator e.g. touching an activity area from the group of VI to V5 on the display field F with one finger could activate an application-specific triggering action.
  • Equipment of the facility can be switched on or off.
  • a first real activity area KQ is provided, which is referred to below as the ACKNOWLEDGE key and has the position coordinates Qx; Qy.
  • At least one second real activity area KT1 is provided, which is subsequently referred to as
  • FUNCTION KEY is called Tl and has the position coordinates KTx; Kly. So that an operator can also recognize the position of this activity area on the display panel here, the display image T1 of a key for this FUNCTION KEY is also advantageously output on the touchscreen TS at this point.
  • the position Vx; Vly of an averaged activity area GQT1 on the display and operating unit D is achieved by geometrically linking the position Qx, Qy of the first real activity area KQ and the position KTx; Kly of the second real activity area KT1 determined.
  • the geometric linkage takes place in that the averaged activity area GQT1 lies in the middle of the connecting line between the activity areas KQ and KT1.
  • the triggering action assigned to the virtual activity area VI is only activated when the following additional conditions are met without interruption.
  • the position Qx, Qy of the first real activity area KQ is first detected, i.e. a touch of the display image Q on the touch screen by a person. Subsequently, the correspondence between the position Vx; Vly of the averaged activity area GQT1 and the position Vx; Vly of the virtual activity area VI is detected. This is achieved by simultaneously touching the touchscreen at the locations of the activity areas KQ and KT1, i.e. through two-hand operation.
  • This embodiment has the advantage that it can be ruled out that the assigned triggering action could also be triggered in an undesired manner by accidentally touching the virtual activity area VI.
  • Safety in two-hand operation can be further increased by the fact that the triggering action is only activated when the following conditions are also met.
  • the further real activity areas KT2 to KT5 are displayed, their FUNCTION KEYS T2 to T5 having the positions KTx; K2y to KTx; K5y.
  • the averaged activity areas GQK2 to GQK5 are formed according to the invention. These are in turn, for example, in the middle of the connection line between the ACKNOWLEDGE key Q and the respective FUNCTION KEY T2 to T5. These are each represented by a dashed line in the figure. Furthermore, in the example of the figure, the positions of the FUNCTION KEYS T2 to T5 are selected such that the associated averaged activity areas GQK2 to GQK5 are again exactly on the positions of the virtual activity areas V2 to V5.
  • the two real activity areas Ka and Kb which have the positions Qx; ay and KTx; by, are also shown in the example of the figure.
  • the above conditions are not met in these areas. If these are touched by a person with two-hand operation, the averaged activity area Gkab is formed according to the invention. Although this is again in the middle on the geometric connecting line L of the two areas, it has a position Vx; aby that does not match the position of a virtual activity area. In this case, no triggering action is activated.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

L'invention concerne un procédé selon lequel la position d'au moins une zone d'activité virtuelle sur l'unité d'affichage et de commande est définie et au moins une action à déclenchement est associée à cette zone d'activité. Ensuite, on définit la position d'une zone d'activité centrale sur l'unité d'affichage et de commande en reliant géométriquement les positions d'une première zone d'activité réelle et d'une deuxième zone d'activité réelle. En dernière étape, on vérifie si la position de la zone d'activité centrale concorde avec la position de la zone d'activité virtuelle. Si les positions concordent, l'action à déclenchement associée est ensuite activée. Ledit procédé permet une commande à deux mains même sur une unité d'affichage et de commande plate, en particulier un écran tactile analogique.
PCT/DE2002/003439 2001-09-28 2002-09-13 Procede de commande a deux mains d'une unite d'affichage et de commande plate, ecran tactile, appareil hmi, systeme d'automatisation et produit programme d'ordinateur pour la mise en oeuvre dudit procede WO2003032141A2 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE20115988.0 2001-09-28
DE20115988 2001-09-28
DE10161924.3 2001-12-17
DE10161924A DE10161924A1 (de) 2001-09-28 2001-12-17 Verfahren zur Zweihandbedienung einer flächigen Anzeige- und Bedieneinheit, mit berührungssensitivem Display, HMI Gerät, Automatisierungssystem und Computerprogrammprodukt zur Durchführung des Verfahrens

Publications (2)

Publication Number Publication Date
WO2003032141A2 true WO2003032141A2 (fr) 2003-04-17
WO2003032141A3 WO2003032141A3 (fr) 2003-10-16

Family

ID=26010790

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2002/003439 WO2003032141A2 (fr) 2001-09-28 2002-09-13 Procede de commande a deux mains d'une unite d'affichage et de commande plate, ecran tactile, appareil hmi, systeme d'automatisation et produit programme d'ordinateur pour la mise en oeuvre dudit procede

Country Status (1)

Country Link
WO (1) WO2003032141A2 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1677180A1 (fr) * 2004-12-30 2006-07-05 Volkswagen Aktiengesellschaft Écran tactile capable de reconnaitre deux points de contact simultanés
EP2060970A1 (fr) 2007-11-12 2009-05-20 Research In Motion Limited Interface d'utilisateur pour dispositif tactile
US7864161B2 (en) 2004-06-17 2011-01-04 Adrea, LLC Use of a two finger input on touch screens
US7920126B2 (en) 2004-12-30 2011-04-05 Volkswagen Ag Input device
CN102915144A (zh) * 2011-08-01 2013-02-06 西门子公司 用于运行用于安全关键应用的操作-和观察装置的方法
US8466893B2 (en) 2004-06-17 2013-06-18 Adrea, LLC Use of a two finger input on touch screens
US8599142B2 (en) 2004-12-30 2013-12-03 Volkswagen Ag Input device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4914624A (en) * 1988-05-06 1990-04-03 Dunthorn David I Virtual button for touch screen
EP0773496A1 (fr) * 1995-11-09 1997-05-14 International Business Machines Corporation Fonctionnement d'un panneau tactile
DE19901481A1 (de) * 1999-01-15 2000-04-27 Siemens Ag Verfahren zum Bedienen eines bildschirmgessteuerten Prozesses und Bediensystem für einen bildschirmgesteuerten Prozeß

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4914624A (en) * 1988-05-06 1990-04-03 Dunthorn David I Virtual button for touch screen
EP0773496A1 (fr) * 1995-11-09 1997-05-14 International Business Machines Corporation Fonctionnement d'un panneau tactile
DE19901481A1 (de) * 1999-01-15 2000-04-27 Siemens Ag Verfahren zum Bedienen eines bildschirmgessteuerten Prozesses und Bediensystem für einen bildschirmgesteuerten Prozeß

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7864161B2 (en) 2004-06-17 2011-01-04 Adrea, LLC Use of a two finger input on touch screens
US8466893B2 (en) 2004-06-17 2013-06-18 Adrea, LLC Use of a two finger input on touch screens
US8633914B2 (en) 2004-06-17 2014-01-21 Adrea, LLC Use of a two finger input on touch screens
EP1677180A1 (fr) * 2004-12-30 2006-07-05 Volkswagen Aktiengesellschaft Écran tactile capable de reconnaitre deux points de contact simultanés
US7920126B2 (en) 2004-12-30 2011-04-05 Volkswagen Ag Input device
US8040323B2 (en) 2004-12-30 2011-10-18 Volkswagen Ag Input device
US8599142B2 (en) 2004-12-30 2013-12-03 Volkswagen Ag Input device
EP2060970A1 (fr) 2007-11-12 2009-05-20 Research In Motion Limited Interface d'utilisateur pour dispositif tactile
CN102915144A (zh) * 2011-08-01 2013-02-06 西门子公司 用于运行用于安全关键应用的操作-和观察装置的方法
CN102915144B (zh) * 2011-08-01 2017-04-12 西门子公司 用于运行用于安全关键应用的操作和观察装置的方法

Also Published As

Publication number Publication date
WO2003032141A3 (fr) 2003-10-16

Similar Documents

Publication Publication Date Title
EP1495399A2 (fr) Procede de commande d'une interface utilisateur a fenetres et appareil a interface homme-machine pour realiser ce procede
DE102009011679A1 (de) Verfahren und Vorrichtung zum Erstellen eines Anwenderprogrammes für eine Sicherheitssteuerung
WO2002019957A2 (fr) Systeme et procede de commande centrale de dispositifs utilises lors d'une operation
EP3140083A1 (fr) Dispositif de services et système de commande
EP2246756B1 (fr) Procédé et appareil de commande destinés à commander un composant d'automatisation industriel lié à la sécurité
DE10161924A1 (de) Verfahren zur Zweihandbedienung einer flächigen Anzeige- und Bedieneinheit, mit berührungssensitivem Display, HMI Gerät, Automatisierungssystem und Computerprogrammprodukt zur Durchführung des Verfahrens
WO2010111989A1 (fr) Dispositif, procédé et produit de programme d'ordinateur permettant de représenter une liste de tâches effectives sur l'interface utilisateur graphique d'un ordinateur de commande d'une machine d'usinage
WO2003032141A2 (fr) Procede de commande a deux mains d'une unite d'affichage et de commande plate, ecran tactile, appareil hmi, systeme d'automatisation et produit programme d'ordinateur pour la mise en oeuvre dudit procede
WO2017186369A1 (fr) Panneau de commande d'une installation industrielle
EP3904984B1 (fr) Procédé d'interaction immersive homme-machine
EP3111283A1 (fr) Procédé pour faire fonctionner un élément de commutation sûr d'une installation
EP2555065B1 (fr) Procédé de fonctionnement d'un appareil de commande et d'observation pour applications critiques à la sécurité
EP3343301B1 (fr) Procédé de programmation d'une commande de sécurité
EP1437642A2 (fr) Appareil de contrôle-commande ayant un clavier à entrée rapide
DE102019008586A1 (de) Anzeigevorrichtung, Werkzeugmaschine und Anomaliebestimmungsverfahren
DE102011052095B4 (de) Busanschaltung zum Anschluss eines Sicherheitssensors an ein AS-i Bussystem
DE202015104887U1 (de) Multifunktionsterminal mit Softkey-Tastenanordnung zur sicherheitsrelevanten Bedienung
EP2977840A1 (fr) Utilisation protégée contre les erreurs d'un appareil dans le domaine de la technique d'automatisation industrielle au moyen de gestes
EP1359532A2 (fr) Procédé d'utilisation d'un dispositif médical, ou procédé d'un système et dispositif médicaux, ou système
EP3726313B1 (fr) Commutateur de sécurité
DE102019103584A1 (de) Verfahren zur Steuerung einer berührungsempfindlichen Anzeige- und Eingabevorrichtung und Vorrichtung zur Ausführung des Verfahrens
DE102009017030A1 (de) Schnelles Mensch-Maschinen-Interface
EP3451089B1 (fr) Procédé de programmation assistée par ordinateur d'une commande par programme enregistré
EP3396480B1 (fr) Procédé de programmation d'un dispositif de sécurité
EP1374000B1 (fr) Procede et dispositif de commande et/ou de surveillance d'un dispositif surveillant la commande d'une installation

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): CN

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FR GB GR IE IT LU MC NL PT SE SK TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase