WO2007060604A2 - Filtrage de coordonnees de pointeur - Google Patents

Filtrage de coordonnees de pointeur Download PDF

Info

Publication number
WO2007060604A2
WO2007060604A2 PCT/IB2006/054351 IB2006054351W WO2007060604A2 WO 2007060604 A2 WO2007060604 A2 WO 2007060604A2 IB 2006054351 W IB2006054351 W IB 2006054351W WO 2007060604 A2 WO2007060604 A2 WO 2007060604A2
Authority
WO
WIPO (PCT)
Prior art keywords
pointer
input device
coordinate data
filtering
representation
Prior art date
Application number
PCT/IB2006/054351
Other languages
English (en)
Other versions
WO2007060604A3 (fr
Inventor
Gerrit-Jan Bloem
Njin-Zu Chen
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Publication of WO2007060604A2 publication Critical patent/WO2007060604A2/fr
Publication of WO2007060604A3 publication Critical patent/WO2007060604A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Definitions

  • the invention relates to a method of handling manipulation of a pointer moving in a sensing region of an input device, the method comprising translating position data of the pointer into coordinate data by the input device, and stabilization filtering of the coordinate data to stabilize a representation of the pointer.
  • the invention further relates to a computer program product to be loaded by a computer arrangement, comprising instructions for handling manipulation of a pointer moving in a sensing region of an input device, the computer arrangement comprising a processing unit and a memory, the computer program product, after being loaded, providing said processing unit with the capability to carry out the following tasks: translating position data of the pointer into coordinate data by the input device, and stabilization filtering of the coordinate data to stabilize a representation of the pointer.
  • the invention further relates to a computer readable storage medium having recorded thereon data representing instructions for performing such a method.
  • the invention further relates to a display device for handling manipulation of a pointer moving in a sensing region of an input device, the display device comprising a display, the input device and a processor configured to perform such a method.
  • the invention further relates to a medical workstation comprising a display and an input device for handling manipulation of a pointer moving in a sensing region of the input device, and a processor configured to perform such a method.
  • a medical workstation comprising a display and an input device for handling manipulation of a pointer moving in a sensing region of the input device, and a processor configured to perform such a method.
  • the coordinate input device in which when a coordinate input pointer is moved on a tablet while being in contact with the tablet, and this state is displayed with cursor movement, fine movement or delay movement of the cursor does not occur.
  • the coordinate input device is constituted by a tablet operated by a coordinate input pointer and a coordinate data generation section for generating coordinate data representing a coordinate position on the tablet operated by the coordinate input pointer.
  • the coordinate data generation section comprises a moving speed detection section for detecting a contact moving speed of the coordinate input pointer on the tablet and a fine movement removing filter for removing an unnecessary frequency component included in the coordinate data, so that a cutoff frequency of the fine movement removing filter is switched in accordance with the moving speed detected by the moving speed detections section. Consequently a problem to display a stabilized cursor is addressed. A similar problem must be solved in the area of displaying a cursor for a touch less input device. Touchless input devices are well known. For example, US patent application
  • 2002/0000977 Al discloses a three-dimensional interactive display system comprising a transparent capaciflector camera formed on a transparent shield layer on a screen surface which is able to detect a pointer such as a probe or finger intruding in the vicinity of that screen surface.
  • US Patent 6,025,726 discloses an alternative to capacitive sensing in which electric field sensing is used to provide a touchless sensing region.
  • US Patent 6,130,663 discloses an other alternative in which an electro-optical scanner is used to provide optical touchless activation of a controlled element, such as a graphic element of a computer display, in response to the presence of a controlling pointer, such as a finger, in a predetermined field of free space separate from the element.
  • a controlled element such as a graphic element of a computer display
  • a controlling pointer such as a finger
  • the position of the pointer to be detected is not as stable as for example the position of the coordinate input device as described above.
  • This instability is for example due to human nature, because it is difficult to keep the pointer in one place in free space and for example due to noise in the touchless input device that translates the position data of the pointer into coordinate data that can be used by an application to display for example a cursor. Due to the instability a user may experience latency between an actual movement of the pointer and the feedback of the application based upon the movement.
  • the invention provides a method of handling manipulation of a pointer moving in a sensing region of a touchless input device, the method comprising translating position data of the pointer into coordinate data by the touchless input device, stabilization filtering of the coordinate data to stabilize a representation of the pointer, and event filtering of the coordinate data to determine an event of the representation of the pointer.
  • a filter By applying a filter to the coordinate data that stabilizes the representation of the pointer, a user can manipulate the pointer better to perform operations that require an accurate position.
  • An example of such a filter is to average the coordinates of the last N positions.
  • an event is a manipulation of the pointer in order to perform a certain operation like moving inside or outside a certain area.
  • the event filtering comprises speed filtering of the coordinate data to determine a speed of the representation of the pointer, and area filtering of the coordinate data to determine if the representation of the pointer is within a predetermined area.
  • speed filtering for example by subtracting consecutive coordinate positions
  • area filtering for example by determining if all coordinate positions within a predefined time interval are within a predefined area
  • the application can for example determine if a user wants to select a widget like for example a button.
  • the event filtering and the stabilization filtering run substantially concurrently.
  • the application can determine the resulting feedback to the user, both with respect to the position of the representation of the pointer and the events, like select/deselect widgets, invoked by the manipulation of the pointer. It is a further object of the invention to provide a computer program product that reduces latency between a movement of a pointer and the feedback of the movement to a user.
  • the computer program product to be loaded by a computer arrangement comprises instructions for handling manipulation of a pointer moving in a sensing region of a touchless input device, the computer arrangement comprising a processing unit and a memory, the computer program product, after being loaded, providing said processing unit with the capability to carry out the following tasks: translating position data of the pointer into coordinate data by the input device, stabilization filtering of the coordinate data to stabilize a representation of the pointer, and event filtering of the coordinate data to determine an event of the representation of the pointer. It is an object of the invention to provide a computer readable storage medium that reduces latency between a movement of a pointer and the feedback of the movement to the user.
  • the computer readable storage medium having recorded thereon data representing instructions for performing a method or any of the examples of the method according to the invention. It is an object of the invention to provide a display and a medical workstation that reduces latency between a movement of a pointer and the feedback of the movement to the user.
  • the display device and the medical workstation for handling manipulation of a pointer moving in a sensing region of a touchless input device comprise a display, the touchless input device and a processor configured to perform a method or any of the examples of the method according to the invention.
  • Figure 1 illustrates a touchless input device with touchless manipulation of a user's hand
  • Figure 2 illustrates a method according to the invention in a schematic way
  • Figure 3 illustrates a display device comprising a touch less input device in a schematic way.
  • Figure 1 illustrates a touchless input device 102 with touchless manipulation of a user's hand 110.
  • the space in which the position of the user's hand can be manipulated in a sensing region is represented by 108. Although the space is represented by a "box" this is for illustration purposes only and the shape of the space may vary depending upon the technology used by the touchless input device 102.
  • the touchless input device 102 is connected to a plane 104. In a typical application, this plane 104 is formed by a display and the sensing region is formed in front of the display by the touchless input device 102.
  • the display shows a graphical user interface (GUI) generated by an application and the user can manipulate gadgets and widgets of the GUI via touchless manipulation of a pointer, such as the user's hand in the sensing region 108.
  • GUI graphical user interface
  • the touchless input device is designed to translate the position of the hand in three dimensions within the sensing region into a coordinate that can be used by the application.
  • the touchless input device uses for this purpose an orthogonal coordinate system, such as a Cartesian coordinate system 106.
  • Figure 2 illustrates a method according to the invention in a schematic way. The method starts with an initialization step 202 in which the touchless input device assigns a coordinate system to the sensing region wherein the position of a pointer can be detected.
  • the touchless input device continuously translates the position of a pointer, such as a user's hand or a stylus, within the sensing region into coordinate data.
  • the coordinate data is filtered to remove instability caused by the instable position of the pointer.
  • an averaging filter is applied that averages the coordinates of the pointer over the last N coordinates. IfN is for example 8 and the frequency that the input device generates coordinate data is 32 per second, a latency of 0.25 seconds is introduced which may not be noticed by the user.
  • Such an event may for example be used for moving a slider for which the speed of the pointer determines the speed with which the slider is moved.
  • the coordinate data is filtered to determine if the pointer is within a certain region. For example, when a user wants to select a button the user positions the pointer, i.e. his hand at a specific location, related to the displayed button, within the sensing region for a certain period of time. The filter subtracts a number of consecutive pointer coordinates and if all these subtractions are below a certain threshold, then the pointer is within the region. If there's one subtraction that is above the threshold, then the pointer is not within the region: f (V/ : 0 ⁇ / ⁇ N :
  • position ⁇ - position n ⁇ threshold) — > true in Re gion n ⁇
  • this region event is also used by the application to give feedback to the user about the manipulation of the pointer within the sensing area of the touchless input device.
  • the three filters work independently from each other thereby reducing the total latency and providing the user a stable pointer and direct manipulation of events.
  • the filters are applied concurrently so that the application can use the results of each filter to determine the pointer representation and the corresponding event if any. Applying the filters may be performed as long as the touchless input device provides the coordinates.
  • step 212 ends in step 212.
  • FIG. 3 illustrates a display device comprising a touch less input device in a schematic way.
  • the display device 316 comprises a computer 302 configured to generate, in accordance with the present invention, a screen display for a conventional flat panel display 304 with integral touchless input device, not shown, to which it is connected.
  • the current invention can be applied to touchless input devices that give a three-dimensional coordinate of a pointer that is positioned or moved in the sensing region of the touchless input devices. Examples of such input devices are mentioned previously.
  • the computer comprises amongst others a processor 306 and a general purpose memory such as random access memory 310.
  • the processor and the memory are communicatively coupled through software bus 308.
  • the memory 310 comprises computer readable code comprising instructions designed to enable the processor 306 to perform the method according to the invention as previously described in cooperation with the touchless input device to which it is connected.
  • the computer readable code 314 can be downloaded onto the computer via a computer readable storage medium 312 such as a compact disk (CD) digital versatile/video disk (DVD) or other storage medium.
  • the computer readable code 314 may also be downloaded via the internet and the computer comprises a suitable medium to enable these downloads.
  • the invention is applied in a medical environment.
  • a medical workstation is provided in the operating theatre that shows medical images of the patients.
  • the medical workstation comprises a touchless input device and a computer configured to generate, in accordance with the present invention, a screen display that allows the previously described user interaction.
  • the images may be acquired before the operation, but they may also be acquired during the operation.
  • the surgeon performs the operation in a sterile environment and should avoid direct contact with the workstation in order to maintain this environment.
  • the current invention allows the surgeon to manipulate the images without direct contact.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention concerne un procédé permettant de gérer la manipulation d'un pointeur qui est déplacé dans une zone de détection d'un dispositif d'entrée sans contact. Ce procédé consiste à convertir des données de position du pointeur en données de coordonnées par le dispositif d'entrée sans contact ; à stabiliser par filtrage les données de coordonnées afin de stabiliser une représentation du pointeur ; et à procéder à un filtrage d'événements sur les données de coordonnées afin de déterminer un événement de la représentation du pointeur. L'invention concerne en outre un produit-programme informatique, un support de stockage informatique, un dispositif d'affichage et un poste de travail médical.
PCT/IB2006/054351 2005-11-25 2006-11-21 Filtrage de coordonnees de pointeur WO2007060604A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP05111294 2005-11-25
EP05111294.4 2005-11-25

Publications (2)

Publication Number Publication Date
WO2007060604A2 true WO2007060604A2 (fr) 2007-05-31
WO2007060604A3 WO2007060604A3 (fr) 2008-02-14

Family

ID=37770682

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2006/054351 WO2007060604A2 (fr) 2005-11-25 2006-11-21 Filtrage de coordonnees de pointeur

Country Status (1)

Country Link
WO (1) WO2007060604A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190050111A1 (en) * 2016-02-18 2019-02-14 Sony Corporation Information processing device, information processing method, and program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0721169A2 (fr) * 1995-01-05 1996-07-10 International Business Machines Corporation Dispositif de pointage sans fil pour une commande à distance d'un curseur
WO2000017848A1 (fr) * 1998-09-22 2000-03-30 Vega Vista, Inc. Commande intuitive d'un ecran portable de presentation de donnees
WO2001043473A1 (fr) * 1999-12-08 2001-06-14 Telbird Ltd. Processeur de donnees portable
WO2002007839A2 (fr) * 2000-07-24 2002-01-31 Jestertek, Inc. Systeme de controle d'images video
US20040227725A1 (en) * 2002-10-14 2004-11-18 Stmicroelectronics S.R.L. User controlled device for sending control signals to an electric appliance, in particular user controlled pointing device such as mouse of joystick, with 3D-motion detection

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0721169A2 (fr) * 1995-01-05 1996-07-10 International Business Machines Corporation Dispositif de pointage sans fil pour une commande à distance d'un curseur
WO2000017848A1 (fr) * 1998-09-22 2000-03-30 Vega Vista, Inc. Commande intuitive d'un ecran portable de presentation de donnees
WO2001043473A1 (fr) * 1999-12-08 2001-06-14 Telbird Ltd. Processeur de donnees portable
WO2002007839A2 (fr) * 2000-07-24 2002-01-31 Jestertek, Inc. Systeme de controle d'images video
US20040227725A1 (en) * 2002-10-14 2004-11-18 Stmicroelectronics S.R.L. User controlled device for sending control signals to an electric appliance, in particular user controlled pointing device such as mouse of joystick, with 3D-motion detection

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190050111A1 (en) * 2016-02-18 2019-02-14 Sony Corporation Information processing device, information processing method, and program
US10747370B2 (en) * 2016-02-18 2020-08-18 Sony Corporation Information processing device, information processing method, and program for outputting a display information item about an operation object

Also Published As

Publication number Publication date
WO2007060604A3 (fr) 2008-02-14

Similar Documents

Publication Publication Date Title
US10599212B2 (en) Navigation of a virtual plane using a zone of restriction for canceling noise
JP6387404B2 (ja) 位置信号を介したユーザインターフェイスエレメントの選択
CA2738185C (fr) Entree tactile a manipulation de composant graphique par association
US9871962B2 (en) Movable user interface shutter button for camera
JP5090161B2 (ja) グラフィカルユーザインタフェースの多階層表示
KR101572307B1 (ko) 정보 처리 장치, 정보 처리 장치의 제어 방법, 및 저장 매체
EP2051160B1 (fr) Système doté d'une interface utilisateur utilisant une sélection d'objets et des gestes
US20080263479A1 (en) Touchless Manipulation of an Image
US20140082559A1 (en) Control area for facilitating user input
JP2012137837A (ja) タッチ入力処理装置、情報処理装置およびタッチ入力制御方法
EP3370134B1 (fr) Dispositif d'affichage et son procédé d'affichage d'interface utilisateur
CN104380235A (zh) 环绕导航
JP2017537395A (ja) 対話型スタイラス及びディスプレイ装置
WO2016057589A1 (fr) Sélection d'une image dans un contenu vidéo sur une interface utilisateur
WO2007060604A2 (fr) Filtrage de coordonnees de pointeur
US20180121080A1 (en) Display Having Position Sensitive Keyboard
JP5065838B2 (ja) 座標入力装置
JP2010049318A (ja) 移動制御プログラム
US10921927B2 (en) Alterable ground plane for touch surfaces
CN105739816A (zh) 选择图形元素
Colley et al. Touchscreens as the de facto interface to complex systems
KR20190049349A (ko) 프로젝션 영상에서 사용자의 터치를 인식하는 방법 및 이러한 방법을 수행하는 장치
JP2014137616A (ja) 表示制御装置、表示制御システム及び表示制御方法
JP2015060455A (ja) 電子装置、制御方法及びプログラム
CN114546240B (zh) 游戏的交互实现方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 06821512

Country of ref document: EP

Kind code of ref document: A2