EP3117289A1 - Dispositifs de commande sans contact modulaires - Google Patents

Dispositifs de commande sans contact modulaires

Info

Publication number
EP3117289A1
EP3117289A1 EP14714610.4A EP14714610A EP3117289A1 EP 3117289 A1 EP3117289 A1 EP 3117289A1 EP 14714610 A EP14714610 A EP 14714610A EP 3117289 A1 EP3117289 A1 EP 3117289A1
Authority
EP
European Patent Office
Prior art keywords
interface device
human interface
input data
sensor element
emulation unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP14714610.4A
Other languages
German (de)
English (en)
Inventor
Jesús PÉREZ-LLANO
Gerardo CABALLERO
Enrique MUÑOZ
Daniel Calvo
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tedcas Medical Systems S L
Original Assignee
Tedcas Medical Systems S L
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tedcas Medical Systems S L filed Critical Tedcas Medical Systems S L
Publication of EP3117289A1 publication Critical patent/EP3117289A1/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Definitions

  • the present disclosure relates to a device for touchless controlling of a computer system, for example to a modular touchless virtual keyboard and/or mouse device.
  • Touchless pointing device a touchless pointing device is described for controlling a computer emulating a mouse by means of gestures over a plane.
  • the pointing device can be used touchless to control a third party computer, it can be only used with the kind of sensors described in the application.
  • the invention described in this application requires drivers and/or software to be installed in the third party computer.
  • this kind of devices have to be used connected to a computer system, which is able to run its drivers with the compatible operating system and with a hardware complying with the minimum requirements.
  • This approach makes it impossible to use this kind of devices in computer systems that do not comply with all the requirements.
  • it implies installing software in the computer system (SDK, drivers, etc.), which is not possible in many B2B use cases (for example, in the medical field, third party workstations do not allow installing any software from other companies.
  • they have specially prepared operating system that is not compatible with the previously mentioned kind of sensors).
  • an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element may comprise a first interfacing module for connecting the touchless sensor element to the apparatus; a second interfacing module for connecting the apparatus to the human interface device emulation unit; a processing module comprising a processor and a memory, embodying instructions stored in the memory and executable by the processor, the instructions being adapted to execute a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element described later; an operating system stored in the memory; at least one driver associated to the touchless sensor element and to the operating system, the driver being stored in the memory.
  • This apparatus allows for providing a device for touchless controlling of a computer system as described later.
  • the apparatus is able to run all the software required for the touchless sensor element (all the software and drivers required for the touchless sensor element to work is installed in this apparatus) and, in combination with the touchless sensor element and the human interface device emulation unit, it is able to touchless control any type of computer system, no matter what hardware and software they have inside. That is, the apparatus is able to control any type of computer system independently of the operating system, microprocessor architecture or characteristics, as long as the computer system supports predefined or standard human interface devices such as standard mouse or keyboard devices. Because all the required drivers and software are installed in the apparatus, no software is required to be installed in the computer system to be controlled by the apparatus.
  • The(se) device(s) may cover any type of device(s) with data processing capabilities, such as e.g. computers, mobile phones (smartphones), tablets, etc.
  • The(se) device(s) may comprise any type of hardware and software components, such as e.g. input, output and storage components which may stand alone or be connected in a network or other similar device(s).
  • The(se) device(s) may also include computer data storage devices or media.
  • driver may refer to the software that allows the operating system to interact with the touchless sensor element. This way, the driver of each touchless sensor element allows the operating system for knowing the state of the touchless sensor element (i.e. if the touchless sensor element is on or off, etc.). Each driver may be provided, for example, by the manufacturer of the touchless sensor element or the manufacturer of the operating system.
  • this software may be structured in layers, this structure in layers ensuring an easy replacement of any layer without affecting the rest.
  • this modularity allows the apparatus being compatible with any touchless sensor element present or future.
  • the apparatus, in combination with the touchless sensor element and the human interface device emulation unit, is able to control any type of computer system.
  • the first layer may comprise the instructions for controlling the touchless sensor element, so if a new touchless sensor element needs to be supported it is sufficient to replace this layer (or a part of it).
  • the second layer may be the main one, the one that may comprise the instructions for converting the received commands from the first layer (gestures, voice commands, eye movements, etc.) into human interface device input data, for example mouse movements or keyboard shortcuts.
  • the piece of software for this second layer may be implemented according to an SDK (Software Development Kit) associated to the touchless sensor element (it may be provided by the manufacturer of the touchless sensor element or the manufacturer of the operating system) and according to the standard mouse/keyboard protocols.
  • SDK Software Development Kit
  • an open hand moved to the right by means of the SDK and assign the determined type of the command to an input data (for example, mouse or keyboard input data) according to the standard mouse/keyboard protocols (for example, input data relating to a movement of the cursor to the right). Consequently, for example, an open hand moved to the right determined by the piece of software (based in the cited SDK) may suppose a movement of the cursor to the right in the computer system.
  • the third layer may comprise the instructions for packing the human interface device input data (e.g. the mouse movements or the keyboard shortcuts) into the corresponding signals which the computer system to be controlled may see as predefined human interface device input data signals (e.g. standard mouse or keyboard signals).
  • predefined human interface device input data signals e.g. standard mouse or keyboard signals.
  • Another advantage of the modularity of the software comprised in the apparatus is that it allows easy interchanging of the touchless sensor element such that it allows the user to control the computer system by means of voice commands, gestures, eye-tracking, etc.
  • this apparatus could be replaced by a compatible one.
  • an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element may comprise a first interfacing module for connecting a touchless sensor element to the apparatus; a second interfacing module for connecting the apparatus to a human interface device emulation unit; computer/electronic means for receiving the at least one command from the touchless sensor element; computer/electronic means for determining the type of command received from the touchless sensor element; computer/electronic means for converting the received command into human interface device input data according to the determined type of the received command; computer/electronic means for packing the human interface device input data into corresponding predefined human interface device input data signals; computer/electronic means for making available the corresponding predefined human interface device input data signals to the human interface device emulation unit; a memory for storing an operating system and at least one driver associated to the touchless sensor element and to
  • the electronic/computer means may be used interchangeably, that is, a part of the described means may be electronic means and the other part may be computer means, or all described means may be electronic means or all described means may be computer means.
  • Examples of an apparatus comprising only electronic means may be a CPLD, a FPGA or an ASIC.
  • the apparatus may comprise a third interfacing module for connecting the apparatus to a communication network, for example a global communication network such as Internet.
  • a communication network for example a global communication network such as Internet.
  • This third interfacing module for connecting the apparatus to a communication network may comprise a wired/wireless communication interface, for example, it may be any standard interface such as Bluetooth, Wi-Fi or Ethernet but it is not limited to them.
  • the first interfacing module for connecting the touchless sensor element to the apparatus may comprise a wired/wireless communication interface, for example, it may be any standard interface such as USB, IR or Bluetooth but it is not limited to them.
  • the second interfacing module for connecting the apparatus to the human interface device emulation unit may comprise a wired/wireless communication interface, for example, it may be any standard interface such as USB, IR or Bluetooth but it is not limited to them.
  • a method of generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element is provided.
  • the method may comprise:
  • converting the received command into human interface device input data according to the determined type of the received command may comprise:
  • packing the human interface device input data into corresponding predefined human interface device input data signals recognizable by a computer system may comprise:
  • making available the corresponding predefined human interface device input data signals to the human interface device emulation unit may comprise:
  • a computer program product may comprise program instructions for causing a computer system to perform a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element as described above.
  • the computer program product may be embodied on a storage medium (for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory) or carried on a carrier signal (for example, on an electrical or optical carrier signal).
  • a storage medium for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory
  • a carrier signal for example, on an electrical or optical carrier signal
  • the computer program may be in the form of source code, object code, a code intermediate source and object code such as in partially compiled form, or in any other form suitable for use in the implementation of the processes according to the invention.
  • the carrier may be any entity or device capable of carrying the computer program.
  • the carrier may comprise a storage medium, such as a ROM, for example a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example a floppy disc or hard disk.
  • a storage medium such as a ROM, for example a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example a floppy disc or hard disk.
  • the carrier may be a transmissible carrier such as an electrical or optical signal, which may be conveyed via electrical or optical cable or by radio or other means.
  • the carrier may be constituted by such cable or other device or means.
  • the carrier may be an integrated circuit in which the computer program is embedded, the integrated circuit being adapted for performing, or for use in the performance of, the relevant methods.
  • a device for touchless controlling of a computer system may comprise an apparatus as described above; the touchless sensor element connected to the apparatus through the first interfacing module; the human interface device emulation unit connected to the apparatus through the second interfacing module, this human interface device emulation unit comprising a fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled; wherein, in operation, the human interface device emulation unit provides, through the fourth interfacing module, the corresponding predefined human interface device input data signals to the computer system, such that the signals received by the computer system are recognizable human interface device signals.
  • the touchless sensor element Because all the drivers and software required are installed in the device (more specifically in the apparatus), no software is required in the computer system to be controlled by the touchless sensor element (i.e. it is not required installing anything in the computer system).
  • the device is able to control any kind of computer system (no matter what the operating system, hardware or software in it may be) and it is sufficient that the computer system has the standard mouse/keyboard drivers. For this reason, it is possible to control the computer system with several types of touchless sensor elements. Furthermore, the touchless sensor element does not need to be embedded in the computer system or be connected to it.
  • the provision of the human interface device emulation unit allows for performing the emulation of the human interface device and allows for performing the connection to (through the fourth module) and control of the computer system. More specifically, the human interface device emulation unit is able to get or receive the packed movements (that is, the corresponding predefined human interface device input data signals) and communicate them to the computer system to be controlled in a way that the computer system may interpret them as coming from a standard keyboard or mouse (or any other standard human interface device). This way, from the point of view of the computer system, the device for touchless controlling of the computer system is seen as a standard mouse or keyboard. Therefore, as this kind of computer systems are already prepared for being controlled by a mouse or keyboard, no drivers or extra software is required to be installed.
  • the touchless sensor element may be a gesture controlled element or a voice controlled element.
  • the touchless sensor element may be any gesture, eye-tracking or voice controlled elements, such as a Microsoft Kinect, a LEAP Motion unit, a MYO from Thamic Labs or a Google Glass, but it is not limited to them. It may be a long, medium or short range sensor based on, for example, IR, computer vision, wearable sensor or any other sensor able to be connected to a computer system through standard ports such as IR, Bluetooth or USB, but it is not limited to them.
  • the fourth interfacing module for connecting the human interface device emulation unit to the computer system to be controlled may comprise a wired/wireless communication interface.
  • a wired/wireless communication interface may be any standard interface such as USB, IR or Bluetooth, but it is not limited to them.
  • the human interface device emulation unit may comprise a unit for emulating a human interface device selected from a mouse or a keyboard.
  • the term "human interface device” may refer to any type of computer device that interacts directly with humans such as a mouse or a keyboard. These human interface devices may use standard protocols, which may be implemented for any computer system.
  • the touchless sensor element may be connected to the apparatus and the drivers and its software associated may be installed in the apparatus. Consequently, it is not necessary to replace neither the apparatus nor the human interface device emulation unit.
  • the apparatus may be replaced by another compatible one, without replacing the touchless sensor element nor the human interface device emulation unit.
  • the human interface device emulation unit allows the device for touchless controlling of a computer system to be seen as a USB or Bluetooth mouse or keyboard by the computer system to be controlled. In case the computer system has to be accessed by another type of interface (IR, WiFi, etc.) only the human interface device emulation unit needs to be replaced (neither the touchless sensor element nor the apparatus have to be replaced).
  • a method of touchless controlling of a computer system is also provided. This method may comprise:
  • making available the corresponding predefined human interface device input data signals to the human interface device emulation unit may comprise sending the corresponding predefined human interface device input data signals to the human interface device emulation unit.
  • the method may comprise the human interface device emulation unit obtaining the corresponding predefined human interface device input data signals made available.
  • This computer program product may comprise program instructions for causing a computer system to perform a method of touchless controlling of a computer system as described above.
  • This computer program product may be embodied on a storage medium (for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory) or carried on a carrier signal (for example, on an electrical or optical carrier signal).
  • a storage medium for example, a CD-ROM, a DVD, a USB drive, on a computer memory or on a read-only memory
  • a carrier signal for example, on an electrical or optical carrier signal
  • Fig. 1 shows a schematic representation of an apparatus according to some embodiments
  • Fig. 2 shows a schematic representation of a device for touchless controlling of a computer system according to some embodiments
  • Fig. 3 is a flow chart illustrating a method of touchless controlling of a computer system according to some embodiments.
  • Figure 1 is a schematic representation of an apparatus for generating predefined human interface device input data signals, recognizable by a computer system, to be used by a human interface device emulation unit, from at least one command generated by a touchless sensor element according to some embodiments.
  • the apparatus 1 may comprise a first interfacing module 2 for connecting a touchless sensor element to the apparatus 1 ; a second interfacing module 3 for connecting the apparatus 1 to a human interface device emulation unit; a third interfacing module 4 for connecting the apparatus 1 to a communication network such as the Internet; and a processing module 5.
  • the processing module 5 may comprise a processor 6 and a memory 7, embodying instructions 8 stored in the memory 7 and executable by the processor 6, the instructions 8 being adapted to execute a method of generating predefined human interface device input data signals to be used by a human interface device emulation unit from at least one command generated by a touchless sensor element described later.
  • the memory 7 may also store an operating system 9 and a driver 10 associated to each touchless sensor element supported by the apparatus 1 (more specifically, by the operating system running on the apparatus 1 ).
  • the first interfacing module 2 for connecting the touchless sensor element to the apparatus 1 may comprise a wired communication interface, for example, it may be any standard interface such as USB, but it could be another wired or wireless communication interface such as IR or Bluetooth. Obviously, it is not limited to them;
  • the second interfacing module 3 for connecting the apparatus to the human interface device emulation unit may comprise a wired communication interface, for example, it may be any standard interface such as USB, but it could be another wired or wireless communication interface such as IR or Bluetooth. Obviously, it is not limited to them;
  • the third interfacing module 4 for connecting the apparatus to a communication network may comprise a wireless communication interface, for example, it may be any standard interface such as Wi-Fi, but it could be another wired or wireless communication interface such as Ethernet, IR or Bluetooth. Obviously, it is not limited to them. It is possible to connect the apparatus 1 to a communication network, for example, for updating the software stored in the memory 6 of the apparatus 1 (or a part or a layer of it) or for uploading new software such as drivers for new touchless sensor elements unsupported by the apparatus;
  • the processing module 5 may be any computer, for example an embedded computer, such as an electrician Leonardo or a Raspberry Pi;
  • the operating system 9 may be Windows XP or higher but it could be another operating system such as Linux or Mac OS; -
  • the driver 10 of each touchless sensor element must be compatible with the described operating system.
  • Figure 2 illustrates a schematic representation of a device 20 for touchless controlling of a computer system.
  • the device may comprise an apparatus 1 as described above (see Figure 1 ); a touchless sensor element 21 connected to the apparatus 1 through the first interfacing module 2; and a human interface device emulation unit 22 connected to the apparatus through the second interfacing module 3.
  • the human interface device emulation unit 22 may comprise a fourth interfacing module 23 for connecting this emulation unit 21 (that is, the device 20) to a computer system 24.
  • the touchless sensor element 21 may be a gesture controlled element or a voice controlled element.
  • the touchless sensor element may be any of the existing or future gesture, eye-tracking or voice controlled elements, such as a Microsoft Kinect, a LEAP Motion unit, a MYO from Thamic Labs or a Google Glass, but it is not limited to them. It may be long, medium or short range based on, for example, IR, computer vision, wearable sensor or any other sensor able to be connected to a computer system through standard ports such as IR, Bluetooth or USB, but it is not limited to them;
  • the human interface device emulation unit 22 may be a mouse/keyboard emulation unit
  • the fourth interfacing module 23 may be a wired communication interface such as USB, but it could be another wired or wireless communication interface such as Wi-Fi, IR or Bluetooth. However, it is not limited to them;
  • the computer system 24 may be, for example, a medical device. This way, because all the drivers and software required are installed in the device 20 (more specifically in the apparatus 1 ), no software is required in the computer system 24 to be controlled by the touchless sensor element 21 (i.e. it is not required to install anything in the computer system).
  • the device 20 is able to control any kind of computer system (no matter what the operating system, hardware or software in it may be) and it is sufficient that the computer system 24 has the standard mouse/keyboard drivers.
  • the human interface device emulation unit 22 allows for performing the emulation of the human interface device and allows for performing the connection to (through the fourth module) and control of the computer system 24. More specifically, the human interface device emulation unit 22 is able to get or receive the packed movements (that is, the corresponding predefined human interface device input data signals) and communicate them to the computer system 24 to be controlled in a way this computer system understands or interprets them as coming from a standard keyboard or mouse (or any other standard human interface device). This way, from the point of view of the computer system 24, the device 20 for touchless controlling of the computer system is shown as a standard mouse or keyboard. Therefore, as this kind of computer systems are already prepared for being controlled by a mouse or keyboard, no drivers or extra software is required to be installed in them.
  • the touchless sensor element 21 when the touchless sensor element 21 detects a gesture (or a voice command or eye movements, etc.) of a user 30 it may generate a command associated to this detected gesture and send it to the device 20 (more specifically, to the apparatus 1 ) through the first interfacing module 2. Then, when the apparatus 1 receives, in a step A, the command it may determine, in a step B, the type of the command received from the touchless sensor element 21 . Depending on the determined type of the command, the apparatus 1 may convert, in a step C, the received command into human interface device input data, that is, for example, into mouse movements or keyboard shortcuts.
  • the apparatus 1 may pack, in a step, D the human interface device input data (that is, for example, the mouse movements or keyboard shortcuts) into corresponding predefined human interface device input data signals, that is, for example, into standard mouse/keyboard signals.
  • D the human interface device input data that is, for example, the mouse movements or keyboard shortcuts
  • predefined human interface device input data signals that is, for example, into standard mouse/keyboard signals.
  • Said corresponding predefined human interface device input data signals may be made available, in a step E, to the human interface device emulation unit 22 (for example a mouse/keyboard emulation unit) by the apparatus 1 through the second interfacing module 3.
  • the expression "made available” may imply that the human interface device input data signals may be sent by the apparatus 1 to the human interface device emulation unit 22 or that the human interface device emulation unit 22 may obtain the corresponding predefined human interface device input data signals from the apparatus 1 .
  • the human interface device emulation unit 22 e.g. the mouse/keyboard emulation unit
  • the emulation unit 22 may send them to the computer system 24 through the fourth interfacing module 23 for touchless controlling of it.
  • the computer system 24 may comprise the standard mouse/keyboard drivers, it may understand the standard mouse/keyboard signals as coming from a standard keyboard or mouse.
  • a gesture for example, an open hand moved to the right
  • a standard mouse/keyboard signal representing a movement of the cursor in the display of the computer system 24 (for example, a movement of the cursor to the right).
  • a gesture representing closing a hand may be converted by the device 20 into a standard mouse/keyboard signal representing a click on a button of the mouse.
  • the described method may be implemented by a computer program or a plurality of computer programs running on the processing module 5.
  • the software may comprise a plurality of computer programs (one for each layer).
  • the method may be implemented by electronic means or a combination of electronic and computer means.
  • the method (or a part of it) may be implemented by logic gates in combination with computer programs.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un appareil destiné à générer des signaux de données d'entrée de dispositif d'interface humaine prédéfinis, reconnaissables par un système informatique, destinés à être utilisés par une unité d'émulation de dispositif d'interface humaine, à partir d'au moins une commande générée par un élément capteur sans contact, l'appareil comprenant un premier module d'interface pour connecter l'élément capteur sans contact à l'appareil ; un second module d'interface pour connecter l'appareil à l'unité d'émulation de dispositif d'interface humaine ; un module de traitement comprenant un processeur et une mémoire, organisant des instructions stockées dans la mémoire et exécutables par le processeur, les instructions étant conçues pour exécuter un procédé de génération de signaux de données d'entrée de dispositif d'interface humaine prédéfinis destinés à être utilisés par une unité d'émulation de dispositif d'interface humaine à partir d'au moins une commande générée par un élément capteur sans contact ; un système d'exploitation stocké dans la mémoire ; au moins un pilote associé à l'élément capteur sans contact et au système d'exploitation.
EP14714610.4A 2014-03-14 2014-03-14 Dispositifs de commande sans contact modulaires Withdrawn EP3117289A1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2014/055149 WO2015135592A1 (fr) 2014-03-14 2014-03-14 Dispositifs de commande sans contact modulaires

Publications (1)

Publication Number Publication Date
EP3117289A1 true EP3117289A1 (fr) 2017-01-18

Family

ID=50424194

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14714610.4A Withdrawn EP3117289A1 (fr) 2014-03-14 2014-03-14 Dispositifs de commande sans contact modulaires

Country Status (2)

Country Link
EP (1) EP3117289A1 (fr)
WO (1) WO2015135592A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ITUB20161095A1 (it) * 2016-02-29 2017-08-29 Fox Bit Srl Console tattica multifunzionale in materiale composito

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7058204B2 (en) * 2000-10-03 2006-06-06 Gesturetek, Inc. Multiple camera control system
US20070061126A1 (en) * 2005-09-01 2007-03-15 Anthony Russo System for and method of emulating electronic input devices
US7884806B2 (en) * 2007-05-14 2011-02-08 Synaptics Incorporated Proximity sensor device and method with keyboard emulation
US8907894B2 (en) * 2009-10-20 2014-12-09 Northridge Associates Llc Touchless pointing device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2015135592A1 *

Also Published As

Publication number Publication date
WO2015135592A1 (fr) 2015-09-17

Similar Documents

Publication Publication Date Title
US8355007B2 (en) Methods for use with multi-touch displays for determining when a touch is processed as a mouse event
US8952892B2 (en) Input location correction tables for input panels
CN104685463A (zh) 用于力感测触摸板的自动使用的设备和方法
TWI471802B (zh) 行動裝置應用程式之轉換方法及可轉換行動裝置應用程式之行動裝置和系統
US10620792B2 (en) Computing device with an appropriate adaptable user hardware interface
EP2741207A1 (fr) Procédé et système pour fournir des informations relatives à un contexte et support d'enregistrement lisible par ordinateur correspondant
US20160170779A1 (en) Device emulator
CN104536563A (zh) 一种电子设备控制方法及系统
CN106462514B (zh) 统一类装置接口与一个主机接口的系统与方法
JP6250842B2 (ja) Ｕｓｂオーバーｉｐを用いた、別のデバイスとの非ｕｓｂセンサの共有
WO2015088926A1 (fr) Modèle de consommation multimodale de contenu
WO2015135592A1 (fr) Dispositifs de commande sans contact modulaires
CN108139851B (zh) 用于软件应用的个性化启动状态
KR20220031764A (ko) 벤더 고유의 주변 장치 클래스 식별자들
US20080180412A1 (en) Dual mode digitizer
CN104820489A (zh) 管理低延时直接控制反馈的系统和方法
ES2601928B1 (es) Dispositivos de control sin contacto modulares
US9547515B2 (en) Convert a gesture
CN118159929A (zh) 虚拟输入设备的基于人体工程学的重新配置
JP2008117270A (ja) 情報処理システム、情報処理装置、情報処理方法、及びプログラム
US10235890B1 (en) System for navigating an aircraft display with a mobile device
Mulfari et al. Embedded systems for supporting computer accessibility
WO2023072406A1 (fr) Changement de disposition d'un dispositif d'entrée virtuel
JP2023532794A (ja) ユーザ機器からの視覚フィードバック
US20130257727A1 (en) Input device and method for simulating input using input device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20161014

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MUNOZ, ENRIQUE

Inventor name: CALVO, DANIEL

Inventor name: PEREZ-LLANO, JESUS

Inventor name: CABALLERO, GERARDO

RIN1 Information on inventor provided before grant (corrected)

Inventor name: MUNOZ, ENRIQUE

Inventor name: CABALLERO, GERARDO

Inventor name: PEREZ-LLANO, JESUS

Inventor name: CALVO, DANIEL

RIN1 Information on inventor provided before grant (corrected)

Inventor name: PEREZ-LLANO, JESUS

Inventor name: CALVO, DANIEL

Inventor name: MUNOZ, ENRIQUE

Inventor name: CABALLERO, GERARDO

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20190415

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20191026