EP1444566A2 - Appareil de saisie, webcam et ecran a fonction d'entree vocale - Google Patents

Appareil de saisie, webcam et ecran a fonction d'entree vocale

Info

Publication number
EP1444566A2
EP1444566A2 EP02787724A EP02787724A EP1444566A2 EP 1444566 A2 EP1444566 A2 EP 1444566A2 EP 02787724 A EP02787724 A EP 02787724A EP 02787724 A EP02787724 A EP 02787724A EP 1444566 A2 EP1444566 A2 EP 1444566A2
Authority
EP
European Patent Office
Prior art keywords
input device
voice control
manual input
control signals
integrated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP02787724A
Other languages
German (de)
English (en)
Inventor
Bernd Gombert
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
3DConnexion GmbH
Original Assignee
3DConnexion GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 3DConnexion GmbH filed Critical 3DConnexion GmbH
Publication of EP1444566A2 publication Critical patent/EP1444566A2/fr
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
    • G06F1/1605—Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202—Constructional details or processes of manufacture of the input device
    • G06F3/021—Arrangements integrating additional peripherals in a keyboard, e.g. card or barcode reader, optical scanner
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543—Mice or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output

Definitions

  • Input device webcam and screen with voice input function
  • the present invention relates to a manual input device for generating control signals for real and / or virtual objects, a screen and an Internet camera attachment for a computing device.
  • keyboards, mice, trackballs and joysticks are widely used today. They are used to control cursors, mouse pointers etc., for example to navigate through a virtual scene or to move virtual objects that are graphically displayed on a screen. While keyboards and mice need a fixed storage space in order to be operated efficiently, using a touch screen or a touch panel is possible directly to point at objects shown on the screen with your finger without the need for additional space-consuming additional devices on the desk.
  • US-A-5,757,360 discloses an egg-shaped input device for computers which can be moved freely in space by a user's hand, determines its current positions, directions of movement, speeds and accelerations and transmits this kinematic data wirelessly to a computer.
  • An analog movement sequence in the form of a movement pattern is identified, from which movement commands are derived and converted into an animated graphic representation.
  • the movement patterns are then automatically recognized with the aid of a pattern recognition algorithm. Control commands are also generated.
  • the disadvantage of this method is that it cannot be freely specified, since the user's movement sequences, which are recorded by the input device in an analog manner, correspond to corresponding movement sequences of stored movement sequences of an animated graphic representation and can only be represented as such.
  • Input devices which have manually operated force / torque sensors are known, for example, from the patents DE 36 11 336 C2, DE 37 64 287 and EP 0 979 990 A2.
  • a conceivable solution would be the input of the numerical data by means of voice control signals (English: “Voice Control”).
  • voice Control the user must carry an attachment according to the prior art on his head that carries a microphone.
  • This attachment must be worn by the user (English: “headset”).
  • This solution also has ergonomic problems, since on the one hand the user now has to handle a total of four input devices, namely the force / moment sensor, the normal computer mouse, the keyboard and the microphone.
  • the number of connections for example on the back of the computer to which the four devices mentioned are to be connected, is not sufficient, or there are double assignments if at least two of the devices mentioned have the same connection type (e.g. USB, RS 232 C) are required.
  • a manual input device for generating control signals for real and / or virtual objects.
  • the manual input device can not only be used to control computers, but also to control robots. tern or other real objects.
  • a microphone for recording and converting acoustic voice control signals from a user into electrical signals is integrated in the housing of the manual input device.
  • This advantageous embodiment achieves two advantages by means of a single measure: on the one hand, the integration of the microphone into the housing of the manual input device relieves the user of handling an input device.
  • the interface of the input device can also be used for the transmission of acoustic voice control signals or their evaluation. This reduces the number of occupied interfaces on the computer. According to the invention, the avoidance of two disadvantages from the prior art is thus achieved by a single simple measure.
  • a processing unit e.g. an application-specific integrated semiconductor component (ASIC) can be provided, which subjects the output signals from the microphone to an algorithm for automatic speaker identification, speech recognition, analysis and / or interpretation. If a speech recognition algorithm that is independent of the voice of the respective speaker is implemented, the implementation of the automatic speaker identification can be omitted.
  • the manual input device not only transmits acoustically or electrically converted signals to the computing unit, but rather commands which can be processed directly by a computer are conveyed.
  • “voice control” also means the input of (for example numerical) values or texts. Voice control is therefore also to be understood in the sense of “voice input” (input of information and control commands).
  • the manual input device can be, for example, a conventional computer mouse, a force / moment sensor or a keyboard.
  • the voice control function ie the activation of the recording and implementation of acoustic voice control signals by the combination of input device and microphone, can be activated by actuating the manual input device (for example by means of a special key).
  • the manual input device can be operated together with driver software that automatically activates the voice control function (recording and converting acoustic voice control signals) as soon as the manual input device is connected to a connection provided on the computing unit. This is a particularly advantageous solution because, when the input device is connected, not only is it possible to enter the usual control commands (cursor or mouse pointer control, etc.) for the computing unit, but the speech recognition function is also provided at the same time.
  • the voice control activation function can be integrated directly into the driver software that is used to implement the other control signals (cursor or object control). This has the advantage that the user does not have to install two different software packages for the manual input device and the voice control, but rather the control signal function and the voice control function can be installed simultaneously by installing a single driver software.
  • interpreted and processed voice control. signals are transmitted together with the other control commands (for example for cursor control, etc.) to a computing unit via a common wired or wireless interface.
  • the other control commands for example for cursor control, etc.
  • Such an input device is particularly advantageous in the field of CAD, desktop publishing or the like.
  • an Internet camera attachment for a computing device.
  • Such camera attachments are often referred to as webcams.
  • a microphone is integrated in the housing of the Internet camera attachment.
  • a microphone can also be permanently connected to the housing of the webcam or attached to it.
  • the invention relates equally to microphones integrated into the display housing for voice input.
  • Fig. 1 shows a first embodiment in which a microphone for recording and converting acoustic voice control signals into electrical signals, an ASIC for automatic speaker identification, speech recognition, analysis and interpretation as well as a button for manual activation of the voice control function are integrated in the housing of a computer mouse .
  • FIG. 2 shows a second exemplary embodiment, in which a microphone for recording and converting acoustic speech signals into the housing of a computer keyboard.
  • Fig. 3 shows a third embodiment in which in the housing of an Internet
  • Camera attachment (“webcam”), a microphone for recording and converting acoustic voice control signals into electrical signals, an ASIC for automatic speaker identification, speech recognition, analysis and interpretation and a button for manual activation of the voice control function are integrated, and
  • Fig. 4 shows a fourth embodiment in which in the housing of a computer screen, a microphone for recording and converting acoustic voice control signals into electrical signals, an ASIC for automatic Speaker identification, speech recognition, analysis and interpretation and a button for manual activation of the voice control function are integrated.
  • FIGS. 1 to 4 The functions of the assemblies contained in four different exemplary embodiments of the present invention, as shown in FIGS. 1 to 4, are described in more detail below. The meaning of the symbols provided with reference symbols in FIGS. 1 to 4 can be found in the attached list of reference symbols.
  • a computer 7 with a screen 7a, a mouse or a force / moment sensor 1 and a keyboard 1 'as manual input devices for entering control commands and an Internet camera attachment 1 "(English:" webcam ") mapped.
  • This computer 7 represents only one example of an environment in which real and / or virtual objects can be controlled.
  • a CAD program can be installed on the computer 7.
  • the manual input devices 1, 1 'and / or the webcam 1 "are expanded in such a way that they each have an integrated microphone 3, as shown in FIGS. 1 to 4.
  • voice control signals of the user can be recorded , converted into electrical signals and converted into suitable commands for controlling the computer 7 by means of a processing unit 4 (microprocessor), for example an application-specific integrated semiconductor component (ASIC).
  • ASIC 4 subjects the output signals of the microphone 3 to an algorithm for automatic speaker identification (if a speech recognition algorithm that is independent of the voice of the respective speaker is implemented), speech recognition and analysis and interprets them as control signals for the connected computer.
  • the control signals are preferably such that they are related to the configuration / setting or the operation of the input device or the webcam.
  • Settings can be made by language (assignment of the degrees of freedom of the input device, etc.) or functions can be triggered.
  • the driver Software (usually on the computer) for the input device or the webcam a function that enables the evaluation of the voice-controlled control signals.
  • the processor 4 for the speech signal evaluation is preferably arranged in the housing of the input device or the webcam, usually as a separate component separate from the processors for the image signal evaluation or the evaluation of the signals from the input device.
  • the voice signal evaluation can preferably be stored as firmware.
  • the implemented and evaluated commands are then transmitted to the computer 7 via the same interface 8, which is also provided for the transmission of the other control commands via the mouse 1 or the keyboard 1 'for controlling the cursor or the mouse pointer.
  • the voice control function can be activated on the manual input device 1, 1 'by means of a special key - key 5 in the case of the mouse 1 or key 5' in the case of the keyboard 1 '.
  • the driver software for the input device automatically activates the voice control function as soon as the input device 1, 1 'or the webcam 1 "is connected to the corresponding port 6 (for example a USB port 6 or a serial RS 232 port). Interface etc.) of the computer 7.
  • the voice control function or the voice Control activation function can be integrated, which reduces the installation effort for the user. With the connection of the manual input device 1, 1 ', the voice control is also available at the same time.
  • wired interface 8 which serves for the joint transmission of the recognized, linguistically analyzed and interpreted voice control signals converted into electrical signals, together with the other control commands
  • wired interface 8 which serves for the joint transmission of the recognized, linguistically analyzed and interpreted voice control signals converted into electrical signals, together with the other control commands
  • An infrared interface or an interface according to the Bluetooth standard is suitable for this wireless interface.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

La présente invention concerne un appareil de saisie manuel (1, 1') destiné à la production de signaux de commande pour des objets réels et / ou virtuels. Selon la présente invention, un microphone (3) destiné à l'enregistrement et à la conversion de signaux de commande vocale acoustiques d'un utilisateur est intégré dans le boîtier (2, 2') de l'appareil de saisie manuel. De cette manière, l'utilisateur est déchargé de la manipulation de l'appareil de saisie (1, 1'). L'interface (8) entre l'appareil de saisie (1, 1') et un ordinateur (7) peut également être utilisée pour la transmission de signaux de commande vocale acoustiques, ou pour l'évaluation desdits signaux. Le nombre des connexions occupées (6) de l'ordinateur (7) est ainsi réduit. Le boîtier de l'appareil de saisie manuel (1, 1') peut en outre contenir une unité de traitement (4), par exemple un circuit intégré à application spécifique, qui soumet les signaux de sortie du microphone (3) à un algorithme d'identification automatique du locuteur, et de reconnaissance vocale, d'analyse vocale et / ou d'interprétation vocale automatiques. Dans ce cas, l'appareil de saisie manuel (1, 1') ne transmet donc pas seulement des signaux à conversion acoustique ou électrique à l'unité de calcul (7), mais transmet plutôt des instructions traitées directement par un ordinateur (7). Ledit appareil de saisie manuel (1, 1') peut fonctionner avantageusement avec un logiciel de pilotage qui active automatiquement une fonction de commande vocale (enregistrement et conversion de signaux de commande vocale acoustiques) aussitôt que l'appareil de saisie manuel (1, 1') est connecté à une connexion (6) prévue à cet effet de l'unité de calcul (7). La fonction de commande vocale-activation peut être intégrée directement dans le logiciel de pilotage qui est destiné à convertir les signaux de commande pour la commande du curseur ou de l'objet. Selon la présente invention, les signaux de commande vocale convertis et traités peuvent être transmis avec les instructions de commande restantes à l'unité de calcul (7) via une interface commune (8) filaire ou sans fil.
EP02787724A 2001-11-16 2002-11-18 Appareil de saisie, webcam et ecran a fonction d'entree vocale Withdrawn EP1444566A2 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE10156457 2001-11-16
DE10156457 2001-11-16
PCT/EP2002/012918 WO2003042802A2 (fr) 2001-11-16 2002-11-18 Appareil de saisie, webcam et ecran a fonction d'entree vocale

Publications (1)

Publication Number Publication Date
EP1444566A2 true EP1444566A2 (fr) 2004-08-11

Family

ID=7706059

Family Applications (1)

Application Number Title Priority Date Filing Date
EP02787724A Withdrawn EP1444566A2 (fr) 2001-11-16 2002-11-18 Appareil de saisie, webcam et ecran a fonction d'entree vocale

Country Status (4)

Country Link
US (1) US20040080622A1 (fr)
EP (1) EP1444566A2 (fr)
AU (1) AU2002352051A1 (fr)
WO (1) WO2003042802A2 (fr)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070109410A1 (en) * 2005-11-15 2007-05-17 Creative Technology Ltd. Apparatus for audio reproduction and image capturing
US7949536B2 (en) * 2006-08-31 2011-05-24 Microsoft Corporation Intelligent speech recognition of incomplete phrases
KR101115467B1 (ko) * 2009-09-30 2012-02-24 주식회사 팬택 가상 키보드 제공 단말 및 그 방법
EP2629175B1 (fr) * 2010-10-15 2020-11-11 Zuken Inc. Dispositif et procédé de traitement d'informations d'entrée, programme et support d'enregistrement lisible par ordinateur
US10430212B1 (en) * 2016-07-13 2019-10-01 Screenshare Technology Ltd. Method for recording, editing and reproduction of computer session
CN107204188A (zh) * 2017-06-13 2017-09-26 大连东软信息学院 电脑语音助手装置及其工作方法
CN110308747B (zh) * 2019-06-26 2022-05-31 西南民族大学 一种基于机器视觉的电子式全自动计算机操作装置
TWI812973B (zh) * 2021-07-02 2023-08-21 矽統科技股份有限公司 觸控系統及其感測方法與主動筆

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2080802A1 (fr) * 1991-10-21 1993-04-22 Anthony Garcia Combinaison d'une souris d'ordinateur et d'un microphone et methode d'utilisation de cette combinaison
US5339095A (en) * 1991-12-05 1994-08-16 Tv Interactive Data Corporation Multi-media pointing device
US5757360A (en) * 1995-05-03 1998-05-26 Mitsubishi Electric Information Technology Center America, Inc. Hand held computer control device
JPH0965224A (ja) * 1995-08-24 1997-03-07 Hitachi Ltd テレビ受像機
DE69731864T2 (de) * 1996-10-09 2005-11-03 Polycom, Inc., Pleasanton Integrierte tragbare Videokonferenzvorrichtung
US6026417A (en) * 1997-05-02 2000-02-15 Microsoft Corporation Desktop publishing software for automatically changing the layout of content-filled documents
US6489947B2 (en) * 1997-08-15 2002-12-03 Ergodevices Corp. Ergonomic dual-section computer-pointing device
DE19835809A1 (de) * 1998-08-07 2000-02-10 Thomas Teufel Kombi-Maus
FR2783625B1 (fr) * 1998-09-21 2000-10-13 Thomson Multimedia Sa Systeme comprenant un appareil telecommande et un dispositif de telecommande vocale de l'appareil
US6348912B1 (en) * 1999-05-25 2002-02-19 Micron Technology, Inc. Family mouse
WO2001040893A2 (fr) * 1999-12-03 2001-06-07 Cyberscan Technology, Inc. Procede, systeme et appareil de courtage electronique face a face pour affaires ou vente au detail
US20010012998A1 (en) * 1999-12-17 2001-08-09 Pierrick Jouet Voice recognition process and device, associated remote control device
US6611725B1 (en) * 2000-02-03 2003-08-26 Solidworks Corporation Computer drawing system
US6859358B2 (en) * 2001-09-14 2005-02-22 International Business Machines Corporation Sub-notebook portable computer with integrated wireless mobile telephone

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO03042802A2 *

Also Published As

Publication number Publication date
WO2003042802A3 (fr) 2004-04-01
AU2002352051A1 (en) 2003-05-26
WO2003042802A2 (fr) 2003-05-22
US20040080622A1 (en) 2004-04-29

Similar Documents

Publication Publication Date Title
EP1428110B1 (fr) Appareil d'entree 3d a ecran tactile integre
DE69018708T2 (de) Dreidimensionale Maus mit einer Vertiefung.
DE10004372B4 (de) Gestaltung von Kraftempfindungen für Computeranwendungen mit Geräuschen
EP2761399B1 (fr) Gant de données à rétro-information tactile et procédé
DE69225550T2 (de) Verfahren und Vorrichtung zum Reduzieren des Betriebsaufwandes für einen berührungsempfindlichen Schirm
DE112017004677T5 (de) Berührungsempfindliche Tastatur
WO2008116642A2 (fr) Appareil de communication mobile et dispositif d'entrée pour cet appareil de communication mobile
DE102008061039A1 (de) Verfahren zur optischen Multitouchsteuerung für grafische Benutzerschnittstelle
DE10056291A1 (de) Verfahren zur visuellen Darstellung und interaktiven Steuerung von virtuellen Objekten auf einem Ausgabe-Sichtfeld
EP3040817A1 (fr) Dispositif et procede de saisie d'un texte au moyen d'elements de commande virtuels avec reaction haptique destinee a simuler une haptique tactile, en particulier dans un vehicule automobile
DE112012003889T5 (de) Verfahren, Vorrichtung und Computerprogramm, die zum Zeigen auf ein Objekt dienen
WO2003023592A2 (fr) Gestionnaire de bureau electronique
DE102007018364A1 (de) Zeigeeinrichtung zum Dreidimensional-Raum-Navigieren unter Verwendung mehrerer fingerbetätigter Sensoren
DE102015012720B4 (de) Interaktives Bediensystem und Verfahren zum Durchführen einer Bedienhandlung bei einem interaktiven Bediensystem
DE102013216152A1 (de) Ultraschallkopf mit Steuerungseinrichtung sowie Verfahren zur Steuerung eines Ultraschallgeräts
EP1573502A2 (fr) Dispositif de saisie rapide
DE102016206719A1 (de) Berührungseingabeeinrichtung und Fahrzeug mit einer Berührungseingabeeinrichtung
WO2003042802A2 (fr) Appareil de saisie, webcam et ecran a fonction d'entree vocale
DE102019118952A1 (de) Verfahren, Vorrichtung und Computerprogramm zum Steuern einer Benutzeroberfläche
EP3093182B1 (fr) Moyen de deplacement, machine de travail, interface utilisateur et procede d'affichage d'un contenu d'un premier dispositif d'affichage sur un second dispositif d'affichage
DE102015003883B4 (de) Kraftfahrzeugsimulationsanordnung zur Simulation einer virtuellen Umgebung mit einem virtuellen Kraftfahrzeug und Verfahren zur Simulation einer virtuellen Umgebung
DE10155030A1 (de) Desktopmanager
EP0878754A2 (fr) Procédé d'interaction avec un ordinateur, affichage et interface à d'utilisation de ce procédé
WO2015176707A1 (fr) Périphérique d'entrée, ordinateur ou installation de commande et véhicule
DE102019114752A1 (de) Verfahren, Vorrichtung und Computerprogramm zum Erfassen einer Eingabe und Fahrzeug mit einer solchen Vorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20040405

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LI LU MC NL PT SE SK TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

17Q First examination report despatched

Effective date: 20070726

REG Reference to a national code

Ref country code: DE

Ref legal event code: 8566

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20071206