GB2292443A

GB2292443A - Plug-compatible sound-controlled self-contained replacement for tactile control devices for an information system e.g.a computer

Info

Publication number: GB2292443A
Application number: GB9516652A
Authority: GB
Inventors: Jonathan Stephen Farringdon
Original assignee: Individual
Current assignee: Individual
Priority date: 1994-08-15
Filing date: 1995-08-14
Publication date: 1996-02-21
Also published as: GB9416463D0; GB9516652D0

Abstract

A foolproof self-contained plug-compatible sound-controlled input-command replacement, for any standard tactile control device 1 for any installed information system 7, such as a joystick- or mouse- or keyboard-controlled video game or computer, comprises a microphone 10 and a voice-recognition-processor 12 to generate inputs to a digital signal processor 14 which is capable of providing at least some identical digital command inputs to those supplied by the tactile control device 1 which is being replaced or augmented; the user is thus enabled to operate the information system by spoken words in a human language as a replacement of or an augmentation to the installed tactile control device. <IMAGE>

Description

PLUG- COMPATIBLE SOUND- CONTROLLED SELF-CONTAINED REPLACEMENT FOR TACTILE CONTROL DEVICES FIELD OF THE INVENTION This invention relates to external control systems for installed information systems such as video games, computers and the like, and more particularly to foolproof plugcompatible self-contained input device replacement or augmentation of existing installed input devices of the tactile control device category by a sound-controlled input command system.

BACKGROUND OF THE INVENTION Input devices (like joysticks, joypads, keyboards, and mice) for information systems (like "computer games", video games, and computers) are fundamentally controlled by tactile effects such as stick movement, ball movement, or button pressing, or by the lack of any effect. For interaction the operator is expected to be in physical contact with the device. Even a typical "remote control" device like a television remote control pad still requires physical contact as the user interacts with the remote-controlling pad.

Information systems (like video games) communicate with users using output devices including visual stimuli, sounds, text and audibly "spoken" words. Users currently communicate in a much more limited way, for example via movin,g-a joystick, and by pressing buttons. (A "key" on a keyboard is a button).

The addition of a sound controlled input device (like a voice controlled device) adds a completely new dimension (literally) to the man-machine interface. Where information systems currently have raw audio input this is achieved by direct effects to the information system, and actions based upon the signal require additional processing on behalf of the information system.

There are many situations where a conventional input device is inconvenient or difficult to manipulate, for example, due to the limited dexterity of hands and fingers, or in situations where the hands are occupied with another task.

This invention alleviates the task load of the hands when interacting with an input device.

The present invention of a plug-compatible self-contained replacement sound control device includes the introduction in a novel combination to an installed information system input device of standard components and subsystems organized and connected in such a way as to enable it to respond to nontactile user stimulus.

Sound waves, like those generated by speaking, enable the device to function independently of any physical contact stimulus from the operator. Thus a user may, for example, speak commands and the input device classifies the utterance and responds accordingly. The input device system realizing the presently-disclosed invention is able to respond to both physical or verbal stimuli.

What distinguishes this input device from say a light sensor or noise sensor is the ability to classify and respond to more than one signal of the same type, for example more than one different spoken words.

The invention relates to replacement or augmentation of an installed input device (e.g. a joystick), and no change is required to the installed information system itself (e.g. the pre-existing computer or video game) . Any installed information system which uses a suitable tactile-control digital input device may henceforth have voice control added by merely substituting the non-sound detecting input device with one specified by this invention in the embodiment providing an auxiliary input socket so that the existing tactile control device may be retained.

Unless specifically intended, an installed information system is not able to distinguish between the type of input device connected (e.g. any number of joysticks can be connected, including a voice controlled one). Thus a voice control input device of the type disclosed herein is interchangeable with any other suitable input device (e.g. a conventional joystick for a voice-controlled joystick, a conventional mouse for a voice-controlled mouse).

The subjects of voice-controlled devices and speech recognition technology are large and burgeoning fields of both research and development activity and commercial product sales at the present time, so that it is easy to jump to the mistaken conclusion that the presently disclosed invention is either 'obvious to one of ordinary skill in the most closely related arts' or is suggested by combining one or more presently available products in a manner suggested by the specifications of these products. However, despite diligent search for more than a year, during which scores of thousands of words of product descriptions and technological publications has been amassed, the present inventor has found nothing truly similar to or suggestive of the present invention.The data-base examined includes more than 16 commercially available Voice Recognition Processors (VRPs), and numerous hardware and software INTERNAL add-ons to Pcs (such as optional speech-processing 'cards' and the like) which provide voice-recognition processing capabilities, but there is nowhere available a self-contained plug-in device compatible with virtually all existing installed-information systems (ISs) which does not require the IS to be opened up and subjected to modification by someone already expert in electronics and computer science.

In contrast, the presently disclosed invention is foolproof and can be plugged in and used immediately by children or by adults having no prior knowledge of computer engineering or electronic technology. There is nothing remotely like this available, or the inventor would already have purchased one rather than make the present invention.

Accordingly there has been an unmet need for selfcontained, foolproof, plug-compatible augmentation or conversion devices which will convert existing information systems to operate upon user-voiced commands or allow augmentation of the capabilities of existing systems by uservoiced commands.

Also there has been an unmet need for such an invention to be composed of a combination of standard and readily available components and subsystems which will enable economical mass-production of this new input device at a price readily affordable by those who would like to augment their installed system at modest additional cost.

It will be demonstrated hereinbelow that the presently disclosed invention satisfies both of these hitherto unmet needs.

SUMMARY OF THE INVENTION In accordance with the principles of the present invention, there is provided a foolproof, self-contained plugcompatible sound-controlled input-command replacement for any standard tactile control device for any installed information system, such as a joystick- or mouse- or keyboard-controlled video game or computer.

The replacement device applies standard voicerecognition-processor technology to generate inputs to a digital signal processor capable of providing at least some identical digital command inputs to those supplied by the tactile control device which is being replaced or augmented; the user is thus enabled to operate the information system by spoken words in a human language as a replacement of or an augmentation to the installed tactile control device.

In accordance with a further aspect of the invention, this hitherto unavailable capability is provided by means of a novel combination of available standard components and subsystems, and therefore may be produced and sold economically for mass market consumption.

Other objects, features, and advantages will become apparent from a consideration of the following detailed description and from the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 depicts schematically an existing information system and installed tactile control device; and FIG. 2 depicts schematically the presently disclosed self-contained speech-controlled replacement/augmentation system for the tactile control device of FIG. 1.

DETAILED DESCRIPTION Referring more particularly to the drawings, FIG. 1 shows a tactile control device (TCD) 1 connected to an input plug, port-connection device or interface inlet 3 compatible with an input socket, port input device or interface receptacle 5 connected to an Information System (IS) 7, all of which is assumed already installed and available to the user of the presently disclosed invention.

FIG. 2 depicts a microphone 10 connected to a voice recognition processor (VRP) 12 connected to a digital signal processor (DSP) 14, which may include an optional alternative input socket, port input device or interface receptacle 16 compatible with the input plug, port connection device or interface inlet 3 from the TCD 1 which is to be replaced or augmented, and is connected to a replacement input plug, portconnect ion device or interface inlet 17 of a type compatible with the input socket, port input device or interface receptacle 5 of the user's installed IS 7.

In the preferred embodiment of the present invention, both the VRP and the DSP are integral subsystems of a solidstate VLSI Application Specific Integrated Circuit (ASIC) 19.

In one presently preferred embodiment, the TCD 1 relays its command signals to the plug 3 by digital signalling means 21 which may consist of metallic conductors; alternatively, the means 21 may consist of sound waves, or any selected type of electromagnetic waves, such as radio waves, microwaves, infra-red rays, visible light rays, or ultraviolet rays.

More detailed specifications depend upon the category of application intended. In general the presently-disclosed input device is to replace or augment an installed input device with none or more physical-state monitored components, and includes one or more sound sensors and analyzers.

The present input device is similar to many modern input devices in that it is effectively a (mini) information system in itself. Therefore standard solid-state ASIC technology is sufficient.

The sound signal detected is classified so that the input device responds with either physical stimulation or sound stimulation accompanied by electronic transduction thereof.

A Voice Recognition Processor of standard type is employed; for example, the Philips company's D6106 VLSI chip performs voice control processing functions, using speaker dependent, isolated word speech recognition technology and is available for below $15.00 when procured in quantity; it can handle a preselected vocabulary of 20 to 30 words. Newer versions are claimed to be speaker independent.A competing circuit, the RSC-164 of Sensory Circuit Inc. of San Jose, California, USA, also can handle 20-30 words but is quoted for only $3.75 each in 'small volumes.' Another alternative is the HM2007 single-chip CMOS VLSI voice-recognition device available from Maryvale Engineering Company, Phoenix, Arizona, USA; this chip can recognize up to 40 words whose spoken length does not exceed 0.9 seconds each, or up to 20 words when spoken lengths of up to 1.9 seconds each are allowed; this chip is available in a 48-pin plastic DIP package, requires a single standard 5V power supply, idles with a 6mA operating current and draws a peak current of 15mA, has a response time of less than 300 ms, and can survive ambient temperatures of up to 70 degrees Centigrade; the present price is $13.00 per chip in lots of 4 or more.

The additionally required Digital Signal Processor which receives information from the VRP and outputs digital signals compatible with the requirements of the installed target IS^an elementary logic circuit which is breadboarded of standard electronic gates, and in serial production can be also fabricated by means of solid-state VLSI technology of the type widely available for Application Specific Integrated Circuits (ASICs) from sources too numerous to mention.

When procured in quantity, the manufacturers will be readily induced to combine the VRP and the DSP into a single ASIC. Furthermore the required microphone and input interface devices are also available as off-the-shelf components.

PRESENTLY PREFERRED EXEMPLARY EMBODIMENTS Two specific embodiments of the invention will now be described by way of examples.

Example 1. The addition of a voice-controlled joystick for interacting with video games adds a completely new dimension (literally) to the man-machine interface.

A joystick is a common information system input device often used with games. Signals to the information system are typically determined by the state of a movable stick or pad and the (depression) state of buttons. This invention supplements a joystick with a hardware device sensitive to audio waves like a microphone(s). Additionally any hardware or software capable of distinguishing zero or more audio signals (including unknown signals) is used so that the joystick responds by modifying its internal state (detectable by the installed information system) in response to both physical or non-physical stimuli.

By having voice control in the joystick, users can add verbal commands to all their games and applications which use the input device. Typical semantics given to joystick movements and button presses on a video-game joypad are: "fire", "jump", "shield", "bombs", "up", "down", "d@@k", "forward", & "turn" ! With the augmented device not only does the joystick remain fully functional, but it also responds to verbal commands.

In fast moving games, this gives the player extra control: one hand on the stick, fingers on the major button(s), plus independent and completely natural control of other features via voice command.

In a more relaxed adventure game, one sits back and controls most of the action with spoken more pedestrian commands: "forward", "stop", "take", "up", "strike." The microphone(s) may be located as is convenient, for example in the joypad, in a headset, or placed elsewhere.

Example 2. A voice controlled (computer) mouse allows for mouse operations, which usually require physical interaction with the mouse, to be carried out "handsfree". A mouse is technically known as a "pointing device" and usually has a number of buttons also. When augmented by the method and principles disclosed herein, a voice- controlled mouse generates its pointing and button signals if physically manipulated or if instructed via voice command.

The foregoing detailed description, and the accompanying drawings relate to two presently preferred illustrative embodiments of the invention. However, various changes may be made without departing from the spirit and the scope of the invention. Thus, by way of example and not of limitation, the presently preferred input plugs 3 and 17 may be replaced by any kind of input port connection device or input interface.

Similarly the presently preferred input sockets 5 may be any kind of input port device or other input interface receptacle.

Furthermore, it is possible to use analog circuits instead of digital circuits in the voice-recognitionprocessor. In addition, the parts need not have the precise configuration described hereinabove, but may have alternative arrangements. Further, instead of the encasing and connecting structural parts being made of metal and wood, they may in many cases be formed of plastics and/or composite materials.

Accordingly, it is to be understood that the detailed description and the accompanying drawings as set forth hereinabove are not intended to limit the breadth of the present invention, which should be inferred only from the following claims and their appropriately construed legal equivalents, rather than from the examples given.

PARTS LIST tactile control device (TCD) 1 . . . . . . . . . . . - 5 input plug, port-connection device or interface inlet 3 . . . -5- input socket, port input device or interface receptacle 5 . . . -5- Information System (IS) 7 . . . . . . . . . . . . . . - 6 microphone 10 . . . . . . . . . . . . . . . . . . - 6 voice recognition processor (VRP) 12 . . . . . . . . - 6 digital signal processor (DSP) 14 . . . . . . . . . . - 6 optional alternative input socket, port input device or interface receptacle 16 . . . . . . . . . . . . - 6 replacement input plug, port-connection device or interface inlet 17 . . . . . . . . . . . . . . . - 6 solid-state VLSI Application Specific Integrated Circuit (ASIC) 19 . . . . . . . . . . . . . . . . . . . . . . . . . . - 6 digital signalling means 21 . . . . . . . . . . . . - 6

Claims

CLAIMS What is claimed is:

1. In the field of external input control systems for installed information systems connected to a socket compatible with the corresponding input plug relaying control signals from a tactile control device, a plug-compatible self-contained sound-controlled replacement control input system comprising:: a microphone, connected to a voice-recognition-processor, connected to a digital signal processor which provides at least some identical digital signal commands previously obtainable from said tactile control device in response to continuous-wave sounds provided to said microphone by the user of said information system, said digital commands being relayed to a replacement plug compatible with said input socket of said information system, whereby said user may control said information system by means of sounds instead of the tactile commands originally installed, said tactile control device comprising a joystick, said voice recognition processor comprising an application specific integrated circuit (ASIC) of the VLSI category using trainable, speaker dependent, isolated word speech-recognition technology, said sounds comprising spoken verbal commands in a selected human language, said voice-recognition-processor comprising a subsystem of said digital signal processor (DSP), and said relaying of said DSP signals to said input plug of said information system being accomplished by means of infrared signals, wherein the claimed use of inexpensive standard technology components and subsystems in the claimed combination will enable the economical serial manufacture of said entire replacement system.

2. In the field of external input control systems for installed information systems connected to a socket compatible with the corresponding input plug relaying control signals from a tactile control device, a plug-compatible self-contained sound-controlled replacement control input system comprising: a microphone, connected to a voice-recognition-processor, connected to a digital signal processor which provides at least some identical digital commands previously obtainable from said tactile control device in response to sounds provided to said microphone by the user of said information system, said digital commands being relayed to a replacement plug compatible with said input socket of said information system, whereby said user may control said information system by means of sounds instead of the tactile commands originally installed.

3. The control input device of claim 2, wherein said device includes an augmentation socket compatible with said tactile control device, whereby both sound and tactile input commands may be employed alternatively at will.

4. The control input device of claim 2, wherein said replacement plug is compatible with an input device port or interface of said information system which is selected from the class consisting of joysticks, mice, and keyboards.

5. The control input device of claim 2, wherein said relayed commands are not relayed by tangible physical connections, such as metallic conductors, but are relayed by energy-wave signals selected from the class consisting of sound waves, radio waves, microwaves, infrared-red rays, visible light rays, and ultra-violet-rays.

6. The control input device of claim 2, wherein said tactile control device comprises a mechanical signaling device selected from the class consisting of joysticks, sticks, rods, levers, wheels, buttons keys, and switches.

7. The control input device of claim 2, wherein said tactile control device comprises a keyboard type of array selected from the class consisting of arrayed keys, balls, switches and buttons.

8. The control input device of claim 2, wherein said tactile control device comprises a pointing device selected from the class consisting of mice, balls, wheels, lightsensors, and buttons.

9. The control input device of claim 2, wherein said sounds comprise oral commands from said user.

10. The control input device of claim 9, wherein said oral commands comprise spoken words in a selected human language.

11. The control input device of claim 10, wherein said spoken words are adapted to recognition by said voice recognition processor, said voice recognition processor being adapted to isolated word recognition.

12. The control input device of 1, wherein said voice recognition processor is selected from the class consisting of speaker-dependent processors and speaker-independent processors, the former requiring preliminary training by prospective users but the latter being operable without said preliminary training.

13. In the field of external input control systems for installed information systems connected to a socket compatible with the corresponding input plug relaying control signals from a tactile control device, the method of providing a plug-compatible self-contained sound-controlled replacement control input system comprising the steps of:: selecting a microphone, and selecting a voice-recognition-processor, and selecting a digital signal processor capable of providing at least some identical digital commands previously obtainable from said tactile control device in response to sounds provided to said microphone by the user of said information system, selecting a replacement plug compatible with said input socket of said information system, connecting said microphone to said voice-recognitionprocessor, connecting said voice-recognition-processor to said digital signal processor, and relaying said digital command signals from said digital signal processor to said replacement plug, whereby said user may control said information system by means of sounds instead of the tactile commands originally installed.

14. The control input method of 3, comprising the additional step of selecting an augmentation socket compatible with said tactile control device, and connecting said augmentation socket to said digital signal processor, whereby both sound and tactile input commands may be employed alternatively at will.

15. The control input method of 3, comprising the additional step of selecting said replacement plug to be compatible with an input device port or interface of said information system which is selected from the class consisting of joysticks, mice, and keyboards.

16. The control input method of 3, comprising the additional step of choosing to relay said digital commands not by any tangible physical connections, such as metallic conductors, but by means of energy-wave signals selected from the class consisting of sound waves, radio waves, microwaves, infrared-red rays, visible light rays, and ultra-violet-rays.

17. The control input method of 3, comprising the additional step of selecting said tactile control device to comprise a mechanical signaling device selected from the class consisting of joysticks, sticks, rods, levers, wheels, buttons keys, and switches.

18. The control input method of 3, comprising the additional step of selecting said tactile control device to comprise a keyboard type of array selected from the class consisting of arrayed keys, balls, switches and buttons.

19. The control input method of 3, comprising the additional step of selecting said tactile control device to comprise a pointing device selected from the class consisting of mice, balls, wheels, light-sensors, and buttons.

20. The control input method of 3, comprising the additional step of choosing said sounds to comprise oral commands from said user.

21. The control input method of claim 20, comprising the additional step of choosing said oral commands to comprise spoken words in a selected human language.

22. The control input method of claim 21, comprising the additional steps of: choosing said spoken words to be adapted to recognition by said voice recognition processor, and adapting said voice-recognition-processor to isolated word recognition.

23. The control input method of claim 22, comprising the additional step of choosing said voice-recognition- processor from the class consisting of speaker-dependent processors and speaker-independent processors, the former requiring preliminary training by prospective users but the latter being operable without said preliminary training.