JP2873268B2 - A portable computer supported by the user without using hands and its operation method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates generally to computers, and more particularly to a portable computer with a hand-held, head-supported eyepiece display and voice recognition capabilities.

[0002]

2. Description of the Related Art Today, many printed publications, especially technical manuals, are known as electronic technical manuals (ETM: electr).
Sonic technical manual and interactive electronic technical manual (IETM: interact)
eve electronictechnical m
anual). Such ETMs and IETMs are essentially electronic databases and are typically housed in conventional calculators with a keyboard for user input and a normal size monitor for information display. Operators may use the ETM and IET for a variety of applications, including troubleshooting and repair / replacement of the system, subsystem, or parts thereof.
A calculator can be used to access the data stored in M and display the data.

[0003]

SUMMARY OF THE INVENTION ETM and IETM
Is particularly useful in the service and repair industry, where technicians often need detailed information from technical manuals to repair and service malfunctioning devices. For example, ETM and IETM
Is useful in automotive repair centers, where service personnel need to access information in the automotive technical manual to service malfunctioning vehicles. In addition, ETMs and IETMs are also useful in military service centers, where military technicians are required to service and repair malfunctioning weapon systems.
Often, access to information in military technical manuals is required. Because printed publications are often bulky, it is more efficient to access ETM and IETM information than printed publications in such situations.

As described above, conventionally, ETM and IE
The TM is stored in and accessed from a conventional computer equipped with a keyboard for operator input and a full size video monitor for displaying data. This type of computer is often installed in a repair shop near the device being repaired, and maintenance personnel must
Move back and forth between the calculator and the device under repair to retrieve the data needed to repair the device under repair. This movement between the computer and the device under repair means that a significant amount of time and effort is wasted retrieving data from the ETM and IETM. Therefore, ETM and IETM can be performed using a conventional computer.
Since it is not efficient to transmit the information in the data as data to the operator, such a computer is used for ETM and IET.
It is not an efficient device for storing M.

[0005]

SUMMARY OF THE INVENTION The present invention is a portable computer der independent compact supported more complete <br/> all users to retrieve and display information in a hands
What the user as carry without hands, have a single housing with capable belt or preparative <br/> only hand stepped Ri strap removal Ha <br/> Ujingu user This single
Housing has storage means, processor means, and
Built-in Dio transducer and converter means
It has a size that can be worn around the waist of the user. This
Built-in storage means in a single housing
Housed in the housing to store the force information
With electrical technical manual and several
Pre-programmed vocabulary mode consisting of words and phrases
And a processor means within the housing.
Mounted to receive information and user commands in accordance with a program stored, searched, it is for processing. Also, this audio transducer
And converter means receives the audio commands from the user, converts the received audio commands into electrical signals and communicates with the processor means for sending the converted electrical signals to the flops Rose'<br/> support means Also to do
So users are supported without hands. The professional
The sensor means is an electronic technical manual recorded in the storage means.
Search and output the corresponding information from
Recognize the command in the converted electrical signal and recognize the recognized
Includes means for responding to commands. Authorize this command
The means to know is to correspond to the context of the stored program
Multiple words and words in a pre-programmed vocabulary model
And a subset of phrases and recognized
To adapt the converted electrical signal to the command
Means. In addition, this portable calculator is
Can communicate with the
Receives the information that has been input and sends the received information for the user
Computer display means for displaying, and the computer
Move the display means within the user's field of view without using hands.
Movable means. So only voice commands
The information received by the computer in hands-free
Can be operated to spray.

[0006]

BRIEF DESCRIPTION OF THE DRAWINGS To illustrate the invention, a presently preferred embodiment is shown in the drawings. It should be understood, however, that the intention is not to limit the invention to only the particular means and methods disclosed herein.

In the drawings, in which the same reference numerals are used for the same parts throughout, FIG. 1 is a schematic front view of an operator (also called a user) wearing a compact portable computer 102 according to the present invention, and FIG. Is Calculator 1
It is a side view of the operator who mounted 02. The mounting locations of the components of the computer 102 to be mounted by the operator shown in FIGS. 1 and 2 merely indicate general locations, and may be changed to be convenient and comfortable for the operator. Calculator 102 has a housing, such as system unit 106, with mounting means in this embodiment corresponding to a strap or belt 104, such that the mounting means allows a user to support the housing or system unit. It is designed to be worn around the waist of the operator for the purpose of attaching to the user.

[0008] Further, the computer 102 has display means for receiving information from the system unit 106 and displaying the received information to a user or an operator. The display means in this embodiment has a headband 108, a display screen 110, and an adjustable arm 112 that couples the display screen 110 to the headband 108. As shown, the headband 108 is devised so that it can be worn by the user at any convenient location, preferably on the user's forehead. The position of the display screen 110 is adjustable by an adjustable arm 112 so that the information displayed on the display screen 110 can be comfortably viewed by an operator. In this embodiment, the display screen 110 is electrically connected to the system unit 106 via the cable 114. However, other connection means may be employed instead.

Further, the computer 102 receives an audio command from the user, converts the audio command of the receiver into an electric signal, recognizes the converted electric signal, and converts the recognized electric signal into the system unit 106. It has an audio transducer and converter means in communication with the system unit 106 for sending to the processor. In this embodiment, the audio transducer and converter means has a microphone 122 for receiving verbal commands from an operator. In this embodiment, the system unit 1 is connected via the cable 124.
Microphone 122 electrically connected to 06
It is preferably an earphone microphone. However, if you are familiar with ordinary technology in the technical field,
It is understood that any audio input or transducer device can be used and that the audio input or transducer can be supported by the user elsewhere, for example, near the user's mouth or throat. Should be done.

Further, the computer 102 in the present embodiment
Calculator 102 has measurement means in communication with system unit 106 to perform electrical measurements on the device being evaluated (including, but not limited to, testing, calibration, and troubleshooting). , Diagnostics, and services). The measuring means in this embodiment can be attached to the belt 104,
It has an equipment pack 116 that is electrically connectable via a cable 118 to a device 120 to be tested, analyzed, repaired, or the like. The device pack 116 is also electrically connected to the system unit 106 via a cable 126 in this embodiment.

From the foregoing description and FIGS. 1 and 2, it can be seen that the computer system 102 has been devised to be completely supported by a user or operator. The display screen 110 is arranged so that the user can occasionally look at the screen 110 for information about the task being performed, while accomplishing another task, namely the service of the device. The user can use the microphone 1
22 allows the computer system 102 to be verbally controlled and display required information while maintaining the user in a hand-free mode (hands-free mode) so as not to hinder the performance of the task. Finally, Equipment Pack 1
16 allows the computer 102 to obtain information from a device, such as a serving device, while keeping the user in the hands-free mode with respect to the computer system 102 Note that in-service devices, test equipment, or other equipment can be handled while in use). The user can access data from the computer system 102 and input data to the computer system 102 in the hand-free mode in which the degree of departure from the task being performed is minimized. By doing so, tasks can be performed in a more efficient manner.

FIG. 3 is an external perspective view of the system unit 106. Since the system unit 106 is intended to be supported by an operator, the system unit 106 is lightweight and small in size, and in this embodiment, is about 5 inches (12.7 cm) x 6 inches (1 inch).
5.2 cm) and weighs about 3 pounds (1.36 k
g) is preferred. System unit 106
Has a top panel 302, a bottom panel 310, a front panel 312, a back panel 308, a first side 304, and a second side panel 306. On the back panel 308,
A clip 328 is connected to attach the system unit 106 to the belt 104. Upper panel 3
02 includes a microphone jack 314 that is well known in the art. The cable 124 connected to the microphone 122 is detachably connected to the system unit 106 via the microphone jack 314 using a suitable connector (not shown). Further, the upper panel 302 is provided with a voice input indicator 318, preferably a light emitting diode (LED), for visually confirming that the ear microphone 122 is receiving verbal input from an operator. Lights up.

Further, the upper panel 302 includes an audio output indicator 316 and a volume controller 320. In some embodiments, the upper panel 302 may include a speaker 332.

The audio output indicator 316, which is preferably a single light emitting diode, is used by the computer 102 to output synthesized or digitized audio for the purpose of providing information, requests, instructions, messages, or other feedback to the user. Lights up to visually confirm that the signal is being output via the speaker 332. A volume control 320, preferably a rotatable knob or a depressible button, controls the volume level of the audio output of speaker 332. Further, the upper panel 302
Is provided with a reset system button 322, a power on / off button 324, and a power on indicator 326. The power on indicator 326, which is preferably a single light emitting diode, includes an on / off button 324.
Lights to visually confirm that the power is connected to the system unit 106 via the. When the reset system button 322 is pressed, the system unit 106
Is initialized. Further, the upper panel 302 is provided with input means in the form of a pointing device 330 such as, for example, a sensitive touchpad, joystick, rollerball, or gyroscope mouse. As shown in FIG. 3, the location of the elements on the upper panel 302 is only a general case, and may vary from ergonomics or other aspects in each case. What is actually used as this type of element (i.e. the light emitting diode for the indicator) can likewise vary from case to case.

In an alternative embodiment of the present invention, microphone 122 (shown in FIG. 1) includes a first transducer for receiving an audio signal and a second transducer for outputting the audio signal as a substantial audio speaker. The microphone / speaker assembly provided. Microphone / speaker assembly 122
May be, for example, a well-known bone conduction device. According to an alternative embodiment, the speaker 33 shown in FIG.
2 is unnecessary, and therefore is not installed on the front panel 332 and is not actually used as a part of the computer system 102.

FIG. 4 is an external plan view of the bottom panel 310 of the system unit 106. The bottom panel 310
One monitor or display port 402, two serial ports 404a and 404b, one parallel port 40
6, one keyboard port 410, mouse port 41
2 and an external power supply port 408. According to a preferred embodiment, the serial ports 404a and 404b
-232 compatible and the parallel port 406 compatible with Centronics. System unit 106 can be modified to include additional and / or additional ports and connectors without departing from the spirit and intent of the present invention.

FIG. 5 is a schematic configuration diagram of main functions in the configuration of the computer 102 according to the present embodiment. Computer 102 includes a bus 502, which preferably has a data width of at least 16 bits. According to the present embodiment,
Bus 502 is included in system unit 106. Further, the computer 102 is, for example, a central processing unit (CPU) 5
And a processor means, such as processor means 04, preferably connected to bus 502 and also included in system unit 106. CPU 504
Are 80286 or 803 available from Intel
Preferably, it is an 865X microprocessor. 8
A 0286 or 803865X microprocessor is preferred, but any other central processing unit or microprocessor available, either now or in the future, is available to those skilled in the art. You should understand that.

Further, the computer 102 includes a memory 506 having a random access memory (RAM) of, for example, 1 megabyte to 20 megabytes. Similarly connected to bus 502 and to system unit 106
The memory 506 preferably included in the
When 02 is functioning, the application program 508 is stored. Application program 5
08 may have been loaded into memory 506 from magnetic storage device 519 (described below) according to operator instructions.

In addition, the computer 102 includes an input / output interface 5 for controlling all data transfers between the CPU 504 and certain other components (herein referred to as peripheral devices).
With 10. The peripheral device communicates with the CPU 504 but is not directly connected to the bus 502. The input / output interface 510 is a video interface, RS
Preferably, it has a controller for at least two serial ports compatible with H.-232, a controller for parallel ports compatible with Centronics, a keyboard and mouse controller, a floppy disk controller, and a hard drive interface. However, those who are familiar with ordinary techniques in the technical field, for example, Ethernet (registered trademark), Arcne
t (registered trademark), for use with other types of peripheral devices, such as a token ring interface.
It should be understood that the output interface 510 can include additional and / or additional interfaces and controllers. Input / output interface 510 is connected to bus 502 and is preferably located within system unit 106.

Further, the computer 102 has input / output connectors 518 collectively representing the aforementioned physical peripheral ports and attached electrical circuits. Input / output connector 518
4, preferably includes a monitor port 402, serial ports 404a and 404b, a parallel port 406, a keyboard port 410, and a mouse port 412, as shown in FIG. However, those skilled in the art will be familiar with the input / output connector 518.
It should be understood that additional and / or other types of physical ports can be provided.

The computer 102 further includes an internal battery 53
9, having an external battery 540 and / or a power converter 536 connected to an AC power source such as, for example, a conventional electrical outlet (not shown in FIG. 5). The external battery 540 is located outside the system unit 106, preferably on the belt 104, while the power converter 536 and the internal battery 539 are
6 are preferably arranged. (External battery 54
0 is not shown in FIGS. 1 and 2). External battery 540 is connected to power converter 536 via external power port 408, as shown in FIG. Computer 10
2 is used in a “desktop” mode (eg, non-portable mode), power supply converter 536 may be connected to an AC power supply to supply stabilized DC power to computer 102. When using the computer 102 in the portable mode, the stabilized DC power is supplied to the computer 102.
Power supply converter 536 generally provides
Internal battery 539 and / or external battery 54
Connected to 0. Only when the power converter 536 is not connected to either the external battery 540 or the AC power source, it is preferable that the internal battery 539 supplies power to the power converter 536 (finally, the computer 102). Furthermore, when the battery is not in use, the internal battery 5
In order to charge the battery 39 and the external battery 540 regularly,
Calculator 102 has a separate battery charger 534. The computer 102 may include a battery-powered indicator mounted on the front panel 302 of the system unit 106 to indicate that the power level of the external battery 540 and / or the internal battery 539 is low.

The bus 502, the CPU 504, the memory 506, the input / output interface 510, the input / output connector 518, and the power converter 536 are formed by a back plate according to a method well known to those skilled in the art. Circuit card, processor circuit card, memory circuit card, input / output circuit card,
Preferably, an input / output connection circuit card is used. The processor circuit card, memory circuit card, input / output circuit card, and input / output connection circuit card are plugged into the backplane circuit card. Dv
er Electronics Manufactur
ing (Longmont, CO) and Ampro
Preferably, a circuit card compatible with the IBM PC / AT available from Computers (Sunnyvale, CA) and / or compatible with 80386 is used. Dover Electronic
The three-dimensional dimensions of sManufacturing circuit cards are about 2 inches (5.08 cm) x about 5 inches (12.
7 cm) x 2 inches (5.08 cm) but Amp
The size of each circuit card manufactured by Ro is about 3.8 inches (9.6 inches).
5 cm) x 3.6 inches (9.14 cm). However, those skilled in the ordinary art in the technical field may use Dove if the circuit card is compatible with a function that fits the relatively small dimensions of the system unit 106.
r Electronics Manufacturi
It should be understood that circuit cards available from ng can be used instead.

Further, in this embodiment, the computer 102 includes a headband 108, a display screen 110, and a headband 10 as shown in FIGS.
8 has a display means with an adjustable arm 112 that couples a display screen 110 to it. As shown in FIG. 5, the display means further comprises a display screen driver module 514, which is preferably located in the system unit 106, but instead has the system close to the display screen 110. It may be arranged outside the unit 106. The display screen driver module 514 transfers display information (ie, information to be displayed to an operator) received from the CPU 504 (via the input / output interface 510, the bus 502, and the input / output connector 518) to the display screen 110. And convert it to a compatible video signal. Display screen driver module 514 is a standard design well known to those skilled in the art.

The display screen 110 is a conventional 12 inch monitor (ie, 80 characters per line x about 25 characters).
It provides a display equivalent to a row, but is preferably a small monitor called an "eyepiece monitor" in which the diagonal length of the display screen is about 1 inch. Because the display screen 110 is positioned in close proximity to the operator's eyes and moves following the movement of the operator's head because it is supported by the operator's head, the operator can view his or her own (eg, during device repair). The display screen 11 can be removed from the device under repair without moving away from the platform.
Just move your gaze to 0 and display screen 110
It is possible to see the information above. Thus, the operator can view the information contained in the electronic database without much distraction from his work,
As described above, the use of the display screen 110 facilitates searching for information contained in such electronic databases.

For those skilled in the art, for example, color graphics adapters (CGA) and enhanced graphics adapters (EGA), video graphics arrays (VGA),
It should be understood that the display screen 110 and the display screen driver module 514 can be implemented using any video technology available now or in the future, such as Super VGA. However, according to the present embodiment, the display screen 110 and the display screen driver module 514 are realized using a known color graphic adapter (CGA) technology. The CGA eyepiece monitor is a reflection technology that manufactures and sells "Private Eye (R)" monitors.
It is available from a number of vendors, including the company org. (Waltham, MA). Alternatively, display screen 110 and display screen driver module 514 are implemented using well-known (monochrome or color) video graphics adapter (VGA) technology. A VGA eyepiece monitor that operates according to the well-known color shutter wheel technology is Tektron.
ix (Beaverton, Oregon)
It is currently available from sources such as lor® Shuttles. Alternatively, the display means may be a flat panel display screen mounted on the system unit 106.

FIG. 11 is a functional block diagram of a conventional display screen 110 connected to a conventional display screen driver module 514, both of which operate according to the color shutter wheel technology. The display screen 110 is a monochrome cathode ray tube (CR)
T) 1106 and a filter 1108 with a color polarizer 1110 for polarizing the light from the CRT 1106 and separating it into cyan (ie, blue and green) and red components.
Is provided. Further, the filter 1108 includes the color polarizer 1
To rotate the polarized light from 110 by zero or 90 degrees, it has a pi-cell 1112, which is preferably a relatively fast liquid crystal switch. In addition, the filter 1108 effectively separates the blue component from green to polarize the light from the pi-cell 1112 and separate it into yellow (ie, red and green) and blue.
Has a color polarizer 1114. Further, the filter 11
08 has a second pi-cell 1116 to rotate the polarized light from the color polarizer 1114 by zero or 90 degrees.

The display screen driver module 514 has a video interface 1102 that receives signals from the bus 502 that represent data to be displayed on the display screen 110 and that generally contains video and color information. Convert to The video signal is supplied to the shutter controller 110
4, the controller causes the CRT 1106 to display an image according to the image information,
The filter 1108 is controlled according to the color information so as to convert the image displayed by T1106 into a color image.

The shutter controller 1104 has a
By selecting an appropriate combination of the states of the cells 1112 and 1116, the filter 1108 causes a red, green, or blue color image to be transmitted. For example, when transmitting green, the shutter controller 1104 may control the pi-cells 1112 and 1116 so that the blue and green components from the first color polarizer 1110 pass through the unaffected first pi-cell 1112. Set both to rotate by zero degrees. The vertically oriented yellow color polarizer 1114 then absorbs the blue component and leaves only the green component. (Because light transmitted through the filter 1108 is necessarily vertically polarized, , Note only the vertical component).

To transmit red, the shutter controller 1104 sets the first pi-cell 1112 to rotate by 90 degrees and the second pie-cell 1116 to rotate by zero degrees. I do. With this arrangement, the red component is placed in a vertical position such that the red component passes through the unaffected yellow polarizer 1114. For transmitting blue, the shutter controller 1104 sets both pi-cells 1112 and 1116 to rotate by 90 degrees, thereby passing through a horizontally oriented blue color polarizer 1110. Then, the blue component initially polarized vertically is rotated. For more information on color shutter wheel technology, see Thomas J. et al., Which is hereby incorporated by reference in its entirety. Have
n "Reinventing the Color Wheel" (Informati)
on Display, Vol. 7, No. 1,199
January, January, pages 11-15).

Referring again to FIG. 5, the computer 102
May be, for example, an internal pointing device 230, a storage means such as a magnetic storage device 519, a measurement means such as an equipment pack 116, the microphone 12
2, and various peripherals such as voice recognition module 522, all of which are connected via input / output connector 518 to system unit 106 (and, in particular,
It is connected to an input / output interface 510) that controls data traffic between the peripheral device and the CPU 504. The internal pointing device 230 is a well-known pointing device such as a mouse, a responsive touchpad, or a gyroscope mouse, and is connected to the upper panel 302 of the system unit 106 (FIG. 3).
(See microphone 122 and voice recognition module 5) as described below.
Under the circumstances where interaction is not desired or possible (via 22), it refers to an alternative means for the operator to interact with the computer 102 (ie, to provide commands and data to the CPU 504). For example, in a work environment where the background noise is too excessive, even for an external hearing protected task, the operator cannot interact via voice. In addition, the present invention allows the use of other non-audio input devices, such as, for example, bar code readers, touch memory readers, and proximity scanners, which allow the operator to communicate with the computer 102. Can be used when the dialogue by the user is not desired or cannot be performed.

Further, the computer 102 includes a packet switching component 542 and an antenna 544, which in this embodiment are preferably included in the system unit 106, and the computer 102 is, for example, a telephone. Or it allows information to be sent and received to a remote location via well-known telecommunication means such as a satellite. Packet switching component 542 and antenna 54
4 is particularly useful for updating a database 520 stored on a magnetic storage device 519 (shown below) in real time with information received from a remote computer or other data source. The computer 102 is, for example, a global positioning system (GlobalPosition).
It is also possible to include a global positioning system component (not shown in FIG. 5) for receiving and processing positioning information (via antenna 544) from a navigation system, such as a navigation system.

The magnetic storage device 519 preferably included in the system unit 106 is a static read / write memory with a relatively large storage capacity, such as a removable or non-removable hard disk drive. In embodiments where the storage device 519 is removable, the system unit 106 includes an external slot for allowing a removable storage disk to be inserted and removed by an operator. The optional storage device 519 may be a read-only memory such as a CD-ROM. Magnetic storage device 519
Preferably has between 80 megabytes and 1 gigabyte of memory. Magnetic storage devices suitable for use as storage device 519 and having a size compatible with the size of system unit 106 include, for example, Integra
l, Connor, Seagate, and Sygue
It is manufactured and sold by many manufacturers such as St. As shown in FIG. 5, the magnetic storage device 519
Stores a database 520 (which may be ETM or IETM), which is connected to the computer 102 via a port of the input / output connector 518.
From a floppy drive (not shown in FIG. 5) or from a remote computer via a packet switching component 542 and an antenna 544 or via a telecommunication link connected to the computer by direct wiring. It may be loaded in the device 519 in advance.

[0033] The equipment pack 116 is used to connect the electrical measurement device to a device to be evaluated or serviced, such as an IEEE-48, for example, a multimeter 524 and a counter / timer 526.
8 connector 528, IEEE-1553 connector 53
0 and a port such as an IEEE-1708 connector 532. It should be understood by one of ordinary skill in the art that the equipment pack 116 can include other types of electrical measurement devices and ports. Referring again to FIG.
The active electrical measurement device included in 16 includes a connector 52
8, 530, and 532, via a cable 118 connected to one of the devices under test (DUs).
T: Device under test (T) 120 is connected to a device to be evaluated or served. This connection is made according to the type of interface specific to the DUT 120. The data from the DUT 120 is stored in the multimeter 524, the counter / timer 52.
6, and / or by any other measurement device included in the equipment pack 116 (suitable for the test in progress). The result of this type of test is sent from the equipment pack 116 to the CPU via the input / output connector 518 and the bus 502.
504. Alternatively, these results can be stored on a battery-backed memory chip.

Referring again to FIG. 5, the computer 102 may further include an external monitor 516, which is not supported by the operator (eg, is located on a desk) and which has a monitor port 402 (see FIG. 5). 4)
Is connected to the system unit 106 via the. External monitor 516 receives the same display information from CPU 504 (via display screen driver module 514) as for display screen 110. In addition, the computer 102 can include an external keyboard and mouse (not shown), which can be connected to the system unit 106 via a keyboard port 410 and a mouse port 412, respectively. An external keyboard and mouse represent conventional means for an operator to interact with the calculator 106. When the calculator 102 is operating in the non-portable mode (eg, as a desktop calculator), an external monitor 516, an external keyboard, and an external mouse are preferably connected to the system unit 106.

The voice recognition module 522 is preferably included in the system unit 106 and is connected to the microphone 122 (preferably an ear microphone located outside the system unit 106). Instead, the voice recognition module 522 may be arranged outside the system unit 106, for example, may be combined with the microphone 122 as one unit. Alternatively, the A / D converter components of the speech recognition module 522 may be located outside the system unit 102, but the remaining components of the speech recognition module 522 are located inside the system unit 102 and the external analog The digital converter preferably communicates with the system unit 102 via a serial communication stream. Microphone 122
Receives audio input (also called verbal utterance) from an operator, converts the audio input to an electrical signal, and digitizes the electrical signal. The speech recognition module 522 recognizes verbal utterances (in the form of digitized electrical signals) and
Recognize spoken utterances for processing according to C.80
Transfer to PU504. Thus, the electrical signal resulting from the operator typing on a conventional keyboard,
Just as a conventional keyboard driver would interpret as characters and words, the speech recognition module 522 was digitized due to the operator speaking near or into the microphone 122. Interpret (recognize) electric signals as characters and words. Thus, as in the case of conventional input devices such as keyboards and pointing devices, the speech recognition module 522 combined with the microphone 122 allows the operator to
02 provides a means for interacting with and controlling its operation.

The speech recognition module 522 operates in accordance with known dependent speech recognition algorithms and is preferably implemented as hardware of a type well known in the art. According to a preferred embodiment, the voice recognition module 522 includes a voice connection.
(Irving, CA). However, those skilled in the art will appreciate that any dependent speech recognition circuit card of a size compatible with the size of the system unit 106 can be used. .

Instead, the speech recognition module 522
Operates in accordance with known stand-alone speech recognition algorithms, which means that the stand-alone speech recognition algorithm is an improvement over the dependent speech recognition algorithm. Specifically, the stand-alone speech recognition module is capable of recognizing the voices of multiple speakers, and includes a "good listener", a learning function that modifies a trained vocabulary model in real time. . On the other hand, the dependent speech recognition module can recognize only the speech of one speaker.

Further, the independent speech recognition module can be integrated into an application program. For example, an application program may interact with a stand-alone speech recognition module to cause a spoken utterance to be recognized by the stand-alone speech recognition module for a subset of the globally trained vocabulary model. For example, the vocabulary subset may include words corresponding to menu selections in the current context of the application program. On the other hand, the dependent speech recognition module cannot be integrated into the application program. Thus, dependent speech recognition modules are generally less reliable than stand-alone speech recognition modules, because they usually attempt to identify verbal utterances from the entire vocabulary.
Systems and methods for speech recognition, particularly stand-alone speech recognition, are described in U.S. Patent Nos. 5,025,471, 4,969,193, and 4,672,667. Is incorporated by reference in its entirety.

FIG. 6 is a partial configuration diagram of the computer 102. In this case, as shown in FIG. 5, the voice recognition module 522 is executed not by hardware but by software. More specifically, FIG. 6 is a partial diagram illustrating the structural differences (compared to FIG. 5) in the computer 102 required to implement an alternative embodiment in which the speech recognition module 522 is implemented in software. FIG. As shown in FIG. 6, the software entity of the speech recognition module is shown as 522 ′ instead of 522 to emphasize its software nature, and is stored in the memory 506 during the operation of the computer 102. The speech recognition module 522 'preferably functions according to a stand-alone speech recognition algorithm,
Instruments (Denton, Texas)
Although embodied as stand-alone speech recognition software, the speech recognition module 522 'operates according to either a dependent speech recognition algorithm or a stand-alone speech recognition algorithm. Actually, the application program 508 and the speech recognition module 52
2 'may be linked to one single computer program loaded into the memory 506 from the magnetic storage means 519 according to the instructions of the operator.

According to an alternative embodiment in which the speech recognition module 522 'is embodied as software, the computer 102
Has an analog / digital converter 608 that is preferably included in the system unit 106 with a buffer 610. Analog / digital converter 608
Is connected to the microphone 122. When activated, microphone 122 converts the audio input spoken by the operator into an electrical signal. An analog / digital converter 608 digitizes the electrical signal, and
The digitized electrical signal is stored in buffer 610 for retrieval by PU 504.

The operation of the computer system 102 will be described with reference to FIGS. 7, 8, 9 and 10. 7 and 8 show the operation of the computer 102 when a dependent speech recognition module (embodied in either hardware or software) is used.
9 and 10 show the operation of the computer 102 when a stand-alone speech recognition module (embodied in either hardware or software) is used.
Shown in

First, an operation flowchart of the computer system 102 in the embodiment using the dependent speech recognition module is shown in FIG. In performing the process shown in FIG.
Computer system 102 continues to operate according to the programming contained in application program 508. In order to simplify the explanation, the computer 102 shown in FIG.
The flow chart of FIG. 7 for the structural embodiment of FIG. 7 is described below, but that the structural alternative embodiment of the calculator 102 shown in FIG. 6 operates in substantially the same manner with respect to the flow chart shown in FIG. I want to be understood.

In step 704, CPU 504 waits for user input from a keyboard buffer (not shown). In effect, the CPU 504 polls the keyboard buffer or, if the keyboard buffer is full, receives an interrupt to process 70.
You can also perform step 4. In either case, if the keyboard buffer is flushed by a keyboard driver or other system operating tool associated with the keyboard buffer, the CPU will fail.
504 receives user input from a keyboard buffer. Note that user input in the keyboard buffer may originate from a conventional input device, such as a keyboard or pointing device, or from the speech recognition module 522.

In step 706, CPU 504 processes the user input according to the programming contained in application program 508. For example, the user input may be a command from the user to search for specific data from the database 520 stored in the magnetic storage device 519. CPU 504
Accesses the database 520 and
20 to retrieve the required data and display the retrieved data for display to the user on display screen 110.
To process user commands.
More specifically, the CPU 504 transmits the retrieved data to the input / output interface 5 together with the request to display the data on the display screen 110.
Transfer to 10. The input / output interface 510
The retrieved data is converted into a general video signal generally suitable for a monitor display, and the general video signal is sent to a display screen driver module 514 via an input / output connector 518. The display screen driver module 514 includes:
The general video signal is converted into a video signal compatible with a particular display screen 110. Alternatively, the user input can be information provided by the user to the computer 102 (eg, for storage on the storage device 520).

At step 708, CPU 504 determines whether the user command has asserted an exit request. If the user command did not assert an exit request, CPU 504 loops back to step 704 to wait for further user input.

FIG. 8 shows an analog / digital converter 6.
08 (see FIG. 6) in combination with the speech recognition module 5
22 (see FIG. 5) or an operation flowchart of the speech recognition module 522 ′, wherein the speech recognition module 522 or 522 ′ operates according to a dependent speech recognition algorithm. Before the process in FIG. 8 is performed, the voice recognition module 522 or 522 ′
It should be noted that the speech recognition module 522 or 522 'is trained for a particular operator using well-known methods to create a vocabulary model that includes the words and phrases recognized. . Vocabulary models are well known and will not be described here, but for each word or phrase recognized by speech recognition module 522 or 522 ', a particular operator (for this operator, speech recognition module 522 or 522'). Note that the vocabulary model includes a finite number (eg, 5) of digitized waveforms corresponding to the various ways in which words are pronounced. A phrase composed of two words (for example, “Next Menu” or “End Pr”
FIG. 12 shows an example of such a waveform
Shown in In this case, the first word is time 4 and time 13
The second word is represented by the time 1
It is represented by the point between 6 and time 22. The word is
Time 0 and time 3, time 14 and time 15, and time 23
Are bounded by points between time and time 26, which are below the energy threshold determined for the particular operator. Similarly, the vocabulary model includes one or more operator-selected keystrokes associated with each word and phrase recognized by the speech recognition module 522 or 522 '. For example, the key strokes “Ctrl” and “x” are changed to “End program” by the application program 508.
am ”command, the command“ End ”
The phrase "Program" can be associated with the keystrokes "Ctrl", "x".

Next, FIG. 8 will be described.
For ease of explanation, FIG. 8 will be described with reference to the structural embodiment of the computer 102 shown in FIG. 5, but the alternative structural embodiment of the computer 102 shown in FIG. Operates in the same manner as in the flow chart of FIG.

Referring to FIG. 8, in step 806,
The voice recognition module 522 receives from the microphone 122 an electrical signal representing the verbal utterance spoken by the operator,
The received electric signal is digitized, and the digitized electric signal is sent to the voice recognition module 522.

In step 808, speech recognition module 522 locates points in the digitized electrical signal that are below an energy threshold (eg, shown in FIG. 12) for the particular operator.
Identify boundaries of words or phrases contained in the digitized electrical signal. In this case, the located points represent word boundaries. If the number of points located below the energy threshold separating the words in the digitized electrical signal is less than a predetermined number (set according to the specific operator's speech characteristics), the digitized electrical signal The signal is determined by the speech recognition module 522 to contain one phrase (ie, multiple words) rather than one single word. A point in the digitized electrical signal corresponding to a word or phrase means a digitized verbal utterance received from (ie, spoken by) the operator. For example, if FIG. 12 represents a digitized electric signal, and if the predetermined number is 5, the number of points located below the energy threshold separating two words is 4 (time 13 and time 15). The voice recognition module 522 determines that the digitized electrical signal includes a phrase having two words (step 808).
At). The points in the digitized electrical signal corresponding to one phrase composed of two words represent the waveform of the received digitized spoken utterance.

Steps 810, 812, 814, and 81
At 6, the speech recognition module 522 includes the digitized verbal utterances received for all digitized waveforms (corresponding to different states when a particular operator pronounces different words) included in the vocabulary model. By recognizing the waveform of the received digitized verbal utterance by matching the waveforms of. More specifically, in step 810, the speech recognition module 522 selects the next word from the vocabulary model for processing. The vocabulary model includes a finite number of digitized waveforms for selected words corresponding to various states in which a particular operator pronounces the selected words; and To include one or more keystrokes selected by the operator in connection with

In step 812, speech recognition module 522 performs a sequential comparison of the digitized verbal utterance waveform and the digitized waveform received for the selected word,
For the selected word, it is determined whether or not a match is found between the received digitized spoken utterance waveform and any of the digitized waveforms.
While the difference between a point in the received digitized verbal utterance waveform and a temporally corresponding point contained in one of the digitized waveforms is less than a limit predefined by the operator. The voice recognition module 522
It is determined that a match occurs between these two points. In this case, the limit predefined by the operator may be zero in some implementations.

At step 814, the speech recognition module 522 determines whether a match was found at step 812 and proceeds to step 816 if no match was found. In step 816, the speech recognition module 522 determines whether words to be processed are still left in the vocabulary module. In step 816, if there are words left to process,
The speech recognition module 522 flows back to step 810 to select the next word to process from the vocabulary model. If no words remain for processing, the speech recognition module 522 determines that the received digitized verbal utterance waveform is unrecognizable based on the current training stage of the vocabulary model, and the speech recognition module 5
Step 22 waits for further operator input, step 80.
Return to 6. Note that when operating according to the dependent speech recognition algorithm, the speech recognition module 522 does not interact with the operator to update the training of the vocabulary model for the purpose of recognizing the waveform of the received digitized spoken utterance.

At step 814, if the speech recognition module 522 determines that a match was found at step 812, the speech recognition module 522 proceeds to step 818.
Perform In step 818, the speech recognition module 522 may include the received digitized verbal utterance waveform in the vocabulary model and associated keystrokes with the selected word (matched with the received digitized verbal utterance waveform). Convert to At step 820, speech recognition module 522 stores the keystrokes in the keyboard buffer. As already mentioned, keystrokes in the keyboard buffer are processed by the CPU 504 when the keyboard buffer is flushed (see the text above describing step 704 in FIG. 7).

FIG. 9 is an operation flowchart relating to the computer system 102 according to the embodiment of the present invention which uses the stand-alone speech recognition module. In performing the process shown in FIG. 9, the computer system 102 operates according to the programming contained in the application program 508.

For ease of explanation, FIG. 9 will be described with reference to the structural embodiment of the computer 102 shown in FIG. 6, but the structural embodiment as an alternative to the computer 102 shown in FIG. It should be understood that it operates in substantially the same way as in the flow chart shown in FIG.

Before the process in FIG. 9 is performed, the voice recognition module 522 '
Note that 2 'is trained for multiple operators using well-known methods to create a vocabulary model containing the words and phrases that it recognizes.
The vocabulary model is well known and will not be described here, but for each word or phrase recognized by the speech recognition module 522 ', the vocabulary model is
Note that it includes one digitized waveform corresponding to the baseline pronunciation of the word or phrase. An example of this type of digitized waveform including a phrase composed of two words is shown in FIG. Similarly, the vocabulary model includes a string (each string having one or more characters) selected by the operator associated with each word or phrase recognized by the speech recognition module 522 '. For example, the string “<Ctrl> x” is changed by the application program 508 to “End pro
If it is recognized as a "gram" command, "En
The phrase "d Program" can be associated with the string "<Ctrl>x".

In addition, the vocabulary model includes an acceptable variance around each point in the digitized baseline waveform. The permissible variance in this case is the speech recognition module 5
22 'means a variety of different states in which words and phrases are pronounced by the operator being trained. For example, assume that the digitized waveform shown in FIG. 12 represents the digitized baseline waveform included in the vocabulary model, assume that the allowable variance for the point at time 10 is 2, and Assume that the digital amplitude of the point at time 10 is 15. According to this example, any digitized verbal utterance waveform such that the amplitude at time 10 is in the range of 13 to 17 is added to the digitized baseline waveform shown in FIG. Matches for.

In step 904 shown in FIG.
04 indicates that the verbal utterance spoken into the microphone 122 by the operator is converted to an analog / digital converter 608.
To determine if it exists. In practice, the microphone 122 is an audio signal from the operator (ie,
(Oral utterance from the operator) into an electrical signal, and send the electrical signal to an analog / digital converter 608. Analog / digital converter 608 digitizes the received electrical signal and places the digitized electrical signal in buffer 610. Next, the CPU 50
4 performs step 904 by polling analog to digital converter 608 to determine when buffer 610 is full. When the buffer 610 is full, the CPU 504 transfers the digitized electrical signal representing the digitized verbal utterance to the buffer 610.
To the analog / digital converter 608 to send it to the CPU 504 via the bus 502.

In step 906, the CPU 504 receives the digitized verbal utterance from the analog / digital converter 608 via the bus 502.

In step 908, the CPU 504 causes the speech recognition module 522 'to recognize digitized verbal utterances for a subset of words and phrases included in the vocabulary model. That is, the CPU 504 sends a number of words and phrases to the speech recognition module 522 ', and the digitized verbal utterance is converted to a stored digitized baseline waveform associated with the transmitted words and phrases. The speech recognition module 522 'is instructed to determine whether any of these waveforms match, taking into account the allowable variance for each digitized baseline waveform. As a result of step 908, the speech recognition module 522 '
CPU 50 for processing strings associated with matched words or phrases stored in the vocabulary model.
Send to 4.

In practice, the word sent by the CPU 504 to the speech recognition module 522 ′ may mean a menu selection from the current context of the application program 508. For example, application program 508 may require the operator to select from a selection menu. Process 90
At 8, the voice recognition module 522 'determines whether the verbal response of the operator matches any of the menu choices. actually,
In processing the steps shown in FIG. 9, CPU 504 may interact with speech recognition module 522 'by calling software routines stored in speech recognition module 522' according to programming in application program 508. Absent.

In step 916, CPU 504 processes the recognized words or phrases (ie, the strings returned in step 908) according to the particular programming of application program 508. For example, the recognized words or phrases are stored in database 5
A command from an operator, intended to access specific information from the operator 20, may be represented. In this case, the CPU 504 accesses and
Database 5 located in magnetic storage device 519
20 to retrieve the data requested. Next, the CPU 5
04 sends the retrieved data to the display screen 110 for display to the operator.

In step 918, CPU 504 determines whether the recognized word or phrase implies an exit command. If the recognized word or phrase does not imply an exit command, the CP
U504 loops back to step 904 to wait for further operator instructions. Otherwise, the CPU 504 terminates the application program at step 920.

The speech recognition module 522 'proceeds to step 908.
FIG. 10 is a flowchart illustrating a method of performing the operation (shown in FIG. 9), that is, an operation flowchart of the voice recognition module 522 ′. In this case, the speech recognition module 522 'operates according to a stand-alone speech recognition algorithm. Before the process shown in FIG. 10 is performed, the voice recognition module 522 '
Note that the training is performed for multiple operators using the well-known method already described with respect to.

In step 1004, speech recognition module 522 'locates the digitized electrical signal (representing the digitized spoken utterance) by locating points in the digitized electrical signal that are below the energy threshold. ) Are identified (eg, see FIG. 12). In this case, the located points represent word boundaries. If the number of points located below the energy threshold separating the words in the digitized electrical signal is less than a predefined number (set according to the speech characteristics of the particular operator), the speech recognition module 522 'Determines that the digitized electrical signal contains one phrase (ie, multiple words) rather than one single word. The points in the digitized electrical signal corresponding to the word or phrase represent the digitized verbal utterance waveform received from (ie, spoken by) the operator. For example, if FIG. 12 represents a digitized electrical signal, and if the predefined number is 5, then two words will have only four points (time 13 and 15) located below the energy threshold. ), The speech recognition module 522 'determines (at step 1004) that the digitized electrical signal includes one phrase having two words. The points in the digitized electrical signal corresponding to the phrase formed by the two words represent the received digitized spoken utterance waveform.

In step 1006, the voice recognition module 522 '
The next word or phrase is selected from the subset of words and phrases sent to 2 '.

In step 1008, speech recognition module 522 'performs a sequential comparison of the received digitized verbal utterance waveform with the digitized baseline waveform associated with the selected word or phrase, and digitized. It is determined whether a match is established between the received digitized verbal utterance waveform and the digitized baseline waveform in view of the allowable variance associated with the baseline waveform. If the difference between the two points is smaller than the variance allowed for that particular point, the speech recognition module 52
2 ′ determines that a match occurs between a point in the received digitized verbal utterance waveform and a point corresponding to the time included in the digitized base in the line waveform. In the process of step 1008, the voice recognition module 52
2 'generates a recognition score that represents, for the selected word or phrase, substantially the cumulative sum of the differences at each point between the received digitized verbal speech waveform and the digitized baseline waveform. . Thus, a lower recognition score indicates a closer match between the received digitized verbal utterance waveform and the digitized baseline waveform.

In step 1010, the speech recognition module 522 'determines whether the recognition score for the selected word or phrase is less than a software-adjustable maximum allowable score by the operator. If the recognition score for the selected word or phrase is even greater than the maximum allowed score,
Speech recognition module 522 'determines that the selected word or phrase did not match the received digitized verbal utterance waveform, and proceeds to step 1014. If the recognition score for the selected word or phrase is even less than the maximum acceptable score, the speech recognition module 522 'may determine that the selected word or phrase and the received digitized verbal utterance waveform are (confidence levels described below). Is determined to be a match, and step 1012 is processed.

In step 1012, speech recognition module 522 'adds the selected word or phrase to the acceptable word list. The words and phrases of the acceptable word list are ordered according to their respective recognition scores in ascending order, for example, such that the first entry in the acceptable word list has the lowest recognition score.

In step 1014, speech recognition module 522 'determines whether all words and phrases sent by CPU 504 to speech recognition module 522' have been processed. Words to process,
And / or if a phrase exists, the CPU 50
4 loops back to step 1006. If not, CPU 504 processes step 1016.

In the rest of the process shown in FIG. 10, the speech recognition module 522 'interacts with the operator to determine which words or phrases in the acceptable word list are the words or phrases spoken by the operator. I do. In particular, at step 1016, the speech recognition module 522 'selects the first entry in the acceptable word list. Recall that the first entry has the lowest speech recognition score of all entries in the acceptable word list.

At step 1018, speech recognition module 522 'generates a confidence value for the first entry by subtracting the recognition score of the second entry from the recognition score of the first entry. The confidence value of the first entry is
Quantify how much the speech recognition module 522 'trusts that the word or phrase spoken by the operator is the first entry. Step 1
At 020, the speech recognition module 522 'determines whether the confidence value of the first entry is high or low by comparing the confidence value with the minimum confidence value selected by the operator. If the confidence value is greater than the minimum confidence value,
The confidence value is high and the voice recognition module 52
2 'processes step 1030. In step 1030, because the confidence value of the first entry is high, speech recognition module 522 'returns the string associated with the first entry to CPU 504 to CPU 504 for processing (in step 916 of FIG. 9).

At step 1020, if the confidence value is less than the minimum confidence value, the confidence value is low, and the speech recognition module 522 'proceeds to step 1022. In step 1022, the speech recognition module 522 'asks the operator if the first entry is a correct word or phrase (ie, the word or phrase spoken by the operator). Voice recognition module 5
22 'displays the message to the operator on the display screen 110, or sends the message in audio form to the operator via the speaker 332 (or alternatively, the microphone / speaker 122 If it is an ear microphone, send it to the microphone / speaker 122, or
If the microphone 122 is a headphone microphone and does not have a transducer for outputting an audio signal, it may be possible to interrogate the operator (by sending it to an independent speaker). The operator speaks into the microphone 122,
Alternatively, the query from the voice recognition module 522 'can be answered in a number of ways, such as by operating the pointing device 330. If the operator responds that the first entry is correct, the speech recognition module 522 'processes step 1028 (described below). Otherwise, the speech recognition module 52
2 'processes step 1024.

In step 1024, the operator has indicated that the first entry is incorrect, so the speech recognition module 522 'determines whether there is an entry in the acceptable word list for processing. If there is an entry to process, speech recognition module 522 'processes step 1026. In this case, the speech recognition module 522 'selects the next entry in the acceptable word list, and loops back to step 1022 to ask the operator if the newly selected entry is correct. Otherwise, if there is no preceding entry to process (see step 1024), speech recognition module 522 'processes step 1028.

As described above, (1) Step 102
2 if the operator indicates that the selected entry is correct, or (2) if the operator actually indicates in step 1024 that there are no correct entries in the acceptable word list. Arrives at step 1028. At step 1028,
The speech recognition module 522 ′ may be used to update the training of the vocabulary model based on well-known methods, for example, such that the speech recognition module 522 ′ will be able to more reliably recognize the verbal utterance of the operator in the future. Interact with. In step 1028, the voice recognition module 522 'uses a well-known method.
Will not be considered further.

After updating the training of the vocabulary model, the speech recognition module 522 ′ processes step 1030. In this case, the speech recognition module 522 ′ may process (step 916, FIG. 9) the CPU 50, as directed by the operator (steps 1022 and 1028), with the string associated with the word or phrase that matches the spoken utterance.
Return to 4.

Having described the preferred embodiment of the invention,
I've been proposing some related mods,
Those skilled in the art can make other modifications to the described embodiments of the invention without departing from the broad inventive concept of the invention. You should admit that. Therefore,
It is to be understood that this invention is not limited to the particular embodiments disclosed herein, but applies to any adaptation within the scope and spirit of the invention as defined by the appended claims. For example, the computer system 102 of the present invention can be used in many applications, including (but not limited to) those for the physically challenged, for educational purposes, for testing and services, and for inventory checks. It is.

[Brief description of the drawings]

FIG. 1 is a schematic front view of an operator equipped with a computer according to the present invention.

FIG. 2 is a schematic side view of an operator equipped with the computer of FIG.

FIG. 3 is a perspective view of a system unit forming a part of the computer of FIG. 1;

FIG. 4 is a bottom plan view of the system unit of FIG. 3;

FIG. 5 is a schematic configuration diagram of the computer of FIG. 1;

FIG. 6 is a partial schematic configuration diagram of an alternative embodiment of the computer in FIG. 1;

FIG. 7 is an operation flowchart of the computer in a case where the computer of FIG. 1 has a dependent speech recognition module.

FIG. 8 is an additional operation flowchart of the dependent speech recognition module.

FIG. 9 is an operation flowchart of the computer in a case where the computer of FIG. 1 has an independent voice recognition module.

FIG. 10 is an additional operation flowchart of the independent speech recognition dependent module.

FIG. 11 is a block diagram of a display screen operating according to the shutter wheel technology.

FIG. 12 is a digitized waveform of an oral utterance.

[Explanation of symbols]

 102 portable calculator 106 system unit 110 display screen 116 equipment pack 120 device under test 122 microphone

──────────────────────────────────────────────────の Continued on the front page (73) Patent holder 594034278 Michael David Jenkins 22111 Virginia, USA 22111 Manassas Cortland Circle 7437 (72) Inventor Edward George Newman United States of America Virginia 22111 Manassas Foster Lane 9541 (72) Inventor Jill Steven Christian United States Virginia 22655 Stevens City Columbia Cycle 4825 (72) Inventor Michael David Jenkins United States Virginia 22111 Manassas Cortland Circle 7437 (56) References JP-A-1-191899 (JP) , A) Hira 2-32130 (JP, U) (58) Field surveyed (Int. Cl. ⁶ , DB name) G06F 1/16 G06F 3/16 G10L 3/00 551

Claims (16)

(57) [Claims] 1. A portable computer independent fully supported compact by the user to retrieve and display information in a hands, so that the user carry without using hands, the user A single housing with detachable belt or strap attachment means, the single housing comprising storage means, processor means,
And audio transducer and converter means
With a size that can be worn around the user's waist.
However , storage means incorporated in a single housing are mounted within said housing for storing previously entered information , electrical technical manuals and a plurality of words.
Pre-programmed vocabulary model consisting of words and phrases
Include Le, the processor means, mounted et in the housing
Is to receive information and user commands in accordance with a program stored, searched, der intended for processing
Ri, the audio transducer and converter means
Receives audio commands from the user and
Was your audio command is converted into an electrical signal, and, its
Those of the converted electrical signals for communicating with flop <br/> processor means for sending the processor unit, using the user manual
And the processor means is provided with an electric technology recorded in the storage means.
Search and output the corresponding information from the surgical manual
Therefore, the command in the converted electric signal is recognized and recognized.
Means for responding to a recognized command , wherein the means for recognizing the command comprises a stored program.
In a vocabulary model that is pre-programmed for the context of
Defines a subset of multiple words and phrases of
And an electrical signal converted for the recognized command
Is intended to include a means for adapting the further this portable computer, has a can communicate with the processor means, the processor Hand
Receives the information output from the stage and sends the received information to the user
Has a display for electrostatic calculation machine display means, means carry without using hands before Symbol computerized machine display means within a user's field of view for, thereby using only voice commands Handofuri
To display the information received by the computer
Supported by the user without the use of hands that can be operated
Portable calculator . 2. The method of claim 1, wherein the computer, information the is previously input, the hand having an electronic technical manuals
A portable calculator supported by users without the use of . 3. The method of claim 1, wherein computer recognition means, in accordance with dependent voice recognition algorithms, the electrical signal the transform on signals representative of words and phrases in the preprogrammed vocabulary model User-supported carrying without hands that have the means to match
Obi calculator . 4. A according to claim 1, wherein computer recognition means, based on the current statement of the program being remembers defines a subset of the preprogrammed vocabulary model, the following independent speech recognition algorithms A mobile device supported by the user without hands having means for matching the converted electrical signals against a defined subset
Calculator . 5. The method of claim 1, wherein the computer, de office <br/> play means, and visual display means, viewing the information received from the processor means Satoshiteki display means and compatibility It converted to a video signal, to the user without using hands and a driver means for communicating with Satoshiteki display means seen to display the video signal a compatible on the visual display means
A portable computer that is supported . 6. The method of claim 5 wherein the computer, visual Satoshiteki display means, including a first color polarizer for by polarized light from the cathode ray tube separated into cyan and red component filter And a first liquid crystal switch for rotating the polarized light from the first color polarizer by zero or 90 degrees, and polarizing the light from the first liquid crystal switch into yellow and blue components. hands having a second color polarizer, the optically coupled to cathode ray tube and a second liquid crystal switch for rotating only zero degrees or 90 degrees polarized light from the second color polarizer for User without
Portable calculator supported by . 7. The of Claim 6 wherein the computer, said to the driver means, an image to display the on behind polar tube in accordance with the video signal that is compatible, for converting a cathode ray tube image into a color image Using a hand with means for controlling the filter according to the color information in the compatible video signal
A portable calculator supported by users without . 8. A according to claim 5, wherein computer visual Satoshiteki display means, hands length of a diagonal line is provided with a video graphics array (VGA) eye monitor 1 inch or less
A portable calculator supported by users without using it . 9. The according to claim 5, wherein computer visual Satoshiteki display means, the length of the diagonal line has an eyepiece monitor 1 inch or less, contact ocular monitor, color graphics adapter (CGA) eye A monitor supported by the user without the use of a monitor, an enhanced graphics adapter (EGA) eyepiece monitor, a video graphics array (VGA) eyepiece monitor, or a super VGA eyepiece monitor
Obi calculator . 10. The method of claim 1, wherein the computer further configured to implement the electrical measurements on devices being evaluated, the electrical measured receiving electrical measurement signals from the devices being evaluated as a result of performing and received a measuring means for communicating with said processor means for sending electrical measurement signal to the processor means, hands which measurement means is supported by the user
A portable calculator supported by users without . 11. The method of claim 1, wherein the computer further includes a power supply means for supplying power to the computer, the user without using hands electrostatic <br/> source means is supported by the user
Portable calculator supported by . By 12. Portable computer independent compact for the user, a portable computer carried by the user without using the hands to search for and display information without using hands
A method of operation, as carry without hands by the user, the user of the base of the single housing having a storage means and processor means
Has a step of mounting the belt, said single housing, storage means, processor means,
And audio Trang Sujusa and converter means
With a size that can be worn around the user's waist
In addition, this method of operating a portable computer makes the computer display device part of the user's field of view.
Comprising the steps of Yoo over THE attaches to users in the procedures as carry without using hands, and the process of attaching the audio transducer, such carry without using hands and also to the users in the procedures to receive a verbal utterance from the user Verbal utterances from the user ,
A step of receiving the Yusa, a process of converting the verbal utterance that said received at electrical signal the audio transducer, a process of transferring an electric signal the conversion from the audio transducer to said processor means, an electric signal the transfer Recognized by the processor means,
Identifying a command that matches the spoken utterance.
The recognition is pre-programmed based on the current operation context.
Subsets of multiple words and phrases in a given vocabulary
Stipulating the converted electrical signal and
Including recognizing commands by matching
, Still, if the operation method of the portable computer, and a procedure of processing the user command by the processor means in accordance with a program stored in the process, the user command represents an information search request Determining the requested information from a database previously input to the storage device when the user command indicates an information search request; and Displaying on a display device, thereby calculating to display the retrieved information in a hand-free manner using only audio commands.
A user-supported mobile phone without using the hand to operate the machine
How to operate the obi calculator . 13. In operation <br/> method of a portable computer according to claim 12, recognition process, the steps of selecting a word or phrase from a vocabulary models previously trained were selected word or a process determining whether the converted electrical signal to one that matches one of a finite number of electrical waveforms associated with the phrase, of the electrical waveform of finite number associated with the selected word or phrase hand and a process converted electrical signal to one is the case of match, which converts the converted electric signal to one or more particular keystrokes associated with the selected word or phrase
A method of operating a portable computer supported by a user without using a computer . 14. In operation <br/> method of a portable computer of claim 12, defined recognition process, a subset of the vocabulary model that has been pre-trained based on the current context of the program being remembers And selecting a word or phrase from the subset, and determining whether the deviation between the converted electrical signal and the baseline waveform is within an acceptable variance. has, baseline waveform and acceptable variance associated with a word or phrase that is selected, if the difference between the converted electrical signals and the baseline waveform is within the allowable dispersion, selected a step of calculating the confidence values for the word or phrase is, when signal Yoriyukichi is greater than a predetermined confidence value, the converted electrical signals, associated with the selected word or phrase string A process of converting, when Shin Yoriyukichi is less than the predetermined confidence value, hands and a process that interacts with user to modify the vocabulary model trained in advance to an electrical signal that is converted Supported by the user
How to operate a portable computer . 15. In operation <br/> method of a portable computer according to claim 12, the information process of displaying the retrieved information, which is search, video graphics array (VGA)
A process of converting a video signal with a monitor compatible mobile supported by the user without using hands and a step of displaying a video signal with each other <br/> commutative on the VGA monitor
How to operate the obi calculator . 16. The method of claim 12 operating <br/> method of a portable computer according, the process of displaying the retrieved information, the information search, a color graphics adapter (CG
Supporting the process of converting the video signal that is compatible with A) a monitor, a video signal a compatible, the user without using hands and a step of displaying on the CGA monitor
How to operate a portable calculator .