JP2002116871A - Portable terminal and telephone terminal and its input system and host computer and mutual communication system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an input system capable of easily inputting characters for performing mobile computing by using a portable terminal. SOLUTION: Characters are inputted to a portable terminal with a voice, and voice recognition is performed by a host computer positioned in a remote place, and the recognized result is displayed with characters, and the characters of the recognized result are played back by performing voice synthesis so as to be listened to, and the correctness/error of the recognized result is confirmed even by the ears at the portable terminal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal or portable telephone,
PHS (PERSONAL HANDY PHON
E), PDA (PERSONAL DIGITAL A)
SISTANT), satellite telephones and car telephones or wired telephone terminals and host computer communication systems.

[0002]

2. Description of the Related Art Conventionally, input devices for portable telephones, PHS, satellite telephones, and automobile telephones (hereinafter collectively referred to as portable telephones) have been composed of a small number of buttons such as numeric buttons, cursor buttons, and navigation buttons. Therefore, it is convenient to input a telephone number, but it takes time to input characters. Therefore, it has been difficult to use a mobile phone as a mobile computing terminal such as a mopile. In PDA, input is performed using a touch panel attached to a display. However, in order to display the entire keyboard of a personal computer on the display, a display of at most about 60 mm × 90 mm uses a fingertip like a mobile phone. It was difficult to enter keys, and he relied on pen input. Moreover, since the display area of one key was small, it was difficult to input.

[0003]

SUMMARY OF THE INVENTION According to the present invention, in order to enable a portable terminal to be used as a mobile computing terminal, an input of a portable terminal capable of easily inputting characters, such as a personal computer, with a small number of buttons. The purpose is to provide a system. It is another object of the present invention to provide a system that can easily input a voice to a portable terminal or a wired telephone terminal. It is another object of the present invention to significantly enhance the capability of a terminal (a portable terminal or a wired telephone terminal) by communicating with a host computer.

[0004]

In order to achieve the above object, in the portable telephone of the present invention, when the portable telephone is used as a mobile computing terminal, a part of the keyboard of the personal computer is displayed on the display of the portable telephone. Display, in conjunction with the operation of a specific input device of the mobile phone, sequentially scans and displays other parts of the keyboard that are not displayed on the display, and displays, near the center of the displayed keyboard. One key is displayed in the vicinity of the center of the display so as to be distinguished from the other keys.By operating the input device, the one distinguished key is determined. Thereafter, characters are picked up from the keyboard in the same manner, and letters, symbols and numerals are displayed. If input is performed, the mobile phone will have a pseudo keyboard. The same applies to a wired telephone terminal. Even if the entire keyboard is displayed on the display, it is difficult to distinguish each key because the keys are too small. However, if a part of the keyboard is enlarged and displayed on almost the entire area of the display, for example, by operating an input device such as a trackball, the other parts of the keyboard which are not displayed are sequentially scanned and displayed on the display,
Any part of the keyboard can be magnified and displayed on the display. One key located near the center of the display is displayed separately from the other keys. The method of distinction can be achieved, for example, by performing black-and-white inverted display and distinguishing.

In an input system of a terminal (portable terminal or wired telephone terminal) having a display in which a touch panel is attached to a display, at least a part of a keyboard used in a personal computer is displayed on the terminal display. In conjunction with the operation of the specific input device, the other parts of the keyboard that are not displayed can be sequentially scanned and displayed on the display, so that any key of the keyboard can be touched and selected. Became.

It is obvious that one key distinguished as described above can be determined by using a determination key if necessary, and characters can be picked up one after another. Save the characters you picked up elsewhere on the display. Obviously, it can be converted into kanji and sentences, and can be performed using a known technique. For example, if you roll a trackball, you can display any part of the keyboard and select any key. In order to determine the selected key, the trackball may be pressed in to determine the key, or another determination key may be used. However, in the case of a display on which a touch panel is attached, the confirmation key is not necessarily required.

The specific input device is not a trackball, but is a so-called navigation button used to move a cursor up, down, left and right, a cursor key, or a display on which four adjacent keys or dials or a touch panel are substituted. May be one of the specific keys displayed in.

[0008]

It is apparent that the terminal (portable terminal or wired telephone terminal) configured as described above can be used as a computing terminal. This is because, once a keyboard input equivalent to that of a personal computer is required, if the screen immediately transitions to the keyboard input screen that displays a part of the keyboard as described above, almost the same ease of input as a keyboard input is performed. Is obtained. In addition, terminals (mobile terminals and wired telephone terminals) are small and do not have the memory capacity of a personal computer. However, it is also possible to store a lot of software in a host computer connected by wireless or wire, and to download and use necessary software as needed each time. Further, as in the embodiment shown in FIG. 7 to be described later, voice input can be performed instead of key input.

[0009]

FIG. 1 is a front view of a portable telephone. Mobile phone 1
A display 2, a cursor key 3 and a numeric key 4 are arranged in front of the display. The antenna 5 is an antenna for wirelessly connecting to a telephone office. In FIG. 2, the same reference numerals as those in FIG. 1 indicate the same components. This is true for all figures. FIG. 2 is an enlarged view of the display,
The display 2 shows a part of the keyboard. A key “Y” is highlighted near the center of the display 2, and this inverted display is indicated by numeral 6. This is an example, and any key can be brought near the center of the display 2 by operating a trackball or the like. If the inverted key "Y" is confirmed, "Y" is transplanted to the confirmation zone indicated by number 7, and characters can be transplanted to the confirmation zone 7 one after another in this way.
The characters transplanted to the fixed zone 7 can be converted to Roman alphabet-Kana, Kana-Kanji, and sentence.

FIG. 2 mainly shows alphabet keys, but a mode in which the display is changed to kana keys may be provided. Further, instead of the numeric keys, the numeric keys may be shifted to symbol keys and displayed. In addition, function keys and other keys used by the computer can be displayed.

FIG. 3 shows another embodiment similar to FIG. 2 except that the inverted character 6 is displayed in an enlarged manner on the place where it should be. This makes it easier to see the characters and to pick up the characters. FIG. 4 shows a front view of the mobile phone, and numeral 8 indicates a trackball. When the trackball 8 is rolled, a part of the keyboard is sequentially scanned and displayed on the display 2. Trackball 8
Is pressed, the reverse character 6 is determined. Roll the trackball to scan the keyboard, and press the trackball to replace the enter key. Alternatively, the confirmation may be performed using another confirmation key.

In the embodiment shown in FIG. 5, in a portable terminal (ie, PDA or portable telephone) 9 having a display in which a touch panel is attached to a display, at least a part of a keyboard used in a personal computer is replaced with the portable terminal. 9 on the display 10 and in response to the operation of the specific input device 11 of the mobile terminal, the other parts of the keyboard that are not displayed can be sequentially scanned and displayed on the display 10 as a result, It has become possible to select any key of the keyboard by touching it with a finger. This is because not all of the keyboard of the personal computer is displayed on the small display of the mobile terminal, but a part of the keyboard is enlarged and displayed on a large part of the display. As a result, the display area of one key can be increased, and the fingertip can be easily moved. This is because one key can be touched to select a key. The specific input device is a trackball or a so-called navigation button that is usually used to move a cursor up, down, left and right,
It may be a cursor key or one of four adjacent keys instead or one of the specific keys shown on the dial or display.

The embodiment shown in FIG. 6 is a front view of a foldable portable telephone 12 having a display 13 and a display 14 to which a touch panel is attached. When the hinge 17 is folded, the display 13 and the display 14 to which the touch panel is attached are folded so as to overlap, and the surface area is reduced to almost half.

Although a part of the keyboard is enlarged and displayed on the display 14, when a specific input device 18 such as a trackball is operated, other parts of the keyboard which are not currently displayed on the display 14 are successively displayed. Scan and display. As a result, the display 1 on which the touch panel is attached is operated while operating the specific input device 18.
By touching the key displayed in 4 with a fingertip, all keys can be input. The display 14 can display not only a computer keyboard but also numerals and other keys as shown in FIG. Of course, at that time, a telephone number is input as a mobile phone.

The specific input device 18 may be a dial, a cursor key, a navigation key or the like instead of the trackball. Further, the position of the specific input device 18 is not limited to the position shown in FIG. 6, and it is apparent that the specific input device 18 may be located anywhere on the mobile phone 12 or may be a specific key displayed on the display 14. The display 13 may be a display without a touch panel, or may be a display with a touch panel. When the display 13 is a display to which a touch panel is attached, at least a part of the keyboard adjacent to the keyboard displayed on the display 14 can be displayed on the display 13 in conjunction with a specific input device 18. In that case, use the left finger to display 13
The user can perform key input on the touch panel of the display 14 with the finger of the right hand. The thumb is convenient for operating a particular input device 18, such as a trackball. The entered characters are displayed in a fixed zone (not shown) in the displays 13 and 14 where the keyboard is not displayed. When the display 13 is a display on which a touch panel is not attached, the display 13 may be used as the above-described confirmation zone or may be used for other displays. Number 5 indicates an antenna, number 15 indicates a receiver, and number 16 indicates a transmitter. The receiver 15 and the transmitter 16 naturally exist in the embodiments shown in FIGS. 1 to 5, but are omitted. 2 to 6
In the embodiment shown in FIG.
Reads the operation state of the specific input device of the mobile terminal, displays a part of the keyboard of the personal computer on the display of the mobile terminal, and sequentially scans other parts of the keyboard that are not displayed according to the change in the operation state. It is obvious that the display can be performed by the software. The software in the CPU (not shown) enables such a display method. This element technology is known and can be easily implemented. The point is that the state of the input device is read and a part of the keyboard is displayed in a specific manner. This is sufficient with the displays shown in FIGS. 2 to 6 and the description thereof.
Further, it is not necessary to show a hardware block diagram. Even if shown, such an obvious block diagram will be omitted because the three blocks of the input device, the CPU, and the display merely represent three blocks connected in this order. For the software in the CPU, "Read the state of the input device"->"Display a part of the keyboard on the display"->"Scan and display other parts of the keyboard according to changes in the operation state of the input device" There is no other way but to outline the algorithm. Such software element technologies are currently made routinely and are not particularly rare. This is a known technique that can be easily implemented. In short, there is novelty in using such a known elemental technology to perform display with characteristics that have not existed before.

The embodiment of FIG. 7 is a block diagram when voice input is performed. The signal flow is indicated by arrows. A voice uttered toward a transmitter 20 of a mobile terminal (mobile phone, PHS or PDA having a telephone function, a satellite phone, a car phone) 19 is converted into a digital signal by an input voice AD conversion unit 24A, and is converted to a CPU 24B. The radio signal is inputted, and further converted into a radio transmission signal via the radio transmission / reception section 24C, and the radio transmission signal 26 is transmitted to the radio base station 28 via the antenna 5. The transmitted radio transmission signal 26 passes through a radio base station 28 and is converted into a digital electric signal, which is input to a base station controller and a switch 29. The signal leaving the above-mentioned exchange passes through a telephone line, a dedicated line, an optical fiber, a cable line such as a CATV, or another mobile communication network, and is input to the host computer 21 via a modem, terminal adapter or router (not shown). . Here, the data may be directly input to the host computer 21 via a modem, a terminal adapter, or a router, or may be input to the host computer 21 via the Internet. The signal input to the host computer 21 is first sent to the speech recognition unit 29
B, and the voice is recognized by the operation of the voice recognition unit 29B and the CPU 29C. The voice recognition unit 29B may be a single computer itself, or may be dedicated hardware for voice recognition. The voice recognition unit 29B
Alternatively, voice recognition may be performed using the CPU 29C itself. When the voice recognition unit 29B is provided separately from the CPU 29C, a plurality of voice recognition units 29B can be provided for one CPU 29C to prepare for a case where access from a large number of mobile terminals is concentrated. It is needless to say that one voice recognition unit 29B can process voice input from a large number of mobile terminals in a time-division manner.
Signal 29D converted to letters, numbers and sentences by voice recognition
Is input to the exchange and the base station controller 29 via a modem, a terminal adapter or a router (not shown), and is returned as a wireless reply signal 27 to the portable terminal 19 via the wireless base station 28. Next, the wireless reply signal 27 is received by the antenna 5 of the mobile terminal 19, input to the processing block 24 as return data 30, and is input to the CPU 24B via the wireless transmitting / receiving unit 24C.
By the function of the conversion unit 24E, a synthesized voice based on the return data 30 is produced and uttered from the receiver 22 of the portable terminal, and the return data 3
It is also possible to display “0” and confirm with ears and eyes whether or not the voice initially uttered toward the transmitter 20 of the portable terminal is correctly recognized. Numeral 25 indicates an input device such as a trackball, a keyboard, a touch panel, etc., and the operation state of the input device 25 is read by the CPU 24B.

[0017] In the current state of the art, the recognition rate of a personal computer is poor, and the voice recognition cannot be performed very much with the size of a portable terminal. However, if a large computer is installed as a host computer in a telephone office or other places, for example, a specific Internet provider, and the host computer performs voice recognition, the recognition rate is dramatically improved and the computer can be used for practical use. At this time, the portable terminal is a sender of the voice and a receiver of the return data.

The transmitted voice is recognized by the host computer, converted into characters, returned to the portable terminal, and uttered from the receiver. In this embodiment, FIG.
The keyboard as shown in FIG. 3 is not displayed. At the time of voice input, there is a cursor (not shown) at the place where characters should be input,
When the user speaks, the recognized word or sentence appears above the cursor. Of course, the cursor can be returned or characters can be deleted by key operation. The return, deletion, and correction by the cursor operation can be similarly performed in all the other embodiments.

As a first variation of the embodiment shown in FIG. 7, the voice synthesizer 24D of FIG. 7 can be connected to the CPU 29C of the host computer 21 without being provided in the portable terminal 19. In this way, it is possible to create data 29D in which speech-recognized character data and speech-synthesized data synthesized based on the character data are combined. This data 29D
And a base station controller 29 and a wireless base station 28 via a modem, terminal adapter or router (not shown).
Can be returned to the portable terminal 19 as a wireless reply signal 27 via the. The portable terminal 19 receives the wireless reply signal 27 via the antenna 5 and the wireless transmitting / receiving unit 24C. At this time, the return data 30 is data in which speech-recognized character data and speech synthesis data are linked. This return data 3
The portion of the voice synthesis data included in 0 is taken out by the CPU 24B, and the receiver 22 generates a synthesized voice via the DA converter 24E. The character data portion included in the return data 30 is taken out by the CPU 24C, sent to the display 23, and displayed.

In FIG. 7 and the above-described embodiment, which is a first variant thereof, the timing of the display of the character data displayed on the display 23 and the timing of the generation of the synthesized voice generated from the receiver 22 can be synchronized. It is possible to produce software for the CPU 24B in this manner using a clear and well-known technique. In this way, the mobile terminal 1
The user holding 9 simply puts the receiver 22 on his / her ear, and outputs the voice that he uttered before to the transmitter 20 before.
It can be played back as a synthesized voice generated from the handset 22, and if the speech recognition is wrong, the synthesized sound played back will also be a different sound, so even if the handset is in contact with the ear, it can easily be mistaken. You can notice.
At that time, the input device 25 is operated to temporarily stop the display of the character data and the playback of the synthesized voice, and the input device 25 is also operated to look at the characters displayed on the display 23, and to find the wrong character. It can be highlighted or underlined below the text. Next, correct speech is re-input to the transmitter 20 and speech recognition is performed by the same mechanism, and incorrect character input data can be corrected. Finally, the input character data that has become completely correct is stored in a memory (not shown) in the mobile terminal 19, and is transmitted as an e-mail to an arbitrary destination. This is the same in the embodiments shown in FIGS. Also, in FIG. 7 and its variants, and in the embodiment of FIG. 8 described later, when an access amount exceeding the treatment capacity of the host computer 21 is received from a large number of portable terminals, the wireless communication signal 26 is transmitted to a memory (not shown) in the host computer 21. The obtained data may be temporarily stored and processed sequentially in a time-division manner, or a plurality of voice recognition units 29B and CPUs 29C may be provided to perform parallel processing. Also, host computers are installed at a plurality of providers, and when a host computer of one provider is too crowded, the wireless transmission signal 26 is automatically transferred to another non-crowded provider to be processed. Is also good. In this case, the wireless reply signal 27 is returned from the transfer destination provider to the portable terminal 19.

In the embodiment of FIG. 7 and its variants, the elemental techniques used for speech recognition include the well-known DP matching method, a method based on segmentation and phoneme labeling, and HMM.
(Hidden markov model), a method using a neural network, or other currently known methods, and the speech recognition unit 29B may be configured, or a new method to be developed in the future may be used. Is obvious. The elemental technology used for speech synthesis may be configured by using a known PARCOR system, LSP system, cepstrum system, or other currently known systems, or may be a new technology to be developed in the future. Obviously, a scheme may be used. The input audio AD conversion unit 24A and the DA conversion unit 24E
It is apparent that the configuration can be made using a conversion integrated circuit or a DA conversion integrated circuit.

It is also possible to provide the host computer 21 at a place other than the Internet provider and other places. At this time, the host computer 21 may be connected to the Internet or may be connected to a wired line such as a telephone line, a dedicated line, an optical fiber, a CATV, or another mobile communication network without using the Internet. Of course, when not via the Internet, it can be said that the communication path has higher security. In addition, the host computer 21 may be installed in the wireless telephone station, and it is needless to say that the configuration is also as shown in FIGS. Therefore, the configurations shown in FIGS. 7 and 8 do not lose generality as a concept.

A second variant of the embodiment shown in FIG. 7 is as follows. Various arbitrary software and well-known word extraction software are stored in a memory (not shown) in the host computer 21. This word extraction software is different from speech recognition software, and is for finding a specific word from a sequence of data that has been speech-recognized into character data, and is known. The storage method may be externally transferred to the memory of the host computer 21 or uploaded from another computer connected to the Internet via the Internet. Alternatively, the data may be uploaded to the host computer 21 from another computer using a telephone line or a dedicated line without using the Internet. Next, voice input is performed on the mobile terminal 19, and at this time, a specific keyword,
For example, when a command voice such as "execute English-Japanese translation" is input, the character data recognized by the voice recognition unit 29B is input to the CPU 29C. , Run and detect words. If detected, known English-to-Japanese translation software is activated, and thereafter, the mode shifts to the translation mode, in which all of the Japanese characters that have been input by voice and become character data are translated into English, and English character data 29D is created. The English character data 29D is returned to the portable terminal 19 along the same route as the embodiment of FIG. The return data 30 is generated from the receiver 22 as an English synthesized voice as described above with reference to FIG. A synthesized voice of English and Japanese can be continuously transmitted as the return data 30, or a synthesized voice of an original command such as "execute English-Japanese translation" may be generated prior to the translated synthesized voice.

In the above embodiment, the translation of the voice input can be heard as a synthesized voice while the portable terminal 19 is kept in contact with the ear. Therefore, if the synthesized voice is uttered, it is possible to talk with a foreigner in almost real time. . If a foreigner has a similar portable terminal, English-Japanese-Japanese-English translation can be performed in real time. Of course, the same applies to translation between all other languages. Since it is easy for the CPU 24B to adjust the generation speed of the synthesized voice according to the user's understanding speed, it is easy to listen to and understand the translated English synthesized voice at a slow speed, for example. You can also speak parrots in English to foreigners. It is easy to prevent the pitch of the sound from lowering even if the synthesized speech is generated at a slow speed. This is because it is only necessary to extend the generation time of the synthesized sound without changing the pitch of the sound. You may also be able to listen as many times as you want. Alternatively, instead of using the receiver 22 of the portable terminal 19, if an amplifier and a speaker (not shown) are connected to the output of the DA converter 24E as an attachment, the generated synthesized voice can be heard by the other party. Conventionally, there has been a stand-alone electronic translator, but in the above embodiment, high-accuracy translation can be executed by wireless transmission to a host computer and using a high-performance large host computer. Not only that, but you can also send translation results by e-mail.

The above is an example in which the translation software is activated, and it is clear that any other type of software can be activated by voice commands. It is apparent that the embodiment of the present invention includes the embodiment in which all kinds of software stored in the host computer are activated by voice commands as described above.

The embodiment shown in FIG. 8 is as follows. FIG.
The display 23 of the portable terminal 19 displays a so-called icon. Regarding the display method, all icons may be displayed, or some icons may be displayed in an enlarged manner. In the embodiment of FIG. 8, the command voice is not input, and the input device 25 such as a trackball is operated to scan other icons that are not currently displayed and to select an arbitrary icon. Obviously you can. When an arbitrary icon is selected, only information that “the icon has been selected” is transmitted to the host computer 21. Since the software corresponding to the arbitrary icon is stored in the memory (not shown) of the host computer 21 in advance, the corresponding software is started. After being activated, the software is sent to the portable terminal 19 as a signal 29D. At this time, the wireless reply signal 27 and the return data 30 indicate the flow of the corresponding software downloaded from the host computer 21 to the portable terminal 19. Since all software cannot be stored in a memory (not shown) of the portable terminal 19, the software is downloaded from the host computer 21 whenever necessary as described above. For this reason, the capability of the portable terminal 19 as a computer is dramatically increased.
Further, since the area of the display 23 of the mobile terminal 19 is small, it is not possible to display too many icons. However, if some icons are enlarged and displayed so that they are easy to see and select, and the input device 25 such as a trackball is operated to display icons that are not currently displayed one after another, a lot of software is activated and downloaded. To handle a large number of icons for In addition, since the capacity of the memory in the portable terminal 19 cannot be so large, any data that is not used immediately can be saved to the host computer 21 for the time being.

It is not always necessary to use the downloaded software to input data using the input device 25 such as a keyboard or a trackball and to operate the software only in the portable terminal. First, the software is activated in the host computer 21 by the icon of the portable terminal, and only the operation state of the input device 25 is transmitted to the host computer 21 in order to control the software. And only the operation result may be periodically returned to the portable terminal 19 as the signal 29D and displayed on the display 23. In this way, even large-scale software can be operated without downloading. At this time, the mobile terminal 19 becomes a mere input / output terminal.

In the embodiment shown in FIG. 7 and its variants and the embodiment shown in FIG. 8, the radio transmitting / receiving unit 24C and the radio base station 2
8 is a known cdm.
aOne, TDMA, W-CDMA, ACELP, PD
C, CSA-CELP, GSM, IS-541
S-136 and other known methods can be used.
Obviously, new schemes to be developed in the future may be used. The encoding method of the input audio AD converter 24A is ADPCM, CELP, VSELP, PSI-CE
LP, QCELP, EVRC or other methods may be used.

The embodiment shown in FIG. 9 is as follows. FIG.
Instead of the portable terminal 19 of the embodiment shown in FIG. 8 and its variants, a known wired telephone terminal 19A is used. Therefore, in FIG. 9, the transmission signal from the CPU 24B of the telephone terminal 19A is transmitted to the wired telephone line as the transmission signal 26A via the telephone line interface 5A. The transmission signal 26A is sent to the central office and the exchange 28A and input to the host computer 21. The signal data 29D sent from the host computer 21 is sent to the telephone terminal 19A as a return signal 27A via the telephone office and the exchange 28A.
Is sent to the CPU 24B as return data 30. In the embodiment of FIG. 9, the configuration, operation and effect other than those described above are exactly the same as those of FIG. 7, its variation, and the embodiment of FIG.

[0030]

Since the present invention has the above configuration,
The following effects are obvious. That is, when a mobile terminal is used as a mobile computing terminal, input is significantly facilitated. Therefore, instead of large terminals such as personal computers, handheld computers, and mopile computers, conventional mobile terminals (mobile phones,
Mobile computing can be performed using a small terminal having a size of about PHS or a PDA having a telephone function, etc., which has the effect of significantly improving the mopile. Further, the accuracy of inputting using a voice or the like is improved for a wired telephone terminal. In addition, since the terminal (mobile terminal or telephone terminal) can be used to operate large-scale software far exceeding the capability of the terminal, the capability of the terminal is significantly improved. Various business models can be constructed using the system of the present invention.

It is apparent that many embodiments not shown here which have similar functions and achieve similar effects to the present invention can be regarded as the same invention as the present invention according to the principle of equivalent. . 8 and the embodiment shown in FIG.
In the embodiment shown in FIG. 7, various business models can be constructed by storing various software in the CPU 29C and operating the system. Therefore, a business method patent based on this is described in the “Applications not shown here” of the present application. It is obvious that the present invention is included in the scope of "Examples". It is obvious that a business of a so-called franchise business in which the host computer 21 is provided in an office of an Internet provider or a wireless communication carrier is also included in the scope of the business model. Further, when all of the embodiments shown in the specification and many of the above-mentioned embodiments not shown here are implemented using the element technology described in the specification, all the element technologies are known technologies. Therefore, it is obvious that the configuration of the present invention is completed.

[Brief description of the drawings]

FIG. 1 is a front view of a mobile phone.

FIG. 2 shows an embodiment in which a part of a keyboard is displayed on a display of a mobile phone.

FIG. 3 shows an embodiment in which a part of a keyboard is displayed on a display of a mobile phone, and an embodiment in which inverted characters are enlarged.

FIG. 4 shows an embodiment with a trackball 8 in a front view of a mobile phone.

FIG. 5 shows an embodiment in which a part of a keyboard is enlarged and displayed on almost the entire area of a display 14 of a mobile terminal (PDA or mobile phone) having a touch panel attached to the display.

FIG. 6 shows an embodiment in which another display 13 is provided in addition to the display 14 having a touch panel attached to the display.

FIG. 7 is an embodiment using a portable terminal for voice input,
FIG. 2 shows a block diagram of the system.

FIG. 8 is a block diagram showing a system in an embodiment in which an icon displayed on a display 23 is selected and a program in a host computer 21 is downloaded to a portable terminal 19;

FIG. 9 shows an embodiment of communicating with a host computer via a wired telephone and a wired telephone line.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Mobile phone 2 Mobile phone display 3 Cursor key 4 Numeric key 5 Antenna 6 One key highlighted near the center of the display 7 Confirmation zone 8 Trackball 9 Mobile terminal (PDA or mobile phone) with a touch panel attached to the display 10) A display on which a touch panel of a mobile terminal 9 is pasted 11 A specific input device of a mobile terminal (PDA or mobile phone) 9 on which a touch panel is pasted on a display 12 In addition to a display 14 with a touch panel pasted on a display, another display A portable terminal having the display 13 13 Another display of the portable terminal 12 14 A display with a touch panel attached to the portable terminal 12 15 Receiver 16 Transmitter 17 Hinge 18 Specific input device such as a trackball 19 Voice input 20 A handset of a mobile terminal that performs voice input 21 A host computer installed at a telephone office or other location 22 A receiver of a mobile terminal that performs voice input 23 A display of a mobile terminal that performs voice input 24 Performs voice input Processing block including CPU of mobile terminal, voice synthesis unit, input voice A / D conversion unit, D / A conversion unit, display control unit, wireless transmission / reception unit, etc. 25 Input device such as keyboard and trackball of mobile terminal performing voice input 26 Host Wireless transmission signal to computer 27 Wireless return signal from host computer 28 Wireless transmission / reception antenna of host computer 29 Processing block including CPU of host computer, voice recognition unit, wireless transmission / reception unit, etc. 30 Return data

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) G06F 15/02 325 G06F 3/023 310L

Claims (15)

[Claims] 1. An input system for a portable terminal, wherein at least a part of a keyboard used in a personal computer is displayed on a display of the portable terminal, and the keyboard is operated in conjunction with an operation of a specific input device of the portable terminal. Operating the input device by scanning and displaying other portions of the keyboard one after another on the display, and displaying one key of the displayed keyboard separately from the other keys on a portion of the display. The input system for a portable terminal, wherein the one distinguished key is determined, and thereafter, characters are picked up from the keyboard in a similar manner, and characters, symbols and numerals are input. 2. The display device according to claim 1, wherein, when the one distinguished key is displayed on a part of the display so as to be distinguished from the other keys, a part of the display is larger than an original display area of the one key. An input system for a mobile terminal, characterized by displaying an area. 3. An input system for a portable terminal having a display in which a touch panel is attached to a display of the portable terminal, wherein at least a part of a keyboard used in a personal computer is displayed on the display of the portable terminal, In conjunction with the operation of a specific input device, the other parts of the keyboard that are not displayed can be sequentially scanned and displayed on the display, so that any key of the keyboard can be touched and selected. An input system for a mobile terminal characterized by the following. 4. A display according to claim 3, wherein two displays to which said touch panel is attached are provided, one display displays at least a part of a keyboard used in a personal computer, and the other displays said keyboard. Display at least a part of the keyboard adjacent to the keyboard displayed on the keyboard, and display the other part of the keyboard not displayed on the two displays in conjunction with the operation of a specific input device of the mobile terminal. An input system for a mobile terminal, wherein the user can select any key of the keyboard by touching the keyboard as a result of successive scanning and display. 5. A method according to claim 1, wherein the specific input device is a trackball or a so-called navigation button, a cursor key, or an alternative to the so-called navigation button used to move a cursor up, down, left and right. An input system for a portable terminal, comprising: one of a plurality of adjacent keys or a specific key displayed on a display to which a dial or a touch panel is attached. 6. An input system for a mobile terminal, wherein a voice uttered toward a transmitter (microphone) of the mobile terminal is sent to a host computer via radio, and speech recognition is performed using the host computer, and a character is input. , A number, a symbol, or a sentence, which is returned from the host computer to the portable terminal via wireless communication as return data, and a synthetic voice based on the return data is generated from a receiver or speaker of the portable terminal, and the portable terminal The portable terminal and the host computer, wherein the return data is displayed on a display of the portable terminal, and whether or not the voice originally uttered toward the transmitter (microphone) of the portable terminal is correctly recognized can be confirmed. And its communication system. 7. An input system for a mobile terminal, wherein a voice uttered toward a transmitter (microphone) of the mobile terminal is sent to a host computer via radio, and voice recognition is performed using the host computer, and a character is output. , Converted to numbers, symbols or sentences to return data, and then performs voice synthesis based on the return data, returns the synthesized voice and the return data to the mobile terminal via wireless communication, and returns from the receiver or speaker of the mobile terminal. In addition to generating the synthesized voice, the return data is displayed on the display of the mobile terminal so that it can be confirmed whether or not the voice originally uttered toward the transmitter (microphone) of the mobile terminal is correctly recognized. A portable terminal, a host computer, and a communication system therefor. 8. The method according to claim 6, wherein the display of the return data displayed on the display of the mobile terminal and the generation of the synthesized voice generated from the mobile terminal are synchronized with each other. If the synthesized sound generated is not correct due to an error in the return data due to a speech recognition error in the computer, the display of the return data and the generation of the synthesized voice are temporarily stopped by operating a specific input device, and The return data is changed to a specific display to mark an erroneous location, and then a correct utterance is made to the transmitter (microphone) of the portable terminal, and the uttered voice is sent to the host computer via wireless communication. The voice recognition is performed again by using, and the return data of the voice recognition result and the synthesized voice are also returned to the mobile terminal via wireless communication in claim 7. A portable terminal, a host computer, and a communication system therefor, wherein the incorrect return data described above is rewritten to correct return data, displayed on a display of the portable terminal, and a synthetic voice is generated from the portable terminal based on the correct return data. . 9. A communication system according to claim 6, wherein a telephone terminal is used in place of the portable terminal, and a radio signal is transmitted and received between the telephone terminal and the host computer. A telephone terminal, a host computer, and a communication system therefor, wherein signals are exchanged via a wired telephone line without exchanging via a telephone line. 10. The method according to claim 1, wherein the input character is stored in a memory of the portable terminal, and the data stored in the memory is transmitted to an arbitrary destination by wireless communication. A mobile terminal characterized in that it can be transmitted as an e-mail via the Internet. 11. A method according to claim 6, wherein the return data or the synthesized voice returned to the terminal (mobile terminal or telephone terminal) is transmitted to the terminal (portable terminal or telephone terminal). It is stored in a memory, and at least a part of the return data stored in the memory can be displayed again on the display of the terminal, or a synthesized voice can be generated again so that the contents of the memory can be confirmed and corrected. A portable terminal or a telephone terminal, a host computer, and a communication system therefor, wherein the return data stored in the memory can be transmitted as an e-mail to an arbitrary destination. 12. A computer system according to claim 6, wherein the translation software is stored and operated in a memory of the host computer, and a voice input to a terminal (a portable terminal or a telephone terminal) is transmitted. A portable terminal or telephone terminal, a host computer, and a communication system therefor, characterized in that translation into different languages is possible. 13. A terminal according to claim 6, wherein word extraction software and other software are stored and operated in a memory of the host computer, and the terminal (a portable terminal or a telephone terminal) is used. A) a portable terminal or a telephone terminal, a host computer, and a communication system therefor, wherein, when a specific voice command input by voice from (1) is recognized, specific software among the other software is activated. 14. A computer system according to claim 6, wherein at least one piece of known software is stored and operated in a memory of said host computer, and said terminal (portable terminal or telephone terminal) is operated by a host computer. A portable terminal or a telephone terminal, a host computer, and a communication system therefor, which provide at least a part of the capability of the computer. 15. The portable terminal according to claim 1, wherein the portable terminal is a portable telephone, a PHS (PERS).
ONAL HANDY PHONE), PDA (PER
A mobile terminal, which is one of a SONALDIGIAL ASSISTANT, a satellite phone, and a car phone.