JP2002259031A - Portable information terminal device, data input method program, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make a device small and to realize efficient inputting of text. SOLUTION: An input device 140 is provided which is used to select and designates an arbitrary position in a screen displayed on a picture display device 110, and a virtual keyboard is displayed on the picture display device 110, when a user selects and designates a prescribed position in the screen by the input device 140. Meanwhile, one or more character/symbols preliminarily registered by the user are stored in a RAM 122, and registered character/symbol corresponding keys which correspond to preliminarily registered character/symbols stored in the RAM 122 are displayed on the screen display device 110. When the user selects and designates one of registered character/symbol corresponding keys by the input device 140, a preliminarily registered character/symbol corresponding to this selected, and designated registered character/symbol corresponding key is displayed and inputted to the prescribed position.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable information terminal device, a data input method, a program, and a storage medium, and more particularly to a palm-sized portable information terminal device which is difficult to have a normal keyboard, and the portable information terminal device. And a program for causing a computer to execute the data input method, and a storage medium storing the program.

[0002]

2. Description of the Related Art Conventionally, a portable information terminal (Personal Digital Assistant, abbreviated as PDA) has been developed as a palm-sized information device for supporting personal intellectual activities. This portable information terminal is equipped with a liquid crystal image display device and has a schedule book function, a memo book function, a telephone directory function, and the like. As this portable information terminal, Zaurus of Sharp, Palm of the United States, and the like are commercially available.

[0003] Conventional peripheral technologies related to this portable information terminal are described below.

[Optical Device] With the development of optical design / production technology, enlarged projection using a free-form surface prism has been realized, and an optical device that provides a large screen despite its small size has been provided. In addition, by combining such an optical device with a high-definition display device such as a microdisplay, a small-sized display with a wide field of view and high resolution has been obtained. Such technology has been used in head-mounted displays HMD
(Head Mounted Display).

[0005] For example, there is a GT-270 manufactured by Canon Inc.

Further, as a computer system integrating an HMD and a CPU, there is an apparatus disclosed in Japanese Patent Application Laid-Open No. Hei 9-179062 proposed by the present applicant.

[High Definition Display Device] With the development of liquid crystal display (hereinafter referred to as "LCD") technology, a small-sized, high-definition display can be realized. In particular, in LCoS (Liquid Crystal on Silicon) technology for mounting a liquid crystal material on a CMOS backplane,
By applying high-density circuit formation technology in semiconductor manufacturing, high definition and high reaction speed are achieved.

For example, there is a CMD8X6 series of microdisplays manufactured by US CMD.

[Input Device Using Pressure-Sensitive Element or the Like] By using a pressure-sensitive element or the like, slight movement of a finger is detected, and pointing and button clicking in a two-dimensional plane equivalent to a pointing device (mouse) are performed. The input devices to be realized are becoming widespread.

[0010] Such an input device is a notebook PC.
(Personal Computer) is used as an embedded pointing button and an auxiliary button for scrolling a mouse.

[Miniaturized Computer Devices] Due to advances in semiconductor manufacturing technology and semiconductor design technology, it has become possible to realize computer devices that are small, have low power consumption, and have high-performance processing capabilities. Further, many processor products in which functions such as a bus control, a memory control, and a timer that constitute a computer device are incorporated on a single chip have been widely distributed.

[0012] In addition, with the advent of SoC (System on a Chip) technology and the like, it has become possible to realize a function that was conventionally configured by combining a plurality of semiconductor chips including an ASIC portion with a single chip. It is now possible. This has made it possible not only to reduce the volume, but also to reduce power consumption.

The processor core for SoC is ARM
ARM (UK) ARM cores are known.

[Wide Area Wireless Communication Network] PHS (Person
al Handy phone System) and wide-area wireless communication networks such as mobile phones have been developed, and the explosion of mobile phone terminals has made it possible to perform network communications without being restricted by locations. Is coming. Furthermore, with the introduction of the IMT-2000 specification, the communication bandwidth has been dramatically increased.

[0015] In addition, in the i-mode service of NTT DoCoMo and the EZ access of Nippon Mobile Communication Co., there are some restrictions, but it is necessary to access the Internet information service via each wide area wireless communication network. It is possible.

[Mobile Phone Terminal] A terminal for connecting to a mobile phone network, which is a wide area wireless communication network provided by NTT DoCoMo, etc., has achieved a significant reduction in size due to the recent development of mounting technology and the like. .

[0017] In addition, a mobile phone terminal compatible with NTT Docomo's i-mode service and Nippon Mobile Communication Co., Ltd.'s EZ access, etc., has some restrictions, but can use the Internet information service. I have.

Furthermore, these portable telephone terminals are provided with a function of playing individually set melodies when receiving a call. This function is called “ringtone”.
As a melody played by the ringtone function, not only a single tone but also a mobile phone terminal that enables a melody by a chord has appeared.

Further, IMT, a next-generation mobile phone system,
-2000, UIM (User Identit
y Module), which is a specification for mounting a user identification device.

[Low-power wireless communication system] With the technical advancement of a communication frequency control circuit and a radio wave intensity adjustment function, a high-speed communication system with low power consumption has been realized. Such a communication system is being adopted for many information devices such as a mobile phone terminal and a notebook PC (Personal Computer).

A typical example of such a low-power-consumption wireless communication system is Bluetooth. In particular, bluetooth which leads this Bluetooth system
In the ootSIG (Special Interest Group), in order to promote the spread, a combination of protocol stacks is defined as a profile for each application that uses communication, and the interconnectivity between Bluetooth-compliant devices is also ensured. For example, “Dial-up Networking profile” included in the Bluetooth specification defines a communication protocol and a communication procedure when a mobile phone terminal or the like is used as an Internet bridge.

[External Memory Device] Due to advances in semiconductor manufacturing technology and storage circuit systems, the storage capacity of memory devices has made remarkable progress. In particular, in recent years, standardized external memory devices have become available between various information devices, and a large amount of information can be easily exchanged via these external memory devices. It has become

For example, MMC of Multi Media Card Association and Compact Flash of San Disk Inc. may be mentioned.

[Internet Information Service] Various information can be obtained via the Internet. This information includes images and text, video and audio, and the like, and the information is written in HTML (Hy
It can be distributed by a description method called perText Markup Language). Also, ISP
(Internet Service Provider) makes it easy to connect to the Internet via a wide area communication network such as a telephone network.

As such an Internet information service is provided on a wide area communication network spread all over the world, a large amount of information has been provided to terminal terminals in real time.

The i-mode provided by NTT DoCoMo, Inc.
By adopting a subset of HTML called compact HTML, it is possible to use the Internet information service even with a mobile phone terminal having various hardware restrictions compared to a PC or the like.

[Small and large-capacity batteries] With the advent of lithium ion batteries and lithium polymer batteries, high power density
In other words, small-sized but large-capacity batteries can be used. This makes it possible to use portable equipment continuously for a long time.

[Software Keyboard Function] For inputting a text in an information device having no actual keyboard, or as an auxiliary text input means even in a device having an actual keyboard, a virtual keyboard similar to the keyboard is displayed on the screen. There is a method of executing text input by displaying a typical keyboard (software keyboard) and selecting a key on the virtual keyboard with a pointing device or the like. Older US Ap
It is implemented in a Macintosh computer from Ple. Recently, it has been implemented in many PDA terminals.

For more efficient text input, the input history is referred to the input history, and a desired phrase is selected from the input history. An ambiguous input method of displaying words in a dictionary corresponding to an input word and selecting a desired word from the words has been proposed. For example, as an ambiguous input method, there is a T9 text input method of Tesic Communications Inc. of the United States, etc., which has been introduced in mobile phones and PDAs.

[Biometrics Applied Technology] It is known that biometrics (biologically dependent information) represented by an iris and a fingerprint of an eyeball can be used as key information for personal authentication. Then, input devices for easily capturing such information and applying it to information processing have become available.

For example, US Sensor Company (Sensar, I.)
nc. ) Provides a highly accurate identity authentication technology based on iris information. In this technique, a standard video camera is used to photograph the iris of the eyeball from a distance of about one meter, and based on this, the image information of the iris is extracted and coded, and
The data is compressed to 56 bytes and used as an identification code.

Further, NEC Corporation has developed a fingerprint authentication module, and has sold the module after miniaturizing it by mounting the module on a PC card having a PCMCIA interface.

By utilizing the various peripheral technologies described above, the portable information terminal can be provided with a communication function, become multifunctional, and be reduced in size and portability.

[0034]

However, in such a conventional portable information terminal, further miniaturization and portability are required. In order to respond to such demands, the actual keyboard implementation will be stopped and text input will be performed using a software keyboard (the keyboard displayed on the screen described above), but the input operation in such a case will become complicated As a result, there is a problem that efficient text input cannot be performed.

The present invention has been made in view of the above-mentioned problems, and a portable information terminal device, a data input method, a program, and the like, which achieve further reduction in size and realize efficient text input. And a storage medium.

[0036]

According to the first aspect of the present invention, a portable information terminal device having a screen display unit and a storage unit is displayed on the screen display unit. Operating means for selecting and specifying an arbitrary position on the screen, and first display means for displaying a virtual keyboard on the screen display unit when the user selects and specifies a predetermined position on the screen by the operating means. Storage means for storing at least one character symbol pre-registered by the user in the storage unit, and a registered character code correspondence key corresponding to at least one pre-registered character symbol stored in the storage unit, on the screen. A second display means for displaying the registration text when the user selects and designates one of the registered character / symbol corresponding keys by the operation means. Wherein the pre-registered character symbol corresponding to the symbol corresponding keys and a display input unit that displays input to the predetermined position.

According to the seventh aspect of the present invention, the portable information terminal device further includes an authentication unit for performing user authentication, and the display input unit allows the user to operate the registered character / symbol using the operation unit. When one of the keys is selected and designated, if a predetermined condition is satisfied, the authentication means is made to perform the personal authentication of the user. If the user is authenticated, the authentication means corresponds to the selected registered character code corresponding key. A pre-registered character symbol to be displayed is input at the predetermined position.

According to the nineteenth aspect of the present invention, a portable device including a screen display unit, a storage unit, and an operation means for selecting and specifying an arbitrary position on a screen displayed on the screen display unit. A data input method applied to the information terminal device, wherein a first display step of displaying a virtual keyboard on the screen display unit when the user selects and designates a predetermined position on the screen by the operation means; A storing step of storing at least one pre-registered character symbol in the storage unit, and displaying a registered character code corresponding key corresponding to at least one pre-registered character symbol stored in the storage unit on the screen display unit. A second display step of: when the user selects and designates one of the registered character / symbol corresponding keys by the operation means,
A display input step of displaying and inputting a pre-registered character symbol corresponding to the selected and specified registered character / symbol corresponding key at the predetermined position.

Further, according to the invention of claim 33, a portable device comprising a screen display unit, a storage unit, and an operation means for selecting and specifying an arbitrary position on the screen displayed on the screen display unit. The data input method applied to the information terminal device, in a program for causing a computer to execute, the data input method, when the user selects and specifies a predetermined position on the screen by the operating means,
A first display step of displaying a virtual keyboard on the screen display unit, a storage step of storing at least one character symbol pre-registered by a user in the storage unit, and at least one of a plurality of character symbols stored in the storage unit. A second display step of displaying registered character / symbol corresponding keys respectively corresponding to pre-registered character / symbols on the screen display unit;
And displaying and inputting a pre-registered character symbol corresponding to the selected and specified registered character / symbol corresponding key at the predetermined position when one is selected and specified.

Further, according to the invention of claim 47,
A data input method applied to a portable information terminal device including a screen display unit, a storage unit, and an operation unit for selecting and specifying an arbitrary position on the screen displayed on the screen display unit is stored as a program. A first display step in which, in a storage medium readable by a computer, the data input method displays a virtual keyboard on the screen display unit when a user selects and specifies a predetermined position on the screen by the operation means. Storing at least one character symbol pre-registered by the user in the storage unit; and a registered character code corresponding key corresponding to at least one pre-registered character symbol stored in the storage unit, on the screen. A second display step of displaying on the display unit, wherein the user operates the operation unit to input the registered character / symbol pair. When one of the key selected and designated,
A display input step of displaying and inputting a pre-registered character symbol corresponding to the selected and specified registered character / symbol corresponding key at the predetermined position.

[0041]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) In the first embodiment, by using a portable information terminal device in combination with a portable telephone terminal, a WWW (World Wide Web) on the Internet via a portable telephone network is used. A description will be given of an operation example of connecting to a server (hereinafter, referred to as “Web server”) and displaying the Web server page information obtained from the server on the portable information terminal device.

Particularly, an example in which a text input box is included in the displayed page information, and when the user selects the text input box, a software keyboard function is activated to enable appropriate text input. explain.

FIG. 1 is an external view showing a first embodiment of the portable information terminal device according to the present invention. (A) is a perspective view of the portable information terminal device, (B) is a front view, and (C) is a diagram illustrating a state in which the portable information terminal device is grasped with a hand.

FIG. 1B shows the front of the portable information terminal device.
The window 1 is located on the eyepiece side of a free-form surface prism described later. The user can magnify and view a screen of a small liquid crystal display, which will be described later, by grasping the portable information terminal device with his hand and bringing his / her eyes close to the window 1 and looking into the window. Since the portable information terminal device uses a battery as a power source and has a wireless communication function, a user can carry the portable information terminal device and view necessary information.

As shown in FIG. 1, an operation button 2 is mounted on the upper left when viewed from the front, and the user operates the operation button 2 to obtain desired information.

FIG. 2 is a sectional view showing the internal arrangement of the portable information terminal device.

In the figure, 112 is a small liquid crystal display for displaying information, and 113 is a small liquid crystal display 11
Reference numeral 111 denotes a free-form surface prism for enlarging the screen of the small liquid crystal display 112. These small liquid crystal displays 112,
The backlight 113 and the free-form surface prism 111 constitute an enlargement display device 110.

Reference numeral 3 denotes a housing of the portable information terminal, and reference numeral 4 denotes a main board for sending a drive signal to the small liquid crystal display 112.

FIG. 3 is a diagram showing an optical path in the free-form surface prism 111.

The free-form surface prism 111 has three optically active surfaces 111a to 111c. In the vicinity of the working surface 111c farthest from the observer, a small liquid crystal display 112 and a backlight 113 are arranged, and they are adjusted to positions that give an appropriate display to the observer. The light from the backlight 113 passes through the small liquid crystal display 112 and the working surfaces 111 c and 111 c
a, 111b to reach the observer.

By using the free-form surface prism 111, a magnifying optical system for enlarging and displaying an image output can be realized with a compact size.

In this embodiment, a transmission type liquid crystal display element is used as the small liquid crystal display 112.
Instead, a reflective liquid crystal display element may be used to adjust the position of the free-form surface prism, the backlight, and the like appropriately.

FIG. 4 is a block diagram showing an electric circuit mounted on the portable information terminal device.

The portable information terminal device includes an enlarged display device 110 including a small liquid crystal display (LCD) 112 and a backlight 113, a small computer device 120 integrated by SoC technology, and a bluetooth.
th compliant communication device 130 with low power consumption, an input device 140 that realizes pointing and button click in a two-dimensional plane equivalent to a pointing device (mouse) by combining a pressure sensitive element and a tact switch, and LED device 150 capable of realizing a plurality of display states by flashing and blinking, and a power supply device 160 composed of a lithium ion secondary battery or the like, which are mounted in a portable information terminal device small enough to fit in a hand. are doing.

Then, this portable information terminal device transmits information obtained from the network via the communication device 130,
It is processed by the computing device 120 and operates to provide the user via the magnifying display device 110.

The inside of the computer device 120 includes a CPU 1 for executing various processes according to programs described later.
21, a RAM 122 serving as a memory for storing programs and holding intermediate results of processing, and a ROM for storing software such as programs and data.
123, a display control circuit 124 for controlling the small liquid crystal display 112 and the backlight 113 so as to reflect the execution result of the program, a CPU 121 and a RAM 12
2, a bus 125 serving as a data communication path, a communication control circuit 126 controlling the communication device 130, an input control circuit 127 controlling the input device 140, an LED control circuit 128 controlling the LED device 150, And a power supply control circuit 129 for controlling the power supply device 160 for control and the like. In this, RAM12
2. ROM 123, display control circuit 124, bus 125
Is connected to the CPU 121 via the. Communication control circuit 12
6. The input control circuit 127, the LED control circuit 128, and the power supply control circuit 129 are connected to the CP via the I / O port.
Connected to U121. And these circuits are SoC
It is compactly mounted on one semiconductor chip by technology.

The ROM 123 of this configuration includes a non-rewritable storage device such as a mask ROM, and a repeatedly rewritable storage device such as a flash ROM.

FIG. 5 is a diagram showing a connection form between the portable information terminal device and the network.

A plurality of Web servers 400 exist on a network such as the Internet. The portable information terminal device 100 according to the present embodiment
The mobile phone terminal 200 is connected to the mobile phone terminal 200 via the mobile phone line network.
Connect to 0.

The mobile phone terminal 200 has a Bluetooth communication function in addition to a function of connecting to a mobile phone network.

Although the mobile telephone network is actually composed of a plurality of radio base stations and switching equipment, a detailed description of the mobile telephone network will be omitted for the sake of simplicity.

A router 300 intervenes to enter the network from the mobile telephone network. Router 300
Is often referred to as an ISP (Internet Service Provide)
r), and acts as a bridge from the mobile phone network to the network.

W issued from portable information terminal device 100
The request for the web page information is sent to the corresponding web server 4
00, and if this is accepted, the Web server 4
From 00, the Web page information is returned to the portable information terminal device 100. Further, the portable information terminal device 100 analyzes and displays the received Web page information.

In the Bluetooth communication from the portable information terminal device 100 to the portable telephone terminal 200, Dial-u
Communication is performed according to the p Networking profile and the serial port profile.

Also, a plurality of Web sites are provided on the network.
The browser 500 is connected, and similarly, the Web server 40
0, and displays the page information stored therein.

Note that the Web server 400 and the Web server
The browser 500 is a server and a browser that implement the widely used Web technology, and the page information stored therein is described in HTML or the like, and includes link information described as a URL. The link information is
It is easy to access another page information from the Web browser 500 or the like. This other page information,
It may be held on the same Web server, or may be held on a different Web server.

In addition to the data communication function, the portable telephone terminal 200 has a general communication function that is widely used. In the present embodiment, the data communication function and the blue
The portable information terminal device 10 using the tooth communication function
The description is limited to the function of relaying the connection from 0 to the Web server 400 only.

That is, in a state where the connection between the portable telephone terminal 200 and the portable information terminal device 100 is established by the Bluetooth communication, the portable information terminal device 1
00, the dial-up function implemented in
The mobile telephone terminal 20 dials the SP telephone number.
Request 0. In accordance with this, the mobile phone terminal 200 establishes a link between the mobile phone terminal 200 and the ISP in the mobile phone network. Further, the portable information terminal device 1
00, a virtual communication path is established between the portable information terminal device 100 and the router 300 operated by the ISP. In this manner, the mobile phone terminal 200 plays a role of relaying the connection from the mobile information terminal device 100 to the Web server 400.

The network shown in FIG. 5 may be an intranet operated in a company or an organization, or may be the Internet connecting the world widely.

FIG. 6 shows HTTP (HyperText Transfer) which is the most general communication protocol used when a Web browser requests Web page information from a Web server.
FIG. 3 is a diagram showing an example of a communication sequence according to (Protocol).

In the HTTP procedure, first, the Web browser establishes a connection with the Web server (HTTP
nect), and then HTTPr from a web browser
A request for data in the request format is issued to the Web server. Then, the Web server that has received the request analyzes the contents of the request, and sends back a response in HTTP response format. Finally, the communication is closed (HTTP
close), one HTTP session ends.

The contents of the HTTP response format will be described below.

The first line in the HTTP response format is defined as a status line (RFC 261).
6 "HTTP 1.1 version"). Here, an HTTP version, a status code, and a reason sentence are arranged separated by a blank character. In particular, the status code, which is the second item, consists of three numbers, and HTTPrespons
Used to classify e-format content. For example, HT
In the TP1.1 version, the following status codes are defined respectively.

The status codes are roughly classified into five categories according to the number of the first character. That is, those starting with 1 notify HTTP connection information, those starting with 2 notify success of HTTP connection, those starting with 3 notify redirection of HTTP connection, and those starting with 4 indicate client connection. Signals a server-side error, and those that begin with a 5 signal a server-side error.

100: Continue 101: Switching Protocols 200: OK 201: Created 202: Accepted 203: Non-Authoritative Information 204: No Content 205: Reset Content 206: Partial Content 300: Multiple Choices 301: Moved Permanently 302: Found 303: See Other 304: Not Modified 305: Use Proxy 307: Temporary Redirect 400: Bad Request 401: Unauthorized 402: Payment Required 403: Forbidden 404: Not Found 405: Method Not Allowed 406: Not Acceptable 407: Proxy Authentication Required 408: Request Time -out 409: Conflict 410: Gone 411: Length Required 412: Precondition Failed 413: Request Entity Too Large 414: Request-URI Too Large 415: Unsupported Media Type 416: Requested range not satisfiable 417: Expectation Failed 500: Internal Server Error 501: Not Implemented 502: Bad Gateway 503: Service Unavailable 504: Gateway Time-out 505: HTTP Version not supported FIG. 7 is a flowchart showing a procedure of the operation of the portable information terminal device 100.

A program describing this operation processing is stored in the ROM 123 shown in FIG.
121. With this execution, the input control circuit 127, the display control circuit 124, the communication control circuit 126, and the like are activated as necessary.

First, step S at the start of the program
At 1001, the setting information is read. Subsequent processing contents are determined based on this setting information. The contents of the setting information are stored in the ROM 123. Typical setting information is fixedly stored in the ROM 123 together with a program or the like. However, some setting information is set and changed by the user and stored in another area of the ROM 123.

Next, in step S1002, an instruction from the user is waited. The standby target here is typically
This is an input signal from the input device 140, but may be an arrival of communication data from the communication device 130.

Then, in step S1003, an instruction or the like from the user is received.

In step S1004, it is determined whether or not the received instruction is for instructing the end of the program. If the instruction indicates termination, the program is terminated. On the other hand, if the termination has not been instructed, the process proceeds to step S1005.

In step S1005, a process corresponding to the content of the instruction is executed, and thereafter, the process returns to step S1002 to wait for the next instruction. The processing program executed in step S1005 is also stored in the ROM 12
3 is executed by the CPU 121.

FIG. 8 is a flowchart showing a procedure of a Web access process executed in portable information terminal device 100. The program describing this processing is called from step S1005 in FIG. 7 in response to an instruction from the user, and has a Web access function,
A function of acquiring and displaying Web page information from an Web server is realized.

The instruction from the user is, for example, a case where the user inputs a click signal from the input device 140 when the pointing cursor on the display screen is at the anchor position (link information display position). This is a case where URL data of Web page information to be acquired is directly input.

First, in step S2000, the magnifying display device 110 is switched to the low power consumption mode. For example, a backlight 113 and a small liquid crystal display 112
Stop supplying power to

Next, in step S2001, the designated URL is obtained. The URL may be instructed directly by the user or by selecting an anchor. In the latter case, the anchor selected by the user is specified from the position information of the click, and the link information included therein is acquired.

Subsequently, in step S2002, the obtained URL is analyzed. According to this analysis, the We to be connected
b Determine server and protocol.

Subsequently, in step S2003, it is determined whether or not the designated URL is a URL corresponding to data existing in the portable information terminal device 100 itself. As a result of the determination, if it is present in the own device, step S200
The process proceeds to step S2004, and if not, the process proceeds to step S2004.

This determination is made when the URL instruction directly refers to data in the own device or when external data is referenced but the data is cached in a history file or a storage file. Is also taken into account.

In step S2004, since the designated page information does not exist in the own device, the designated Web server sends the UR to the designated Web server in order to obtain necessary Web page information.
Connect with the protocol indicated by L.

Here, the HTTP protocol is typically used, but an FTP (File Transfer Protocol) protocol or the like may be specified. When the specification of the protocol is omitted, the HTTP protocol is used.

Then, in step S2005, the Web server specified by the URL from the connection destination Web server
The web page information is acquired, and the process proceeds to step S2007.
Specifically, it requests the Web server for the data specified by the URL, and then waits for a response from the Web server, and acquires desired Web page information.

On the other hand, in step S2006, since the designated page information exists in the own device, necessary Web page information is obtained from the own device, and the process proceeds to step S2007.

In the next step S2007, the acquired W
Analyze web page information. Specifically, the content described in the HTML format or the like is read, and an image or other multimedia information embedded in the content or an anchor (link information) is detected, and then the logical structure of the page information is determined.

Subsequently, in step S2008, the magnifying display device 110 is switched to the normal mode. That is, the backlight 113 and the small liquid crystal display 1
If the power supply to the power supply 12 has been stopped, the power supply is restarted.

Then, in step S2009, the analyzed Web page information is displayed on the small liquid crystal display 112. Specifically, the acquired Web page information is laid out in an appropriate arrangement based on various embedded information and the logical structure of the analysis result. Then, the layout result is reflected on the screen of the small liquid crystal display 112.

Then, in step S2010, the user is notified of the completion of the access to the Web page information. Here, the user is notified by using the ringtone function of the mobile phone terminal 200 that is the communication partner. Specifically, the portable information terminal device 100 transmits the serial port pr of Bluetooth communication.
Using the ofile specification, it is directly connected to the mobile phone terminal 200, receives appropriate melody data in accordance with a predetermined ringtone function interface, and instructs execution of the melody. Typically, HTTPre
A melody performance that can identify the status is designated for each status code in the sponse format.

After that, in order to wait for the next instruction from the user, this processing ends, and the flow returns to step S1002 in FIG.

FIG. 9 is a view showing a Web screen displayed on the small liquid crystal display 112 by the Web access processing shown in FIG.
FIG. 4 is a diagram illustrating an example of page information. Here, the URL data “http://www.xyznews.com”
/ Jp / ”indicates Web page information displayed as a result of directly inputting.

This Web page information is electrically transmitted from the display control circuit 124 to the small liquid crystal display 112, and the display image formed on the small liquid crystal display 112 is optically transmitted by the light from the backlight 113. The transmitted light passes through the optically magnifying action of the free-form surface prism 111 to form an image at the observer position.

Note that the ringtone function interface of the portable telephone terminal 200 in the present embodiment receives appropriate melody data from the portable information terminal device 100 via a Bluetooth communication device provided in the portable telephone terminal 200, and transmits the melody data. , Mobile phone terminal 20
0 to the built-in tone generator. At this time, data communication between the portable information terminal device 100 and the portable telephone terminal 200 is performed by serial communication in Bluetooth communication.
It is performed according to the ort profile specification.

FIG. 10 is a flowchart showing the procedure of the setting process executed in portable information terminal device 100. The program describing this processing is called from step S1005 in FIG. 7 in response to an instruction from the user, and realizes a function of setting values designated by the user to various setting items of the portable information terminal device 100. Specifically, the designation by the user is, for example, a case where a setting function is selected from a menu item on the display screen and the designation is performed by this function, or a case where the user directly inputs.

First, in step S3001, the current setting value of portable information terminal device 100 is displayed on small liquid crystal display 112, and a setting session is started. Figure 1
FIG. 1 is a diagram showing an example of set values displayed on the small liquid crystal display 112.

Subsequently, in step S3002, the system waits for a user input on the setting screen.

In step S3003, a user input is determined. If the user input is a setting end command, the process advances to step S3004. The setting end instruction is one of “submit” and “cancel”. On the other hand, if the command is not the setting end command, step S
Proceed to 3007.

In step S3004, the setting end instruction is “submit” or “cancel”.
Is determined. If the former, step S
Proceeding to 3005, the processing is terminated after the held data of the setting content during the setting session is reflected on the portable information terminal device 100. Here, the setting contents are stored in the portable information terminal device 100.
The process of reflecting the setting contents includes storing the setting contents in the ROM 123.

On the other hand, if “cancel” is instructed, the flow advances to step S3006 to discard the contents of the set session and end the processing.

If it is determined in step S3003 that the received instruction is not a setting end command, the flow advances to step S3007 to proceed to step S3007.
The setting contents received by the user input are reflected on the data held in the setting session and on the screen.

Then, the flow returns to step S3002 to wait for the next user input.

FIG. 12 is a flowchart showing a procedure of a software keyboard process executed in portable information terminal device 100. The program describing this processing is executed in step S100 of FIG. 7 in response to an instruction from the user.
5, which realizes a text input function that allows text input using a software keyboard displayed on the screen.

Specifically, the instruction from the user is, for example, when the pointing cursor on the display screen is located at the position of a text input box (such as an element having a TEXT type INPUT tag described in HTML), an input device by the user. When a click signal is input from 140, when URL data of Web page information to be acquired is directly input, or when a text input area is selected on the setting screen.

First, in step S4001, context information representing the current environment and situation is obtained. When a software keyboard process is activated by clicking on a text input element (text input box) described on a page described in HTML or the like, this context information is displayed as a text input element on the page information. It consists of position information, page identification information such as a URL, and tag information such as an HTML description assigned to elements in the page. When text data is already stored in the context information, for example, when the text input box already stores a value, the value is copied to a text variable of the text input session and the text variable is initialized. If the text input box contains nothing, initialize the text variable with an empty string.

Next, in step S4002, a virtual keyboard similar to a keyboard (hereinafter referred to as a "software keyboard") is displayed on the small liquid crystal display 112, and a text input session is started. This software keyboard includes keys for inputting a plurality of words (phrases) registered in advance, in addition to keys for character input included in a normal keyboard.

Pre-registered phrases are phrases that are expected to be frequently input, and are registered in advance and can be input only by operating the corresponding key when inputting those phrases. To complete. The pre-registered words are, for example, a user's name, address, telephone number, login account, mail address, and the like. In addition, the attribute of the security level is also registered in the pre-registered phrase, and a phrase having a high security level (for example, a bank account number, a password, and the like) cannot be used for input by anyone other than a legitimate user as described later. To FIG. 13 shows an example of a pre-registered word. FIG. 14 shows a screen on which the software keyboard including the input key of the pre-registered word is displayed on the small liquid crystal display 112.

Next, in step S4003, an instruction from the user by selecting and specifying (pointing) any key on the software keyboard is received.

Subsequently, in step S4004, it is determined whether or not the received instruction is an instruction to end text input using the software keyboard. If it is an input end command, step S4005
If it is not the input end command, the process proceeds to step S400.
Proceed to 8. Here, the input end command is the key “submit” or the key “cancel” on the screen shown in FIG.
Is an instruction instructed by pointing.

In step S4005, the input end instruction is “submit” or “canmit”.
cel ”. If it is the former, the process proceeds to step S4006, where the text data value of the text variable during the text input session is reflected in the context in which the software keyboard is activated, and the process ends. Here, the process of reflecting the text data value in the context includes displaying the text data in an appropriate part of the currently displayed page information.

On the other hand, if the input end command is “cancel”, the flow advances to step S4007 to discard the contents of the text input session, and ends the processing.

If it is determined in step S4004 that the received instruction is other than the input end instruction, the flow advances to step S4008 to process a text variable of the text input session according to the instruction. This process is typically the addition of a character string to a text variable, but may be an editing operation such as changing the editing position or deleting a character in the text variable. In addition of a character string, a desired character is selected and input by operating a software keyboard, and a pre-registered word can be easily input by operating a key corresponding to the pre-registered word.

However, in the process of step S4008, the instruction received in step S4003 is an operation of adding a pre-registered word to a text variable, and
If the security level (degree of confidentiality) of the registered word is higher than a predetermined value (for example, 4), an authentication procedure described later with reference to FIG. 15 is requested, and it is determined whether an additional operation should be performed. . Then, only when the user is authenticated, the registration word is input. As shown in FIG. 14, a registered word having a higher security level than a predetermined value has a key image icon set in advance as a key, and is distinguished from other words as a registered word having a higher security level.

Then, the flow returns to step S4003 to receive the next instruction.

In pointing a key on the software keyboard, a normal pointing cursor (corresponding to a mouse cursor) is not displayed, and only the key of interest is displayed by blinking to indicate the key being pointed. Then, when the user operates the input device 140 to move the key to be pointed, the key to be pointed is skipped in accordance with the amount of operation movement. That is,
Instead of using the pointing cursor to select points, selection is made in units of keys (or buttons).

Thus, the user can easily point any key on the software keyboard.

FIG. 15 is a flowchart showing an authentication procedure which is a part of the procedure of the software keyboard processing executed in portable information terminal apparatus 100. A program describing this processing is stored in step S4003 in FIG.
If the instruction received in step 2 is an operation to add a pre-registered word to a text variable and the security level of the registered word is higher than a predetermined value (on the software keyboard, the icon of the key image This is called from step S4008 in FIG. 12 when the key is set in advance), and realizes an authentication function prior to input of a pre-registered word.

First, in step S5001, a software keyboard similar to the software keyboard shown in FIG. 14 is displayed on the small liquid crystal display 112, and an authentication session is started. The software keyboard displayed here is, for example, as shown in FIG. 16, excluding the input key of the pre-registered word. At this time, the authentication code variable held in the authentication session is emptied and initialized.

Next, in step S5002, an instruction from the user represented by pointing any key on the software keyboard is received.

Subsequently, in step S5003, it is determined whether or not the received instruction is an instruction to end input of the authentication code using the software keyboard. If it is an input end command, step S50
04, if not an input end command, step S5
Proceed to 007. Here, the input end instruction is the key “submit” or the key “cancel” on the screen shown in FIG.
"1" is an instruction designated by pointing.

In step S5004, the input end instruction is “submit” or “cancel”.
l ”. If it is the former, the process proceeds to step S5005, where the value of the authentication code variable during the authentication session is compared with the pre-registered authentication password, the comparison result is output as the authentication result, and the process ends. On the other hand, if the input end command is “cancel”, the process advances to step S5006 to discard the contents of the authentication session, output an authentication result indicating “authentication failed”, and end the process.

If it is determined in step S5003 that the received instruction is other than the authentication code input end instruction, the flow advances to step S5007 to process the authentication code variable of the authentication session in accordance with the instruction.
The process of step S5007 is typically the addition of a character to the authentication code variable, but may be an editing operation such as the deletion of a character. To add a character to the authentication code variable, the user's password is entered using a software keyboard.

Then, the flow returns to step S5002 to receive the next instruction.

As described above, the portable information terminal device according to the present embodiment, which is so small that it can be put in the hand, can be used in combination with the portable telephone terminal 200 to be connected to the portable telephone line network. Web server 4 on the Internet
00, and the obtained Web page information can be displayed on a large screen and operated.

In particular, text input into a text input box included in Web page information (TEXT type INP
For example, the selection of an element having a UT tag or the direct input of a URL) makes it possible to use a software keyboard function to input text on a small device that is difficult to have an actual keyboard.

Furthermore, in this software keyboard function, a key (or button) is not selected by using a normal pointing device on the screen, but by a skip movement in units of keys (or buttons) represented on the software keyboard. ) Enables fast and accurate text input.

In the software keyboard function of the present embodiment, in addition to ordinary keys, words that are expected to be frequently input are registered in advance, and only keys corresponding to these words are selected. An interface that allows the user to input such words and phrases enables the user to input text more easily for specific words that are frequently input.

In addition, the security level is also registered in the pre-registration of the pre-registered words described above, and the input of words having a high security level is selected and designated by operating a key corresponding to the pre-registered words. Even if the user is authenticated,
Enables the user to enter the phrase. Thereby, it is possible to prevent a pre-registered word from being used by others in an indiscriminate manner, and high security can be ensured. Together,
It also has the efficiency of being able to input a frequently input word by selecting one of the corresponding keys, thereby realizing the compatibility between the conflicting features of high security and high efficiency.

In the present embodiment, the value of the text variable of the text input session is initialized using the context information at the time of activating the software keyboard function, but the context information is also used. It is possible.

For example, the display position of the software keyboard can be controlled using the display position information of the text input box included in the context information, and the text input box can be displayed so as not to be hidden by the software keyboard. Conversely, a software keyboard can be displayed to cover the text entry box.

The URL included in the context information
Using the page identification information, tag information, and the like, the relevance between these and the pre-registered words is calculated. It may be displayed preferentially on a screen on which a software keyboard including input keys for registered words is displayed, so that selection can be made efficiently. further,
If the calculated relevance is larger than a certain value, prior to displaying the software keyboard, arrange highly relevant words and display a dialog screen that allows the user to select directly. Is also good.

In this embodiment, the keys corresponding to the words registered in advance are displayed at the lower part of the software keyboard as shown in FIG. 14, but only the software keyboard is used instead. It is also possible to prepare a screen to show and a screen to show each key corresponding to the pre-registered word, and switch between the screens by operating a predetermined button. At this time, the predetermined button may be a software button displayed on a part of the software keyboard, or a hardware switch of the portable information terminal device 100 to which an equivalent function is assigned. Good.

Also, in the present embodiment, a registered word having a high security level requiring personal authentication is distinguished from other registered words by using a key image icon as a key corresponding to the registered word. But not necessarily
There is no need to display an icon for distinction on the display screen. Further, when the registered words are divided into two according to the security level, the registered words are divided into three or more according to the security level, and different security management is performed for the registered words in each division. You may.

Further, in the present embodiment, the character string in the "display" column shown in FIG. 13 is displayed on the key corresponding to the pre-registered word shown in FIG. Instead, an appropriate icon image may be displayed on the corresponding key.

Further, in the present embodiment, since the present invention is applied to a small portable information terminal device using the free-form surface prism 111, the software keyboard can be seen only by the user and cannot be seen by others. No, but normal C
When the present invention is applied to a device using an RT or a liquid crystal screen, it is necessary to devise a display method for displaying words with a high security level so as to avoid leakage to others. Specifically, it is conceivable to use a translucent color to display the relevant phrase portion or to display the relevant phrase portion by painting it out. Alternatively, similar to the display performed when entering a password on a personal computer,
Replace the characters in the relevant phrase with "*" (star) to display.

(Second Embodiment) Next, a second embodiment will be described.

In the second embodiment, an authentication session using biometrics is introduced.

That is, in the first embodiment, words having a high security level among words registered in advance are:
When the phrase is selected and specified as a word to be input, an authentication session is generated, and a user's password is input using a software keyboard to perform authentication. In this method, even if the words and phrases are pre-registered and the trouble of inputting the words and phrases is reduced, the trouble of inputting the password remains. Therefore, in the second embodiment, an authentication session using biometrics is introduced to reduce the operation of inputting a password.
Realize more efficient and safe word input. In particular, the present embodiment employs an authentication session using iris information.

The configuration of the second embodiment is basically similar to that of the first embodiment.
This is the same as the configuration of the embodiment. Therefore, in the description of the second embodiment, the configuration of the first embodiment will be used, and only different parts will be described.

The second embodiment differs from the first embodiment in that it includes a new image pickup optical system and differs from an electric circuit and an authentication procedure which is a part of a procedure of software keyboard processing.

FIG. 17 is a diagram showing a configuration of an image pickup optical system according to the second embodiment. Here, the same portions as those in the configuration of the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.

In the second embodiment, the imaging optical system 171 and the imaging device 17 are provided around the free-form surface prism 111.
2. An infrared light source 173 is arranged, and these constitute an imaging optical system for inputting iris information.

The infrared light source 173 is a light source for illuminating an observer's eyes to obtain an iris image, and is composed of a light emitting diode or the like which emits infrared light having low visual sensitivity for the observer.

The imaging optical system 171 is an optical system for collecting the infrared light reflected by the iris of the observer to the imaging device 172, and the optically operating surface 111 of the free-form surface prism 111
It is designed to cancel (cancel) the effect of a.

The imaging device 172 is an image sensor for acquiring iris image data, and is composed of a CMOS sensor device or the like.

FIG. 18 is a block diagram showing an electric circuit mounted on the portable information terminal device according to the second embodiment. Here, the same portions as those in the configuration of the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.

In the second embodiment, the imaging device 1 is different from the electric circuit in the first embodiment shown in FIG.
72, an infrared light source 173, and an imaging control circuit 175 for controlling them are newly added.

The imaging control circuit 175 includes the input control circuit 12
7 and the like, it is connected to the CPU 121 via an I / O port, and turns on / off the infrared light source 173 and transfers image data captured from the imaging device 172 according to a control signal from the CPU 121.

FIG. 19 is a flowchart showing an authentication procedure which is a part of the procedure of the software keyboard process executed in portable information terminal apparatus 100 according to the second embodiment. The program describing this processing is stored in the same manner as in the first embodiment in step S4003 in FIG.
If the instruction received in step 2 is an operation to add a pre-registered word to a text variable and the security level of the registered word is higher than a predetermined value (on the software keyboard, the icon of the key image This is called from step S4008 in FIG. 12 when the key is set in advance), and realizes an authentication function prior to input of a pre-registered word.

First, in step S6001, an electric power is supplied to the infrared light source 173 and the imaging device 172, and the imaging control circuit 175 is instructed to start preparation for imaging.

Next, in step S6002, the infrared light source 1
After the image signal 73 is stabilized, the image capturing control circuit 175 is instructed to transfer the image data captured by the image capturing device 172 to the RAM 122. The RAM 122 is provided with a predetermined storage area for storing an authentication image variable, and the image data is stored in the predetermined storage area.

In step S6003, an instruction is given to the imaging control circuit 175 to stop supplying power to the infrared light source 173 and the imaging device 172.

Then, in step S6004, the RAM 1
The authentication image variables stored in 22 are analyzed, and a partial image corresponding to the iris is extracted and encoded. The authentication iris code variable thus obtained is stored in another predetermined storage area of the RAM 122. For the encoding at this time, for example, the above-described identity authentication technology provided by the sensor company is used.

In step S6005, the value of the iris code variable for authentication is compared with the iris code for personal authentication registered in advance, and the comparison result is output as an authentication result.
This processing ends.

As described above, in the second embodiment, by using biometrics information, in particular, an iris pattern for personal authentication, the trouble of inputting a password for authentication is relieved.

In the present embodiment, illumination is performed using an infrared light source to obtain an iris image, but a visible light source may be used instead. When a visible light source is used, iris color information and the like can be used for authentication in addition to iris pattern information.

Further, in the present embodiment, iris information is used as biometrics information, but instead, authentication may be performed using fingerprint information or voiceprint information.

Further, in the present embodiment, the personal authentication is performed using the authentication means built in the portable information terminal device. Instead, the portable information terminal device communicates with the external authentication device. Personal authentication may be performed. In this case, examples of the external authentication device include a secure IC card terminal, a mobile phone terminal having a built-in UIM (User Identity Module), and the like. Also, the communication in this case is
Even with a wired connection such as USB, Bluetooth
Wireless communication such as

Further, the personal authentication means is not performed by a single method as in the present embodiment, but by using the biometrics described so far, using an external authentication device, and performing password authentication using a software keyboard. May be used in combination. Furthermore, these may be properly used according to the security level of the words registered in advance.

A storage medium storing program codes of software for realizing the functions of the above-described embodiments is supplied to a system or an apparatus, and the computer (or CPU or MPU) of the system or the apparatus stores the storage medium in the storage medium. It goes without saying that the present invention is also achieved by reading and executing the stored program code.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. .

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, magnetic tape, nonvolatile memory card, ROM,
Alternatively, a server computer or the like connected to a communicable network can be used.

When the computer executes the readout program codes, not only the functions of the above-described embodiments are realized, but also an OS or the like running on the computer based on the instructions of the program codes. Performs some or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.
Needless to say, this is included in the present invention.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instruction of the program code, It is needless to say that the present invention includes a case where the CPU or the like provided in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments. No.

[0172]

As described in detail above, claims 1 and 1
9. According to the invention of claim 33 or claim 47,
An operation unit for selecting and specifying an arbitrary position on the screen displayed on the screen display unit, and when the user selects and specifies a predetermined position on the screen by the operation unit, a virtual keyboard is displayed on the screen display unit. indicate. On the other hand, at least one character symbol pre-registered by the user is stored in the storage unit, and a registered character code corresponding key corresponding to at least one pre-registered character symbol stored in the storage unit is displayed on the screen display unit. I do. And
When the user selects and designates one of the registered character / symbol corresponding keys by the operation means, a pre-registered character / symbol corresponding to the selected / designated registered character / symbol corresponding key is displayed and input at the predetermined position.

With such a virtual keyboard, the size of the portable information terminal device can be further reduced, and an efficient text input can be realized by the registered character / symbol corresponding key.

In inputting a registered character symbol, personal authentication is performed to prevent a person other than the person from inputting a highly confidential registered character symbol.

[Brief description of the drawings]

FIG. 1 is an external view showing a first embodiment of a portable information terminal device according to the present invention.

FIG. 2 is a sectional view showing an internal arrangement of the portable information terminal device.

FIG. 3 is a diagram showing an optical path in a free-form surface prism.

FIG. 4 is a block diagram showing an electric circuit mounted on the portable information terminal device.

FIG. 5 is a diagram showing a connection form between a portable information terminal device and a network.

FIG. 6 is a diagram showing an example of an HTTP communication sequence.

FIG. 7 is a flowchart showing a procedure of an operation of the portable information terminal device.

FIG. 8 is a flowchart illustrating a procedure of a Web access process executed in the portable information terminal device.

9 is a diagram showing an example of Web page information displayed on a small liquid crystal display by the Web access processing shown in FIG.

FIG. 10 is a flowchart illustrating a procedure of a setting process executed in the portable information terminal device.

FIG. 11 is a diagram showing an example of set values displayed on a small liquid crystal display.

FIG. 12 is a flowchart illustrating a procedure of a software keyboard process executed in the portable information terminal device.

FIG. 13 is a diagram illustrating an example of words registered in advance.

FIG. 14 is a diagram showing a screen on which a software keyboard including an input key of a pre-registered word is displayed on a small liquid crystal display.

FIG. 15 is a flowchart showing an authentication procedure which is a part of a procedure of a software keyboard process executed in the portable information terminal device.

FIG. 16 is a diagram showing a screen in which a software keyboard excluding a pre-registered word input key is displayed on a small liquid crystal display.

FIG. 17 is a diagram illustrating a configuration of an imaging optical system according to a second embodiment.

FIG. 18 is a block diagram showing an electric circuit mounted on the portable information terminal device according to the second embodiment.

FIG. 19 is a flowchart illustrating an authentication procedure which is a part of a procedure of a software keyboard process executed in the portable information terminal device according to the second embodiment.

[Explanation of symbols]

REFERENCE SIGNS LIST 100 portable information terminal device 110 magnifying display device (screen display unit) 111 free-form surface prism 112 small liquid crystal display 113 backlight 120 small computer device 121 CPU (first display means, storage means, second display means, display input) Means) 122 RAM (storage unit, display input means) 123 ROM 124 display control circuit (first display means, second display means, display input means) 125 bus 126 communication control circuit 127 input control circuit 128 LED control circuit 129 Power supply control circuit 130 Communication device 140 Input device (operation means) 150 LED device 160 Power supply device 171 Imaging optical system 172 Imaging device 173 Infrared light source 175 Imaging control circuit 200 Mobile phone terminal 300 Router 400 Web server 500 Web browser

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B019 DA06 DA08 HA06 HD13 HD20 5B020 AA02 CC12 CC20 DD02 DD30 FF17 FF53 GG13 5B087 AA06 AA09 AE09 BC12 BC13 BC19 BC26 DE03 DE07 5E501 AA04 BA05 CA04 CB07 EA10 FA12 FA03 FA03

Claims (60)

[Claims] 1. A portable information terminal device comprising a screen display unit and a storage unit, wherein: an operation unit for selecting and specifying an arbitrary position on a screen displayed on the screen display unit; First display means for displaying a virtual keyboard on the screen display unit when a predetermined position on the screen is selected and designated; storage means for storing at least one character symbol pre-registered by a user in the storage unit; Second display means for displaying, on the screen display unit, registered character / symbol corresponding keys respectively corresponding to at least one pre-registered character / symbol stored in the storage unit; When one of the keys is selected and designated, a pre-registered character symbol corresponding to the selected and designated registered character symbol corresponding key is displayed at the predetermined position. Portable information terminal device and having a display input unit configured to force. 2. A text input box is located at the predetermined position, and the display input means displays and inputs a pre-registered character symbol corresponding to the selected and designated registered character symbol corresponding key in the text input box. The portable information terminal device according to claim 1, wherein: 3. An acquiring means for acquiring belonging information belonging to the predetermined position when the user selects and designates the predetermined position on the screen by the operating means, based on the belonging information obtained by the acquiring means. And display control means for controlling display of said virtual keyboard and / or said registered character / symbol corresponding key respectively performed by said first and / or second display means. Portable information terminal device. 4. The portable information terminal according to claim 3, wherein said display control means determines a display arrangement of each of said registered character / symbol corresponding keys based on belonging information obtained by said obtaining means. apparatus. 5. The portable information terminal device according to claim 3, wherein the display control means determines the display position of the virtual keyboard based on the belonging information obtained by the obtaining means. 6. The belonging information is display position information of the predetermined position on the screen, identification information of information including the predetermined position displayed on the screen, or tag information assigned to the predetermined position. Claim 3 characterized by the following:
The portable information terminal device described in the above. 7. An authentication means for authenticating a user, wherein the display input means satisfies a predetermined condition when the user selects and designates one of the registered character / symbol corresponding keys by the operation means. Then, the authentication means is made to perform the personal authentication of the user, and when the user is authenticated, a pre-registered character symbol corresponding to the selected and designated registered character symbol corresponding key is displayed and input at the predetermined position. 2. The portable information terminal device according to claim 1, wherein: 8. The storage unit stores the degree of confidentiality of the corresponding pre-registered character symbol in the storage unit together with the pre-registered character symbol, and the predetermined condition is a key corresponding to the selected and specified registered character / symbol corresponding key. 9. The portable information terminal device according to claim 7, wherein the condition is that the degree of confidentiality of the pre-registered character symbol corresponding to the predetermined condition is greater than a predetermined degree. 9. The portable information terminal device according to claim 8, wherein said authentication means performs personal authentication based on at least one of a user's fingerprint information, eye iris information, and voiceprint information. 10. The portable information terminal device according to claim 8, wherein the authentication unit performs the personal authentication by exchanging data regarding the user with an external authentication device. 11. A first method for performing personal authentication based on fingerprint information of a user according to a degree of confidentiality of a pre-registered character / symbol corresponding to the selected / designated registered character / symbol corresponding key, A second method of performing personal authentication based on iris information of the user's eyes, a third method of performing personal authentication based on user's voiceprint information, and performing personal authentication by exchanging data regarding the user with an external authentication device 9. The portable information terminal device according to claim 8, wherein one or a combination of the fourth methods is selected and executed. 12. The second display means displays registered character / symbol corresponding keys respectively corresponding to pre-registered character / symbols stored in the storage unit by different display methods according to the degree of confidentiality of the corresponding pre-registered character / symbol. 9. The portable information terminal device according to claim 8, wherein the information is displayed on the screen display unit. 13. The system according to claim 1, wherein said first display means and said second display means operate simultaneously, and said virtual keyboard and said registered character / symbol corresponding key are displayed on the same screen. 1. The portable information terminal device according to 1. 14. The first display means and the second display means operate independently and independently, and the virtual keyboard and the registered character / symbol corresponding key are not necessarily displayed on the same screen. 2. The portable information terminal device according to claim 1, wherein: 15. Selecting one of making the first display means display the virtual keyboard and making the second display means display the registered character / symbol corresponding key. The portable information terminal device according to claim 1, further comprising a selection unit. 16. The apparatus according to claim 1, wherein the selection unit is configured by a button on the screen or a hardware switch provided in the portable information terminal device.
5. The portable information terminal device according to 5. 17. The portable information terminal device according to claim 1, wherein a position to be selected and designated by said operation means is moved for each key on a virtual keyboard displayed on said screen display unit. . 18. The portable information terminal device according to claim 1, wherein the screen display unit includes an enlargement optical system and a display device. 19. A data input method applied to a portable information terminal device comprising a screen display unit, a storage unit, and operation means for selecting and specifying an arbitrary position on a screen displayed on the screen display unit. A first display step of displaying a virtual keyboard on the screen display unit when the user selects and designates a predetermined position on the screen by the operation means; and at least one character symbol registered in advance by the user. A storage step of storing in the storage unit; a second display step of displaying registered character / symbol corresponding keys respectively corresponding to at least one pre-registered character / symbol stored in the storage unit on the screen display unit; When one of the registered character / symbol corresponding keys is selected and designated by the operating means, the key corresponding to the selected / designated registered character / symbol corresponding key is selected. Data input method characterized by having a display input step of displaying enter a pre-registered character symbols in the predetermined position. 20. A text input box is located at the predetermined position, and the display input step displays and inputs a pre-registered character symbol corresponding to the selected and designated registered character / symbol corresponding key in the text input box. 20. The data input method according to claim 19, wherein: 21. An acquiring step of acquiring belonging information belonging to the predetermined position when the user selects and designates the predetermined position on the screen by the operation means, and based on the belonging information acquired by the acquiring step. 20. A display control step of controlling the display of the virtual keyboard and / or the registered character / symbol corresponding key respectively performed by the first and / or second display steps. Data input method. 22. The data input method according to claim 21, wherein the display control step determines a display arrangement of each of the registered character / symbol corresponding keys based on the belonging information obtained in the obtaining step. . 23. The data input method according to claim 21, wherein the display control step determines a display position of the virtual keyboard based on the attribution information obtained in the obtaining step. 24. The belonging information is display position information of the predetermined position on the screen, identification information of information including the predetermined position displayed on the screen, or tag information assigned to the predetermined position. 22. The data input method according to claim 21, wherein: 25. An authentication step for performing user authentication of the user, wherein the display input step satisfies a predetermined condition when the user selects and designates one of the registered character / symbol corresponding keys by the operation means. Then, in the authentication step,
20. The data according to claim 19, wherein the user is authenticated, and when the user is authenticated, a pre-registered character symbol corresponding to the selected and designated registered character symbol corresponding key is displayed and input at the predetermined position. input method. 26. The storage step, wherein the degree of confidentiality of a corresponding pre-registered character symbol is stored in the storage unit together with the pre-registered character symbol. 26. The data input method according to claim 25, wherein a condition is such that the degree of confidentiality of the pre-registered character symbol corresponding to. 27. The data input method according to claim 26, wherein the authentication step performs personal authentication based on at least one of a user's fingerprint information, eye iris information, and voiceprint information. 28. The data input method according to claim 26, wherein said authentication step performs personal authentication by exchanging data relating to a user with an external authentication device. 29. A first method of performing personal authentication based on fingerprint information of a user according to a degree of confidentiality of a pre-registered character / symbol corresponding to the selected / designated registered character / symbol corresponding key, A second method of performing personal authentication based on iris information of the user's eyes, a third method of performing personal authentication based on user's voiceprint information, and performing personal authentication by exchanging data regarding the user with an external authentication device 27. The data input method according to claim 26, wherein one or a combination of the fourth methods is selected and executed. 30. The display method according to claim 27, further comprising: registering the registered character / symbol corresponding keys respectively corresponding to the pre-registered character / symbols stored in the storage unit by different display methods according to the degree of confidentiality of the corresponding pre-registered character / symbol. The data input method according to claim 26, wherein the data is displayed on the screen display unit. 31. The method according to claim 31, wherein the first display step and the second display step operate simultaneously, and the virtual keyboard and the registered character / symbol corresponding key are displayed on the same screen. 19. The data input method according to item 19. 32. The first display step and the second display step operate independently and independently, and the virtual keyboard and the registered character / symbol corresponding key are not necessarily displayed on the same screen. 20. The data input method according to claim 19, wherein: 33. A data input method applied to a portable information terminal device comprising a screen display unit, a storage unit, and operation means for selecting and specifying an arbitrary position on a screen displayed on the screen display unit. A first display for displaying a virtual keyboard on the screen display unit when the user selects and specifies a predetermined position on the screen by the operation means. Storing at least one character symbol pre-registered by a user in the storage unit; and storing a registered character code corresponding key corresponding to at least one pre-registered character symbol stored in the storage unit. A second display step of displaying on a screen display unit, and a key corresponding to the registered character symbol by a user operating the operation unit. When one selected and designated, the program characterized by having a display input step of displaying enter a pre-registered character symbols corresponding to the registered character symbol corresponding key that is the selected specified in the predetermined position. 34. A text input box is located at the predetermined position, and the display input step includes displaying and inputting a pre-registered character symbol corresponding to the selected and designated registered character / symbol corresponding key in the text input box. 34. The program according to claim 33, wherein: 35. The data input method, comprising: obtaining, when the user selects and specifies the predetermined position on the screen by the operation means, belonging information belonging to the predetermined position; A display control step of controlling display of the virtual keyboard and / or the registered character / symbol corresponding key respectively performed in the first and / or second display steps based on the assigned attribution information. The program according to claim 33, wherein: 36. The program according to claim 35, wherein the display control step determines a display arrangement of each of the registered character / symbol corresponding keys based on the belonging information obtained in the obtaining step. 37. The program according to claim 35, wherein the display control step determines the display position of the virtual keyboard based on the attribution information obtained in the obtaining step. 38. The belonging information is display position information of the predetermined position on the screen, identification information of information including the predetermined position displayed on the screen, or tag information assigned to the predetermined position. The program according to claim 35, characterized by: 39. The data input method further comprises an authentication step of performing user authentication, wherein the display input step is performed when the user selects and designates one of the registered character / symbol corresponding keys by the operation means. If the predetermined condition is satisfied, in the authentication step,
34. The program according to claim 33, wherein the user is authenticated, and when the user is authenticated, a pre-registered character symbol corresponding to the selected and designated registered character symbol corresponding key is displayed and input at the predetermined position. . 40. The storage step stores the degree of confidentiality of the corresponding pre-registered character symbol in the storage unit together with the pre-registered character symbol. 40. The program according to claim 39, wherein the condition is that the degree of confidentiality of the pre-registered character / symbol corresponding to. 41. The program according to claim 40, wherein the authentication step performs personal authentication based on at least one of a user's fingerprint information, eye iris information, and voiceprint information. 42. The program according to claim 40, wherein the authentication step performs personal authentication by exchanging data on a user with an external authentication device. 43. A first method for performing personal authentication based on fingerprint information of a user in accordance with a degree of confidentiality of a pre-registered character / symbol corresponding to the selected / designated registered character / symbol corresponding key, A second method of performing personal authentication based on iris information of the user's eyes, a third method of performing personal authentication based on user's voiceprint information, and performing personal authentication by exchanging data regarding the user with an external authentication device 41. The program according to claim 40, wherein one or a combination of the fourth methods is selected and executed. 44. The second display step, wherein a registered character / symbol corresponding key respectively corresponding to a pre-registered character / symbol stored in the storage unit is displayed by a different display method according to the degree of confidentiality of the corresponding pre-registered character / symbol. 41. The program according to claim 40, wherein the program is displayed on the screen display unit. 45. The method according to claim 45, wherein the first display step and the second display step operate simultaneously, and the virtual keyboard and the registered character / symbol corresponding key are displayed on the same screen. The program according to claim 33. 46. The method according to claim 46, wherein the first display step and the second display step operate independently and independently, and the virtual keyboard and the registered character / symbol corresponding key are not necessarily displayed on the same screen. The program according to claim 33, characterized by: 47. A data input method applied to a portable information terminal device comprising a screen display unit, a storage unit, and operation means for selecting and specifying an arbitrary position on a screen displayed on the screen display unit. Wherein the data input method displays a virtual keyboard on the screen display unit when the user selects and designates a predetermined position on the screen by the operation means. A first display step, a storing step of storing at least one character symbol pre-registered by a user in the storage unit, and a registered character symbol respectively corresponding to the at least one pre-registered character symbol stored in the storage unit A second display step of displaying a corresponding key on the screen display unit; A display input step of, when one of the registered character / symbol corresponding keys is selected and designated, displaying and inputting a pre-registered character / symbol corresponding to the selected / designated registered character / symbol corresponding key at the predetermined position. Storage media. 48. A text input box is located at the predetermined position, and in the display input step, a pre-registered character symbol corresponding to the selected and designated registered character symbol corresponding key is displayed and input in the text input box. 48. The storage medium according to claim 47, wherein: 49. The method according to claim 49, wherein: when the user selects and designates the predetermined position on the screen by the operation means, an acquisition step of acquiring belonging information belonging to the predetermined position; A display control step of controlling display of the virtual keyboard and / or the registered character / symbol corresponding key respectively performed in the first and / or second display steps based on the assigned attribution information. The storage medium according to claim 47, wherein 50. The storage medium according to claim 49, wherein said display control step determines a display arrangement of each of said registered character / symbol corresponding keys based on belonging information obtained in said obtaining step. 51. The storage medium according to claim 49, wherein said display control step determines a display position of said virtual keyboard based on attribution information obtained in said obtaining step. 52. The belonging information is display position information of the predetermined position on the screen, identification information of information including the predetermined position displayed on the screen, or tag information assigned to the predetermined position. 50. The storage medium according to claim 49, wherein: 53. The data input method further comprises an authentication step of performing user authentication, wherein the display input step is performed when the user selects and designates one of the registered character / symbol corresponding keys by the operation means. If the predetermined condition is satisfied, in the authentication step,
48. The storage according to claim 47, wherein the user is authenticated, and when the user is authenticated, a pre-registered character symbol corresponding to the selected and designated registered character symbol corresponding key is displayed and input at the predetermined position. Medium. 54. The storage step stores the degree of confidentiality of a corresponding pre-registered character symbol in the storage unit together with the pre-registered character symbol. 54. The storage medium according to claim 53, wherein a condition is such that the degree of confidentiality of the pre-registered character symbol corresponding to. 55. The storage medium according to claim 54, wherein said authentication step performs personal authentication based on at least one of a user's fingerprint information, eye iris information, and voiceprint information. 56. The storage medium according to claim 54, wherein in the authentication step, the personal authentication is performed by exchanging data relating to a user with an external authentication device. 57. A first method for performing personal authentication based on fingerprint information of a user according to a degree of confidentiality of a pre-registered character / symbol corresponding to the selected / designated registered character / symbol corresponding key, A second method of performing personal authentication based on iris information of the user's eyes, a third method of performing personal authentication based on user's voiceprint information, and performing personal authentication by exchanging data regarding the user with an external authentication device The storage medium of claim 54, wherein one or a combination of the fourth methods is selected and executed. 58. The second display step includes, using different display methods according to the degree of confidentiality of the corresponding pre-registered character / symbol, corresponding to registered character / symbol corresponding keys respectively corresponding to the pre-registered character / symbol stored in the storage unit. The storage medium according to claim 54, wherein the storage medium is displayed on the screen display unit. 59. The method according to claim 59, wherein the first display step and the second display step operate simultaneously, and the virtual keyboard and the registered character / symbol corresponding key are displayed on the same screen. 47. The storage medium according to 47. The first display step and the second display step operate individually and independently, and the virtual keyboard and the registered character / symbol corresponding key are not necessarily displayed on the same screen. 48. The storage medium according to claim 47, wherein: