JP2001117694A - Portable information terminal equipment and device for touch panel input - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide portable information terminal equipment whose portability and operability can be made compatible and a device for a touch panel input. SOLUTION: The portable information terminal equipment 1 accepts timer interrupt at each fixed time, and operates display control processing and input control processing corresponding to moving amounts. That is, the position on a virtual space region is calculated by acceleration detectors 6X and 6Y. Then, when a touch panel input operating part 3P is depressed based on the calculated position, whether unprocessed information is present is determined. A character code is obtained from an unprocessed virtual key, or event processing is executed according to unprocessed event processing information according to the determined result. Also, the character code is obtained from handwritten character stroke information, whose character recognition is unprocessed, or new handwritten character stroke information is stored in a memory.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable information terminal device and a touch panel input device which have a small size and are easily portable, and which allow easy viewing and inputting of information.

[0002]

2. Description of the Related Art Conventionally, a portable information terminal device has a shape specializing in a specific function and emphasizing more portability, such as a mobile phone specializing in a telephone function and a simple mail function. Some have a type. In addition, there is a type such as a notebook-type personal computer that requires an easy-to-read screen of a certain size and an easy-to-use character input operation unit such as a keyboard and a touch panel, and that emphasizes information browsing and input operations. is there.

In recent years, portable telephones have been able to perform not only a simple mail function but also various information browsing and input operations using the Internet. As for personal computers, handheld and palm-sized personal computers that are smaller than conventional notebook personal computers have emerged and are becoming more popular.

[0004]

However, in a conventional portable telephone, when trying to browse various information using the Internet on a WEB screen or the like, a conventional small display screen is created for a normal personal computer. It is difficult to display a standard WEB page. Therefore, it is necessary to newly create a display-only WEB page of the mobile phone, and there has been a problem that information that can be viewed is limited.

[0005] Further, it is still difficult to achieve both portability and operability in conventional notebook, handheld, and palm-sized personal computers. For this reason, if the conventional shape is maintained, it has reached a level that balances the portability that anyone can easily carry and use without discomfort like a recent mobile phone, and the operability that allows easy input operation of information. I didn't.

It is an object of the present invention to provide a portable information terminal device and a device for inputting a touch panel, which have both portability and operability.

[0007]

According to the first aspect of the present invention,
A portable information terminal device in which an input operation unit (for example, a touch panel input operation unit 3P shown in FIGS. 1A and 2) is provided in a device body, and is a virtual space area (for example, a virtual space shown in FIG. 4A). A virtual space area information storage means (for example, a virtual space area information memory 7c shown in FIG. 3A; FIG. 3) for storing input operation information corresponding to each position on the space area VR).
(B) a position information memory 7ca, a display data conversion information memory 7cb, and an input operation information memory 7cc), and position specifying means (for example, a touch panel shown in FIGS. 1 and 2) for specifying a position in the virtual space area. Input operation unit 3P,
Touch panel input device 3T; step S1 shown in FIG.
05) and the contents of the input operation performed at the position specified by the position specifying means, and the input operation information corresponding to the position stored in the virtual space area information storage means (for example, FIG. 3B). Input control means (for example, C shown in FIG. 2) which processes based on the input operation information memory 7cc shown in FIG.
PU2; steps S113, S115, S1 shown in FIG.
18, S120) and a moving amount detecting means (for example, the acceleration detector 6 shown in FIG.
X, 6Y; the movement amount detection unit 6 shown in FIG. 2; step S102 shown in FIG. 5), and the position designation unit on the virtual space area according to the movement amount of the apparatus main body detected by the movement amount detection unit. And a virtual space area moving means (for example, CPU 2 shown in FIG. 2) for moving to a position designated by.

According to the portable information terminal device of the present invention, the portable information terminal device provided with the input operation section in the device main body stores the virtual space area information storage means at each position on the virtual space area. The corresponding input operation information is stored, the position in the virtual space area is designated by the position designation means, and the contents of the input operation at the position designated by the position designation means are designated by the input control means in the virtual space. The processing is performed based on the input operation information corresponding to the position stored in the area information storage means, the movement amount detection means detects the movement amount of the apparatus main body, and the virtual space area movement means detects the movement amount. The position specified by the position specifying means in the virtual space area is moved in accordance with the movement amount of the apparatus main body detected by the means.

According to a second aspect of the present invention, a display unit (for example, the display unit 4 shown in FIGS. 1A and 2) and an input operation unit (for example, shown in FIGS. 1A and 2) are provided on the apparatus main body. A portable information terminal device provided with a touch panel input operation unit 3P), the displayable information corresponding to each position in a virtual space area (for example, a virtual space area VR shown in FIG. 4A), and the information. Virtual space area information storage means (for example, a virtual space area information memory 7c shown in FIG. 3A; a position information memory 7 shown in FIG. 3B)
ca, display data conversion information memory 7cb, input operation information memory 7cc), and position specifying means for specifying a position in the virtual space area (for example, touch panel input operation unit 3P shown in FIGS. 1 and 2; Device 3T;
Step S105 shown in FIG. 5), among the displayable information in the virtual space area stored in the virtual space area information storage means, the information corresponding to the position designated by the position designation means, Display means for displaying on the display unit (for example, display unit 4 shown in FIG. 4; step S shown in FIG. 5)
104) and selection input means (for example, a touch panel input operation unit 3P shown in FIGS. 1 and 2 and a touch panel input) for selecting a part of information from information displayed on the display unit by the display means. Device 3T; FIG.
T1 and T2 shown in (a); T3) shown in FIG.
Input control means (for example, CPU 2 shown in FIG. 2) for performing input processing based on the input operation information (for example, input operation information memory 7cc shown in FIG. 3B) accompanying the information selected by the selection input means; Step S shown in FIG.
113, S115, S118, and S120) and a moving amount detecting means (for example, FIG. 1) for detecting the moving amount of the apparatus main body.
(A) The acceleration detectors 6X and 6Y shown in FIG. 5; the movement amount detection unit 6 shown in FIG. 2; step S102 shown in FIG. 5), and the virtual amount corresponding to the movement amount of the apparatus body detected by the movement amount detection means. Virtual space area moving means (for example, moving the position specified by the position specifying means on the space area)
And a CPU 2) shown in FIG.

According to the portable information terminal device of the present invention, the portable information terminal device provided with the display unit and the input operation unit in the device main body stores the virtual space area information storage means in the virtual space area. The displayable information corresponding to each position and the input operation information accompanying the information are stored, the position in the virtual space area is specified by the position specifying means, and the virtual space area information storing means is specified by the display means. Of the information that can be displayed on the virtual space area stored in the information corresponding to the position specified by the position specifying means,
Displayed on the display unit, selected information is selected by the input operation, from the information displayed on the display unit by the display unit by the selection input means, selected by the input operation, selected by the input control means by the selection input means An input process is performed based on the input operation information accompanying the information, a movement amount of the device body is detected by a movement amount detection unit, and a movement of the device body detected by the movement amount detection unit is detected by a virtual space area moving unit. The position specified by the position specifying means on the virtual space area is moved according to the amount.

According to a third aspect of the present invention, in the portable information terminal device according to the second aspect, the virtual space area information storage means stores the virtual space area (for example, a virtual space area VR shown in FIG. 4C). Each virtual key of the virtual keyboard (for example, the virtual keyboard input area KR shown in FIG. 4C) is assigned and set to each of the upper positions, and the display information of the character corresponding to each virtual key and the information associated with the character are displayed. Input operation information to be stored, and the display means displays a character corresponding to the virtual key assigned to the position designated by the position designation means (for example, the virtual key “H” shown in FIG. 4C). (For example, the display unit 4 shown in FIG. 4C), and the input control means performs an input operation associated with a character corresponding to a virtual key on the virtual keyboard selected by the selection input means. Based on the distribution, performs input processing of the character (eg, CPU shown in FIG. 2; step S113 shown in FIG. 5) is characterized by.

According to the portable information terminal device of the third aspect of the present invention, in the portable information terminal device of the second aspect of the present invention, each position on the virtual space area is stored in the virtual space area information storage means. Each virtual key of the virtual keyboard is assigned and set, and display information of a character corresponding to each virtual key and input operation information associated with the character are stored. A character corresponding to the virtual key assigned to the designated position is displayed, and the input control means displays input operation information associated with the character corresponding to the virtual key on the virtual keyboard selected by the selection input means. On the basis of,
The input processing of the character is performed.

Therefore, the portable information terminal device according to any one of the first, second, and third aspects of the present invention executes a process corresponding to each position on the virtual space area, thereby reducing the size of the device. Even in this case, information set on a virtual space area larger than the size is easily and quickly selected and designated by moving the apparatus body in the physical space corresponding to the virtual space area, and the selection is made. Efficient input control can be performed based on input operation information accompanying the specified information.

[0014] The user can reconstruct and memorize the display contents once displayed and their display positions together in the head, so that the entire display contents in the virtual space area can be roughly summarized. It is possible to grasp in advance. Therefore,
Once all the display contents are roughly grasped, the necessary information can be displayed and selected and input instantaneously by simply moving the portable information terminal device to the display position of the necessary display contents when needed. Becomes possible.

Further, the display area of the display unit can be scrolled and changed and displayed in a direction opposite to the moving direction of the portable information terminal device with a moving amount substantially equal to the detected moving amount and position. Therefore, by moving the portable information terminal device, it is possible to obtain an operational feeling as if browsing information while moving the display area of the display unit in the virtual space area.

The portable information terminal device can operate information in the real world in the same manner as when searching for necessary information from a single book or pressing a key on a keyboard. it can. In other words, in the real world, searching for information based on the memory of the location of the information in the head is more convenient than searching for the necessary information by actually looking at the table of contents. The information can be quickly searched from inside. Also, pressing the key based on the memory of the position of the key in the head is faster than pressing the key on the keyboard, rather than pressing the key that the user wants to press by actually looking at the keyboard. Can be. Therefore, it is possible to more easily and intuitively browse and operate information using a computer, such as viewing an actual book or keyboard, which has been conventionally difficult to realize.

According to a fourth aspect of the present invention, there is provided a portable information terminal device capable of inputting handwritten characters using a touch panel input operation unit (for example, a touch panel input operation unit 3P shown in FIGS. 1A and 2). Character stroke information input means (for example, FIGS. 1B and 2) for inputting stroke information of the handwritten character operated above (for example, handwritten character strokes “A” and “I” shown in FIG. 4B). 4T; a handwriting character input area WR shown in FIG. 4B) and a movement detecting means for detecting the movement of the apparatus body (for example, acceleration detectors 6X and 6Y shown in FIG. 1A). The movement amount detection unit 6 shown in FIG. 2; Steps S102 and S116 shown in FIG. 5), and when the movement detection unit detects the movement of the apparatus main body over a certain distance, the text The character recognition process based on the stroke information of the handwritten character input by the stroke information input means is started (for example, CPU2 shown in FIG. 2; step S118 shown in FIG. 5), and the stroke information of the next handwritten character can be input. (For example, C shown in FIG. 2)
PU2; step S119 shown in FIG. 5) character input control means (for example, CPU2 shown in FIG. 2).

According to the portable information terminal device of the invention described in claim 4, the portable information terminal device capable of inputting handwritten characters by the touch panel input operation unit is characterized in that the handwritten characters operated on the touch panel by the character stroke information input means. Enter the stroke information of the character and use the movement detection means.
When the movement of the apparatus body is detected by the character input control means, and when the movement detection means detects the movement of the apparatus body over a predetermined distance, the stroke information of the handwritten character input by the character stroke information input means is used. The character recognition process based on the character stroke is started, and input of the next handwritten character stroke information is enabled.

Therefore, the portable information terminal device according to the fourth aspect of the present invention enables the scroll operation of the display screen and the input operation to the touch panel input operation section to be performed independently and simultaneously. Also, the start of the character recognition process and the input instruction of the next handwritten character stroke information are
This can be executed by detecting the movement of the apparatus main body. Therefore, there is no need to operate the separate dedicated area provided on the touch panel input operation unit to issue an instruction for the delimitation of each character, and it is not necessary to divide the touch panel input operation unit into small areas, and more efficient handwritten character input. Can be performed. That is, the user can perform a quick input operation to the display position of the display content desired by the user and a quick selection operation to the display position of the display content desired by the user.

According to a fifth aspect of the present invention, there is provided a touch panel input device (eg, FIG. 1B and FIG. 1B) for performing an input operation on a touch panel (eg, a touch panel input operation unit 3P shown in FIGS. 1A and 2). 2 (Touch input device 3T shown in FIG. 2), a ring-shaped band (for example, band 3T shown in FIG.
a), and a projection (eg, a projection 3Tb shown in FIG. 1B) provided to the outside of the band, wherein the band is adapted to the size of the user's finger. It is characterized in that the size can be adjusted by elastic deformation.

According to the touch panel input device of the invention, a touch panel input device for performing an input operation on the touch panel includes a ring-shaped band portion to be put on a user's finger, and an outer portion of the band portion. The band portion is adjustable in size by being elastically deformed to fit the size of the user's finger.

Therefore, with the touch panel input device according to the fifth aspect of the present invention, the input operation to the touch panel input operation unit can be performed with the same hand while holding the touch panel input operation unit with one hand. Therefore, when more emphasis is placed on portability and operability, it is possible to provide the user with a more effective input operation method, and to perform an easy and detailed input operation.

[0023]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A portable information terminal device 1 and a touch panel input device 3T according to an embodiment of the present invention will be described below with reference to FIGS.

As will be described later in detail, when the portable information terminal device 1 receives a timer interrupt at regular intervals, it starts display control processing and input control processing according to the amount of movement. That is, the portable information terminal device 1 calculates a position on the virtual space area by the acceleration detectors 6X and 6Y. When the touch panel input operation unit 3P is pressed based on the calculated position,
It is determined whether there is unprocessed information. According to this determination result, a character code is obtained from the unprocessed virtual key information,
Alternatively, event processing is executed according to unprocessed event processing information. Alternatively, a character code is obtained from handwritten character stroke information that has not been subjected to character recognition, or new handwritten character stroke information is stored in the memory.

First, the configuration of the portable information terminal device 1 will be described. FIG. 1 is a diagram showing a device configuration of a portable information terminal device 1 and a touch panel input device 3T according to an embodiment of the present invention.

FIG. 1A is a top view schematically showing the device configuration of the portable information terminal device 1 according to the embodiment of the present invention. The portable information terminal device 1 includes a device main body case 1C of the portable information terminal device 1, a display unit 4, and a touch panel input operation unit 3P corresponding to the display unit 4. An acceleration detector 6X in the X direction of the display unit 4 and an acceleration detector 6Y in the Y direction are installed on the device main body case 1C of the portable information terminal device 1.

Although the details will be described later, the display unit 4
It is integrated with the touch panel input operation unit 3P, which is the input unit 3, and accepts an input operation by the user. The acceleration detector 6X detects the moving acceleration of the portable information terminal device 1 in the X direction, and similarly, the acceleration detector 6Y detects the moving acceleration of the portable information terminal device 1 in the Y direction.

FIG. 1B shows an example of a device for inputting to the input section 3 of the portable information terminal device 1 according to the embodiment of the present invention. The portable information terminal device 1 uses a touch panel input device 3T, a touch panel input pen (not shown), or the like to enable finer and more accurate input operation to the touch panel input operation unit 3P.

The input operation to the touch panel input operation unit 3P can be performed even when the contact area is large, such as when the user touches and operates the touch panel input operation unit 3P with a finger. However, the touch panel input operation unit 3P
It is common to use a touch panel input pen (not shown) in order to enable finer and more accurate input operation to the touch panel.

In the embodiment of the present invention, since the portability and operability of the portable information terminal device 1 are more emphasized, a touch panel input device 3T is used as an input device to the touch panel input operation unit 3P. ing. The touch panel input device 3T has a band 3Ta and a protrusion 3Tb.

The band 3 of the touch panel input device 3T
Ta has a ring-like shape that is partially open so that it can be put on a finger. Then, the ring-shaped open part is pushed and spread and elastically deformed according to the size of the finger, the size is adjusted, and the finger is worn on the user's finger. The projection 3Tb of the touch panel input device 3T is provided with a band 3Ta.
, For example, as shown in FIG. 1B, on the opposite side of the ring-shaped open portion. The projection 3Tb is made of a material that does not easily damage the surface of the touch panel operation unit 3P. The touch panel input device 3T having such a configuration is mounted on a user's finger, the portable information terminal device 1 is held with one hand of the user, and input operation to the portable information terminal device 1 can be performed in that state. I have to.

For example, it is possible to hold the portable information terminal device 1 with the right hand, attach the touch panel input device 3T to the thumb of the right hand, and perform an input operation on the touch panel input operation unit 3P with only one hand. Further, it is also possible to hold the portable information terminal device 1 with the left hand and attach the touch panel input device 3T to the right index finger, which is the opposite hand, to perform a character or graphic input operation on the touch panel input operation unit 3P.

Next, the internal configuration of the portable information terminal device 1 will be described. FIG. 2 is a block diagram showing an internal configuration of portable information terminal device 1 according to the present embodiment.

In FIG. 2, the portable information terminal 1
Is a CPU 2, an input unit 3 including a touch panel input operation 3P and a touch panel input device 3T, a display unit 4, a timer 5, a movement amount detection unit 6 including an acceleration detector 6X and an acceleration detector 6Y, a RAM 7, and a storage device. 8, a storage medium 9, and a communication device 10, and each part except the storage medium 9 is connected by a bus 11.

CPU (Central Processing Unit) 2
Is an application program specified from various application programs corresponding to the portable information terminal device 1 stored in the storage medium 9 of the storage device 8,
Various data corresponding to various instructions input from the input unit 3 are stored in a work memory area of the RAM 7, and various processes are executed according to the application program stored in the RAM 7 according to the input instructions and the input data. Is stored in the work memory area in the RAM 7 and displayed on the display unit 4. Then, the processing result stored in the work memory area is stored in the storage medium 9 of the storage device 8 which is instructed to be input from the input unit 3.

Further, the CPU 2 receives an interruption at predetermined time intervals by the timer 5, and performs a display control process and an input control process according to the amount of movement. That is, the CPU 2
The position on the virtual space area is calculated by the acceleration detectors 6X and 6Y. Then, based on the calculated position, if touch panel input operation unit 3P is pressed, CPU 2 determines whether there is any unprocessed information.
Based on this determination result, the CPU 2 acquires a character code from the unprocessed virtual key information, or executes an event process according to the unprocessed event process information. Or,
The CPU 2 acquires a character code from handwritten character stroke information that has not been subjected to character recognition, or stores new handwritten character stroke information in a memory.

The input unit 3 includes the touch panel input operation unit 3P (see FIG. 1A) and a touch panel input device 3T (see FIG. 1B). Then, a coordinate signal of the position pressed by the touch panel input device 3T is output to the CPU 2 to the touch panel input operation unit 3P. Touch panel input device 3T
Is made of a material that does not damage the touch panel input operation unit 3P, and is made of, for example, hard plastic or resin.

The display unit 4 is constituted by a liquid crystal display device or the like, and displays key input data input via the CPU 2, expanded file data, and the like. The display area of the display unit 4 is integrated with the operation area of the touch panel input operation unit 3P (see FIG. 1A). Therefore, the display unit 4 is an input unit in the portable information terminal device 1 including the input panel on a plane having a certain area,
The input panel is of a transparent pressure-sensitive type. When data is input by a touch panel input device 3T (see FIG. 1B) or a pen (not shown) for input, coordinates on the input panel are detected and the CPU 2 detects the coordinates. To output the coordinate signal.

The timer 5 generates an interrupt signal at regular time intervals, outputs each interrupt signal to the CPU 2, and causes the portable information terminal device 1 to perform display control processing and input control as the portable information terminal device 1 moves. Interrupt the processing. In the present embodiment, for example, when the timer 5 generates an interrupt signal every 40 ms and outputs the interrupt signal to the CPU 2 to cause an interrupt, the portable information terminal device 1 starts the display control process and the input control process. I do.

The moving amount detector 6 includes an acceleration detector 6X and an acceleration detector 6Y, a movement guide (not shown), a weight (not shown), a spring (not shown), and the like. Then, by detecting the moving acceleration of the portable information terminal device 1 in each direction and integrating the moving acceleration, the moving distance of the portable information terminal device 1 can be obtained, and the moving distance to the free position in the air can be obtained. The moving position of the portable information terminal device 1 on a two-dimensional plane can be obtained.

In the movement amount detecting section 6, the movement guide includes:
It is provided parallel to the acceleration detection direction, and the weight is
The two springs are engaged at both ends in the apparatus main body case 1C. When one of the two springs contracts in accordance with the movement of the portable information terminal device 1, the other spring extends. Therefore, the movement amount detection unit 6 detects the acceleration from the movement amount of the weight moving along the movement guide,
It is stored in a device acceleration information memory 7f in the RAM 7 described later.

When detecting the acceleration, the movement amount detecting section 6 uses an RA (described later) as an argument to correct variations inherent in the acceleration detector 6X and the acceleration detector 6Y.
The correction parameters stored in the acceleration detector parameter information memory 7g in M7 are used.

A RAM (Random Access Memory) 7 has a work memory area for storing a designated application program, input instructions, input data, processing results, and the like.

FIG. 3A is a diagram showing an example of the configuration of the memory set in the RAM 7. As shown in FIG. 3A, the RAM 7 includes a display buffer memory 7a, a display area information memory 7b, a virtual space area information memory 7c,
It has a position information memory 7d on the virtual space area, a device movement amount information memory 7e, a device acceleration information memory 7f, an acceleration detector parameter information memory 7g, a handwritten character stroke information memory 7h, a virtual key information memory 7i, and the like. .

The display buffer memory 7a converts the information set in the virtual space area information memory 7c into image information that can be developed and displayed on a two-dimensional plane based on the conversion data stored in the display data conversion information 7cb. And a memory area for storing expanded data.

The display area information memory 7b is a memory area for storing the coordinates of the position of the display unit 4 on the display buffer memory 7a and the size of the area. When the display unit 4 moves in the virtual space, the movement is performed. The position of the display unit 4 on the display memory 7a corresponding to the result is stored.

The virtual space area information memory 7c stores displayable information corresponding to each predetermined position in the virtual space area, input operation information accompanying the information, and the like. As shown in FIG. 3B, the virtual space area information memory 7c stores memories 7ca to 7cc for each virtual space area as shown in FIG.
have.

FIG. 3B is a diagram showing an example of a memory configuration in the virtual space area information memory 7c described above.
As shown in FIG. 3B, the virtual space area information memory 7c stores the position information memory 7c for each virtual space area.
a, a display data conversion information memory 7cb, an input operation information memory 7cc, and the like.

The position information memory 7ca shown in FIG. 3B stores each piece of position information associated with information that can be displayed on each virtual space area. The position information memory 7ca
The image can be developed in the above-mentioned display memory 7a based on the respective pieces of position information associated with the displayable information stored in the display memory 7a.

The display data conversion information memory 7cb includes:
Display data conversion for converting displayable information into bit image information as display data based on the displayable information in each virtual space area and the position information stored in the position information memory 7ca. Information is stored. The displayable information is converted by the display data conversion information, and the image is developed in the display memory 7a.

The input operation information memory 7cc stores input operation operation information accompanying information that can be displayed on each virtual space area. For example, the input operation information memory 7cc
Stores information for acquiring a character code from the input handwritten character stroke information in the handwritten character input region (the handwritten character input region WR in FIG. 4A; see FIG. 4B). Further, in the virtual keyboard input operation area (see the virtual keyboard input area KR in FIG. 4C), information for acquiring a character code from the input virtual key information is stored.

As described above, the virtual space area information memory 7
c has a position information memory 7ca, a display data conversion information memory 7cb, an input operation information memory 7cc, and the like for each virtual space area.

The position information memory 7d in the virtual space area shown in FIG. 3A stores the previous and current position information of the portable information terminal device 1 in the virtual space area. The displayable information is determined based on the position information on the virtual space area and the display size of the display unit 4.

The device movement amount information memory 7e stores the previous and current movement amount information of the portable information terminal device 1 in the movement space. The respective movement amount information is information calculated based on each acceleration information of the portable information terminal device 1 stored in a device acceleration information memory 7f described later.

The device acceleration information memory 7f stores the previous and current acceleration information of the portable information terminal device 1 in the moving space. The respective acceleration information is information detected by the acceleration detector 6X and the acceleration detector 6Y (see FIG. 2) installed in the apparatus main body case 1C. The respective pieces of acceleration information are used to calculate the respective pieces of movement amount information in the moving space of the portable information terminal device 1 as described above.

Acceleration detector parameter information memory 7g
Stores the parameter information of the acceleration detector 6X and the acceleration detector 6Y necessary for detecting the acceleration information of the portable information terminal device 1. The parameter information includes a correction parameter or the like used as an argument when each piece of acceleration information is detected in order to correct a variation or the like unique to the acceleration detector 6X and the acceleration detector 6Y.

The handwritten character stroke information memory 7h stores
In the handwritten character input area set at a predetermined position in the virtual space area (the handwritten character input area WR in FIG. 4A; see FIG. 4B), the input handwritten character stroke information is stored. .

The virtual key information memory 7i stores a virtual keyboard input area (FIG. 4) set on the virtual space area.
(See the virtual keyboard input area KR in (c)).
Stores the virtual key information that was input.

The storage device 8 has a storage medium 9 in which programs, data and the like are stored in advance, and this storage medium 9 is constituted by a magnetic or optical storage medium or a semiconductor memory. The storage medium 9 is fixedly provided in the storage device 8 or is detachably mounted. The storage medium 9 includes the portable information terminal device 1.
Various application programs and the like corresponding to are stored.

The program, data, and the like stored in the storage medium 9 are partially or wholly received from another device connected via a communication line such as a computer network and stored. Is also good. Further, a storage device having the storage medium 9 is provided on another device connected via a communication line or the like, and a program, data, or the like stored in the storage medium 9 is used via the communication line. It may be.

When the communication connection between the portable information terminal device 1 and each of the other devices is a wired connection, the communication device 10 is a modem (MODEM / MODulator / DEModulator), a terminal adapter (TA: Terminal Adapter), a router, or the like. And performs control for communicating with an external device via a communication line (not shown) such as a telephone line, an ISDN line, or a dedicated line. The modem modulates the digital data processed by the CPU 2 into an analog signal that is in the frequency band of the telephone line to communicate with an external device via the telephone line, and receives the input signal via the telephone line. A device that demodulates an analog signal to a digital signal, a terminal adapter is a device that converts an existing interface into an I interface compatible with ISDN in order to communicate with an external device via an ISDN line, and a router is The file processing device 1 is a LAN
(Local Area Network) when connecting to other LANs.

Further, wireless communication may be performed between the portable information terminal device 1 and other devices. In this case, the communication device 10
Connects a wireless communication adapter to connect and communicate between devices and LANs using electromagnetic waves (radio waves) or light (infrared rays) without using a wired cable. If it is composed of modems for mobile phones and teleterminals,
Data communication, etc., can be performed over a wide area, such as within the prefecture and Japan.
A wireless device that reaches only a limited range such as a weak radio wave, a specific low-power radio wave, or infrared light can be applied to data communication in a narrow range.

Next, an example of display and input on the virtual space area of the portable information terminal device 1 will be described. The display buffer memory 7a in the RAM 7 of the portable information terminal device 1 (FIG. 3)
The area range indicated by the display area information memory 7b among the bit image information developed in (a) is displayed in the display area of the display unit 4. Then, when the portable information terminal device 1 moves, the display area range indicated by the display area information memory 7b is changed to the display area range corresponding to the new coordinate position, and the display area of the display unit 4 is currently displayed. From the displayed position on the display buffer memory 7a to the changed coordinate position, the display is smoothly scrolled by a movement amount substantially equal to the movement amount of the apparatus main body and changed and displayed. The scroll direction of the display area of the display unit 4 is opposite to the moving direction of the portable information terminal device 1 in the moving space.

FIG. 4A is a diagram showing an example in which the selection item information corresponding to the menu M0 is set in the virtual space area VR. The selection item information corresponding to each menu is set in the virtual space area VR as needed.

In the virtual space area VR in FIG. 4A, as the selection item information corresponding to the menu M0, the selection item M01 “1. mail communication” and the selection item M02 “2.
Text edit ", selection item M03" 3. Handwriting input ”,
Selection item M04 “4. Virtual keyboard input”, selection item M05 “5. Input area setting”, and selection item M06
“6. End” is set.

As shown in FIG. 4A, first, the portable information terminal device 1 is moved to an area including the display position of the selection item information desired by the user in the menu M0. When the selection item information is pressed by the user using the touch panel input device 3T on the touch panel input operation unit 3P of the input unit 3, and selected, the event processing program corresponding to the selection item is executed. Is done.

For example, when the selection item information desired by the user in the menu M0 is the selection item M03 “3. Handwriting input”, first, the portable information terminal device 1 causes the user to select the selection item M03 “3. Is moved to the area including the display position of "". And the portable information terminal device 1
Are detected by the acceleration detectors 6X and 6Y, and the movement amount is calculated. According to the calculated movement amount,
The bit image information of the display area corresponding to the position of the portable information terminal device 1, which is developed on the display memory 7a, is read and scroll-displayed. That is,
An area including the selection item M03 “3. Handwriting input” is displayed.

Next, the user presses the position T1 on the touch panel input operation unit 3P of the input unit 3 by using the touch panel input device 3T. As described above, when the selection item M03 “3. Handwriting input” is selected, the selected selection item M03 “3. Handwriting input” is shaded (see FIG. 4A), and the selection item M03 “ 3. An event processing program corresponding to “3.

When the selection item information desired by the user in the menu M0 is the selection item M04 “4. virtual keyboard input”, the selection item M03 “3. The portable information terminal device 1 is moved by the user to an area including the display position of the selection item M04 “4. Then, the acceleration of the portable information terminal device 1 is detected by the acceleration detector 6X.
And 6Y, and the movement amount is calculated. According to the calculated movement amount, the bit image information of the display area corresponding to the position of the portable information terminal device 1, which is developed in the image on the display memory 7a, is read and scroll-displayed. That is, an area including the selection item M04 “4. virtual keyboard input” is displayed.

Next, the user presses the position T2 on the touch panel input operation unit 3P using the touch panel input device 3T. Thus, selection item M04
When "4. virtual keyboard input" is selected, the selected selection item M04 "4. virtual keyboard input" is shaded (not shown) and corresponds to the selection item M04 "4. virtual keyboard input". The event processing program is executed.

FIG. 4B is a diagram showing an example in which handwritten character input area WR information for inputting handwritten characters is set on the virtual space area VR. FIG. 4C is a diagram showing an example in which virtual keyboard input area KR information for virtual keyboard input is set on the virtual space area VR.

First, FIG. 4B shows an example in which the display unit 4 of the portable information terminal device 1 is moved by the user to the handwritten character input area WR on the virtual space area VR.
explain.

In the example shown in FIG. 4B, the display unit 4 of the portable information terminal device 1 is moved and fixed by the user to the area (1) of the handwritten character input area WR on the virtual space area VR. . In this state, the user operates the touch panel input device 3T (FIG. 1B; FIG. 2) to input a handwritten character stroke to the touch panel input operation unit 3P (FIG. 1A; FIG. 2). Is entered. The handwritten character stroke information input on the touch panel input operation unit 3P is stored in a handwritten character stroke information memory 7h (see FIG. 3A) in the RAM 7.

For example, the handwritten character stroke “A”
When input is made to the area (1) of the handwritten character input WR, the handwritten character stroke information corresponding to the handwritten character stroke “A” is stored in the handwritten character stroke information memory 7.
h.

Next, the handwritten character stroke information is stored in a handwritten character stroke information memory 7 h in the RAM 7.
When the mobile information terminal device 1 is detected to have moved a predetermined distance or more in the state stored in the virtual space area information memory 7c, the handwritten character is determined based on the information for character recognition stored in the virtual space area information memory 7c. The character recognition process of the stroke information is started and is recognized as a character code. At the same time, a handwritten character stroke information memory 7h in the RAM 7
Is cleared, and the input for the next handwritten character stroke is accepted.

That is, when the CPU 2 determines that the handwritten character input area WR has moved from the position of the area (1) to the position of the area (2) with the movement of the portable information terminal device 1, the handwritten character Character recognition processing of handwritten character stroke information corresponding to the stroke “A” is started. Further, the character stroke information memory 7h storing the handwritten character stroke information corresponding to the handwritten character stroke “A” is cleared, and the input for the next handwritten character stroke is accepted. Then, an input such as a handwritten character stroke “i” is accepted.

Next, in FIG. 4C, an example in which the display unit 4 of the portable information terminal device 1 is set in the virtual keyboard input area KR in the virtual space area VR will be described.

In the example shown in FIG. 4C, the display unit 4 of the portable information terminal device 1 is set in the virtual keyboard input area KR on the virtual space area VR. The display unit 4
Corresponds to the position where the portable information terminal device 1 has moved,
The displayable virtual keys in the virtual keyboard input area KR are displayed. The touch panel input operation unit 3 is associated with the virtual key displayed on the display unit 4.
In P, the same key area is assigned.

A specific virtual key among the virtual keys displayed on the display unit 4 is pressed by the user using the touch panel input device 3T in the touch panel input operation unit 3P. Then, the touch panel input operation unit 3P
Is stored in the RAM 7
Is stored in a virtual key information memory 7i (see FIG. 3A).

For example, when the position T3 of the virtual key "H" is pressed in the virtual keyboard input area KR, the virtual key information corresponding to the position T3 of the virtual key "H" is stored in the virtual key information memory 7i. You. Then, based on the information stored in the virtual space area information memory 7c in the RAM 7, the virtual key information is recognized as a character code.

The operation of the portable information terminal 1 according to the embodiment of the present invention relating to the display control processing and the input control processing accompanying the movement of the portable information terminal 1 will be described in detail.

FIG. 5 is a flowchart for explaining the operation of the portable information terminal device 1 according to the present embodiment relating to the display control processing and the input control processing accompanying the movement of the portable information terminal apparatus 1.

In FIG. 5, the CP of the portable information terminal 1
U2 accepts a timer interrupt for each fixed time (for example, 40 ms) by the timer 5 (see FIG. 2),
The display control process and the input control process are started based on the display control process and the input control process program developed in M7 (step S101).

First, the CPU 2 of the portable information terminal device 1
X-axis direction acceleration detector 6 included in movement amount detector 6
Each piece of acceleration information detected by the X and Y axis direction acceleration detectors 6Y (see FIGS. 1A and 2) is stored in a device acceleration information memory 7f in the RAM 7 (see FIG. 3A). Then, the CPU 2 integrates the acceleration information to obtain a moving amount of the portable information terminal device 1 in the virtual space area VR, and stores the moving amount in the device moving amount information memory 7e (see FIG. 3A). The CPU 2 calculates the current positions Vx and Vy of the portable information terminal device 1 on the virtual space area VR (step S102) and stores them in the position information memory 7d on the virtual space area (see FIG. 3A). .

Next, the CPU 2 determines the positions Vx and V
The virtual space area information of the range indicated by the display area information corresponding to y is obtained from the virtual space area information memory 7c (see FIG. 3A) (step S103). And CP
U2 is the display data conversion information stored in the display data conversion information memory 7cb (see FIG. 3B) based on the position information stored in the position information memory 7ca (see FIG. 3B). The bit image information converted by using is developed into a display memory 7a (see FIG. 3A) and displayed on the display unit 4 (step S104) (see FIG. 4A).

Then, the CPU 2 determines whether or not the touch panel input operation unit 3P (see FIGS. 1A and 2) which is the input unit 3 is currently pressed (step S1).
05). When determining that the touch panel input operation unit 3P has not been pressed (step S105; N).
O), the display control processing and the input control processing are ended as it is. On the other hand, the CPU 2 operates the touch panel input operation unit 3P
Is determined to have been pressed (step S105; Y
ES), it is determined whether there is any unprocessed information (step S106).

When determining that there is no unprocessed information (step S106; NO), the CPU 2 ends the display control processing and the input control processing as it is. On the other hand, the CPU 2
If it is determined that there is unprocessed information (step S106;
YES), one of the unprocessed information is selected (step S1)
07), it is determined whether or not the selected information is input operation information (step S108).

When determining that the selected information is not the input operation information (step S108; NO), the CPU 2 returns to step S106, determines again whether there is any unprocessed information, and executes the processing. On the other hand, when determining that the selected information is the input operation information (step S108; YES), the CPU 2 determines whether the input operation information is the handwritten character input information (step S10).
9). If the input information is handwritten character information (step S109; YES), the CPU 2 proceeds to step S116.
To step S120, and in the case of other input operation information (step S109; NO), the processing of steps S110 to S115 is executed.

When the CPU 2 determines that the input operation information is input operation information other than the handwritten character input information (step S109; NO), the position of the selected information in the virtual space area VR and the touch panel input operation It is determined whether the pressed position on the unit 3P matches (step S110). When determining that they do not match (step S110; NO), the CPU 2 returns to step S106 and determines that they match (step S110; YE).
S), the selected information is inverted or shaded (see T1 in FIG. 4A and T3 in FIG. 4C) (step S111).

Then, the CPU 2 determines whether or not the input operation information is character input information (step S112).
When the CPU 2 determines that the input operation information is character input information (step S112; YES), the CPU 2 determines that the input operation information is virtual key information input and operated on the virtual keyboard input area KR, and stores the virtual key information memory. 7i (FIG. 3)
(See (a)). Then, the CPU 2 acquires a character code from the virtual key information based on the input operation information stored in the input operation information memory 7cc (see FIG. 3B) (step S113). On the other hand, CPU2
Determines that the input operation information is not character input information (step S112; NO), then determines whether or not the input operation information is event processing input information (step S114).

If the CPU 2 determines that the input operation information is event processing input information (step S114;
YES), an event processing program corresponding to the input operation information is called from the RAM 7 and executed (step S115), and the process returns to step S106. On the other hand, CPU
2 judges that the input operation information is not the event processing input information (Step S114; NO), returns to Step S106 as it is.

Next, in step S109, the CPU
2 will be described when it is determined that the input operation information is handwritten character input information (step S109; YES). The CPU 2 determines whether or not the current position of the portable information terminal device 1 has moved a predetermined distance or more from the previous position based on the position information stored in the position information memory 7d on the virtual space area ( Step S11
6).

If the CPU 2 determines that the portable information terminal device 1 has moved a predetermined distance or more from the previous position (step S116; YES), the CPU 2 stores the input operation information in the handwritten character stroke information memory 7h. Judge as character stroke information. Then, the CPU 2 determines whether or not the handwritten character stroke information that has not been subjected to character recognition is stored in the handwritten character stroke information memory 7h (see FIG. 3A) (step S117).

When the CPU 2 determines that there is handwritten character stroke information that has not been subjected to character recognition (step S11).
7; YES), perform a character recognition process, and, based on the input operation information stored in the input operation information memory 7cc,
A character code is obtained from the handwritten character stroke information (step 118). Then, the CPU 2 clears the handwritten character stroke information memory 7h in which the handwritten character stroke information is stored (step S119).
It returns to step S106. On the other hand, if the CPU 2 determines that there is no handwritten character stroke information that has not been subjected to character recognition (step S117; NO), the CPU 2 proceeds to step S1.
Return to 06.

The CPU 2 determines in step S116
When it is determined that the portable information terminal device 1 has not moved a predetermined distance or more from the previous position (step S116; N
O) The input operation information is determined to be handwritten character stroke information that is being input in the handwritten character input area WR currently displayed in the display area. And CP
U2 is the previous and current touch panel input operation unit 3P
The handwritten character stroke information is acquired on the basis of the pressed position at step S1, stored in the handwritten character stroke information memory 7h (step S120), and the process returns to step S106.

As described above, according to the operation related to the display control process and the input control process of the portable information terminal device 1 in the present embodiment, the CP of the portable information terminal device 1
When U2 receives a timer interrupt at regular intervals, the acceleration detectors 6X and 6Y calculate a position on the virtual space area VR. Then, based on the calculated position, if touch panel input operation unit 3P is pressed, CPU 2 determines whether there is any unprocessed information. Based on this determination result, the CPU 2 can acquire the character code from the unprocessed virtual key information or execute the event processing according to the unprocessed event processing information. Alternatively, the CPU 2 can acquire a character code from handwritten character stroke information that has not been subjected to character recognition, or can store new handwritten character stroke information in a memory.

Therefore, the portable information terminal device 1 executes a process associated with each position on the virtual space area, so that even a small device, the virtual space area VR larger than its size can be obtained. The information set above is easily and quickly selected and designated by a movement operation of the apparatus main body in the physical space corresponding to the virtual space area VR, and based on input operation information accompanying the selected and designated information. Thus, efficient input control can be performed.

Then, the user can reconstruct the display contents once displayed and their display positions together in the mind and store them, so that all display contents on the virtual space area VR can be displayed. It is possible to roughly grasp them. Therefore, once all the display contents are roughly grasped, the necessary information can be displayed and selected and input instantly by simply moving the portable information terminal device 1 to the display position of the required display contents when needed. Can be performed.

Further, the portable information terminal device 1 moves in a direction opposite to the moving direction of the portable information terminal device 1 by a movement amount substantially equal to the movement amount and the position calculated based on the detected acceleration information. The display area of the display unit 4 can be scrolled and changed and displayed. Therefore, by moving the portable information terminal device 1, it is possible to obtain an operational feeling as if browsing information while moving the display area of the display unit 4 in the virtual space area VR.

Further, the portable information terminal device 1 searches for necessary information from a single book in the real world,
Or pressing a key on the keyboard,
Information can be manipulated. In other words, in the real world, searching for information based on the memory of the location of the information in the head is more convenient than searching for the necessary information by actually looking at the table of contents. The information can be quickly searched from inside. Also, pressing the key based on the memory of the position of the key in the head is faster than pressing the key on the keyboard, rather than pressing the key that the user wants to press by actually looking at the keyboard. Can be. Therefore, it is possible to more easily and intuitively browse and operate information using a computer, such as viewing an actual book or keyboard, which has been conventionally difficult to realize.

The portable information terminal device 1 can independently and simultaneously perform the scroll operation of the display screen of the portable information terminal device 1 and the input operation to the touch panel input operation unit 3P. In the process related to the handwritten character input, the start of the input handwritten character recognition process and the instruction of the next handwritten character input can be executed by detecting the movement of the apparatus main body. Therefore, there is no need to operate the separate dedicated area provided on the touch panel input operation unit 3P to give an instruction for the delimitation of each character, or to divide the handwritten character input area WR into small areas, thereby achieving more efficient handwriting. Character input can be performed. That is, the user can perform a quick input operation to the display position of the display content desired by the user and a quick selection operation to the display position of the display content desired by the user.

Further, the portable information terminal device 1 uses the touch panel input projection 3R so that the portable information terminal device 1 can be input to the portable information terminal device 1 with the same hand while holding the portable information terminal device 1 with one hand. Can operate. Therefore, in the portable information terminal device 1 which places more importance on portability and operability, it is possible to provide the user with a more effective input operation method, and it is possible to perform an easy and fine input operation. I do.

The detailed part of this embodiment is not limited to the contents of the above embodiment,
Changes can be made as appropriate without departing from the spirit of the present invention.
For example, in the handwritten character recognition process, a handwritten character is input for each character in the handwritten character input area WR. However, if the virtual key pressed on the virtual keyboard can be recognized, more virtual characters can be recognized. The keys may be displayed on the display unit 4 at the same time. In addition, in this embodiment, the case where the apparatus main body is used in a hand is considered, and therefore, an acceleration detector is provided in the movement amount detection unit, and the movement amount is calculated from the detected acceleration. In such a case, the movement detection unit may directly count the movement amount, such as a mouse device.

The projection 3Tb of the touch panel input device 3T is made of hard plastic, resin or the like, but is not limited to this, and is made of a material that does not easily damage the surface of the touch panel input operation unit 3T. If so, it may be made of another material.

[0105]

According to any one of the first, second and third aspects of the present invention, a small-sized apparatus is provided by executing a process corresponding to each position in a virtual space area. Also, the information set in the virtual space area larger than the size is easily and quickly selected and designated by moving the apparatus main body in the physical space corresponding to the virtual space area, and the selected and specified information is set. Input control can be performed based on input operation information attached to the information.

According to the fourth aspect of the present invention, the scroll operation on the display screen and the input operation on the touch panel input operation unit can be performed independently and simultaneously. Also,
The start of the character recognition process and the instruction to input the next handwritten character stroke information can be executed by detecting the movement of the apparatus main body, and thus, more efficient handwritten character input can be performed. That is, the user can perform a quick input operation to the display position of the display content desired by the user and a quick selection operation to the display position of the display content desired by the user.

According to the fifth aspect of the invention, the input operation to the touch panel input operation unit can be performed with the same hand while holding the touch panel input operation unit with one hand. Therefore, when more emphasis is placed on portability and operability, it is possible to provide the user with a more effective input operation method, and to perform an easy and detailed input operation.

[Brief description of the drawings]

FIG. 1A is a diagram showing an outline of a device configuration of a portable information terminal device 1 according to an embodiment of the present invention, and FIG. FIG. 4 is a diagram illustrating an example of a unit 3.

FIG. 2 is a block diagram showing an internal configuration of the portable information terminal device 1 according to the embodiment of the present invention.

FIG. 3A shows a RAM 7 of the portable information terminal device 1;
FIG. 3B is a diagram showing an example of the memory configuration of the virtual space area information memory 7c shown in FIG. 3A.

FIG. 4A is a diagram illustrating an example in which selection item information corresponding to a menu M0 is set on a virtual space area VR, and FIG. 4B is a diagram illustrating handwriting on the virtual space area VR; FIG. 4C is a diagram illustrating an example in which a character input area WR is set, and FIG.
Is a virtual keyboard input area KR on the virtual space area VR.
It is a figure showing the example which set up.

FIG. 5 is a flowchart illustrating an operation related to a display control process and an input control process of the portable information terminal device 1.

[Explanation of symbols]

 Reference Signs List 1 portable information terminal device 1C device main body case 2 CPU 3 input unit 3P touch panel input operation unit 3T touch panel input device 3Ta band unit 3Tb projection unit 4 display unit 5 timer 6 movement amount detection unit 6X acceleration detector in X-axis direction 6Y Y Axial acceleration detector 7 RAM 7a Display buffer memory 7b Display area information memory 7c Virtual space area information memory 7ca Position information memory 7cb Display data conversion information memory 7cc Input operation information memory 7d Position information memory on virtual space area 7e Device movement amount information memory 7f Device acceleration information memory 7g Acceleration detector parameter information memory 7h Handwritten character stroke information memory 7i Virtual key information memory 8 Storage device 9 Storage medium 10 Communication device 11 Bus M0 menu M01 to M06 Selection item VR Virtual spatial domain KR virtual keyboard input region WR handwritten character input area

Claims (5)

[Claims] 1. A portable information terminal device provided with an input operation unit in an apparatus main body, wherein virtual space area information storage means for storing input operation information corresponding to each position on a virtual space area; Position specifying means for specifying the position above, and the content of the input operation at the position specified by the position specifying means, the input operation information corresponding to the position stored in the virtual space area information storage means Input control means for performing processing based on the movement amount; movement amount detection means for detecting the movement amount of the device main body; and the position designation means on the virtual space area in accordance with the movement amount of the device main body detected by the movement amount detection means. A portable information terminal device, comprising: virtual space area moving means for moving a position specified by: 2. A portable information terminal device provided with a display unit and an input operation unit in an apparatus main body, comprising: displayable information corresponding to each position in a virtual space area; and input operation information accompanying the information. Virtual space area information storing means for storing, position specifying means for specifying a position on the virtual space area, and displayable information on the virtual space area stored in the virtual space area information storing means, A display unit that displays information corresponding to the position specified by the position specifying unit on the display unit; and a part of information selected from information displayed on the display unit by the display unit by an input operation. Selection input means, input control means for performing input processing based on the input operation information accompanying information selected by the selection input means, and movement amount detection means for detecting the movement amount of the apparatus body Virtual space area moving means for moving a position designated by the position designating means on the virtual space area in accordance with the movement amount of the apparatus main body detected by the movement amount detecting means. Mobile information terminal device. 3. The virtual space area information storage means assigns and sets each virtual key of a virtual keyboard to each position on the virtual space area, and displays display information of a character corresponding to each virtual key and the character. The display means displays characters corresponding to a virtual key assigned to a position designated by the position designating means, and the input control means comprises: 3. The portable information terminal device according to claim 2, wherein input processing of the character is performed based on input operation information associated with the character corresponding to the virtual key on the virtual keyboard selected by the means. 4. A portable information terminal device capable of inputting handwritten characters by a touch panel input operation unit, comprising: character stroke information input means for inputting stroke information of a handwritten character operated on said touch panel; A movement detecting means for detecting, and when the movement detecting means detects a movement of the apparatus main body over a predetermined distance, a character recognition process based on stroke information of a handwritten character input by the character stroke information input means is started. And a character input control means for enabling input of stroke information of the next handwritten character. 5. A touch panel input device for performing an input operation on a touch panel, comprising: a ring-shaped band portion to be fitted to a user's finger; and a projection provided to the outside of the band portion. The device for touch panel input, wherein the size of the band unit is adjustable by elastically deforming the band unit so as to match the size of the user's finger.