JP2002062984A - Portable information terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable information terminal using a pointing device sufficiently miniaturized and allowing an easy moving operation of a pointer (cursor). SOLUTION: The pointing device 4 is arranged in a through hole 8a part arranged in an outer case 8 of the portable information terminal. The pointing device 4 is constructed of a finger plate 4a installed into the through hole 8a by means of a hinge 4e, a photographing element 4c arranged on a circuit board 6, a condensing lens 4d forming an image on the outside face of the finger plate 4a on a photographing face of the photographing element 4c, and a light emitting device 4b radiating illumination light onto the outside face of the finger plate 4a, and a pattern such as a fingerprint of a fingertip 7 abutted to the outside face of the finger plate 4a is photographed by means of the photographing element 4c. When the fingertip 7 is moved while pressed to the finger plate 4a, an image photographed by the photographing element 4c is changed, and according to this change, the pointer displayed on a display screen is moved in the direction of the change by a distance matching the change quantity.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable information terminal using a pointing device for moving a pointer (cursor) on a display screen.

[0002]

2. Description of the Related Art Conventionally, in a portable information terminal such as a portable personal computer or a portable telephone, a pointer indicating a desired position of an image displayed on the display screen is displayed, and the pointer is moved to the desired position. A pointing device for moving is provided on the operation surface.

As such a pointing device,
Conventionally, a trackball that moves a pointer by detecting rotation of a sphere and a dial type that moves a pointer by detecting rotation of a disk are known. In order to increase the size and enable more and more selection items to be arbitrarily and smoothly selected with the pointer, a cross pointer having an independent feed switch for each direction of movement of the up, down, left, and right pointers, A stick pointer, which is used for a game machine or the like and moves a pointer by tilting a stick or a disc back and forth and left and right, is also known. Furthermore, although it is used in personal computers and the like, in order to continuously move the pointer in an image such as a map displayed on the display screen, it is composed of a flat sensor plate having a certain area. When a finger is continuously moved, a so-called trackpad, which detects a continuously changing position of the finger and continuously moves a pointer according to the detection result, is also known. .

[0004]

Incidentally, portable information terminals are required to be more portable, and therefore are required to be further reduced in size, weight, and thickness. Given such demands, the trackball and the dial-type pointing device have physically movable parts such as a ball and a disk, so that miniaturization is limited and not easy. .

In the pointing devices such as the cross pointer and the stick pointer, basically, one operation is performed one stage at a time, that is, one screen displayed on the display screen.
Since the pointer moves one item at a time, in order to select an item that is sufficiently distant on the display screen, the number of necessary operations increases, and the operation is troublesome.

In the above-mentioned track pad, the finger is moved by bringing the finger into contact with the sensor plate. Therefore, the sensor plate must be sufficiently larger than the area of the finger in contact with the sensor plate. Not suitable for

An object of the present invention is to provide a portable information terminal using a pointing device which can solve such a problem, can be sufficiently reduced in size, and can easily move a pointer.

[0008]

In order to achieve the above object, the present invention provides a transparent plate having an outer surface for abutting a surface of an object, and a surface of the object abutting the outer surface of the plate. A pointing device comprising: an image detecting means for detecting an image of the plate; an optical means for forming an image on the outer surface of the plate on a detection surface of the image detecting means; and a light emitting means for irradiating the outer surface of the plate with illumination light. A first means for measuring the reflectance on the outer surface of the plate from the amount of light received by the image detecting means and the amount of light emitted by the light emitting means; and the reflectance measured by the first means is preset. When the light emission amount is equal to or less than the reference minimum value, the light emission amount of the light emitting means is set to a first preset value.
When the reflectance measured by the first means exceeds the minimum reference value, the light receiving amount of the image detecting means is larger than the first reference value. Second means for adjusting the light emission amount of the light emitting means so as to be a reference value, and detecting the movement of the image detected by the image detecting means and moving the pointer in a direction corresponding to the detected direction of the movement. Means 3 and the presence or absence of movement of the image detected by the image detection means. If there is movement, the pointing device is set to the active mode, and the pointer is moved in a direction corresponding to the direction of movement. Fourth means for setting the pointing device to a standby mode when there is no movement for a predetermined period of time, wherein the sensing frequency of the pointing device in the standby mode is determined by the pointing data in the active mode. It is intended to be smaller than the sensing frequency of the chair.

The second means temporarily changes the light emission amount of the light emitting means when the reflectance measured by the first means is equal to or less than a preset reference minimum value. When the amount of light received by the image detecting means does not change with respect to the change in the light emission amount, the light emitting amount of the light emitting means is set to a first reference value set in advance.

According to the above arrangement, when the user touches the fingertip on the plate and moves the fingertip in that state, the fingerprint of the fingertip is detected as a moving image, and is displayed on the display screen in a direction corresponding to the direction of the movement. The pointer moves, but since the image on the outer surface of the plate is illuminated by the light emitting means, the image detecting means can detect a high-brightness image, and a fingertip or the like can be detected on the outer surface of the plate. If the pointer is not moved without touching it, this can be detected, and the standby mode can reduce the amount of light emitted from the light emitting means and save power. Moreover, whether or not a fingertip or the like is touching the outer surface of the plate is determined based on the reflectance of the image on the outer surface of the plate. Since the change in the amount of received light is detected, it is more accurate to determine whether or not a fingertip or the like is touching the outer surface of the plate. Furthermore, it is possible to detect images with necessary and sufficient brightness without being affected by individual differences such as the color of the fingertips and differences between parts.Also, even if you are wearing gloves, the difference in color or material due to it can be detected. The image can be detected with the necessary and sufficient luminance without being affected.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a front view showing an embodiment of a portable information terminal according to the present invention, wherein 1 is a portable information terminal, 2 is an operation surface, 2a is a "power / end call" button, 2b is a "call start" button, 2c is a "menu" button, 2d is a "return" button, 3 is a display screen, and 4 is a pointing device. Here, this embodiment is a mobile phone, but another mobile information terminal such as a mobile personal computer may be used.

In FIG. 1, an operation surface 2 on which various operation members such as a pointing device 4 are arranged, and a display screen on which an image and a pointer (cursor, not shown) are displayed on the front of the portable information terminal 1. 3 are provided. On the operation surface 2, a power button and a “power / end” button 2 a for instructing the end of the call, a “start call” button 2 b for instructing the start of the call, and a menu screen are displayed on the display screen 3. "Menu" button 2c for "Return" to return to the previous screen displayed on display screen 3
A button 2d, a numeric keypad for both character input, and the like are provided.

The pointer displayed on the display screen 3 can be moved by moving the surface of the pointing device 4 on the operation surface 2 with a fingertip. Although not shown, the pointing device 4 also has a determination function.
Is pressed with a fingertip, this determination function is activated, and it is possible to determine items indicated by the pointer, touch buttons, and the like on the display screen 3.

FIG. 2 shows a specific example of the pointing device 4 used in the portable information terminal 1 shown in FIG. 1, wherein FIG. 2 (a) is a longitudinal sectional view, and FIG. 4a is a finger plate, 4b is a light emitting device, 4c is an image sensor, 4d is a condenser lens, 4e is a hinge, 5 is a "decision" switch, 6 is a circuit board, 7 is a fingertip, 7a Denotes a belly of the fingertip 7, 8 denotes an outer case of the portable information terminal 1, and 8a denotes a through hole provided in the outer case 8. In FIG. 2A, the upper side of the outer case 8 in the drawing is outside the portable information terminal 1.

1A and 1B, a finger plate 4a, a light emitting device 4b, an image pickup device 4c, and a condenser lens 4 are shown.
d and the hinge 4e constitute the pointing device 4 in FIG. 1, and a transparent finger plate 4a of these components is provided on the outer case 8 on the operation surface 2 (FIG. 1) side of the portable information terminal 1. It is installed in a state fitted in the through hole 8a. The outer surface of the finger plate 4a (that is, the surface on the fingertip 7 side shown in the drawing) has a convex shape,
It protrudes outside the outer surface of the outer case 8 so that it can be easily touched by the belly 7 a of the fingertip 7. One end of the finger plate 4a is supported by a hinge 4e, and the finger plate 4a is attached to the hinge 4e so as to be rotatable in the arrow direction.
To the inside of the outer case 8 (that is, the inside of the portable information terminal 1). When the pressing by the fingertip 7 is released, the finger plate 4a returns to the original state shown in the figure by a returning means such as a spring (not shown).

Inside the outer case 8, the light emitting device 4b
And a condenser lens 4d and an image pickup device 4c.
The imaging element 4c is fixed to the circuit board 6 inside the outer case 8, and the normal to the center of the imaging surface of the imaging element 4c, the optical axis of the condenser lens 4d, and the center axis of the finger plate 4a are substantially the same. The condensing lens 4d is arranged so that the image of the subject on the outer surface of the finger plate 4a is focused on the imaging surface of the imaging device 4c. Also, the light emitting device 4b
Irradiates illumination light obliquely from the inside of the outer case 8 toward the outer surface of the finger plate 4a. Therefore, the finger plate 4a
When there is nothing on the outer surface of the mobile phone, the illumination light from the light emitting device 4b is emitted to the outside of the portable information terminal 1 through the finger plate 4a, but when the belly 7a of the fingertip 7 is applied to the outer surface of the finger plate 4a, the light emitting device The illumination light from 4b illuminates the antinode 7a, and part of the reflected light from the antinode 7a is condensed on the image sensor 4c via the condenser lens 4d. Thereby, the pattern of the surface of the object applied to the finger plate 4a, for example, the fingertip 7
When the belly 7a of the child is hitting the finger plate 4a,
The fingerprint is imaged by the image sensor 4c. The imaging area of the image sensor 4c on the finger plate 4a is a partial area, such as the central part of the finger plate 4a, and therefore, a part of the belly 7a of the fingertip 7 applied to the finger plate 4a. This is for imaging the area.

As described above, when the illumination light is applied to the object surface that comes into contact with the finger plate 4a from an oblique direction, the pattern of the object surface may be a pattern formed of uneven portions, such as a fingerprint of the fingertip 7. The contrast between the portion irradiated with the illumination light and the portion not irradiated becomes more remarkable, and an image having a clear pattern is captured by the image sensor 4c.

When the finger plate 4a is pushed in the direction of the arrow with the fingertip 7 as described above, the "decision" switch 5 provided inside the finger plate 4a is provided.
, And actuate this so that the determination operation described later is performed.

FIG. 3 is a block diagram showing another specific example of the illumination means in the pointing device 4 shown in FIG. 2, 4f, 4f _1, 4f ₂ is an optical path changing means, the portions corresponding to FIG. 2 Are denoted by the same reference numerals, and redundant description is omitted.

In the specific example shown in FIG. 3A, the light emitting device 4b is arranged upward on the circuit board 6 (that is, the emission direction of the illuminating light is directed to the direction perpendicular to the surface of the circuit board 6). Light is emitted in a direction perpendicular to the surface of the circuit board 6. Then, an optical path changing means 4f composed of a mirror or a prism is provided between the light emitting device 4b and the outer case 8, and the optical path of the illumination light emitted from the light emitting device 4b is changed by the optical path changing means 4f, so that the finger plate 4a Irradiation from below.

In the specific example shown in FIG. 3B, the light emitting device 4b is arranged laterally on the circuit board 6 (that is, the emission direction of the illumination light is directed in a direction parallel to the surface of the circuit board 6). Light is emitted in a direction parallel to the surface of the circuit board 6. Then, the optical path changing means 4f ₁ consisting mirror or prism to face on the circuit board 6 to the light exit of the light emitting device 4b, also the optical path changing means 4f ₁ between the circuit board 6 and the outer case 8 the opposing optical path changing means 4f ₂ consisting of a mirror or prism is provided respectively,
The optical path of the illumination light emitted from the light emitting device 4b is changed by these optical path changing means 4f ₁ and 4f ₂ so that the finger plate 4
Irradiation is performed obliquely from below.

As described above, the light emitting device 4 which is an electronic component
By installing b on the same circuit board as the image sensor 4c, wiring holding parts and the like can be simplified, manufacturing costs can be reduced, and work time can be shortened.

FIG. 4 is a block diagram showing another arrangement of the finger plate 4a in the pointing device 4 shown in FIG. 2. In FIG. 4, parts corresponding to those in FIG.

The specific example shown in FIG.
a is attached to the inside of the outer case 8. In this case, the entire finger plate 4a may be arranged inside the outer case 8, or the central portion of the convex outer surface of the finger plate 4a may be located in the through hole 8a of the outer case 8. Or the finger plate 4a may be arranged so as to protrude outward from the through hole 8a.

In this case, since the distance between the finger plate 4a and the circuit board 6 is short, the heat of the finger plate 4a is substantially uniform in consideration of the arrangement of the optical system such as the condenser lens 4d. Then, the inner surface side may be recessed to increase the distance.

The specific example shown in FIG.
a is arranged outside the outer case 8. In this case, the “enter” switch 5 is also attached to the outer case 8 so that at least the operation part pressed by the finger plate 4 a is also outside the outer case 8.

FIG. 5 shows the finger plate 4a shown in FIGS.
3 is a perspective view showing a specific example of the configuration of the outer surface of FIG. here,
Although the planar shape of the finger plate 4a is shown as a perfect circle, it is not limited to this, and may be another planar shape such as an elliptical shape or a rectangular shape.

The specific example shown in FIG.
a peripheral portion 10a as an opaque edge portion 10;
The inside of 0 is a transparent portion 9 that transmits light. The imaging element 4c (FIG. 2) sets a predetermined area in the transparent section 9 as an imaging area. With the border portion 10, unnecessary incident light on the image pickup surface of the image pickup device 4c from the outside can be reduced.

The specific example shown in FIG.
A is provided with a groove-shaped guide 11 which is shallow in the radial direction passing through its center, thereby facilitating movement of the fingertip 7 (FIG. 2) while making contact. A central portion in the guide 11 may be an imaging area of the imaging element 4c, and an area other than the imaging area may be opaque.

In this specific example, the guide 1 in one direction
1, but two guides 11a and 11b orthogonal to each other may be provided as shown in FIG. 5 (c). In this case, these guides 11a, 11b
The imaging area 12 of the imaging element 4c is set at the intersection of.

The specific example shown in FIG. 5 (d) is a specific example of the specific example shown in FIG. 5 (c), in which the guides 11a and 11b are further gloss-finished, and the other areas 13 are grained. By subjecting this area 13 to graining,
This has the effect of making the finger slippery and less likely to sweat.

The specific example shown in FIG.
A hollow portion 14 is provided in the center of the outer surface of a, and an imaging area of the image sensor 4c is set in the hollow portion 14. By setting the imaging region of the imaging element 4c in the recessed portion 14 as described above, for example, when the portable information terminal 1 is stored in a bag or the like, it is possible to prevent other stored items from touching the imaging region and perform the imaging. The area can be prevented from being damaged. Also in this specific example, it is needless to say that the portion other than the recessed portion 14 may be made opaque, and as shown in FIG.
The guides 11a and 11b similar to those shown in FIG. 5C may be provided. Further, similarly to the specific example shown in FIG. 5D, the guides 11a and 11b and the recess 14 are gloss-finished. Alternatively, the other portions may be textured.

FIG. 6 is a diagram showing another specific example of the operation means of the "decision" switch 5 shown in FIG. 2. In FIG. 6, portions corresponding to those in FIG. .

The specific example shown in FIG.
The position at which a is attached to the inner surface of the outer case 8 by the hinge 4e is a position sufficiently distant from the through hole 8a provided in the outer case 8. According to this, it is possible to increase the distance L between the position on the finger plate 4a pressed by the fingertip at the time of the determination operation and the mounting position of the finger plate 4a on the outer case 8, and in fact, the hinge 4e Although the movement is in the form of an arc around the center, a movement closer to the pushing in the vertical direction can be realized.

The specific example shown in FIG.
The attachment position of the outer case 8 to the inner surface of the outer case 8 by the hinge 4e is set to a position close to the through hole 8a provided in the outer case 8, and the finger plate 4a of Natsuko is further extended beyond the attachment portion by the hinge 4e. A "decision" switch 5 is provided in the portion. According to such a configuration, when the finger plate 4a is pushed in with a fingertip, the "decision" switch 5 is lifted around the mounting portion by the hinge 4e, and the operating portion is pressed against the inner surface of the outer case 8,
A decision operation will be performed. In this case, hinge 4
Depending on the positional relationship between e and the "decision" switch 5, the leverage allows the decision operation to be performed with a smaller force.

FIGS. 7A and 7B are configuration diagrams showing another specific example of the pointing device 4 used in the portable information terminal according to the present invention, wherein FIG. 7A is a top view, and FIG. 15 is a "return" switch, 16a and 16b are protrusions,
17 is a rotation axis. In addition, portions corresponding to the above-described drawings are denoted by the same reference numerals, and redundant description will be omitted.

In this example, the pointing device 4 described with reference to FIGS. 2 to 4 is multifunctional.

7A and 7B, the outer case 8
Inside the through hole 8a, a "decision" switch 5
And a “return” switch 15 are provided, and a protruding pressing portion is formed on the finger plate 4 a for each of the switches 5 and 15. The finger plate 4a is arranged so as to be rotatable around the rotation shaft 17 by an attachment means (not shown). Here, the rotation axis 17 is “determined”.
It is orthogonal to the straight line connecting the switch 5 and the “return” switch 15. Of course, such a mounting means is provided by a transparent member or by avoiding the imaging area so that the imaging element 4c (FIG. 2) does not hinder the imaging of the image on the outer surface of the finger plate 4a. Also, a protrusion 16a is provided on the “return” switch 15 side of the outer surface of the finger plate 4a, and a protrusion 16b is provided on the “decision” switch 5 side. The imaging region of the image sensor 4c on the outer surface of the finger plate 4a is a central portion between the projections 16a and 16b on the outer surface.

When the pointing device 4 is provided with a "return" function as described above, the "return" switch 2d may be provided on the operation surface 2 as shown in FIG. It is not necessary.

With this configuration, in the pointing device 4, the image of the image pickup area on the outer surface of the finger plate 4a is picked up by the image pickup device 4c. When the finger is pushed in with a fingertip, the protruding pressing portion of the finger plate 4a presses and activates the "determination" switch 5, and the determination operation is performed. In this case, since the projection 16b is provided, the fingertip is hooked on the projection 16b, and the finger plate 4a can be easily pushed on the "decision" switch 5 side. When the "return" switch 15 side of the finger plate 4a is pushed in with a fingertip, the protruding pressing portion of the finger plate 4a presses and operates the "return" switch 15, and the display screen 3 (FIG. 1). A return operation is performed to return to the display of the previously displayed image. In this way, for example, during a series of operations for switching between menus having a hierarchical structure, the operations can be performed without releasing the finger from the pointing device. Further, once the operator puts his finger on the pointing device, he can concentrate on the display screen without looking at his / her hand and can easily perform the operation. Also in this case, since the projection 16a is provided, the fingertip is caught on this and the finger plate 4
It becomes easy to push the "return" switch 15 side of a.

Also in this embodiment, the pointer displayed on the display screen 3 is moved continuously or stepwise by moving the imaging area in the center of the finger plate 4a with a fingertip. When moving on a map, it moves continuously, and when moving on a screen of a selection item such as a menu screen, it moves stepwise). Further, the projections 16a and 16b are not always necessary.

FIGS. 8A and 8B are configuration diagrams showing still another specific example of the pointing device 4 used in the portable information terminal according to the present invention. FIG. 8A is a top view, FIG. Figures (c) and (d) are explanatory diagrams of functions, respectively.
a and 17b are rotation axes, 18a to 18d are function switches,
19 is a projection. In addition, portions corresponding to the above-described drawings are denoted by the same reference numerals, and redundant description will be omitted.

In this example, the pointing device 4 described with reference to FIGS.

8A and 8B, the outer case 8
The four function switches 18a, 18b, 18c, and 18d are arranged at equal intervals around the through hole 8a of the outer case 8 inside the finger case 4a.
A protruding pressing portion is formed for each of a, 18b, 18c, and 18d.

The finger plates 4a are attached to the rotating shafts 17a, 17 orthogonal to each other by attaching means (not shown).
It is arranged so as to be pivotable about two axes about b. Here, the rotating shaft 17a is orthogonal to a straight line connecting the function switches 18c and 18d, and the rotating shaft 17b is orthogonal to a straight line connecting the function switches 18a and 18b. Of course, the mounting means of the finger plate 4a is such that the image pickup device 4c (FIG. 2) uses the finger plate 4a.
In order not to interfere with capturing images on the outer surface of the
It is composed of a transparent member. Further, projections 19 are provided on the outer surface of the finger plate 4a on the side of the function switches 18a to 18d. The imaging area on the outer surface of the finger plate 4a of the imaging device 4c is a central portion between the projections 19 on the outer surface.

With this configuration, in the pointing device 4, an image of the image pickup area on the outer surface of the finger plate 4a is picked up by the image pickup device 4c, but the function switch 18a side of the finger plate 4a is touched with a fingertip. By pressing the finger switch 4a, the function switch 1
The function switch 18a is tilted toward the side 8a, and the protruding pressing portion of the finger plate 4a presses the function switch 18a to operate. in this case,
The protrusion 1 is provided on the function switch 18a side of the outer surface of the finger plate 4a.
Since the finger plate 9 is provided, the finger tip is hooked on the finger plate 9 and the function switch 18a of the finger plate 4a is easily pushed. The same applies to the other function switches 18b to 18d, and the finger plate 4a can be pushed into these switch sides, and these switches can be operated. Also, since the projections 19 are provided on these switch sides, it is easy to push the finger plate 4a into those switch sides.

Here, the function switches 18a to 18d are given predetermined functions. FIG. 8 (c) shows an example of this. Here, the pointer displayed on the display screen 3 (FIG. 1) is moved step by step (that is, when the menu screen is displayed on the display screen 3; (One item for each operation). 8A, the function switch 18a moves the pointer to the right by one switch, the function switch 18b moves the pointer to the left by one step, and the function switch 18c moves the pointer upward. The function switch 18d moves the pointer one step at a time in the downward direction.

In the case where the function shown in FIG. 8C is provided, the pointer displayed on the display screen 3 is continuously displayed by moving the imaging area in the center of the finger plate 4a with a fingertip. It is something to move. Also,
The projection 19 is not always necessary.

FIG. 8D shows another example of functions. The portable information terminal 1 provided with the pointing device 4 provided with the image pickup device 4c (FIG. 2) and the display screen 3 has a function as a video camera for photographing a landscape or the like using the image pickup device 4c as described later. The image signal photographed by the image pickup device 4c can be stored in a built-in storage device having a large storage capacity, or recorded on a large-capacity storage medium that can be mounted and used, and read out. Can be reproduced and displayed on the display screen 3.

The reproduction operation function in this case can be provided as shown in FIG. 8A, the function switch 18a has a fast-forward playback function, the function switch 18b has a rewind function, the function switch 18c has a playback / pause function, and the function switch 18d has a playback stop function. Each function is provided.

In the case where the function shown in FIG. 8D is provided, the pointer displayed on the display screen 3 is continuously displayed by moving the imaging area in the center of the finger plate 4a with a fingertip. Alternatively, move the pointer stepwise (when moving the pointer on the map,
When moving continuously and moving on a screen of a selection item such as a menu screen, step movement is performed). Also, projection 1
9 is not always necessary.

FIG. 9 is a structural view showing still another specific example of the pointing device 4 used for the portable information terminal according to the present invention, wherein FIG. 9 (a) is a top view, and FIG.
(C) is a cross-sectional view along the dividing line AA ', BB' of (a), and (d) is a functional explanatory view.
0 is a decision operation unit, 21 is a function operation unit, 22 is an operation member,
23 is a hinge. Also, portions corresponding to those in FIG. 8 are denoted by the same reference numerals, and redundant description will be omitted.

In this specific example, the pointing device 4 described with reference to FIG.

In other words, in FIGS. 9A to 9D, the finger plate 4a is divided into a central part and a peripheral part, and the central part is a decision operation unit 2 for performing a decision operation.
As shown in FIG. 8, the peripheral parts 0 and 0 constitute function operation units 21 for operating the function switches 18a to 18d. Since the function operation unit 21 is the same as the finger plate 4a in the specific example shown in FIG. 8, the description is omitted, but the determination operation unit 20 is configured to be able to be pushed. One end of an operating member 22 rotatably supported by a hinge 23 is attached to the inner surface side of the determination operation unit 20, and the other end of the operating member 22 is connected to the outer case 8.
Is an operation unit of a "decision" switch 5 provided on the inner surface of.

Then, when the decision operation section 20 of the finger plate 4a is pushed in with the fingertip, the operation member 22 rotates about the hinge 23, and the operation section at the tip of the operation member 22 is "decided".
Acts on switch 5 to activate it. Decision operation unit 2
When the pressing to zero is released, the determination operation unit 20 returns to the original position by means not shown.

Also in this specific example, the imaging area of the imaging element 4c (FIG. 2) is set in the determination operation section 20, and the display screen 3 is displayed on the display screen 3 by moving the imaging area with a fingertip. The displayed pointer is moved continuously.

FIG. 10 is a block diagram showing a circuit configuration of the portable information terminal 1 shown in FIG.
5 is a radio device for transmitting and receiving radio signals, 26 is a modem for modulating a signal to be transmitted and demodulating a received signal,
27 is a transmission / reception signal processor that processes a signal to be transmitted or an incoming signal; 28 is an audio processor that processes an audio signal from a sound transmitter 29 such as a microphone or an audio signal supplied to a sound receiver 30 such as a speaker; 31 is a controller for controlling the entire portable information terminal 1, 32 is a storage for storing and holding a telephone directory, various setting data, information from the Internet, and the like.
Reference numeral 3 denotes a display for displaying an image, a pointer, and the like on the display screen 3 (FIG. 1). Reference numeral 34 denotes a silent incoming call alert such as a vibrator for generating vibration for notifying the user of an incoming call.
Parts corresponding to those in FIG. 1 are denoted by the same reference numerals.

As shown in FIG. 2, when the pointing device 4 is touched with the fingertip 7 as shown in FIG.
An image of the pattern a, that is, a fingerprint is imaged by the image sensor 4c, and the image signal is supplied to the controller 31. The controller 31 reads the image signal from the image pickup device 4c at a predetermined time interval, so that time t ₁ and time t ₂ as shown in FIG. 11, by comparing an image of the image signal read back and forth By detecting the change, the movement of the fingertip 7 on the pointing device 4 is detected. Then, the controller 31 controls the position of the pointer displayed on the display screen 3 (FIG. 1) by the display 33 according to the detection result. When the movement of the fingertip 7 is not detected, Keep the pointer in a stopped state,
When the movement of the fingertip 7 is detected, the pointer is moved at a speed corresponding to the speed of the movement of the fingertip 7 and in a direction corresponding to the direction of the movement of the fingertip 7. In this way,
By touching the finger plate 4 a of the pointing device 4 with the fingertip 7 and moving the fingertip 7 in that state, the pointer can be moved on the display screen 3.

As described above, when the pointer reaches a predetermined position on the display screen 3 (for example, a position where a predetermined item is displayed) and the finger flat 4 is pressed with the fingertip 7,
The "decision" switch 5 is actuated, and the position (for example, the predetermined item) is selected and specified.

The controller 31 also detects the amount of light received by the image sensor 4c of the pointing device 4, controls the amount of light emitted by the light emitting device 4b, and the like.

The other parts are the same as those of the conventional portable information terminal.

In FIG. 2, when the display screen 3 is large and the pointer is moved in one direction, the fingertip 7
When the pointer cannot be moved to the desired position by one movement of the fingertip 7, the fingertip 7 is repeatedly moved on the finger plate 4a, but the movement of the fingertip 7 at this time is a reciprocating movement. In this case, if this reciprocating motion is performed while the fingertip 7 is in contact with the finger plate 4a, the controller 3
1 (FIG. 10) determines that the fingertip 7 is reciprocating, and the pointer is reciprocated in accordance with the reciprocation, so that the pointer cannot be moved to a desired position. Therefore, when the pointer cannot be moved to a desired position unless the fingertip 7 is moved a plurality of times, it is necessary to separate the fingertip 7 from the finger plate 4a when returning the fingertip 7.

However, this is a case where the display screen 3 is large, and it is difficult to move the pointer from one side of the display screen 3 to the other side opposing the display screen 3 as in a mobile phone. Such a problem does not occur when the fingertip 7 needs to be moved only once on the finger plate 4a.

In the pointing device 4, it is only necessary to capture an image of a part of the belly 7 a of the fingertip 7.
It is sufficient that the controller 31 detects a change in the image read before and after. For this reason, the surface area of the finger plate 4a can be reduced, and the finger plate 4a can be reduced. As a result, the pointing device 4 can be reduced in size.

FIG. 12 is a flowchart showing the control operation of the pointing device 4 by the controller 31.

In the figure, the portable information terminal 1 shown in FIG.
When the power is turned on by operating the "power / end call" button 2a on the operation surface 2, the fold is released from the folded state after the cover is opened or folded by the portable information terminal 1 having a configuration described later. When the pointing device 4 is in a usable state, for example, when the pointing device 4 is turned on, the pointing device 4 is set to a standby mode (step 100). In the standby mode, the controller 31 causes the light emitting device 4b to emit illumination light at a predetermined light emission amount, and the imaging element 4c repeats imaging at a frequency of about 10 times per second (sensing frequency). When the image sensor 4c captures an image, the amount of light received by the image sensor 4c is detected from the output, and the reflectance (==) on the outer surface of the finger plate 4a is determined from the amount of received light and the amount of light emitted by the light emitting device 4b at this time. The amount of received light / the amount of emitted light) is determined (step 101). The amount of received light may be, for example, an integrated value of an output signal value for one screen from the image sensor 4c, and the amount of light emitted by the light emitting device 4b may be a drive power value of the light emitting device 4b.

Next, the calculated reflectance is compared with a preset minimum reflectance (reference minimum value) (step 102). This step 102 is for determining whether or not the fingertip 7 is applied to the finger plate 4a. The reference minimum value can be determined by, for example, an experiment or the like so as to be able to determine this.

If the reflectance obtained in step 101 is equal to or less than the reference minimum value, the operation for moving the pointer on the finger plate 4a on the display screen 3 (hereinafter referred to as pointer operation) is performed. It is determined that the fingertip or the like is not touched (if the reflectance is equal to or lower than the reference minimum value, the light emission amount of the light emitting device 4b is temporarily increased, and the light reception amount of the imaging element 4c at this time is detected. When the light reception amount hardly changes even if the light emission amount is increased in this manner, it may be determined that the fingertip or the like is not applied to the finger plate 4a.) The light emission amount of the light emitting device 4b is set in advance. Set a small reference value (Step 1
03), proceed to step 105. Thereby, power saving is achieved in the standby mode. If the reflectance obtained in step 101 exceeds the reference minimum value, it is determined that a fingertip or the like has been applied to the finger plate 4a for pointer operation (step 102), and the light emission amount of the light emitting device 4b is determined. A value corresponding to the reflectance is set so that the amount of light received by the image sensor 4c becomes a predetermined constant value (step 104). Therefore, for example, the reflectance of a finger placed on the finger plate 4a with gloves or the like is low, and the image sensor 4c
If the amount of light received does not reach a sufficient level to capture an image on the imaging surface with good luminance, the amount of light emitted from the light emitting device 4b is increased to increase the output level of the image sensor 4c. For example, when the reflectance of the fingertip 7 applied to the finger plate 4a is high and the amount of light received on the imaging surface of the imaging device 4c is too large, the amount of light emission of the light emitting device 4b is reduced, and the light emitting device 4b No wasteful light is output to reduce waste of power consumption. After the adjustment of the light emission amount, the process proceeds to step 105.

In step 105, the imaging element 4c performs imaging at a low frequency in the standby mode (that is, the sensing frequency is, for example, about 10 times / second).
The image at that time is compared with the image obtained by the previous imaging, and the presence or absence of a change (movement) in the image is detected. If no change in the image is detected for one second or longer (step 106), unless the "power / end call" button 2a (FIG. 1) on the operation surface 2 is operated again to turn off the power (step 11).
0), returning to step 100, and detecting the reflectance and adjusting the light emission amount of the light emitting device 4b as described above. The power is turned off by operating the “power / end call” button 2a on the operation surface 2, or the portable information terminal 1 is covered by the portable information terminal 1 having a configuration described later. When the use is completed (step 11
0), the pointing device 4 is stopped.

If there is a change (movement) in the image (step 105), it is determined that the pointer operation has been performed, and the pointing device 4 is switched to the active mode (step 107). In this activity mode, the sensing frequency of the image sensor 4c is set to a high speed of, for example, about 1000 times / second, so that the image obtained from the image sensor 4c changes smoothly with the movement of the fingertip 7. To do. The controller 31 captures an image for each image capture, detects a change from the previously captured image, and changes the position of the pointer according to the change, that is, according to the movement of the fingertip 7 (step 108). As long as the pointing device 4 is operated (step 109), the operations of steps 107 and 108 are repeated.

In the above-mentioned activity mode, the imaging device 4c performs imaging (sensing) more frequently than a normal video camera, for example, about 1000 times per second. Because the range is very narrow, high-resolution image detection can be performed even if the number of pixels is smaller than that of an image sensor used in a normal video camera, and thus the number of pixels can be reduced. In addition, the sensing frequency can be increased as described above. As described above, when the sensing frequency is increased, the exposure time of each pixel is shortened. However, by increasing the light emission amount so as to obtain a required light amount in the short exposure time (this is performed in step 104). ), The amount of light received by each pixel increases, and an image signal of a sufficient level can be obtained from the image sensor 4c. Alternatively, a device capable of emitting light in a pulsed manner, such as a light emitting diode, may be used as the light emitting device 4b to generate a necessary and sufficient amount of light in a short time.

In the above standby mode, when the fingertip 7 or the like does not touch the finger plate 4a, the vise 4
Since the light emission amount of b is reduced (step 103) and the sensing frequency of the image sensor 4c is set to be considerably lower than that in the active mode (step 100), the power consumption can be considerably suppressed. Even when the fingertip 7 or the like is applied to the finger plate 4a, the sensing frequency of the image sensor 4c is considerably reduced (step 100), so that power consumption can be suppressed. However, when the fingertip 7 or the like is applied to the finger plate 4a, the fingertip 7 is almost immediately moved to the active mode in that state.
It is more important to adjust the light emission amount of b (step 104) so that the fingertip 7 is moved and the operation mode can be immediately shifted to the active mode.

After that, when the finger plate 4a of the pointing device 4 is pressed with the fingertip 7 to make a decision operation or an operation switch other than the pointing device 4 is operated to complete the operation of the pointing device 4 (step 109), the operation surface "Power / End call" button 2
a (FIG. 1) is operated, the power is turned off, or the portable information terminal 1 is covered with the portable information terminal 1 having a configuration as described below, and the use of the portable information terminal 1 is not terminated (step 110). Returning to the operation from step 100 described above, the pointing device 4 is held in a standby state until the next operation is performed.

FIG. 13 is a diagram showing an example of the arrangement of the pointing device 4 in the embodiment of the portable information terminal 1. FIG.
FIG. 2B shows an example in which the pointing device 4 is arranged on the back surface 1 a of the main body of the portable information terminal 1, and FIG. 2C shows the example in which the pointing device 4 is arranged on the main body of the portable information terminal 1. An example in which it is arranged on the side surface 1b is shown (here, it is arranged on the side surface 1b side, but it may be arranged on the side opposite to the side surface 1b), and FIG. The example which arrange | positioned beside is shown. Further, the specific example shown in FIG. 13E shows an embodiment in which the number key for inputting a telephone number is eliminated, and a number is input only by operating a pointing device. When inputting a number, a list of numbers and a pointer are displayed on the periphery of the display screen 3, the pointer can be moved to the number to be input by the pointing device 4, and the number can be input by performing a determination operation. In such a portable information terminal 1, the pointing device 4 can be arranged at an appropriate position.

As described above, the pointing device 4 may be arranged at any place of the main body of the portable information terminal 1 in consideration of ease of use. For example, FIG.
In the arrangement examples shown in (b) and (c), the back surface 1a and the side surface 1b of the main body of the portable information terminal 1 usually do not use most of the area. By arranging, the surface of the main body of the portable information terminal 1 can be effectively used, the operation surface can be reduced, and the size of the portable information terminal 1 can be further reduced.

FIG. 14 is a diagram showing an example of the arrangement of the pointing device 4 in another embodiment of the portable information terminal 1.

FIGS. 14A to 14C relate to the foldable portable information terminal 1, in which a case 1d having a display screen 3 and a case 1e having an operation surface 2 are rotated by a hinge 1c. When the case 1d and 1e are not used, the display screen 3 and the operation surface 2 can be prevented from being exposed to the outside by being folded so that the cases 1d and 1e are overlapped.

In the portable information terminal 1 having such a configuration, a specific example shown in FIG.
Are arranged on the operation surface 2, and in the specific example shown in FIG. 14B, the pointing device 4 is arranged on the hinge 1c. In each of these specific examples,
By arranging the pointing device 4 on the operation surface 2, it is possible to protect the pointing device 4 when the portable information terminal 1 is not used.

Further, in the specific example shown in FIG. 14C, a notch 1f is provided at a part of the case 1d on the side of the case 1e, so that the case 1d can be folded as shown on the right. The notch 1f exposes a part of the case 1e to the outside, and the pointing device 4 is arranged on the exposed portion. In this specific example, when the folding device is in the folded state, the function of the pointing device 4 is switched to a function different from the original function (that is, the function of moving the pointer on the display screen 3, that is, the pointer operation function), and the function is changed. The pointing device 4 can be used even in the folded state. As such a function, for example, there is an incoming call display function, and when there is an incoming call in the folded state, the light emitting device 4b (FIG. 2) of the pointing device 4 emits light.

The specific example shown in FIG. 14D is provided with a flip (open / close cover) 1 g for the operation surface 2, and the specific example shown in FIG. 1h. In any of these specific examples, by disposing the pointing device 4 on the operation surface 2, it is possible to protect the pointing device 4 when the portable information terminal 1 is not used.

In each of the specific examples shown in FIG.
The pointing device 4 performs the operation shown in FIG. 12. When the pointing device 4 is folded in the specific examples shown in FIGS.
In the specific example shown in (e), when the covers 1g and 1h are closed, it is determined in step 110 that the operation of the portable information terminal 1 has been completed, the pointing device 4 is stopped, and FIG. In the specific examples shown in FIGS. 14A to 14C, when the state is changed from the folded state to the open state, or in the specific examples shown in FIGS.
When 1h is opened, the pointing device 4 starts the operation in the standby mode in step 100. In this case, in each portable information terminal 1 shown in FIG. 14, although not shown, the folded state and the cover 1g, 1h
Needless to say, a sensor for detecting the open / closed state of the camera is provided.

As described above, the pointing device 4
Is placed at an appropriate position on the portable information terminal 1, and the position is such that when the user holds the portable information terminal 1 with his hand, it is easy to operate with any fingertip such as his thumb or index finger Needless to say, it is a position. Of course,
Although the pointing device 4 may be operated with the finger of the hand that does not have the portable information terminal 1, it is more convenient to operate the pointing device 4 with the finger of the hand that has the portable information terminal 1. Needless to say, there is.

FIG. 15 is a block diagram showing a circuit configuration of another embodiment of the portable information terminal according to the present invention.
Is an open / close detector, 36 is a contact sensor, 37 is an operation lock switch, and 38 is a receiver proximity sensor. The same reference numerals are given to portions corresponding to those in FIG.

In this embodiment, in this embodiment, all or at least one of the open / close detector 35, the contact sensor 36, the operation lock switch 37, and the receiver proximity sensor 38 is different from the circuit configuration shown in FIG. It has been added.

The open / close detector 35 is provided, for example, in the portable information terminal 1 provided with a foldable type as shown in FIG. 15 or a cover. For example, as shown in FIG. Case 1d,
1e (here, case 1
d of the display screen 3 side). The open / close detector 35 may be a push-type switch or an optical sensor. When the cases 1d and 1e overlap and are folded, the open / close detector 35 detects this. The output is supplied to the controller 31. The controller 31 determines from this detection output
In the case of the foldable portable information terminal 1, it is determined whether or not the fold is unfolded and opened, and in the case of the portable information terminal 1 having a cover, it is determined whether the cover is opened or closed.

The contact sensor 36 is, for example, as shown in FIG.
As shown in FIG. 1, the portable information terminal 1 is disposed on the side surface 1b of the portable information terminal 1, and detects whether or not the palm of the user has touched. This detection output is supplied to the controller 31, and the controller 31 determines whether or not the portable information terminal 1 is held in the hand of the user based on the detection output. The contact sensor 36 may be disposed on the side surface 1b of the portable information terminal 1, or may be disposed on both side surfaces 1b.

The contact sensor 36 is used to determine when the operator is holding it with his / her hand for operation and at other times (for example, when touching the surroundings in a bag or the like).
In the case of detection on the side surface 1b, a capacitance type capable of distinguishing between a human hand and the other hand is suitable. A method used as a detection reference is suitable.

The operation lock switch 37 is, for example, as shown in FIG.
As shown in FIG. 6 (c), one side 1 of the portable information terminal 1
b, and by operating this, each operation switch on the operation surface 2 and the pointing device 4 are locked in an inoperable state.

The receiver proximity sensor 38 is, for example, disposed near the position of the sound receiver 30 such as a speaker in the portable information terminal 1 as shown in FIG. Is close to (for example, 1 cm
), And sends a detection output to the controller 31. Based on the detection output, the controller 31 determines that the user's ear is close to the sound receiver 30 and is in a listening state.

FIG. 17 shows the open / close detector 35 and the contact sensor 3
6, operation lock switch 37, receiver proximity sensor 3
8 is a flowchart illustrating a control operation of the controller 31 based on a detection output of No. 8; Here, the portable information terminal 1 includes these open / close detector 35, contact sensor 36, operation lock switch 3
7. Description will be made assuming that all or any of the receiver proximity sensors 38 are provided.

In the figure, in the case of the portable information terminal 1 as shown in FIG. 16C, the operation lock switch 37 is turned on.
(Step 201), the operation switches on the operation surface 2 are locked so that they cannot be operated. At this time, the controller 31 stops the pointing device 4 (ie, the light emitting device 4b in FIG. 2). And image sensor 4
c is not operating. Step 200). Further, in the case of the foldable portable information terminal 1 as shown in FIG. 16A, when the cases 1d and 1e are in a state of being overlapped and folded, the open / close detector 35 is in an open state (step 202). Also in this case, the controller 31 stops the pointing device 4 (step 200). Further, the receiver proximity sensor 3 as shown in FIG.
In the case of the portable information terminal 1 provided with the communication terminal 8, during a call, the receiver proximity sensor 38 sends a detection output to the controller 31 indicating that the user's ear is close to the sound receiver 30 and the call is in progress. Then, the controller 31 stops the pointing device 4 (step 200). Furthermore, for example, FIG.
In the case of the portable information terminal 1 provided with the contact sensor 36 as shown in FIG. 6B, when the contact sensor 36 does not detect a contact object (step 204), the controller 31
Determines from the detection output from the contact sensor 36 that the portable information terminal 1 is not held in the user's hand and is not in use, and the pointing device 4
Is stopped (step 200).

In this way, steps 201 and 20
When the mobile information terminal 1 detects that the mobile information terminal 1 is not in use, the pointing device 4 is set to a stop state.
Even if the user accidentally touches the finger plate 4a (FIG. 2) of the pointing device 4 accidentally, or if the portable information terminal is put in a bag or handbag, it is stored in the bag. Even if the other object touches the finger plate 4a (FIG. 2) of the pointing device 4, the pointing device 4 does not operate, and the malfunction of the pointing device 4 can be prevented. In addition, power consumption by the pointing device 4 can be suppressed, and power can be saved.

The open / close detector 35 is used for a folding type portable information terminal or a portable information terminal 1 having a cover as shown in FIG. 14, but the contact sensor 36, the operation lock switch 37, the receiver The unit proximity sensor 38 can be used for any type of portable information terminal 1 shown in FIGS. Therefore, as the portable information terminal 1,
For example, it may have any of the open / close detector 35, the contact sensor 36, and the operation lock switch 37, and the receiver proximity sensor 38. In this case, the operation shown in FIG. The detection operation of any one of steps 204 and step 203 is performed.

In any of the detection results in steps 201, 202, and 204, if the portable information terminal 1 is in a state of being used by the user and the receiver proximity sensor 38 does not detect a nearby object, the procedure shown in FIG. Step 1
The operation from 00 is performed. Step 10 in FIG.
In the case of “Yes” in 6,109, step 20 in FIG.
1 (FIG. 17 includes the flowchart shown in FIG. 12, but does not include step 110 in FIG. 12).

FIG. 18 is a view showing another specific example of the erroneous operation preventing means of the pointing device 4, in which 39 is a crown. I do.

FIG. 18A shows the case of the foldable portable information terminal 1, in which the pointing device 4 is arranged on a hinge 1c connecting the cases 1d and 1e. When the pointing device 4 is operated, the pointing device 4 can be made to appear outside and can be operated when the pointing device 4 is operated. When the pointing device 4 is not used, the pointing device 4 can be operated as shown on the right. At least part of 4 is hidden.

Of course, in the folding portable information terminal 1, the pointing device 4 is
18 can be prevented, but this is a state in which the portable information terminal 1 is not used. When the portable information terminal 1 is used, the cases 1d and 1e are opened, and FIG. The specific example of (a) makes it possible to prevent erroneous operation of the pointing device 4 even in such a case.

FIG. 18B shows a portable information terminal 1 in which the display screen 3 and the operation surface 2 are always exposed to the outside.
In this case, one end of a rotating shaft (not shown) inside the case is connected to the outer case 8 (see FIG. 2).
A crown 39 is attached to the outside of the case 1 so as to protrude outward from the side surface 1b, and the pointing device 4 is attached to the other end of the rotating shaft in the case.
When using the pointing device 4, the crown 3
As shown in FIG. 2, the user operates the touch device 9 by touching the finger plate 4 a with a fingertip from the through hole 8 a provided in the outer case 8 as shown in FIG. When not in use, the pointing device 4 is rotated by rotating the crown 39, and FIG.
8 (b), the finger plate 4a is hidden.

In this way, erroneous operation of the pointing device 4 when not in use can be prevented.

Note that the means shown in FIG.
Needless to say, the present invention can be applied to the portable information terminal 1 having the structure shown in (a), (c) to (e). Of course, FIG.
In the specific examples shown in (d) and (e), erroneous operation of the pointing device 4 is prevented by closing the cases 1d and 1e and closing the covers 1g and 1h. The terminal 1 is not used, and when the portable information terminal 1 is used, the cases 1d and 1e are opened or the covers 1g and 1h are opened.
Is opened, and the specific example of FIG. 18B enables to prevent erroneous operation of the pointing device 4 even in such a case.

FIG. 19 is a view showing still another specific example of the erroneous operation preventing means of the pointing device 4, and FIG. 19A shows the entire portable information terminal 1, and FIG. , (C) are cross-sectional views of the finger plate 4a of the pointing device 4 as viewed from the parting line of FIG. 3 (a). I do.

In the specific example shown in FIG. 19 (b), the outer shape of the finger plate 4a of the pointing device 4 is formed so as to be deeper toward the center thereof. The pointing device 4 has the configuration shown in FIG. 2 except for the finger plate 4a.
d is arranged so that the image near the center of the concave outer surface of the finger plate 4a converges on the imaging surface of the imaging element 4c. Therefore, when the finger plate 4a having the configuration shown in FIG. 19B is used, for example, when the portable information terminal 1 is stored in a bag, other stored items are stored in the portable information terminal 1.
When the user touches the operation surface 2 and moves the pointing device 4, the image of this surface on the imaging surface of the imaging element 4c is obtained because the surface of the other storage object is farther than the center of the outer surface of the finger plate 4a. Becomes very blurred and the control unit 16
(FIG. 15) cannot detect the image (that is, pattern) of this surface. For this reason, even if this other storage item moves with respect to the pointing device 4, the control unit 16 cannot detect this, and does not proceed to step 107 in FIG. 12 following the operation in FIG. The erroneous operation of the pointing device 4 can be prevented.

In the specific example shown in FIG. 19C, the outer surface of the finger plate 4a of the pointing device 4 is made flat,
And an outer case 8 into which the finger plate 4a is fitted.
And a projection 8b is provided around the through hole 8a. The outer surface of the finger plate 4a is arranged at a position recessed from the projection 8b. Also in this specific example, the configuration of the pointing device 4 other than the above is the same as that shown in FIG. 2, and the condenser lens 4d is arranged so that the image on the outer surface of the finger plate 4a converges on the imaging surface of the imaging device 4c. , Is located.

According to this configuration, for example, the portable information terminal 1 is stored in a bag and the other stored items are stored in the operation surface 2 of the portable information terminal 1 in the same manner as in the specific example shown in FIG.
The pointing device 4 does not malfunction even if it is touched and moves on the pointing device 4.

Next, an operation example of the embodiment of the portable information terminal 1 described above will be described. FIG. 20 is a flowchart showing an operation procedure for making a call. When making a call to the other party whose telephone number is registered, the operation can be performed almost only by operating the pointing device 4. FIG. 20 shows this case. FIG.
1 is a diagram showing a screen displayed on the display screen 3 in accordance with this operation, and 40 is a pointer (cursor).

In FIG. 1, FIG. 20, and FIG. 21, when the power is turned on by operating the “power / call end” button 2d, the initial screen shown in FIG. When the "menu" button 2c is operated in this state (step 300), the menu screen shown in FIG. On this menu screen, menus (selection items) such as “phone book”, “mail”, “map service”, “shopping”,... Can be selected, and a frame-shaped pointer 40 is also displayed. I have. The pointer 40 is moved one step at a time in a direction (ie, up and down direction) corresponding to the moving direction of the fingertip by performing a pointer operation of moving the fingertip by touching the finger plate 4a in front of the pointing device 4. Selected items).

A pointer operation is performed on this menu screen to set the pointer 40 to a desired selection item, here, the selection item "telephone directory" (step 301), and press the finger plate 4a of the pointing device 4 with a fingertip. When the operation is performed (step 302), FIG. 21 (c)
Is displayed on the display screen 3. On this telephone directory screen, the name of the other party whose telephone number is registered and the pointer 40 for selecting one of them are displayed. Therefore, by performing a pointer operation with the finger plate 4a of the pointing device 4 (step 303), the pointer 40 is moved on the telephone directory screen so as to match the other party who wants to make a call. Here, when the name of the other party is not displayed, FIG.
When the pointer 40 is moved to the end of the telephone directory screen and the pointer operation is performed in the same direction, the telephone directory screen is scrolled (step 304), and the name of the desired partner is displayed. State.
The telephone directory screen shown in FIG. 21E shows this state, whereby the pointer 40 can be set to the desired partner (here, “Kinoshita XX”) (step 305). . Then, with the pointer 40 aligned with the desired partner, the pointing device 4
(Step 306), the telephone number and the selection items "call" and "edit phonebook" are displayed as shown in FIG. 21 (f). When the screen is shifted to the number screen and a call is made to the other party, the pointer 40 is moved to the selection item "Call" and the above-described determination operation is performed with the pointing device 4 (step 307), as shown in FIG. 21 (g). The screen is shifted to such a call screen, and the other party is called (step 308).

On the call screen, as shown in FIG. 21 (g), an item "stop the call" is also displayed, and the pointer 40 is set to this item. For example, if you want to cancel the call because the other party does not answer the call easily,
If the above-described determination operation is performed on the pointing device 4 while the call screen shown in FIG. 21G is displayed, the call is stopped and the display returns to the initial screen display state shown in FIG.

A call is made in the display state of the call screen shown in FIG. 21 (g) (step 308). Thereafter, when the other party answers the telephone, a call is started. Name and phone number are displayed. When the "power / end call" button 2a is operated after talking with the other party is completed, the screen returns to the initial screen shown in FIG.

In this way, the other party to be called can be called by operating the pointing device 4.

When a call is made to the other party whose telephone number is not registered, the "power / end call" button 2a is operated to display the telephone number input screen, and the ten keys are operated, as in the prior art. After inputting the telephone number of the other party on the leverage input screen, the "call start" button 2b is operated to call the other party.

In any of the steps shown in FIG. 20, by operating the "power / call end" button 2a, the display returns to the initial screen display state shown in FIG.
In any of the steps shown in FIG.
Then, by operating the "return" button 2d, the screen returns to the screen displayed immediately before.

FIG. 22 is a flowchart showing another example of operation of the portable information terminal according to the present invention in each of the above-described embodiments, that is, an operation procedure for receiving a map service. Also,
FIG. 23 is a diagram showing a screen displayed on the display screen 3 in accordance with this operation, in which 41 is a map, 42 is a pointer (cursor), and 43 is a scroll icon.

In FIGS. 1, 22 and 23, step 400 is the same as step 300 in FIG.
When the "menu" button 2c is operated in a state where the initial screen shown in FIG. 23A is displayed on the display screen 3, a menu screen similar to FIG. 21B shown in FIG. Is displayed (step 400). By performing a pointer operation on this menu screen, the frame-shaped pointer 40 is moved to a desired selection item, in this case, as shown in FIG. When a decision operation of pushing the 4a with a fingertip is performed (step 401), FIG.
Is displayed on the display screen 3.

Then, by operating the pointer, the pointer 40 is selected in accordance with the target place name on this place name selection screen (here, the town name "Shibuya"), and the above-described determination operation is performed. Step 402), a map screen of the selected town as shown in FIG. On this map screen, a map 41 of the selected Shibuya, an arrow-shaped pointer (cursor) 42, and a white triangular scroll icon 43 are displayed. A total of eight scroll icons 43 are displayed, four at the four corners of the map 41 and four between them. These scroll icons 43 indicate the scroll direction of the map 41, and one of them can be selected by the pointer 42.

In the display state of the map screen shown in FIG. 23 (e), the pointer 42 is moved by operating the pointer with the pointing device 4 so that the pointer 42 is moved.
As shown in FIG. 23 (f), when the above determination operation is performed with the pointing device 4 in accordance with the scroll icon 43 indicating the desired scroll direction of the map 41 (step 403), as shown in FIG. The map 41 scrolls in the direction indicated by the scroll icon 43 (step 404). In this case, scrolling continues while the finger plate 4a of the pointing device 4 is being pushed, and when this pushing is finished, this scroll ends. The scroll icon 43 selected by the pointer 42 is, as shown in FIGS. 23 (f) and 23 (g),
It changes to a black triangle and clarifies the scroll direction.

When scrolling progresses and a desired place, for example, a shop where information is to be viewed, appears on the map 41, the determination operation is stopped to stop the scroll, and the pointer 42 is moved by the pointer operation. As shown in h), when the pointer 42 is made to coincide with a desired place and the above-mentioned determination operation is performed (step 405), a detailed information screen showing detailed information of the desired place is displayed on the display screen 3 (step 405). Step 406).

FIGS. 23 (i) and 23 (j) schematically show an example of the detailed information screen. The detailed information of the store desired to be viewed in FIG. 23 (h), for example, the name of the store (Italian restaurant), opening hours (10: 00-20: 0)
0), regular holiday (Tuesday), telephone number (03-1111-)
Xxx).

Further, on this detailed information screen, two selection items "call" and "return to map display" and a frame-shaped pointer 40 are displayed, and the pointer 40 is moved by the pointer operation with the pointing device 4. By doing so, one of the selection items can be selected (step 407). Therefore, if the user wants to call this store by looking at the detailed information on this detailed information screen, FIG.
As shown in (i), by selecting the selection item "make a call" with the pointer 40 and performing the above-described determination operation with the pointing device 4, the telephone is automatically called (step 408). When the user ends the call and operates the “power / end call” button 2a, FIG.
Alternatively, the display returns to the display state of the map screen shown in FIG.
In addition, even if the user does not want to call the store after seeing the detailed information on the detailed information screen, as shown in FIG. 23 (j), the user selects the selection item "return to map display" with the pointer 40 and selects the pointing device. By performing the above-described determination operation in step 4, it is possible to return to the display state of the map screen shown in FIG. 23 (h) or 23 (e). Then, in such a display state, the operation from step 405 or from step 403 can be performed to re-designate the desired place. However, when the map service is to be stopped (step 409), the "return" button 2d By operating
Each time this operation is performed, it is possible to return from the map screen to the place name selection screen shown in FIG. 23D, the menu screen shown in FIGS. 23B and 23C, and the initial screen shown in FIG. .

By operating the "power / end call" button 2a in the display state in each step except the case of the call in step 408, the display state of the initial screen shown in FIG. It can be. Step 4
08, the "power / end call" button 2a
By operating, the call is ended and the above-described map screen is displayed, but the “power / end call” button 2
By operating a, the display state of the initial screen directly shown in FIG.

In such a “map service”, under the control of the controller 31 (FIGS. 10 and 15), the arrow-shaped pointer 42 displayed on the map 41 is moved in accordance with the pointer operation of the pointing device 4. Move continuously. As a result, a desired place on the map 41 can be specified accurately. On the screen where the selection items are displayed, a frame-shaped pointer 40 is displayed.
Under the control of the controller 31, the pointer 40 moves stepwise. As a result, a desired selection item can be smoothly selected without requiring fine position adjustment of the pointer 40. In this manner, in the present invention, the method of moving the pointer is automatically switched according to the type of screen to be displayed, while the method of operating the pointer with the pointing device 4 is the same, and the pointer is displayed on each screen. The movement will be adapted.

FIG. 24 is a cross-sectional view showing still another specific example of the pointing device 4 used in each of the above embodiments of the portable information terminal according to the present invention, wherein 4d ₁ , 4d ₂ , 4d
Reference numeral ₃ denotes a condenser lens, 4g denotes a lens exchange mechanism, and 4h denotes a lens expansion / contraction mechanism.

In this specific example, each of the above-described embodiments of the portable information terminal 1 described above is provided with a function as a digital camera or a video camera since the image pickup device 4c is provided. is there.

In the specific example shown in FIG. 24A, the condenser lenses 4d ₁ and 4d ₂ having different focal lengths can be exchanged by the lens exchange mechanism 4g. The condenser lens 4d ₁ is used for pointer operation. is sufficient short lens focal length, the converging lens 4d ₂ is the focal length is sufficiently long lens for imaging, such as landscapes. The lens exchange mechanism 4g is composed of a slide plate or a rotary plate,
d ₁ and 4d ₂ are attached. Further, an operation member for operating the lens exchange mechanism 4g on the operation surface 2 and the side surface 1b of the main body shown in FIG. 1 and the like is provided.

FIG. 24A shows a state in the case of a pointer operation, in which the finger plate 4a and the image pickup device 4c are shown.
Focal length converging lens 4d ₁ is arranged a short between. When the portable information terminal 1 functions as a video camera, by sliding or rotating the lens exchange mechanism 4g, as shown in (b) of FIG.
The focal length are arranged long condenser lens 4d ₂ between the fingers plate 4a and the image pickup element 4c.

The specific example shown in FIG. 24B uses a condensing lens 4d ₃ having a variable focal length. The condenser lens 4d ₃ is, for example, a retractable lens in a direction perpendicular to its optical axis, with a lens telescopic mechanism 4h,
In its radially equidistant at a plurality of points of the lens periphery or apply uniform force simultaneously, by or clear it, can change the thickness of the condenser lens 4d _3, whereby the condensing lens 4d The focal length of ₃ changes. The lens extension mechanism 4h may be configured, for example, as an aperture mechanism used in a camera or the like.

[0127] Figure 24 (b) (i) shows the state when the pointer operation, the condenser lens 4d ₃ is thick and the focal length is sufficiently short state. When it is to function portable information terminal 1 as a video camera, acting lens telescopic mechanism 4h, as shown in (b) of FIG. 24 (b), the the focal length is long lens condenser lens 4d ₃ I do.

The same applies to the case where the portable information terminal 1 functions as a digital camera.

In this embodiment in which a function as a digital camera or a video camera is provided, an operation button for a video camera, a recording / reproduction button, and the like are provided on the display surface 2 of the portable information terminal 1. (For the playback operation, the pointing device 4 may have a function as shown in FIG. 8D). When the portable information terminal 1 functions as a video camera, FIG. , The controller 31 controls the imaging device 4c
The output signal is appropriately processed by a processing circuit (not shown), recorded on an external recording medium (not shown) such as the storage device 32 or a floppy (registered trademark) disk, and a reproduced image is displayed on the display surface 3 by performing a reproducing operation. To be displayed.

Also, the portable information terminal 1 is connected as described above.
In order to function as a digital camera or a video camera, an image sensor usually used for a digital camera or a video camera is used as the image sensor 4c. By using such an image sensor 4c, as in the previous embodiment, the pointing device 4c is used. When is used for pointer operation, a part of the imaging surface of the imaging element 4c is used as a scanning target to perform image detection at a high sensing frequency as described above. When functioning as a digital camera or a video camera as described above, the entire imaging surface of the imaging element 4c is used as a scan target. Such a change of the scan area used on the imaging surface can be achieved by, for example, changing the cycle and amplitude of the scan signal used for the image sensor 4c.

[0131]

As described above, according to the present invention,
Since the pointer displayed on the display screen can be moved in accordance with the movement of the image on the outer surface of the plate detected by the image detecting means, the user places a fingertip on the plate, and Is moved, the fingerprint of the fingertip is detected as a moving image, and the pointer on the display screen moves in a direction corresponding to the direction of the movement. Therefore, it is not necessary to operate different operation switches according to the moving direction of the pointer, and the operation is easy. Further, since the movement of the image on the plate may be detected, the detection range of the image is narrowed. The pointing device can be downsized.

Further, a light emitting means for irradiating the outer surface of the plate with illumination light is provided, and the reflectance on the outer surface of the plate is measured from the amount of light received by the image detecting means and the amount of light emitted by the light emitting means. Means, when the reflectance measured by the first means is equal to or less than a preset minimum reference value, the light emission amount of the light emitting means is set to a preset first reference value, and the first
When the reflectance measured by the above means exceeds the reference minimum value,
The second means for adjusting the light emission amount of the light emitting means so that the light reception amount in the image detection means becomes a second predetermined reference value larger than the first reference value, and the image detection means detects the light emission amount. Third means for detecting movement of the image and moving the pointer in a direction corresponding to the direction of the detected movement; and determining whether or not there is movement of the image detected by the image detection means. In the active mode and move the pointer in the direction according to the direction of the movement,
Fourth means for setting the pointing device to a standby mode when there is no movement for a predetermined period of time,
The sensing frequency of the pointing device in the standby mode is set to be smaller than the sensing frequency of the pointing device in the active mode, and the second means includes:
When the reflectance measured by the first means is equal to or less than a preset minimum reference value, the light emission amount of the light emitting means is temporarily changed, and the light reception amount of the image detecting means is changed in response to the change of the light emission amount. When the light emission does not change, the light emission amount of the light emitting means is set to the first reference value set in advance. Therefore, the image detecting means illuminates the image on the outer surface of the plate. Can be detected and also
When the pointer is not moved without touching the outer surface of the plate with the fingertip or the like, this can be detected, and the light emission amount of the light emitting means can be suppressed in the standby mode, thereby saving power. Moreover, whether or not a fingertip or the like is touching the outer surface of the plate is determined based on the reflectance of the image on the outer surface of the plate. Since the change in the amount of received light is detected, it is more accurate to determine whether or not a fingertip or the like is touching the outer surface of the plate.

[Brief description of the drawings]

FIG. 1 is a front view showing an embodiment of a portable information terminal according to the present invention.

FIG. 2 is a configuration diagram showing a specific example of a pointing device used for a portable information terminal according to the present invention.

FIG. 3 is a configuration diagram showing another specific example of the lighting unit in the pointing device shown in FIG. 2;

FIG. 4 is a configuration diagram illustrating another arrangement example of the finger plate in the pointing device illustrated in FIG. 2;

FIG. 5 is a perspective view showing a specific example of the configuration of the outer surface of the finger plate shown in FIGS. 2 to 4;

FIG. 6 is a block diagram showing another specific example of the operation means of the “enter” switch shown in FIG. 2;

FIG. 7 is a configuration diagram showing another specific example of the pointing device used for the portable information terminal according to the present invention.

FIG. 8 is a configuration diagram showing still another specific example of the pointing device used in the portable information terminal according to the present invention.

FIG. 9 is a configuration diagram showing still another specific example of the pointing device used for the portable information terminal according to the present invention.

FIG. 10 is a block diagram showing a specific example of a circuit configuration of the embodiment shown in FIG.

11 is a diagram for explaining a method of detecting a change in a captured image from a pointing device of the controller in FIG.

12 is a flowchart showing the operation of the pointing device shown in FIG. 2 by the controller in FIG. 10;

FIG. 13 is a diagram showing an example of an arrangement of a pointing device in a portable information terminal according to the present invention.

FIG. 14 is a diagram illustrating another arrangement example of the pointing device in the portable information terminal according to the present invention.

FIG. 15 is a block diagram showing a specific example of a circuit configuration in another embodiment of the portable information terminal according to the present invention.

16 is a diagram showing an example of arrangement of the open / close detector, the contact sensor, the operation lock switch, and the receiver proximity sensor shown in FIG. 15 in a portable information terminal.

17 is a flowchart showing a control operation of the pointing device based on detection outputs of the open / close detector, the contact sensor, the operation lock switch, and the receiver proximity sensor shown in FIG.

FIG. 18 is a diagram showing another specific example of a pointing device erroneous operation prevention means used in a portable information terminal according to the present invention.

FIG. 19 is a view showing still another specific example of the pointing device erroneous operation prevention means used in the portable information terminal according to the present invention.

FIG. 20 is a flowchart showing a specific example of an operation procedure when making a call according to the embodiment of the portable information terminal according to the present invention.

21 is a diagram showing a specific example of a screen sequentially displayed on the display screen according to the operation procedure shown in FIG.

FIG. 22 is a flowchart showing a specific example of an operation procedure for receiving a map service of the embodiment of the portable information terminal according to the present invention.

FIG. 23 is a diagram showing a specific example of a screen sequentially displayed on the display screen according to the operation procedure shown in FIG. 22.

FIG. 24 is a cross-sectional view showing a specific example of a pointing device when a function of a video camera is provided in the embodiment of the portable information terminal according to the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Personal digital assistant 1a Back surface 1b Side surface 1c Hinge 1d, 1e Case 1f Notch 1g Flip 1h Slide cover 2 Operation surface 3 Display screen 4 Pointing device 4a Finger plate 4b Light emission vice 4c Image sensor 4d, 4d1-4d3 Condensing lens 4e Hinge 4f, 4f1, 4f2 Optical path changing means 4g Lens exchange mechanism 4h Lens expansion / contraction mechanism 5 "Determine" switch 6 Circuit board 8 Outer case 8a Through hole 9 Transparent section 10 Edge section 11, 11a, 11b Guide 12 Imaging area 13 Grain processing Area 14 Depressed part 15 "Return" switch 16a, 16b Projection 17, 17a, 17b Rotation axis 18a to 18d Function switch 19 Projection 20 Determination operation unit 21 Function operation unit 22 Operating member 23 Hinge 30 Sound receiver 31 Controller 32 Storage Instrument 33 Display 35 Open Detector 36 contact sensor 37 Lock switch 38 the receiver section the proximity sensor 39 crown 40 frame-shaped pointer (cursor) 41 Map 42 arrow-shaped pointer (cursor) 43 scroll icon

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Yukinori Asada 292 Yoshida-cho, Totsuka-ku, Yokohama-shi, Kanagawa Prefecture F-term in the Digital Media Development Division of Hitachi, Ltd. 5B019 DA10 5B087 AA09 AC02 AE09 BC12 BC13 BC19 BC26 BC32 DD03

Claims (2)

[Claims] 1. A portable information terminal having a display screen on which a pointer is displayed, comprising: a transparent plate having an outer surface for contacting a surface of an object; and a surface of the object contacting the outer surface of the plate. An image detecting means for detecting the image of, an optical means for forming the image on the outer surface of the plate on a detection surface of the image detecting means, and a light emitting means for irradiating the outer surface of the plate with illumination light, A pointing device that moves the pointer in accordance with the movement of the image on the outer surface of the plate that has not been detected by the image detection unit; and the plate detects the amount of light received by the image detection unit and the amount of light emitted by the light emission unit. A first means for measuring the reflectance on the outer surface of the light emitting device, and when the reflectance measured by the first means is equal to or less than a predetermined reference minimum value, the light emission amount of the light emitting means is set in advance. The first reference value When the reflectance measured by the first means exceeds the reference minimum value, a predetermined second reference value in which the amount of light received by the image detection means is larger than the first reference value is used. Second means for adjusting the light emission amount of the light emitting means, and detecting the movement of the image detected by the image detecting means, and moving the pointer in a direction corresponding to the detected direction of the movement. A third means for determining whether or not the image detected by the image detecting means has a motion, and when there is the motion, the pointing device is set to an active mode, and the pointer is moved in a direction corresponding to the direction of the motion. And moving the pointing device to a standby mode when there is no movement for a predetermined period of time, wherein the sensing frequency of the pointing device in the standby mode is changed in the active mode. A portable information terminal, characterized by less than the sensing frequency of the pointing device. 2. The method according to claim 1, wherein the second unit temporarily reduces the light emission amount of the light emitting unit when the reflectance measured by the first unit is equal to or less than a preset minimum reference value. When the amount of light received by the image detecting means does not change with respect to the change in the amount of light emission,
A portable information terminal, wherein the light emission amount of the light emitting means is set to a first reference value set in advance.