JP2008146680A - Portable information terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable information terminal using a pointing device which can be sufficiently miniaturized and facilitate the moving operation of a pointer (cursor). <P>SOLUTION: At the part of a through-hole 8a provided on the outer case 8 of the portable information terminal, the pointing device 4 is disposed. This device 4 comprises a finger plate 4a attached to the through-hole 8a by a hinge 4e, an imaging device 4c disposed on a circuit board 6, a condenser lens 4d for image-forming an image on the outer surface of the finger plate 4a on the imaging surface of the imaging element 4c, and a light emitting device 4b for irradiating the outer surface of the finger plate 4a with illumination light, and a pattern such as the fingerprint of a fingertip 7 abutted on the outer surface of the finger plate 4a is imaged by the imaging device 4c. When the fingertip 7 is moved while being abutted on the finger plate 4a, the image imaged in the imaging device 4c is changed and the pointer displayed on a display image is moved in a direction according to the change direction for a distance corresponding to the change amount. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a portable information terminal using a pointing device for moving a pointer (cursor) on a display screen.

  Conventionally, in a portable information terminal such as a portable personal computer or a mobile phone, a pointer indicating a desired position of an image displayed on the display screen is displayed, and a pointing for moving the pointer to the desired position is displayed. A device is provided on the operation surface.

  As such a pointing device, conventionally, a trackball that detects the rotation of a sphere and moves the pointer and a dial type device that detects the rotation of a disk and moves the pointer are known. In order to increase the number of functions and the size of the display screen and to select more and more selection items arbitrarily and smoothly with the pointer, an independent feed switch is provided for each of the up / down / left / right pointer movement directions. There are also known cross pointers and stick pointers that are used for game machines and the like, and that move a pointer by tilting a stick or a disk back and forth and right and left. Furthermore, it is used in personal computers, etc., but it consists of a flat sensor plate with a certain area in order to move the pointer continuously in an image such as a map displayed on the display screen. A so-called track pad is also known in which when a finger is continuously moved, the continuously changing position of the finger is detected, and the pointer is continuously moved according to the detection result. .

  By the way, since the portable information terminal needs to be convenient to carry, further miniaturization, light weight, and thickness reduction are required. In view of such requirements, the above-described trackball and dial-type pointing device have physical movable parts such as a ball and a disk, and therefore, downsizing is limited and not easy. .

  In the above pointing device such as a cross pointer or stick pointer, the pointer moves basically by one step each time it is operated, that is, by one item displayed on the display screen. In order to select items that are sufficiently distant from each other, the number of necessary operations is increased, which takes time and effort.

  In addition, since the above-mentioned track pad is moved by bringing a finger into contact with the sensor plate, the sensor plate must be sufficiently larger than the area of the finger in contact with the sensor plate, and is suitable for miniaturization. Absent.

  An object of the present invention is to provide a portable information terminal using a pointing device that can solve such problems, can be sufficiently miniaturized, and can be easily moved by a pointer.

  In order to achieve the above object, the present invention provides a pointing device for moving a pointer displayed on a display screen of a display device, comprising: a substrate disposed inside a housing; An exterior body that constitutes a housing, and the exterior body includes an opening formed in the upper portion of the substrate, a plate that is held so as to be able to be pushed through a holding unit, and a pushing operation of the plate And a return means for releasing the pushing operation and restoring the plate to its original position, the plate being exposed from the opening and contacting the surface of the object The substrate has a transparent outer surface portion, and the substrate detects light reflected from the surface of the object that is in contact with the outer surface portion of the plate, and light emitting means for irradiating illumination light toward the outer surface portion of the plate Image detection means; A condensing lens that forms an image of the reflected light on the detection surface of the image detection unit, and a control unit that controls the pointing device. The control unit detects the amount of light received by the image detection unit and The reflectance on the outer surface of the plate is obtained from the amount of light and the amount of light emitted from the light emitting means at this time, and when the reflectance is lower than a preset reference minimum reflectance, it is determined that there is no pointer operation, When the light emission amount is maintained and the reflectance is higher than a preset reference minimum reflectance, it is determined that there is a pointer operation, and the light emitting means is operated with a light emission amount set in advance corresponding to the reflectance. It is turned on, and the pointer is moved according to the movement of the image on the outer surface of the plate detected by the image detecting means, and the operation switch is operated according to the pushing operation of the plate. .

  Further, according to the present invention, the control unit includes a standby mode in which the number of imaging is set in advance and an activity mode in which the number of imaging is set to be greater than the number of imaging in the standby mode. If there is a change in the captured image, it is determined that a pointer operation is being performed, and the mode is switched to the activity mode.

  According to the present invention, since the pointer displayed on the display screen can be moved according to the movement of the image on the outer surface of the plate detected by the image detection means, the user places the fingertip on the plate, When the fingertip is moved in this state, the fingerprint of the fingertip is detected as a moving image, and the pointer on the display screen moves in a direction corresponding to the direction of the movement. Therefore, it is easy to operate without operating different operation switches in accordance with the moving direction of the pointer, and it is only necessary to detect the movement of the image on the plate, so the detection range of the image is narrowed. The pointing device can be downsized.

  Further, there is provided light emitting means for irradiating illumination light to the outer surface of the plate, and first means for measuring the reflectance on the outer surface of the plate from the amount of light received by the image detecting means and the light emission amount of the light emitting means; When the reflectance measured by the first means is equal to or lower than a preset reference minimum value, the light emission amount of the light emitting means is set to a preset first reference value, and the reflection measured by the first means is used. When the rate exceeds the reference minimum value, the second light amount of the light emitting means is adjusted so that the amount of light received by the image detecting means becomes a preset second reference value larger than the first reference value. And a third means for detecting the movement of the image detected by the image detecting means and moving the pointer in a direction corresponding to the detected direction of the movement, and determining the presence or absence of the movement of the image detected by the image detecting means And pointing device when there is movement And a fourth means for setting the pointing device to a standby mode when the pointer is moved in a direction corresponding to the direction of movement and there is no movement for a predetermined period of time. The sensing frequency of the pointing device is made smaller than the sensing frequency of the pointing device in the active mode, and the second means is that the reflectance measured by the first means is not more than a preset reference minimum value. In some cases, the amount of light emitted from the light emitting unit is temporarily changed. When the amount of light received by the image detecting unit does not change with respect to the change in the amount of emitted light, the light emission amount of the light emitting unit is set to a first reference value set in advance. In order to illuminate the image on the outer surface of the plate with the light emitting means, the image detecting means can detect a high-intensity image, In addition, when the fingertip or the like does not touch the outer surface of the plate and the pointer is not moved, this can be detected, and the amount of light emitted from the light emitting means can be suppressed as a standby mode, thereby saving power. . Moreover, it is determined whether or not a fingertip or the like is touching the outer surface of the plate based on the reflectance of the image on the outer surface of the plate. Since the change in the amount of received light is detected, it is possible to more accurately determine whether or not a fingertip or the like is touching the outer surface of the plate.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a front view showing an embodiment of a portable information terminal according to the present invention, wherein 1 is a portable information terminal, 2 is an operation surface, 2a is a “power / end call” button, 2b is a “call start” button, 2c is a “menu” button, 2d is a “return” button, 3 is a display screen, and 4 is a pointing device. Here, this embodiment is a mobile phone, but it may be another portable information terminal such as a portable personal computer.

  In the figure, on the front surface of the portable information terminal 1, there are an operation surface 2 on which various operation members such as a pointing device 4 are arranged, and a display screen 3 on which an image and a pointer (cursor, not shown) are displayed. Is provided. On the operation surface 2, a menu screen is displayed on the power screen and the “power / call end” button 2 a for instructing the end of the call, the “call start” button 2 b for instructing the start of the call, and the display screen 3. There are provided a “menu” button 2c, a “return” button 2d for returning to the previous screen displayed on the display screen 3, a numeric keypad for character input, and the like.

  The pointer displayed on the display screen 3 can be moved by moving the surface of the pointing device 4 on the operation surface 2 with a fingertip. Although not shown, the pointing device 4 also has a determination function. When the pointing device 4 is held with a fingertip, the determination function is activated and items indicated by the pointer on the display screen 3, touch buttons, and the like. Decisions can be made.

2 shows a specific example of the pointing device 4 used in the portable information terminal 1 shown in FIG. 1. FIG. 2A is a longitudinal sectional view, and FIG. 2B is a perspective view of the inside. 4a is a light emitting device, 4c is an imaging device, 4d is a condenser lens, 4e is a hinge, 5 is a "decision" switch, 6 is a circuit board, 7 is a fingertip, 7a is a fingertip 7 8 is an outer case of the portable information terminal 1, and 8 a is a through-hole provided in the outer case 8.
In FIG. 2A, the upper side of the outer case 8 in the drawing is the outside of the portable information terminal 1.

  1A and 1B, a finger plate 4a, a light emitting device 4b, an image pickup device 4c, a condenser lens 4d, and a hinge 4e constitute the pointing device 4 in FIG. A finger plate 4a is installed in a state of being fitted into a through hole 8a provided in the outer case 8 on the operation surface 2 (FIG. 1) side of the portable information terminal 1. The outer surface of the finger plate 4a (that is, the surface on the fingertip 7 side shown in the figure) is convex, protrudes outward from the outer surface of the outer case 8, and can be easily touched by the belly 7a of the fingertip 7. Yes. The finger plate 4a is supported at one end by a hinge 4e and is pivotably mounted in the direction of the arrow about the hinge 4e. The finger plate 7 attaches the finger plate 4a to the inside of the outer case 8. (That is, inside the portable information terminal 1). When the pushing by the fingertip 7 is released, the finger plate 4a returns to the original state shown in the figure by a return means such as a spring (not shown).

  Inside the outer case 8, a light emitting device 4b, a condenser lens 4d, and an image sensor 4c are provided. The imaging element 4c is fixed to the circuit board 6 inside the outer case 8, and the normal line of the center of the imaging surface of the imaging element 4c, the optical axis of the condenser lens 4d, and the central axis of the finger plate 4a are substantially equal. The condenser lens 4d is arranged so that the image of the subject on the outer surface of the finger plate 4a is focused on the imaging surface of the imaging element 4c. The light emitting device 4b irradiates illumination light obliquely from the inside of the outer case 8 toward the outer surface of the finger plate 4a. Therefore, when there is nothing on the outer surface of the finger plate 4a, the illumination light from the light emitting device 4b is emitted outside the portable information terminal 1 through the finger plate 4a, but the belly 7a of the fingertip 7 is placed on the outer surface of the finger plate 4a. When hit, the illumination light from the light emitting device 4b illuminates the antinode 7a, and a part of the reflected light from there is condensed on the image sensor 4c via the condenser lens 4d. Thereby, when the pattern of the surface of what is applied to the finger plate 4a, for example, when the belly 7a of the fingertip 7 is in contact with the finger plate 4a, the fingerprint is imaged by the imaging element 4c. The imaging region on the finger plate 4a of the imaging element 4c is a partial region, such as the central portion of the finger plate 4a, and therefore, a part of the belly 7a of the fingertip 7 applied to the finger plate 4a. An area is imaged.

  As described above, when the illumination light is irradiated on the object surface contacting the finger plate 4a from an oblique direction, the illumination pattern is formed when the pattern on the object surface is a pattern including uneven portions such as a fingerprint of the fingertip 7. The brightness and darkness of the portion that has been exposed to light and the portion that has not been exposed become more prominent, and an image with a clear pattern is captured by the image sensor 4c.

  Further, by pushing the finger plate 4a with the fingertip 7 in the direction of the arrow as described above, the finger plate 4a comes into contact with the “decision” switch 5 provided on the inner side of the finger plate 4a, and this is operated to be described later. Make sure that the decision operation has been performed.

FIG. 3 is a block diagram showing another specific example of the illuminating means in the pointing device 4 shown in FIG. 2, wherein 4f, 4f ₁ and 4f ₂ are optical path changing means, and parts corresponding to those in FIG. A duplicate description is omitted.

  In the specific example shown in FIG. 3A, the light-emitting device 4b is arranged upward on the circuit board 6 (that is, the emission direction of the illumination light is directed in a direction perpendicular to the surface of the circuit board 6), and the illumination light is supplied to the circuit. Light is emitted in a direction perpendicular to the surface of the substrate 6. Then, an optical path changing means 4f made of a mirror or a prism is provided between the light emitting device 4b and the outer case 8, and the optical path of the illumination light emitted from the light emitting device 4b is changed by the optical path changing means 4f, so that the finger plate 4a Irradiate from below at an angle.

In the specific example shown in FIG. 3B, the light emitting device 4b is disposed laterally on the circuit board 6 (that is, the illumination light is emitted in a direction parallel to the surface of the circuit board 6), and the illumination light is supplied to the circuit. Light is emitted in a direction parallel to the surface of the substrate 6. Then, the optical path changing means 4f ₁ consisting mirror or prism to face on the circuit board 6 to the light exit of the light emitting device 4b, also the optical path changing means 4f ₁ between the circuit board 6 and the outer case 8 Opposing optical path changing means 4f ₂ composed of mirrors or prisms are provided oppositely, and the optical path of the illumination light emitted from the light emitting device 4b is changed by these optical path changing means 4f ₁ and 4f ₂ to irradiate the finger plate 4a obliquely from below. To do.

  Thus, by installing the light emitting device 4b, which is an electronic component, on the same circuit board as the imaging device 4c, wiring holding components and the like can be simplified, manufacturing costs can be reduced, and work time can be shortened.

  FIG. 4 is a block diagram showing another arrangement of the finger plate 4a in the pointing device 4 shown in FIG. 2, and parts corresponding to those in FIG.

  In the specific example shown in FIG. 4A, the finger plate 4 a is attached to the inner side of the outer case 8. In this case, the entire finger plate 4a may be arranged on the inner side of the outer case 8, or the center portion of the outer surface of the finger plate 4a which is convex is located in the through hole 8a of the outer case 8. Alternatively, the finger plate 4a may be disposed so as to protrude outward from the through hole 8a.

  In this case, since the distance between the finger plate 4a and the circuit board 6 is shortened, the heat of the finger plate 4a is made almost uniform in consideration of the arrangement of the optical system such as the condenser lens 4d. The inner surface can be recessed to increase the distance.

  In the specific example shown in FIG. 4B, the finger plate 4 a is arranged outside the outer case 8. In this case, the “decision” switch 5 is also attached to the outer case 8 such that at least the operation portion pressed by the finger plate 4 a is outside the outer case 8.

  FIG. 5 is a perspective view showing a specific example of the configuration of the outer surface of the finger plate 4a shown in FIGS. Here, the planar shape of the finger plate 4a is shown as a perfect circle. However, the planar shape is not limited to this, and may be another planar shape such as an elliptical shape or a rectangular shape.

  In the specific example shown in FIG. 5A, the peripheral portion of the finger plate 4a is an opaque border portion 10, and the inside of the border portion 10 is a transparent portion 9 that transmits light. The imaging element 4c (FIG. 2) uses a predetermined area in the transparent portion 9 as an imaging area. With this edging portion 10, unnecessary incident light from the outside to the imaging surface of the imaging device 4c can be reduced.

  The specific example shown in FIG. 5 (b) is provided with a shallow groove-shaped guide 11 in the radial direction passing through the center of the finger plate 4a, so that the fingertip 7 (FIG. 2) is in contact. It is easy to move. The central portion in the guide 11 becomes an imaging area of the imaging device 4c, and an area other than the imaging area may be opaque.

  In this specific example, the unidirectional guide 11 is provided, but as shown in FIG. 5C, two guides 11a and 11b orthogonal to each other may be provided. In this case, the imaging region 12 of the imaging device 4c is set at the intersection of the guides 11a and 11b.

  The specific example shown in FIG. 5 (d) is the same as the specific example shown in FIG. 5 (c), in which the insides of the guides 11a and 11b are finished with a gloss finish, and the other regions 13 are textured. By applying the embossing to the region 13, the finger can be easily slipped and sweat can hardly be applied.

  In the specific example shown in FIG. 5E, a depression 14 is provided in the center of the outer surface of the finger plate 4a, and the imaging region of the image sensor 4c is set in the depression 14. Thus, by setting the imaging area of the imaging device 4c in the hollow portion 14, for example, when the portable information terminal 1 is stored in a bag or the like, this imaging is performed by preventing other stored items from touching the imaging area. It is possible to prevent the area from being scratched. Of course, in this specific example, the portions other than the recess 14 may be opaque, and as shown in FIG. 5 (f), the same guides 11a and 11b as in FIG. 5 (c) are provided. Alternatively, similarly to the specific example shown in FIG. 5 (d), the guides 11a and 11b and the recess 14 may be polished and the other portions may be subjected to a textured process.

  FIG. 6 is a view showing another specific example of the operation means of the “decision” switch 5 shown in FIG. 2, and the same reference numerals are given to the portions corresponding to FIG.

  In the specific example shown in FIG. 6A, the attachment position of the finger plate 4a to the inner surface of the outer case 8 by the hinge 4e is set to a position sufficiently away from the through hole 8a provided in the outer case 8. is there. According to this, the distance L between the position on the finger plate 4a pressed by the fingertip when performing the determination operation and the mounting position of the finger plate 4a on the outer case 8 can be increased. In practice, the hinge 4e Although it is an arc-shaped movement centering on, a movement closer to pushing in the vertical direction can be realized.

  In the specific example shown in FIG. 6B, the attachment position of the finger plate 4a to the inner surface of the outer case 8 by the hinge 4e is set to a position close to the through hole 8a provided in the outer case 8, and the Natsuko finger plate 4a is moved to this position. It extends further than the attachment part by the hinge 4e, and the "decision" switch 5 is provided in the extension part. According to this configuration, when the finger plate 4a is pushed by the fingertip, the “decision” switch 5 is lifted around the attachment portion by the hinge 4e, and the actuating portion is pressed against the inner surface of the outer case 8, thereby performing the decision operation. Will be. In this case, although depending on the positional relationship between the hinge 4 e and the “decision” switch 5, the decision operation can be performed with a smaller force according to the lever principle.

  7A and 7B are configuration diagrams showing another specific example of the pointing device 4 used in the portable information terminal according to the present invention. FIG. 7A is a top view, FIG. 7B is a sectional view, and FIG. "Return" switch, 16a and 16b are protrusions, and 17 is a rotation shaft. In addition, the same reference numerals are given to the portions corresponding to the previous drawings, and redundant description is omitted.

  In this specific example, the pointing device 4 described with reference to FIGS.

  7 (a) and 7 (b), a “decision” switch 5 and a “return” switch 15 are arranged inside the outer case 8 with a through hole 8a interposed therebetween. A protruding pressing portion is formed on each of the switches 5 and 15 side. And the finger plate 4a is arrange | positioned so that rotation is possible centering | focusing on the rotating shaft 17 by the attachment means which is not shown in figure. Here, the rotation shaft 17 is orthogonal to a straight line connecting the “decision” switch 5 and the “return” switch 15. Of course, such attachment means is provided with a transparent member or avoiding the imaging region so that the imaging device 4c (FIG. 2) does not hinder the imaging of the image on the outer surface of the finger plate 4a. Further, a protrusion 16a is provided on the “return” switch 15 side of the outer surface of the finger plate 4a, and a protrusion 16b is provided on the “decision” switch 5 side. The imaging region on the outer surface of the finger plate 4a of the image sensor 4c is a central portion between the protrusions 16a and 16b on the outer surface.

  As described above, when the pointing device 4 is provided with the “return” function, the “return” switch 2d may be provided on the operation surface 2 as shown in FIG. Not that.

  With this configuration, in this pointing device 4, an image of the imaging area on the outer surface of the finger plate 4a is picked up by the image pickup device 4c, and the “decision” switch 5 side of the finger plate 4a is pushed with the fingertip. Thus, the protruding pressing portion of the finger plate 4a presses and operates the “decision” switch 5 to perform the decision operation. In this case, since the protrusion 16b is provided, the fingertip is caught on the protrusion 16b and the finger plate 4a is easily pushed on the “decision” switch 5 side. Further, by pushing the “return” switch 15 side of the finger plate 4a with the fingertip, the protruding pressing portion of the finger plate 4a presses and operates the “return” switch 15, and the display screen 3 (FIG. 1). A return operation is performed to return to the display of the previous image. In this way, for example, the operation can be performed without releasing the finger from the pointing device while performing a series of operations for going back and forth through the hierarchical menu. Further, once the operator places a finger on the pointing device, the operator can concentrate on the display screen without looking at his / her hand and can easily perform the operation. Also in this case, since the protrusion 16a is provided, the fingertip is caught on the protrusion 16a and the finger plate 4a can be easily pushed on the “return” switch 15 side.

  In this embodiment as well, the pointer displayed on the display screen 3 is moved continuously or stepwise by moving the fingertip against the imaging area at the center of the finger plate 4a (the pointer is on the map). When moving on the screen, it moves continuously, and when moving on the screen of a selection item such as a menu screen, it moves stepwise). Further, the protrusions 16a and 16b are not necessarily required.

  FIG. 8 is a block diagram showing still another specific example of the pointing device 4 used in the portable information terminal according to the present invention. FIG. 8 (a) is a top view, FIG. 8 (b) is a cross-sectional view, and FIG. ) And (d) are explanatory diagrams of functions, respectively, 17a and 17b are rotating shafts, 18a to 18d are function switches, and 19 is a protrusion. In addition, the same reference numerals are given to the portions corresponding to the previous drawings, and redundant description is omitted.

  In this example, the pointing device 4 described with reference to FIGS.

  8A and 8B, four function switches 18a, 18b, 18c, and 18d are arranged at equal intervals around the through hole 8a of the outer case 8 inside the outer case 8, and are placed on the finger plate 4a. Each of the function switches 18a, 18b, 18c, and 18d has a protruding pressing portion.

  The finger plate 4a is disposed so as to be capable of two-axis rotation about rotation axes 17a and 17b orthogonal to each other by attachment means (not shown). Here, the rotation shaft 17a is orthogonal to the straight line connecting the function switches 18c and 18d, and the rotation shaft 17b is orthogonal to the straight line connecting the function switches 18a and 18b. Of course, such attachment means of the finger plate 4a is made of a transparent member so as not to interfere with the imaging device 4c (FIG. 2) taking an image on the outer surface of the finger plate 4a. Moreover, the protrusion 19 is provided in the function switch 18a-18d side of the outer surface of the finger plate 4a, respectively. The imaging area on the outer surface of the finger plate 4a of the imaging element 4c is the central portion between the protrusions 19 on the outer surface.

  By having such a configuration, in this pointing device 4, an image of the imaging region on the outer surface of the finger plate 4a is picked up by the image pickup device 4c. By pressing the function switch 18a side of the finger plate 4a with the fingertip, The finger plate 4a is inclined toward the function switch 18a, and the protruding pressing portion of the finger plate 4a presses the function switch 18a to operate it. In this case, since the protrusion 19 is provided on the function switch 18a side of the outer surface of the finger plate 4a, the fingertip is caught on the protrusion 19 and the function switch 18a side of the finger plate 4a is easily pushed. The same applies to the other function switches 18b to 18d, and the finger plate 4a can be pushed into these switches, and these switches can be operated. Further, since the projections 19 are also provided on the switch sides, the finger plate 4a can be easily pushed into the switch sides.

  Here, each of the function switches 18a to 18d has a predetermined function. FIG. 8C shows an example. Here, the pointer displayed on the display screen 3 (FIG. 1) is moved step by step (that is, when the menu screen is displayed on the display screen 3) It has a function of moving one item each time it is operated. More specifically, referring to FIG. 8A, the function switch 18a moves the pointer one step to the right, the function switch 18b moves the pointer one step to the left, and the function switch 18c moves the pointer up. The function switch 18d moves the pointer downward one step at a time.

  Even when the function shown in FIG. 8C is provided, the pointer displayed on the display screen 3 is continuously moved by moving the fingertip against the imaging area at the center of the finger plate 4a. It is. Further, the protrusion 19 is not always necessary.

  FIG. 8D shows another function example. As will be described later, the portable information terminal 1 including the pointing device 4 including the image sensor 4c (FIG. 2) and the display screen 3 has a function as a video camera that captures a landscape or the like using the image sensor 4c. The image signal photographed by the image pickup device 4c can be stored in a built-in storage device with a large storage capacity, or can be recorded on a large-capacity storage medium that can be used by being mounted and read out. Can be reproduced and displayed on the display screen 3.

  The reproduction operation function in this case can be provided as shown in FIG. 8A, the function switch 18a has a fast-forward playback function, the function switch 18b has a rewind function, the function switch 18c has a playback / pause function, and the function switch 18d has playback stopped. Each has a function.

  Even in the case where the function shown in FIG. 8D is provided, the pointer displayed on the display screen 3 is moved continuously or stepwise by moving the fingertip to the imaging area at the center of the finger plate 4a. (The pointer moves continuously when moved on the map, and moves stepwise when moved on the screen of a selection item such as a menu screen). Further, the protrusion 19 is not always necessary.

  FIG. 9 is a block diagram showing still another specific example of the pointing device 4 used in the portable information terminal according to the present invention. FIG. 9A is a top view, and FIGS. 9B and 9C are the same. Sectional drawing along the dividing lines AA 'and BB' in (a), FIG. 4D is a function explanatory diagram, 20 is a decision operation part, 21 is a function operation part, and 22 is an actuating member. , 23 is a hinge. Also, parts corresponding to those in FIG.

  This specific example is obtained by adding a determination operation unit to the pointing device 4 described with reference to FIG.

  That is, in FIGS. 9A to 9D, the finger plate 4a is divided into a central portion and a peripheral portion thereof, and a determination operation portion 20 for performing a determination operation at the central portion, and the peripheral portion thereof. However, as in the specific example shown in FIG. 8, the function operation units 21 for operating the function switches 18 a to 18 d are configured. Since the function operation unit 21 is the same as the finger plate 4a in the specific example shown in FIG. 8, the description operation unit 20 is configured to be pushed in, although the description thereof is omitted. One end of an operating member 22 that is rotatably supported by a hinge 23 is attached to the inner surface side of the determining operation unit 20, and the other end of the operating member 22 is provided on the inner surface of the outer case 8. This is the operation unit of the “OK” switch 5.

  Then, when the determination operation part 20 of the finger plate 4a is pushed in with the fingertip, the operation member 22 rotates around the hinge 23, and the operation part at the tip of the operation member 22 acts on the “decision” switch 5 Is activated. When the pressing on the determination operation unit 20 is released, the determination operation unit 20 returns to the original position by means not shown.

  Also in this specific example, the imaging area of the imaging device 4c (FIG. 2) is set in the determination operation unit 20, and the image is displayed on the display screen 3 by moving the imaging area with a fingertip. The pointer is moved continuously.

  10 is a block diagram showing a circuit configuration of the portable information terminal 1 shown in FIG. 1, in which 24 is an antenna, 25 is a radio that transmits and receives radio signals, 26 is a signal that modulates a signal to be transmitted, and receives the signal. A demodulator 27 for demodulating, a transmission / reception signal processor 27 for processing a signal to be transmitted and an incoming signal, 28 a sound signal from a sound transmitter 29 such as a microphone, and a sound signal supplied to a sound receiver 30 such as a speaker. 31 is a controller for controlling the portable information terminal 1 as a whole, 32 is a storage device for storing and holding a telephone book, various setting data, information from the Internet, etc. 33 is a screen for displaying images, pointers, etc. 3 (FIG. 1), a display 34, and a silent incoming call notification device such as a vibrator for generating a vibration for notifying the user of an incoming call. In FIG. Wearing a.

2, when the pointing device 4 is touched with the fingertip 7 as described in FIG. 2, an image of the pattern of the belly 7 a, that is, a fingerprint is picked up by the image pickup device 4 c, and the image signal is supplied to the controller 31. Is done. The controller 31 reads the image signal from the image pickup device 4c at a predetermined time interval, so that time t ₁ and time t ₂ as shown in FIG. 11, by comparing an image of the image signal read back and forth By detecting the change, the movement of the fingertip 7 at the pointing device 4 is detected. The controller 31 controls the position of the pointer displayed on the display screen 3 (FIG. 1) by the display 33 according to the detection result. When the movement of the fingertip 7 is not detected, the controller 31 Although the pointer is held in a stopped state, when the movement of the fingertip 7 is detected, the pointer is moved at a speed corresponding to the movement speed of the fingertip 7 and in a direction corresponding to the movement direction of the fingertip 7. In this way, the pointer can be moved on the display screen 3 by touching the finger plate 4a of the pointing device 4 with the fingertip 7 and moving the fingertip 7 in this state.

  In this way, when the pointer reaches a predetermined position on the display screen 3 (for example, a position where a predetermined item is displayed) and the finger fret 4a is pushed in with the fingertip 7, the “decision” switch 5 is activated, The position (for example, the predetermined item) is selected and designated.

  The controller 31 also detects the amount of light received by the imaging device 4c of the pointing device 4 and controls the amount of light emitted from the light emitting device 4b.

  Other parts are the same as those of the conventional portable information terminal.

  By the way, in FIG. 2, when the display screen 3 is large and the pointer is moved in one direction, if the pointer cannot be moved to a desired position by one movement of the fingertip 7, the fingertip 7 is repeatedly moved to the finger plate 4a. The movement of the fingertip 7 at this time is a reciprocating movement. In this case, if this reciprocation is performed while the fingertip 7 is in contact with the finger plate 4a, the controller 31 (FIG. 10) determines that the fingertip 7 is reciprocating, and reciprocates the pointer accordingly. And cannot be moved to the desired position. Therefore, when the fingertip 7 cannot be moved to a desired position unless the fingertip 7 is moved a plurality of times, it is necessary to separate the fingertip 7 from the finger plate 4a when the fingertip 7 is returned.

  However, this is a case where the display screen 3 is large, and the display screen 3 is small like a mobile phone, and the finger plate 4a is used to move the pointer from one side of the display screen 3 to the other side opposite thereto. When the fingertip 7 only needs to be moved once, there is no such problem.

  In such a pointing device 4, it is only necessary to image even a part of the belly 7 a of the fingertip 7. In short, it is only necessary to detect a change in the image read back and forth by the controller 31. For this reason, the surface area of the finger plate 4a can be reduced, and the finger plate 4a can be reduced. As a result, the pointing device 4 can be reduced in size.

  FIG. 12 is a flowchart showing the control operation of the pointing device 4 by the controller 31.

  In the same figure, when the “power / call end” button 2a on the operation surface 2 of the portable information terminal 1 shown in FIG. 1 is operated to turn on the power, or the portable information terminal 1 having the configuration described later covers the cover. When the pointing device 4 becomes usable, for example, when the folding device is opened or folded from the folded state to the opened state, the pointing device 4 is set to the standby mode (step 100). In this standby mode, the controller 31 causes the light emitting device 4b to emit illumination light with a predetermined light emission amount, and the imaging element 4c repeats imaging at a frequency of about 10 times per second (sensing frequency). Then, when the image pickup device 4c picks up an image, the amount of light received by the image pickup device 4c is detected from the output thereof, and the reflectivity (= on the outer surface of the finger plate 4a is calculated from the amount of light received and the amount of light emission of the light emitting device 4b at this time. The amount of received light / the amount of emitted light is obtained (step 101). The received light amount may be, for example, the integral value of the output signal value for one screen from the image sensor 4c, and the emitted light amount of the light emitting device 4b may be the driving power value of the light emitting device 4b.

  Next, the obtained reflectance is compared with a preset minimum reflectance (reference minimum value) (step 102). In this step 102, it is determined whether or not the fingertip 7 is applied to the finger plate 4a. The reference minimum value can be obtained by, for example, experiments so that this can be determined.

  Therefore, when the reflectance obtained in step 101 is equal to or lower than the reference minimum value, a fingertip or the like is used for an operation (hereinafter referred to as a pointer operation) for moving the pointer on the display screen 3 to the finger plate 4a. (If the reflectance is below the reference minimum value, the light emission amount of the light emitting device 4b is temporarily increased to detect the light reception amount of the image sensor 4c at this time. If there is almost no change in the amount of received light even if the amount of light emission is increased, it may be determined that the fingertip or the like is not applied to the finger plate 4a), and the light emission amount of the light emitting device 4b is set to a small reference value set in advance. (Step 103), the process proceeds to step 105. Thereby, power saving is achieved in the standby mode. If the reflectance obtained in step 101 exceeds the reference minimum value, it is determined that a fingertip or the like has been applied to the finger plate 4a for a pointer operation (step 102), and the light emission amount of the light emitting device 4b is determined. A value corresponding to this reflectance is set so that the amount of light received by the image sensor 4c becomes a predetermined constant value (step 104). Accordingly, for example, when the reflectance of an object placed on the finger plate 4a such as a glove in the hand is low and the amount of received light does not reach a sufficient brightness to capture an image on the imaging surface of the image sensor 4c. For example, the light emission amount of the light emitting device 4b is increased to increase the output level of the image pickup device 4c. Conversely, for example, the reflectance of the fingertip 7 applied to the finger plate 4a is high, and the image pickup surface of the image pickup device 4c is high. When the amount of received light is too large, the amount of light emitted from the light emitting device 4b is reduced so that the light emitting device 4b does not output a useless amount of light so as to eliminate wasteful power consumption. After this light emission amount adjustment, the process proceeds to step 105.

  In this step 105, the imaging device 4c performs imaging at a low frequency in the standby mode (that is, the sensing frequency is, for example, about 10 times / second). And the presence or absence of a change (motion) in the image is detected. If no change in the image is detected for more than 1 second (step 106), the “power / call end” button 2a (FIG. 1) on the operation surface 2 is operated again and the power is not turned off (step 110). Returning to step 100, as described above, the reflectance is detected and the light emission amount of the light emitting device 4b is adjusted. It should be noted that the “power / call end” button 2a on the operation surface 2 is operated to turn off the power, or the portable information terminal 1 having a configuration described later is covered, or the like. When the use is finished (step 110), the pointing device 4 is stopped.

  If there is a change (movement) in the image (step 105), it is determined that a pointer operation is being performed, and the pointing device 4 is switched to the active mode (step 107). In this activity mode, the sensing frequency of the image sensor 4c is increased to, for example, about 1000 times / second, so that the change in the image obtained from the image sensor 4c with respect to the movement of the fingertip 7 becomes smooth. Like that. The controller 31 captures an image for each imaging, detects a change from the previously captured image, and changes the position of the pointer according to the change, that is, according to the movement of the fingertip 7 (step 108). As long as the pointing device 4 is operated (step 109), the operations of steps 107 and 108 are repeated.

  In the above-described activity mode, the imaging device 4c performs imaging (sensing), for example, at a frequency of about 1000 times per second, as compared with a normal video camera. However, the imaging range of the imaging device 4c is extremely high. Therefore, even if the number of pixels is smaller than that of an image sensor used in a normal video camera, high-resolution image detection can be performed. In this way, the number of pixels can be reduced. The frequency can be increased as described above. As described above, when the sensing frequency is increased, the exposure time of each pixel is shortened. However, by increasing the light emission amount so that a necessary light amount can be obtained with the short exposure time (this is performed in step 104). As a result, the amount of light received by each pixel increases, and a sufficient level of image signal is obtained from the image sensor 4c. Further, a device capable of emitting light in a pulsed manner such as a light emitting diode can be used as the light emitting device 4b, and a necessary and sufficient amount of light can be generated in a short time.

  In the standby mode, when the fingertip 7 or the like is not touching the finger plate 4a, the amount of light emitted from the vise 4b is reduced by light emission (step 103), and the sensing frequency of the image sensor 4c is compared with that in the activity mode. Since the power consumption is considerably low (step 100), the power consumption can be considerably suppressed, and even when the fingertip 7 or the like is applied to the finger plate 4a, the sensing frequency of the image sensor 4c is considerably low. Therefore, it can be expected that power consumption is suppressed. However, when the fingertip 7 or the like is applied to the finger plate 4a, the fingertip 7 is moved almost immediately in that state to shift to the active mode, so rather the light emission amount of the light emitting device 4b is adjusted (step 104). It is more important that the fingertip 7 is moved and that the mode can be immediately shifted to the active mode.

  After that, when the finger plate 4a of the pointing device 4 is pushed in with the fingertip 7 to perform a determination operation or the operation switch other than the pointing device 4 is operated to end the operation of the pointing device 4 (step 109), When the “power / call end” button 2a (FIG. 1) is operated, the power is turned off, or the portable information terminal 1 configured as described later is covered, and the use of the portable information terminal 1 is terminated. Unless otherwise (step 110), returning to the operation from step 100 described above, the pointing device 4 is held in a standby state until the next operation is performed.

  FIG. 13 is a view showing an arrangement example of the pointing device 4 in the embodiment of the portable information terminal 1, and FIG. 13 (a) shows an example in which the pointing device 4 is arranged on the operation surface 2, and FIG. ) Shows an example in which the pointing device 4 is arranged on the back surface 1a of the main body of the portable information terminal 1, and FIG. 5C shows an example in which the pointing device 4 is arranged on the side surface 1b of the main body of the portable information terminal 1 (here, Although it is arranged on the side surface 1b side, it may be arranged on the opposite surface side of the side surface 1b.) FIG. 4D shows an example in which the pointing device 4 is arranged beside the display screen 3. In addition, the specific example shown in FIG. 13E shows an embodiment in which a numeric key for inputting a telephone number is eliminated and a number is input only by a pointing device operation. When inputting numbers, a list of numbers and a pointer are displayed in the periphery of the display screen 3, and the pointer can be input by moving the pointer to the number to be input and performing a determination operation. Also in the portable information terminal 1, the pointing device 4 can be arranged at an appropriate position.

  As described above, the pointing device 4 may be arranged at any location on the main body of the portable information terminal 1 in consideration of ease of use. For example, in the arrangement examples shown in FIGS. 13B and 13C, the back surface 1a and the side surface 1b of the main body of the portable information terminal 1 are usually not used in most areas, and among them, the position that is easy to use. By disposing the pointing device 4 on the surface, the surface of the main body of the portable information terminal 1 can be used effectively, the operation surface can be reduced, and the portable information terminal 1 can be further downsized.

  FIG. 14 is a diagram illustrating an arrangement example of the pointing device 4 in another embodiment of the portable information terminal 1.

  FIGS. 14A to 14C relate to a foldable portable information terminal 1, and a case 1d provided with a display screen 3 and a case 1e having an operation surface 2 can be rotated by a hinge 1c. When not in use, the display screen 3 and the operation surface 2 can be prevented from being exposed to the outside by placing the cases 1d and 1e in a folded state.

  In the portable information terminal 1 having such a configuration, the specific example shown in FIG. 14A is the one in which the pointing device 4 is arranged on the operation surface 2, and the specific example shown in FIG. 14B is the pointing device on the hinge 1c. 4 is arranged. In any of these specific examples, by disposing the pointing device 4 on the operation surface 2, it is possible to protect the pointing device 4 when the portable information terminal 1 is not used.

  Further, in the specific example shown in FIG. 14C, the notch 1f is provided in a part of the end of the case 1d on the case 1e side, and this cut is also shown in the folded state as shown on the right side. A part of the case 1e is exposed to the outside by the notch portion 1f, and the pointing device 4 is disposed on the exposed portion. In this specific example, when the folded state is set, the function of the pointing device 4 is switched to a function different from the original function (that is, the function of moving the pointer on the display screen 3, that is, the pointer operation function). The pointing device 4 can be used even in the folded state. As such a function, for example, there is an incoming call display function, and when there is an incoming call in a folded state, the light emitting device 4b (FIG. 2) of the pointing device 4 emits light.

  The specific example shown in FIG. 14 (d) is provided with a flip (open / close cover) 1g for the operation surface 2, and the specific example shown in FIG. 14 (e) is provided with a slide cover 1h for the operation surface 2. It is a thing. In any of these specific examples, by disposing the pointing device 4 on the operation surface 2, it is possible to protect the pointing device 4 when the portable information terminal 1 is not used.

  In each specific example shown in FIG. 14, the pointing device 4 performs the operation shown in FIG. 12, but when it is in the folded state in the specific examples shown in FIGS. Alternatively, when the covers 1g and 1h are in the closed state in the specific example shown in FIGS. 14D and 14E, it is determined in step 110 that the operation of the portable information terminal 1 is completed, and the pointing device 4 is in the stopped state. In addition, when the cover 1g, 1h is opened in the specific example shown in FIGS. 14 (a) to 14 (c), or when the cover 1g, 1h is opened in the specific example shown in FIGS. 14 (d), 14 (e). When it is in the open state, the pointing device 4 starts operation in the standby mode in step 100. In this case, it goes without saying that each portable information terminal 1 shown in FIG. 14 is provided with a sensor that detects the folded state and the open / closed state of the covers 1g and 1h, although not shown.

  As described above, the pointing device 4 is disposed at an appropriate position of the portable information terminal 1. As the position, when the user holds the portable information terminal 1 with his / her hand, the thumb, index finger, etc. Needless to say, the position is easy to operate with any of the fingertips. Of course, the pointing device 4 may be operated with the finger of the hand of the person who does not have the portable information terminal 1, but it is better to be able to operate with the finger of the hand of the holding person. Needless to say, it is convenient.

  FIG. 15 is a block diagram showing a circuit configuration of another embodiment of the portable information terminal according to the present invention. 35 is an open / close detector, 36 is a contact sensor, 37 is an operation lock switch, and 38 is a receiver proximity sensor. Yes, parts corresponding to those in FIG.

  In this figure, in this embodiment, all or any one or more of the open / close detector 35, the contact sensor 36, the operation lock switch 37, and the receiver proximity sensor 38 are added to the circuit configuration shown in FIG. Is.

  The open / close detector 35 is provided, for example, in the portable information terminal 1 having a foldable type or cover as shown in FIG. 15. For example, as shown in FIG. In the case of the terminal 1, it is arranged on the surface of either the case 1d or 1e (here, the surface on the display screen 3 side of the case 1d). The open / close detector 35 may be a push-type switch or an optical sensor. When the cases 1d and 1e are overlapped to be in a folded state, this is detected, and the detection is performed. The output is supplied to the controller 31. From this detection output, the controller 31 determines whether or not the folding portable information terminal 1 is unfolded and opened, and if the portable information terminal 1 has a cover, the cover is opened or closed. Judgment is made for each.

  For example, as shown in FIG. 16B, the contact sensor 36 is disposed on the side surface 1b of the portable information terminal 1, and detects whether or not the palm of the user has touched. The detection output is supplied to the controller 31. The controller 31 determines whether or not the portable information terminal 1 is held in the user's hand from the detection output. The contact sensor 36 may be disposed on the side surface 1b of the portable information terminal 1 or may be disposed on both side surfaces 1b.

  The contact sensor 36 is detected on the side surface 1b in order to determine when it is held by the operator's hand to operate and when it is not (for example, when touching the surroundings in a bag or the like). In this case, a capacitance type that can distinguish between human hands and other types is suitable, and when placed on both sides, the electrical resistance value of human hands is used as the detection standard. Is suitable.

  For example, as shown in FIG. 16C, the operation lock switch 37 is provided on one side surface 1 b of the portable information terminal 1, and by operating this, the operation switches and the pointing device 4 on the operation surface 2 are operated. It locks in an impossible state.

  For example, as shown in FIG. 16 (d), the receiver proximity sensor 38 is disposed in the vicinity of the position where the sound receiver 30 such as a speaker in the portable information terminal 1 is disposed, and is close thereto. If there is something (for example, within a range of 1 cm), this is detected and a detection output is sent to the controller 31. Based on this detection output, the controller 31 determines that the user's ear is close to the sound receiver 30 and is in a receiving state.

  FIG. 17 is a flowchart showing a control operation of the controller 31 based on detection outputs of the open / close detector 35, the contact sensor 36, the operation lock switch 37, and the receiver proximity sensor 38. Here, description will be made assuming that the portable information terminal 1 is provided with all or any of the open / close detector 35, the contact sensor 36, the operation lock switch 37, and the receiver proximity sensor 38.

  In the figure, in the case of the portable information terminal 1 as shown in FIG. 16C, when the operation lock switch 37 is ON (step 201), each operation switch on the operation surface 2 is locked so that it cannot be operated. At this time, the controller 31 stops the pointing device 4 (ie, the light emitting device 4b and the image sensor 4c in FIG. 2 are not operating, step 200). In the case of the foldable portable information terminal 1 as shown in FIG. 16A, when the cases 1d and 1e are overlapped and folded, the open / close detector 35 is in an open state (step 202). Also in this case, the controller 31 stops the pointing device 4 (step 200). Further, in the case of the portable information terminal 1 provided with the receiver proximity sensor 38 as shown in FIG. 16D, the receiver proximity sensor 38 can bring the user's ear closer to the sound receiver 30 during a call. Then, a detection output indicating that a call is in progress is supplied to the controller 31 (step 203), whereby the controller 31 stops the pointing device 4 (step 200). Furthermore, for example, in the case of the portable information terminal 1 provided with the contact sensor 36 as shown in FIG. 16B, when the contact sensor 36 does not sense a contact object (step 204), the controller 31 Based on the detection output from the contact sensor 36, it is determined that the portable information terminal 1 is not held in the user's hand and is not being used, and the pointing device 4 is brought into a stopped state (step 200).

  In this way, when it is detected in steps 201, 202, and 204 that the portable information terminal 1 is not in a state of being used, the pointing device 4 is set to a stopped state, and as a result, it happens to be unintentional. Even if the finger plate 4a (FIG. 2) of the pointing device 4 is touched in preparation, or when the portable information terminal is put in a bag or handbag, it is stored in that. Even if another object touches the finger plate 4a (FIG. 2) of the pointing device 4, the pointing device 4 does not operate, and the pointing device 4 can be prevented from malfunctioning. Thus, power consumption at the pointing device 4 can be suppressed, and power saving can be achieved.

  Note that the open / close detector 35 is used for a folding portable information terminal or a portable information terminal 1 having a cover as shown in FIG. 14, but includes a contact sensor 36, an operation lock switch 37, a receiver proximity sensor. 38 can be used for any type of portable information terminal 1 shown in FIGS. Therefore, the portable information terminal 1 may include, for example, any one of the open / close detector 35, the contact sensor 36, and the operation lock switch 37 and the receiver proximity sensor 38. In this case, as shown in FIG. In the illustrated operation, a detection operation in any one of steps 201, 202, and 204 and step 203 is performed.

  In any of the detection results of steps 201, 202, and 204, if the portable information terminal 1 is in a state of being used by the user and the receiver proximity sensor 38 does not detect the proximity object, step 100 shown in FIG. The operation from is performed. If “Yes” in steps 106 and 109 in FIG. 12, the process returns to step 201 in FIG. 17 (this flowchart also includes the flowchart shown in FIG. 12, but does not include step 110 in FIG. 12).

  FIG. 18 is a view showing another specific example of the erroneous operation preventing means of the pointing device 4, wherein 39 is a crown, and the same reference numerals are given to portions corresponding to the above-mentioned drawings, and the duplicated explanation is omitted.

  FIG. 18 (a) shows the case of a foldable portable information terminal 1, in which a pointing device 4 is arranged on a hinge 1c connecting cases 1d and 1e. The hinge 1c is rotatable. When the pointing device 4 is operated, the entire pointing device 4 can be exposed and operated as shown on the left side, and when the pointing device 4 is not used, at least the pointing device 4 is shown as shown on the right side. Try to hide some.

  Of course, in the foldable portable information terminal 1, it is possible to prevent an erroneous operation of the pointing device 4 by folding, but this is a state in which the portable information terminal 1 is not used, and the portable information terminal 1 is used. In this case, the cases 1d and 1e are opened, and the specific example of FIG. 18A makes it possible to prevent an erroneous operation of the pointing device 4 even in such a case.

  FIG. 18B shows a case of the portable information terminal 1 in which the display screen 3 and the operation surface 2 are always exposed to the outside. In this case, the rotation axis (inside the case) A structure in which a crown 39 is attached to one end of an outer case 8 (see FIG. 2) protruding from the side surface 1b of the outer case 8 (see FIG. 2), and a pointing device 4 is attached to the other end of the rotating shaft in the case. It is what. When using the pointing device 4, the crown 39 is operated to touch the finger plate 4a with the fingertip as shown in FIG. 2 from the through hole 8a provided in the outer case 8, as shown on the left side. When the pointing device 4 is not used, the crown 39 is rotated to rotate the pointing device 4 so that the finger plate 4a is hidden as shown on the left side of FIG. 18B. .

  In this way, erroneous operation of the pointing device 4 when not in use can be prevented.

  Needless to say, the means shown in FIG. 18B can also be applied to the portable information terminal 1 having the structure shown in FIGS. 14A and 14C. Of course, in the specific examples shown in FIGS. 1A, 1D, and 1E, the pointing device 4 is prevented from being erroneously operated by closing the cases 1d and 1e or closing the covers 1g and 1h. However, this is in a state where the portable information terminal 1 is not used. When the portable information terminal 1 is used, the cases 1d and 1e are opened and the covers 1g and 1h are opened. The specific example of FIG. 18B makes it possible to prevent erroneous operation of the pointing device 4 even in such a case.

  FIG. 19 is a view showing still another specific example of the erroneous operation preventing means of the pointing device 4. FIG. 19 (a) shows the entire portable information terminal 1, and FIGS. ) Is a cross-sectional view of the finger plate 4a portion of the pointing device 4 as seen from the dividing line of FIG.

  In the specific example shown in FIG. 19 (b), the outer surface shape of the finger plate 4a of the pointing device 4 is recessed so as to become deeper at the center. The pointing device 4 has the configuration shown in FIG. 2 except for the finger plate 4a, and the condenser lens 4d has an image near the center of the concave outer surface of the finger plate 4a on the imaging surface of the imaging device 4c. Arranged to converge. Therefore, when the finger plate 4a having the configuration shown in FIG. 19B is used, for example, when the portable information terminal 1 is stored in a bag, another stored item is the operation surface 2 of the portable information terminal 1. Even if it touches and moves on the pointing device 4, the surface of the other stored item is farther away from the center of the outer surface of the finger plate 4a, so that the image of this surface on the imaging surface of the imaging device 4c is very blurred. Therefore, the control unit 16 (FIG. 15) cannot detect the image (that is, the pattern) on the surface. For this reason, even if this other stored item moves relative to the pointing device 4, the control unit 16 cannot detect this, and does not proceed to step 107 in FIG. 12 following the operation in FIG. An erroneous operation of the pointing device 4 can be prevented.

  In the specific example shown in FIG. 19 (c), the outer surface of the finger plate 4a of the pointing device 4 is planar, and the protrusion 8b is formed around the through hole 8a in the outer case 8 in which the finger plate 4a is fitted. Is provided. The outer surface of the finger plate 4a is disposed at a position recessed from the protrusion 8b. Also in this specific example, the configuration of the pointing device 4 other than this is the same as that shown in FIG. 2, and the condenser lens 4d is arranged so that the image on the outer surface of the finger plate 4a converges on the imaging surface of the imaging device 4c. Have been placed.

  According to such a configuration, for example, the portable information terminal 1 is accommodated in a bag, and other contents touch the operation surface 2 of the portable information terminal 1 in the same manner as the specific example shown in FIG. Even if it moves on the pointing device 4, the pointing device 4 does not malfunction.

Next, an operation example of the embodiment of the portable information terminal 1 described above will be described.
FIG. 20 is a flowchart showing an operation procedure for making a call. When a call is made to the other party whose telephone number is registered, it can be performed almost only by operating the pointing device 4. FIG. 20 shows this case.
FIG. 21 is a diagram showing a screen displayed on the display screen 3 in accordance with this operation, and 40 is a pointer (cursor).

  In FIG. 1, FIG. 20 and FIG. 21, when the “power / call end” button 2d is operated to turn on the power, the initial screen shown in FIG. When the “menu” button 2 c is operated in such a state (step 300), the menu screen shown in FIG. 21B is displayed on the display screen 3. In such a menu screen, menus (selection items) such as “phone book”, “mail”, “map service”, “shopping”,... Can be selected, and a frame-shaped pointer 40 is also displayed thereon. Yes. The pointer 40 is moved one step at a time in accordance with the direction of movement of the fingertip (that is, the vertical direction) by performing a pointer operation for moving the fingertip against the finger plate 4a of the pointing device 4 (1). Can be moved (by selection).

  On this menu screen, a pointer operation is performed to align the pointer 40 with a desired selection item, here, the selection item “phone book” (step 301), and a determination operation for pushing the finger plate 4a of the pointing device 4 with the fingertip is performed. (Step 302), the telephone directory screen shown in FIG. 21 (c) is displayed on the display screen 3. On this telephone directory screen, the name of the other party whose telephone number is registered and a pointer 40 for selecting one of them are displayed. Therefore, by performing a pointer operation with the finger plate 4a of the pointing device 4 (step 303), the pointer 40 is moved on the telephone directory screen so as to match the other party who wants to make a call. Here, when the name of the other party is not displayed, as shown in FIG. 21 (d), when the pointer 40 is moved to the end of the telephone directory screen and the pointer operation is performed in the same direction, the telephone The book screen is scrolled (step 304), and the name of the desired partner can be displayed. The telephone directory screen shown in FIG. 21 (e) shows this state, so that the pointer 40 can be set to a desired partner (here, “Kinoshita xx”) (step 305). . Then, when the above-described determination operation is performed with the pointing device 4 with the pointer 40 set to the desired opponent (step 306), the telephone number of the selected opponent and the selection item “telephone” as shown in FIG. Move to the phone number screen on which “Call” and “Edit phone book” are displayed, and when making a call to the other party, place the pointer 40 on the selection item “Call” and make the above decision on the pointing device 4 When the operation is performed (step 307), a call screen as shown in FIG. 21 (g) is displayed and the other party is called (step 308).

  In this call screen, as shown in FIG. 21G, the item “Canceling the phone” is also displayed, and the pointer 40 is set to this item. For example, if the other party does not readily answer the call, for example, if he / she wants to cancel the call, the call is canceled by performing the above determination operation with the pointing device 4 while the call screen shown in FIG. Then, the display state of the initial screen shown in FIG.

  When a call is made in the display state of the call screen shown in FIG. 21 (g) (step 308) and then the other party answers the phone call, the call is started. The phone number is displayed. When the “power / call end” button 2a is operated after talking with the other party, the screen returns to the initial screen shown in FIG.

  In this way, the other party who wants to talk can be called by operating the pointing device 4.

  When making a call to the other party whose telephone number is not registered, the “power / end call” button 2a is operated to display the telephone number input screen and the numeric keypad is operated to make this input as before. After inputting the telephone number of the other party on the screen, the other party is called by operating the “call start” button 2b.

  Further, at any step in FIG. 20, the “power / call end” button 2a is operated to return to the initial screen display state shown in FIG. 21 (a). Even in the step, on the display screen 3, the “return” button 2d is operated to return to the previous screen.

  FIG. 22 is a flowchart showing another operation example of the portable information terminal according to the present invention, that is, an operation procedure in the case of receiving a map service. FIG. 23 is a diagram showing a screen displayed on the display screen 3 in accordance with this operation. 41 is a map, 42 is a pointer (cursor), and 43 is a scroll icon.

  1, FIG. 22 and FIG. 23, step 400 is the same as step 300 in FIG. 20, and the “menu” button 2c is displayed with the initial screen shown in FIG. Is operated, a menu screen similar to FIG. 21B shown in FIG. 23B is displayed on the display screen 3 (step 400). On this menu screen, a pointer operation is performed so that the frame-shaped pointer 40 is moved to a desired selection item, here, as shown in FIG. 23C, the finger plate of the pointing device 4 according to the selection item “map service”. When the determination operation of pushing 4a with the fingertip is performed (step 401), the place name selection screen shown in FIG. 23 (d) is displayed on the display screen 3.

  Therefore, by operating the pointer, the pointer 40 is selected in accordance with the target place name (here, the name of the town “Shibuya”) on this place name selection screen, and the above determination operation is performed (step 402). A map screen of the selected town, that is, Shibuya as shown in FIG. On this map screen, a selected Shibuya map 41, an arrow-shaped pointer (cursor) 42, and a white triangular scroll icon 43 are displayed. A total of eight scroll icons 43 are displayed, four at the four corners of the map 41 and four between them. These scroll icons 43 represent the scroll direction of the map 41, and one of them can be selected by the pointer 42.

  In the display state of the map screen shown in FIG. 23 (e), the pointer 42 is moved by performing the pointer operation with the pointing device 4, and the map 41 is set as desired as shown in FIG. 23 (f). When the determination operation is performed with the pointing device 4 in accordance with the scroll icon 43 representing the scroll direction (step 403), the map 41 scrolls in the direction indicated by the scroll icon 43 as shown in FIG. Step 404). In this case, scrolling continues while the finger plate 4a of the pointing device 4 is pushed in. When the pushing is finished, the scrolling is finished. The scroll icon 43 selected by the pointer 42 changes to a black triangle as shown in FIGS. 23 (f) and 23 (g) to clarify the scroll direction.

  When scrolling progresses and a desired place, for example, a store where information is desired to appear, appears on the map 41, the determination operation is stopped and the scrolling is stopped, and the pointer 42 is moved by the pointer operation, as shown in FIG. As shown in the figure, when the above-mentioned determination operation is performed with the pointer 42 coincident with the desired location (step 405), a detailed information screen showing the detailed information of the desired location is displayed on the display screen 3 (step 406). .

  FIGS. 23 (i) and (j) schematically show an example of the detailed information screen. The detailed information of the store to be viewed selected in FIG. 23 (h), for example, the name of the store (Italian Restaurants), opening hours (10: 00-20: 00), regular holidays (Tuesday), telephone numbers (03-1111-xxx).

  Also, on this detailed information screen, two selection items “call” and “return to map display” and a frame-shaped pointer 40 are displayed, and the pointer 40 is moved by a pointer operation on the pointing device 4. One of the selection items can be selected (step 407). In view of the detailed information on the detailed information screen, if the user wants to make a call to this store, as shown in FIG. 23 (i), the user selects the selection item "call" with the pointer 40 and points to the pointing device. 4 is automatically called (step 408), and when the call is finished and the “power / call end” button 2a is operated, FIG. 23 (h) or FIG. Return to the display state of the map screen shown in FIG. Further, even if it is not desired to make a call to this store by looking at the detailed information on the detailed information screen, the selection item “return to map display” is selected with the pointer 40 as shown in FIG. By performing the above-described determination operation at 4, the display state of the map screen shown in FIG. 23 (h) or FIG. 23 (e) can be restored. Then, in the display state, the operation from step 405 or step 403 can be performed to re-designate the desired location. However, if the map service is to be canceled (step 409), the “return” button 2d Each time this operation is performed, a place name selection screen shown in FIG. 23 (d), a menu screen shown in FIGS. 23 (b) and 23 (c), and an initial screen shown in FIG. 23 (a) are displayed. It can be returned to.

  It should be noted that the initial screen display state shown in FIG. 23 (a) is set directly by operating the “power / call end” button 2a in the display state in each step except for the case of the call in step 408. Can do. In the call state at step 408, the “power / call end” button 2a is operated to end the call and display the above map screen. However, the “power / call end” button 2a is operated again. As a result, the initial screen display state shown in FIG.

  In such a “map service”, the arrow-like pointer 42 displayed on the map 41 is continuously displayed as the pointing device 4 is operated by the control of the controller 31 (FIGS. 10 and 15). Moving. As a result, the desired location on the map 41 can be specified accurately. In addition, a frame-shaped pointer 40 is displayed on the screen on which the selection items are displayed. Under the control of the controller 31, the pointer 40 moves in a step shape. This makes it possible to smoothly select a desired selection item without requiring a fine position adjustment of the pointer 40. In this way, in the present invention, the pointer operation method on the pointing device 4 is the same, but the method of moving the pointer is automatically switched according to the type of screen displayed, and the pointer is displayed on each screen. The movement will be adapted.

FIG. 24 is a cross-sectional view showing still another specific example of the pointing device 4 used in each of the embodiments of the portable information terminal according to the present invention, in which 4d ₁ , 4d ₂ and 4d ₃ are condensing lenses, and 4g is a lens exchange. A mechanism 4h is a lens expansion / contraction mechanism, and the same reference numerals are given to portions corresponding to the above-mentioned drawings, and redundant description is omitted.

  In this specific example, each of the above-described embodiments of the portable information terminal 1 described above is provided with a function as a digital camera or a video camera since the imaging element 4c is provided.

In the specific example shown in FIG. 24A, the condenser lenses 4d ₁ and 4d ₂ having different focal lengths can be exchanged by the lens exchange mechanism 4g. The condenser lens 4d ₁ has a focal length for pointer operation. The condensing lens 4d ₂ is a sufficiently short lens, and is a lens having a sufficiently long focal length for imaging such as landscapes. The lens exchange mechanism 4g is composed of a slide plate or a rotary plate, and condenser lenses 4d ₁ and 4d ₂ are attached to these. Further, an operation member for operating the lens exchange mechanism 4g on the operation surface 2 shown in FIG. 1 or the like, the side surface 1b of the main body, or the like is provided.

Figure 24 (a) (b) shows a state where the pointer operation, the focal length converging lens 4d ₁ is arranged a short between the finger plate 4a and the image pickup element 4c. When the portable information terminal 1 is functioned as a video camera, by sliding or rotating the lens exchange mechanism 4g, the finger plate 4a and the image sensor 4c can be moved as shown in (b) of FIG. A condensing lens 4d ₂ having a long focal length is disposed therebetween.

The specific example shown in FIG. 24B uses a condensing lens 4d ₃ having a variable focal length. The condensing lens 4d ₃ is, for example, a lens that can be expanded and contracted in a direction perpendicular to the optical axis, and the lens expansion / contraction mechanism 4h has a uniform force in the radial direction at a plurality of equally spaced points on the outer periphery of the lens. The thickness of the condensing lens 4d ₃ can be changed by simultaneously adding or canceling, and the focal length of the condensing lens 4d ₃ changes accordingly. For example, the lens expansion / contraction mechanism 4h may be configured as a diaphragm mechanism used in a camera or the like.

FIG. 24B shows the state in the case of a pointer operation. The condenser lens 4d ₃ is thick and has a sufficiently short focal length. When it is to function portable information terminal 1 as a video camera, acting lens telescopic mechanism 4h, as shown in (b) of FIG. 24 (b), the the focal length is long lens condenser lens 4d ₃ To do.

  The above is the same when the portable information terminal 1 functions as a digital camera.

  In this embodiment in which a function as a digital camera or a video camera is also provided in this way, an operation button for video camera, a recording / playback button, etc. are provided on the display surface 2 of the portable information terminal 1 (playback). For the operation, the pointing device 4 may have a function as shown in FIG. 8D). When the portable information terminal 1 functions as a video camera, the controller shown in FIGS. A display 31 displays the output signal of the image pickup device 4c by appropriately processing it in a processing circuit (not shown), recording it on an external recording medium (not shown) such as a storage device 32 or a floppy (registered trademark) disk, and performing a reproduction operation. The reproduced image is displayed on the surface 3.

  In addition, in order for the portable information terminal 1 to function as a digital camera or a video camera as described above, an image sensor normally used for a digital camera or a video camera is used as the image sensor 4c, but the image sensor 4c is used. When the pointing device 4 is used for a pointer operation as in the previous embodiment, a part of the imaging surface of the imaging element 4c is used as a scan target, and image detection is performed at a high sensing frequency as described above. When the portable information terminal 1 is caused to function as a digital camera or a video camera as described above, the entire imaging surface of the imaging element 4c is used as a scan target. Such a change of the scan area to be used on the imaging surface can be performed by changing the cycle and amplitude of the scan signal used for the imaging element 4c, for example.

It is a front view which shows one Embodiment of the portable information terminal by this invention. It is a block diagram which shows a specific example of the pointing device used for the portable information terminal by this invention. It is a block diagram which shows the other specific example of the illumination means in the pointing device shown in FIG. It is a block diagram which shows the other example of arrangement | positioning of the finger plate in the pointing device shown in FIG. It is a perspective view which shows the specific example of a structure of the outer surface of the finger plate shown in FIGS. FIG. 6 is a configuration diagram showing another specific example of the operation means of the “decision” switch shown in FIG. 2. It is a block diagram which shows the other specific example of the pointing device used for the portable information terminal by this invention. It is a block diagram which shows the other specific example of the pointing device used for the portable information terminal by this invention. It is a block diagram which shows the other specific example of the pointing device used for the portable information terminal by this invention. FIG. 2 is a block diagram illustrating a specific example of a circuit configuration of the embodiment illustrated in FIG. 1. It is a figure for demonstrating the method to detect the change of the captured image from the pointing device of the controller in FIG. 11 is a flowchart showing an operation of the pointing device shown in FIG. 2 by the controller in FIG. It is a figure which shows the example of arrangement | positioning of the pointing device in the portable information terminal by this invention. It is a figure which shows the other example of arrangement | positioning of the pointing device in the portable information terminal by this invention. It is a block diagram which shows one specific example of the circuit structure in other embodiment of the portable information terminal by this invention. It is a figure which shows the example of arrangement | positioning in the portable information terminal of the opening / closing detector, contact sensor, operation lock switch, and receiver part proximity sensor which are shown in FIG. It is a flowchart which shows the control operation of the pointing device by the detection output of the opening / closing detector of the controller shown in FIG. 15, a contact sensor, an operation lock switch, and a receiver part proximity sensor. It is a figure which shows the other specific example of the erroneous operation prevention means of the pointing device used for the portable information terminal by this invention. It is a figure which shows the other specific example of the erroneous operation prevention means of the pointing device used for the portable information terminal by this invention. It is a flowchart which shows one specific example of the operation procedure in the case of making a telephone call of embodiment of the portable information terminal by this invention. It is a figure which shows the specific example of the screen displayed on a display screen sequentially by the operation procedure shown in FIG. It is a flowchart which shows a specific example of the operation procedure in the case of receiving the map service of embodiment of the portable information terminal by this invention. It is a figure which shows the specific example of the screen displayed on a display screen sequentially by the operation procedure shown in FIG. It is sectional drawing which shows the specific example of the pointing device in the case of giving the function of a video camera in embodiment of the portable information terminal by this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Portable information terminal 1a Back surface 1b Side surface 1c Hinge 1d, 1e Case 1f Notch 1g Flip 1h Slide cover 2 Operation surface 3 Display screen 4 Pointing device 4a Finger plate 4b Vise by light emission 4c Image sensor 4d, 4d1-4d3 Condensing lens 4e Hinge 4f, 4f1, 4f2 Optical path changing means 4g Lens exchange mechanism 4h Lens expansion / contraction mechanism 5 “Determination” switch 6 Circuit board 8 Outer case 8a Through hole 9 Transparent portion 10 Edge portion 11, 11a, 11b Guide 12 Imaging region 13 Wrinkle processing Area 14 Indentation 15 "Return" switch 16a, 16b Protrusion 17, 17a, 17b Rotating shaft 18a-18d Function switch 19 Protrusion 20 Determination operation section 21 Function operation section 22 Actuating member 23 Hinge 30 Sound receiver 31 Controller 32 Memory Device 33 Display 35 Open Detector 36 contact sensor 37 Lock switch 38 the receiver section the proximity sensor 39 crown 40 frame-shaped pointer (cursor)
41 Map 42 Arrow-shaped pointer (cursor)
43 Scroll icon

Claims (2)

A pointing device for moving a pointer displayed on a display screen of a display device,
A substrate disposed inside the housing, and an exterior body that constitutes the housing above the substrate,
The exterior body includes an opening formed in the upper portion of the substrate, a plate that is held so as to be able to be pushed through a holding unit, an operation switch that operates in accordance with the pushing operation of the plate, A return means for releasing the pushing operation and restoring the plate to its original position,
The plate is exposed from the opening and has a transparent outer surface for contacting the surface of the object,
The substrate includes light emitting means for irradiating illumination light toward the outer surface portion of the plate, image detecting means for detecting reflected light reflected on the surface of the object in contact with the outer surface portion of the plate, and the reflected light. A condensing lens that forms an image on the detection surface of the image detecting means, and a control unit that controls the pointing device,
The control unit detects the amount of light received by the image detecting unit, obtains the reflectance on the outer surface of the plate from the amount of received light and the amount of light emitted by the light emitting unit at this time, and the reflectance is preset. When the reflectance is lower than the reference minimum reflectance, it is determined that there is no pointer operation, and the current light emission amount is maintained, and when the reflectance is higher than a preset reference minimum reflectance, it is determined that there is a pointer operation. Then, the light emitting means is turned on with a light emission amount set in advance corresponding to the reflectance,
A pointing device that moves the pointer according to the movement of the image on the outer surface of the plate detected by the image detection means, and operates the operation switch according to the pushing operation of the plate. . In claim 1,
The control unit includes a standby mode in which the number of imaging is set in advance, and an activity mode in which the number of imaging is set more than the number of imaging in the standby mode,
In the standby mode, if the captured image changes from the previously captured image, it is determined that a pointer operation is being performed, and the pointing device is switched to the active mode.

Images