JP2009265872A - Portable terminal equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent any erroneous input when a pointer is moved, and a determination key is depressed in the configurations of a determination key where an optical pointing device is arranged in portable terminal equipment. <P>SOLUTION: Portable terminal equipment is configured of: a determination key in which a moving amount detection part 31 for detecting the moving amounts of a traveling object in a prescribed cycle is arranged; a key operation detection part 36 for generating a key operation signal on the basis of the operation of an operation key 201; and a slide operation signal output part 32 for delaying moving amounts detected by the moving amount detection part 31 only by a first time T2, and for outputting it as a slide operation signal. When a key operation signal is generated by the operation of the determination key until the slide operation signal is output the next, a slide operation signal output part 32 ends the output of the slide operation signal on the basis of the moving amounts detected after the point of time prior to a second time T4 which is equal to or less than a first time T2 going back from the generation point of time of the key operation signal. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a portable terminal device, and more particularly, to an improvement of a portable terminal device that detects a moving amount of a moving body using light and outputs a predetermined operation signal.

  In recent years, a mobile phone including an optical pointing device that can move a mouse pointer or a cursor on a screen by sliding a finger in a detection area has been proposed (for example, Patent Document 1). In the mobile phone described in Patent Document 1, an optical pointing device is arranged in the determination key, and the movement of the finger is detected using the surface of the determination key as a detection area. An optical pointing device consists of a light projecting unit that emits detection light toward the finger and a light receiving unit that receives the detection light reflected by the finger, for example, comparing finger images generated at regular intervals By doing so, the amount of movement of the finger is detected. Such an optical pointing device has a high detection accuracy and can detect even a slight movement of a finger, so that it can be placed even in a narrow space.

  In a portable terminal device in which an optical pointing device is arranged in an operation key and the operation key and the optical pointing device can be operated independently and independently, after inputting by a finger slide operation, the finger is not released from the operation key. However, input by key operation can be performed. However, since the operation key must be pressed after the finger is slid, the movement of the finger when the operation key is pressed is erroneously detected by the optical pointing device, and an input unintended by the user is performed. there were.

As a technique for preventing an erroneous operation of the pointing device, a method of invalidating the input by the pointing device for a certain period after the key operation has been proposed (for example, Patent Document 2). The method described in Patent Document 2 can prevent an erroneous operation of the pointing device immediately after a key operation, but cannot prevent an erroneous operation of the pointing device in an attempt to operate an operation key. That is, since the method of Patent Document 2 invalidates the input by the pointing device based on the operation of the operation key, it cannot prevent the erroneous operation of the pointing device immediately before the key operation.
JP 2002-62984 A JP 2002-182824 A

  The present invention has been made in view of the above circumstances, and the operability of a mobile terminal device that detects the amount of movement of a moving body using light and outputs a slide operation signal that can be used to move a mouse pointer or cursor. It aims to improve. In particular, an object of the present invention is to provide a portable terminal device that can suppress erroneous input when operating an operation key disposed inside the optical pointing device following input by the optical pointing device.

  A portable terminal device according to a first aspect of the present invention includes a light projecting unit that emits detection light and a light receiving unit that receives the detection light reflected by the moving body, and detects a movement amount of the moving body at a predetermined cycle. Detected by the movement amount detection means, the operation key in which the light receiving unit is disposed, the key operation detection means for generating a key operation signal based on the operation of the operation key, and the movement amount detection means. Slide operation signal output means for delaying the movement amount by a first time and outputting it as a slide operation signal, and the key until the slide operation signal output means outputs the slide operation signal next time. When the operation signal is generated, the slide operation signal is generated based on the amount of movement detected after the time point before the second time, which is equal to or less than the first time, from the time point when the key operation signal is generated. Configured to terminate the output of.

  In this portable terminal device, when the key operation signal is generated before the next slide operation signal is output, the key operation signal is detected after the second time before the generation time of the key operation signal. Since the output of the slide operation signal is terminated based on the amount of movement, it is possible to suppress the erroneous detection of the movement of the moving body immediately before the key operation and the input not intended by the user. Accordingly, it is possible to suppress erroneous input when operating the operation key following input by the optical pointing device, and to prevent an input unintended by the user from being performed. It is possible to improve the operability of the portable terminal device that detects the above and outputs a slide operation signal that can be used to move the mouse pointer or the cursor.

  In addition to the above configuration, the portable terminal device according to the second aspect of the present invention resumes the output of the slide operation signal when the slide operation signal output means detects the movement amount exceeding a predetermined threshold. Configured to do.

  In addition to the above configuration, the mobile terminal device according to the third aspect of the present invention is based on the fact that the slide operation signal output means detects that the amount of movement exceeding a predetermined threshold has passed a third time. It is comprised so that the output of the said slide operation signal may be started. According to such a configuration, the slide operation signal is not output for the movement amount detected from when the movement amount exceeding the threshold is first detected until the third time elapses. Incorrect input immediately after operation of the optical pointing device can be suppressed.

  In addition to the above configuration, the mobile terminal device according to the fourth aspect of the present invention is configured such that the second time is equal to or longer than the period.

  In addition to the above configuration, the mobile terminal device according to the fifth aspect of the present invention is configured such that the first time is equal to or longer than the period.

  According to the mobile terminal device of the present invention, the output of the slide operation signal is terminated based on the movement amount detected after the time point before the second time retroactively from the generation point of the key operation signal. It is possible to suppress erroneous detection of the movement of the moving body immediately before the operation and input that is not intended by the user. Accordingly, it is possible to suppress erroneous input when operating the operation key following input by the optical pointing device, and to prevent an input unintended by the user from being performed. It is possible to improve the operability of the portable terminal device that detects the above and outputs a slide operation signal that can be used to move the mouse pointer or the cursor.

  FIG. 1 is an external view showing an example of a schematic configuration of a mobile terminal device according to an embodiment of the present invention. A foldable mobile phone 1 is shown as an example of the mobile terminal device. The mobile phone 1 is a mobile information terminal in which a display housing 100 and an operation housing 200 are connected via a hinge unit 300 and can be folded with one surface of each housing facing each other.

  The display housing 100 is provided with a display 101 for displaying information and a receiver 102 for receiving a call. A display surface of a liquid crystal display panel is disposed on the display 101. The operation housing 200 is provided with a large number of operation keys 201 and a transmission microphone 202.

  The hinge unit 300 is a connecting unit that connects the display housing 100 and the operation housing 200 in a foldable manner. In the cellular phone 1, a storage state in which both housings are folded and a deployed state in which both housings are deployed can be changed.

  The operation key 201 includes a direction key 203 and an enter key 204. The direction key 203 is an operation key for instructing one of up, down, left, and right, and has a rectangular opening at the center. The direction key 203 is a composite key composed of four contact type switches arranged on the top, bottom, left, and right with the determination key 204 interposed therebetween, and four types of inputs that are different depending on the pressed part are possible. By operating the direction key 203, four directions of up, down, left and right are input, and the cursor can be moved and the screen can be scrolled.

  The determination key 204 is a push-type operation key for instructing a determination operation, and is arranged in an opening provided in the direction key 203. In the determination key 204, an optical pointing device that detects the movement of a moving body such as a finger using light is disposed.

  FIG. 2 is a cross-sectional view illustrating a configuration example of a main part of the mobile phone 1 in FIG. 1, and illustrates a cross-sectional state of the operation housing 200 taken along line AA. The decision key 204 is disposed between the left key 203a and the right key 203b that are disposed adjacent to each other.

  Each of the left key 203a and the right key 203b is a directional key composed of a contact switch, and includes a key top 10a, a pusher 11, a dome-shaped electrode plate 14, and a substrate 12, respectively.

  The key top 10a is a surface cover that covers the contact portion, and a pusher 11 is disposed on the back surface. In the left key 203a and the right key 203b, when the pusher 11 is pressed through the key top 10a, the electrode plate 14 is elastically deformed by the pusher 11, and the deformation of the electrode plate 14 causes the contact point on the substrate 12 to move. Turns on when conducting.

  The decision key 204 is an operation key composed of a contact point switch similar to the left key 203a and the right key 203b. The key top 10b, a housing portion 10c for housing an optical pointing device, a pusher 11, and a dome-shaped electrode. It is constituted by a plate 14 and a substrate 13.

  The key top 10b is a surface cover having translucency for closing the opening of the accommodating portion 10c. Here, the pusher 11 is arrange | positioned at the bottom face of the accommodating part 10c. In addition, a spacer 15 is disposed between the direction key 203 and the determination key 204 configured by the left key 203a and the right key 203b. It is assumed that the up key and the down key constituting the direction key 203 are configured in the same manner as the left key 203a and the right key 203b.

  When the pusher 11 is pressed through the key top 10b and the accommodating portion 10c, the determination plate 204 is elastically deformed by the pusher 11, and the deformation of the electrode plate 14 causes the contact point on the substrate 13 to move. Turns on when conducting.

  In the accommodating part 10c, the light projection part 21, the condensing lens 22, and the image sensor 23 which comprise an optical pointing device are arrange | positioned. The light projecting unit 21 is an illumination device that uses a moving body such as a finger as a detection target and emits detection light toward such a moving body to illuminate the moving body. For example, an LED that generates infrared light (Light Emitting Diode) is used.

  The condensing lens 22 is an optical lens for condensing the detection light reflected by the moving body and forming an image on the image sensor 23.

  The image sensor 23 is an imaging device that includes a plurality of light receiving elements that receive detection light reflected by the moving body, and outputs light reception amount information for each light receiving element. The condensing lens 22 and the image sensor 23 constitute a light receiving unit of an optical pointing device.

  In this optical pointing device, the key top 10b serves as a detection window for detecting the movement of the finger when operating the optical pointing device, and the movement of the moving body in front of the detection window is based on the received light amount information. Detected. That is, the detection light emitted outside through the detection window is reflected by a moving body such as a finger, and the reflected light is received by the image sensor 23 through the detection window, thereby detecting the movement of the moving body. The Therefore, the input by the finger slide operation is possible even when the finger is in contact with the key top 10b or when the finger is away from the key top 10b. By sliding the finger in front of the key top 10b in this manner, the movement of the finger is detected, and the cursor or the like can be moved.

  Further, since the optical pointing device is arranged in the operation key, it can be arranged even in a narrower space as compared with the case where it is arranged separately from the operation key, so that the apparatus can be miniaturized. .

  The optical pointing device and the determination key 204 in which the optical pointing device is arranged inside the key can be individually operated independently. After inputting by the finger slide operation, the finger is not released from the determination key 204. However, input by key operation can be performed. However, since the determination key 204 must be pressed after the finger is slid, the movement of the finger when the determination key 204 is pressed is erroneously detected by the optical pointing device, and an input unintended by the user is likely to occur.

  In the present embodiment, the detection value of the movement amount is delayed by a first time equal to or longer than the detection cycle and output as a slide operation signal, and the operation of the enter key 204 in which the optical pointing device is embedded is monitored. Then, by selectively outputting the detected value of the movement amount based on the detection result of the key operation, erroneous input due to such erroneous detection is prevented.

  FIG. 3 is a block diagram illustrating a configuration example of the mobile phone 1 in FIG. 1, and illustrates an example of a functional configuration in the mobile phone 1. In the cellular phone 1, the movement amount of the finger when the finger is slid on the surface of the key top 10b is detected by image processing based on the received light amount information, and a slide operation signal is generated based on the movement amount information. This slide operation signal is an input signal used for moving a mouse pointer or cursor on the display 101 or scrolling the screen.

  The mobile phone 1 includes a movement amount detection unit 31, a slide operation signal output unit 32, a movement amount temporary storage unit 33, an initial value storage unit 34, a display control unit 35, and a key operation detection unit 36.

  The movement amount detection unit 31 includes a light projecting unit 21, an LED driving unit 41, a light receiving unit 42 including a condenser lens 22 and an image sensor 23, and an image processing unit 43. An operation of repeatedly detecting at a period is performed.

  The LED driving unit 41 is a light projecting control unit including a driver circuit that controls the light projecting unit 21. For example, if necessary, an operation of shutting off the power supply to the light projecting unit 21 and turning it off is performed.

  The image processing unit 43 repeatedly detects the movement amount of the finger at a predetermined cycle (referred to as a detection cycle T1) based on the received light amount information from the image sensor 23, and the detection result is a slide operation signal output unit. The operation to output to 32 is performed.

  In the image processing unit 43, for example, a finger image having a two-dimensional distribution of received light amount is generated based on the received light amount information at regular time intervals, and the finger image, for example, a fingerprint image is compared between successive frames. By doing so, the movement amount of the finger is detected. That is, the finger movement amount is generated as difference information of finger images sampled continuously. The amount of finger movement is detected for each component in the x-axis direction and the y-axis direction.

  The LED drive unit 41, the image sensor 23, and the image processing unit 43 are configured by, for example, one DSP (Digital Signal Processor).

  The key operation detection unit 36 is a key operation signal generation unit that generates a predetermined key operation signal based on a pressing operation of the operation key 201 and outputs the signal to the display control unit 35. This key operation signal is an input signal generated according to the operation key 201 operated by the user.

  The slide operation signal output unit 32 generates a predetermined slide operation signal based on the movement amount of the finger detected by the movement amount detection unit 31 and the key operation signal from the key operation detection unit 36, and the display control unit The operation to output to 35 is performed.

  Specifically, an operation of delaying the movement amount of the finger detected by the image processing unit 43 by a first time T2 (T2 ≧ T1) and outputting it as a slide operation signal is performed. This delay process is performed by storing the detection value of the movement amount in the movement amount temporary storage unit 33. Then, the detection value of the movement amount is compared with a predetermined threshold value, and output of the slide operation signal is started based on the comparison result. That is, a slide operation input determination unit that determines whether or not to output a slide operation signal by comparing the detection value of the movement amount and a threshold value is output. If the detection value of the movement amount is equal to or less than the threshold value, a slide operation signal is output. No action is taken. On the other hand, when the detected value of the movement amount exceeds the threshold value, the output of the slide operation signal is started based on the detection of the movement amount exceeding the threshold value.

  For example, the output of the slide operation signal is started based on the elapse of the third time T3 (T3 ≧ T1) from when the movement amount exceeding the threshold is first detected. That is, the slide operation signal generated based on the detection result of the finger movement is not output for a certain period after the detected value of the movement amount exceeds the threshold value.

  Such a non-output period of the slide signal is a period in which the mouse pointer or the cursor is not moved, and an initial value (a constant value), for example, zero may be output as the control signal. The initial value output instead of the detected value of the movement amount is held in the initial value storage unit 34.

  Further, when a key operation signal is generated by the operation of the enter key 204 before the next slide operation signal is output, the slide operation signal output unit 32 goes back from the generation time of the key operation signal. On the basis of the movement amount detected after the time point T2 (T4 ≦ T2) before 2, an operation to end the output of the slide operation signal is performed. That is, when the enter key 204 is operated after the start of the slide operation signal output, the slide operation signal is output based on the movement amount detected after a certain time T4 before the key operation. Is terminated. Here, it is assumed that the second time T4 is equal to or longer than the detection cycle T1.

  Note that the output of the slide operation signal may be terminated based on the fact that a certain time has elapsed since the detected value of the movement amount becomes equal to or less than a predetermined threshold value. The output of the slide operation signal may be started by turning on the power.

  The display control unit 35 includes an LCD controller that controls a liquid crystal display panel constituting the display 101, and based on a key operation signal from the key operation detection unit 36 and a slide operation signal from the slide operation signal output unit 32. An operation to display information on the display surface is performed.

  For example, when the direction key 203 is operated by the user, an operation of moving the cursor on the display surface by a predetermined amount in a predetermined direction is performed. Further, when an operation of sliding a finger on the key top 10b is performed, the mouse pointer or cursor on the display surface is moved by a predetermined amount in a predetermined direction according to the movement amount of the finger, or the screen is A scrolling operation is performed. In the case of input by a finger slide operation on the key top 10b, control may be performed to vary the moving speed and moving amount of the mouse pointer or cursor according to the moving speed of the finger.

  FIG. 4 is a diagram illustrating an example of the operation of the mobile phone 1 of FIG. 1, in which an example of output of the movement amount detection unit 31 and the slide operation signal is illustrated. The detection of the movement of the finger by the movement amount detection unit 31 is repeatedly performed at a constant detection cycle T1. For example, the movement amount is repeatedly detected at a time interval of about T1 = 30 ms.

  On the other hand, the slide operation signal is output with a delay of a predetermined time (first time T2) from the detection point of the movement amount. At this time, the output of the slide operation signal is started based on the elapse of a certain time (third time T3) after the movement amount exceeding the threshold is detected.

  In this example, the detection value “detection value 1” of the movement amount exceeds the threshold value for the first time, and “detection value 1” and “detection value 2” detected within a certain time T3 from the detection time of this detection value are The detection value is not output, and the output of the slide operation signal is started based on the elapse of a certain time T3 from the detection time of “detection value 1”.

  With respect to “detection value 3”, “detection value 4”,..., “Detection value 12” detected after the elapse of the predetermined time T3, these detection values are sequentially output as slide operation signals.

  Further, when the enter key 204 is operated before the next slide operation signal is output, the movement detected from the operation time point to a time point before a certain time (second time T4). With respect to the amount, the detected value of the movement amount is not output, and the output of the slide operation signal is ended based on the movement amount detected after the time point before the predetermined time T4.

  In this example, the operation of the decision key 204 is detected after the detection value “detection value 11” of the movement amount is output, and “detection value 13” and “detection” detected within a predetermined time T4 from the time of this key operation. For the value “14”, these detection values are not output, and the output of the slide operation signal is terminated based on the detection of the “detection value 13”.

  In general, when the finger is slid, it is better that the response time until an input based on the operation is actually made is short. Therefore, it is desirable that the delay time T2 is short. Therefore, for example, the delay time T2 = T1 is determined. For times T3 and T4, for example, T3 = T4 = T1 is set.

  Steps S101 to S108 in FIG. 5 are flowcharts showing an example of operations in the mobile phone 1 in FIG. First, the slide operation signal output unit 32 acquires a detection value of the movement amount from the image processing unit 43 (step S101).

  At this time, the detection value of the movement amount is compared with a predetermined threshold value, and if the detection value of the movement amount is equal to or less than the threshold value, the slide operation signal is not output and the processing procedure of step S101 is repeated (step S102). On the other hand, when the detection value of the movement amount exceeds the threshold value, the detection value is temporarily stored, and the detection value of the movement amount is determined based on the fact that a certain time has elapsed since the detection of the movement amount exceeding the threshold value. In response to this, a slide operation signal is output (steps S103 to S105).

  Next, when the enter key 204 is operated before the next slide operation signal is output, the slide operation signal output unit 32 invalidates the period from the operation time point to the time point before the predetermined time T4. As the period, for the movement amount detected within this invalid period, the detection value of the movement amount is not output, and the output of the slide operation signal is terminated (steps S106 to S108).

  Here, if the operation of the enter key 204 is not detected, the slide operation signal output unit 32 repeats the processing procedure of step S105 (step S106). Even after the operation of the enter key 204 is detected, the processing procedure of step S106 is repeated even if the detection value of the movement amount detected before the invalid period has not been output (step S107).

  According to the present embodiment, when a key operation signal is generated by operating the enter key 204 before the next slide operation signal is output, the second time is traced back from the generation time of the key operation signal. Since the output of the slide operation signal is ended based on the movement amount detected after the time point before T4, the movement of the finger immediately before the key operation is erroneously detected, and an input unintended by the user is made. Can be suppressed. Accordingly, erroneous input when the enter key 204 is operated following input by the optical pointing device is suppressed, and input that is not intended by the user can be prevented, so that the amount of finger movement using light can be prevented. It is possible to improve the operability of the portable terminal device that detects the above and outputs a slide operation signal that can be used to move the mouse pointer or the cursor.

  In addition, since the amount of movement detected between the time when the amount of movement exceeding the threshold is first detected and the third time T3 elapses is not output, erroneous input immediately after the operation of the optical pointing device is suppressed. be able to.

1 is an external view showing an example of a schematic configuration of a mobile terminal device according to an embodiment of the present invention, and a foldable mobile phone 1 is shown as an example of the mobile terminal device. It is sectional drawing which showed the structural example in the principal part of the mobile telephone 1 of FIG. 1, and the mode of the cross section which cut | disconnected the operation housing | casing 200 by the AA line is shown. FIG. 2 is a block diagram illustrating a configuration example of the mobile phone 1 in FIG. 1, illustrating an example of a functional configuration in the mobile phone 1. It is the figure which showed an example of operation | movement of the mobile telephone 1 of FIG. 1, and the output example of the movement amount detection part 31 and a slide operation signal is shown. 3 is a flowchart showing an example of an operation in the mobile phone 1 of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Cellular phone 10a, 10b Key top 10c Storage part 11 Pusher 12, 13 Board | substrate 14 Electrode board 15 Spacer 21 Light projection part 22 Condensing lens 23 Image sensor 31 Movement amount detection part 32 Slide operation signal output part 33 Movement amount temporary storage Unit 34 initial value storage unit 35 display control unit 36 key operation detection unit 41 LED drive unit 42 light receiving unit 43 image processing unit 100 display casing 101 display 102 receiver for receiver 200 operation casing 201 operation key 202 transmitting microphone 203 direction Key 203a Left key 203b Right key 204 Enter key 300 Hinge part

Claims (5)

A movement amount detection means for detecting a movement amount of the moving body at a predetermined period, and having a light projecting section for emitting detection light and a light receiving section for receiving the detection light reflected by the moving body;
An operation key in which the light receiving unit is disposed;
A key operation detecting means for generating a key operation signal based on the operation of the operation key;
A slide operation signal output means for delaying the movement amount detected by the movement amount detection means by a first time and outputting it as a slide operation signal;
When the key operation signal is generated until the next slide operation signal is output, the slide operation signal output means is configured to go back to the second time that is equal to or less than a first time retroactively from the generation time of the key operation signal. The portable terminal device ends the output of the slide operation signal based on the amount of movement detected after a time point before the time.   The portable terminal device according to claim 1, wherein the slide operation signal output means restarts the output of the slide operation signal based on detection of the movement amount exceeding a predetermined threshold.   2. The slide operation signal output means starts outputting the slide operation signal based on a third time having elapsed since the movement amount exceeding a predetermined threshold was detected. The mobile terminal device according to 1.   The mobile terminal device according to claim 1, wherein the second time is equal to or longer than the period.   The mobile terminal device according to claim 1, wherein the first time is equal to or longer than the period.

Images