WO2010119713A1

WO2010119713A1 - Portable terminal

Info

Publication number: WO2010119713A1
Application number: PCT/JP2010/050506
Authority: WO
Inventors: 英樹根本; 託也千葉
Original assignee: 株式会社東芝
Priority date: 2009-04-17
Filing date: 2010-01-18
Publication date: 2010-10-21
Also published as: JP2012137800A

Abstract

A portable terminal is provided with a display section for displaying a predetermined image, a detection section for receiving an instruction to the image via an operation surface and detecting the instruction as input positional information, a time acquisition section for acquiring the time from when the detection section has completed the detection of the input positional information till the detection section next starts the detection of the input positional information, a complementary processing section for obtaining complementary positional information which complements input positional information from when the detection has been completed till the detection has been started on the basis of the input positional information when the detection has been completed and the input positional information when the detection has been started if the time acquired by the time acquisition section is less than predetermined time, and a control unit for controlling the display of the image on the basis of the input positional information detected by the detection section and the complementary positional information.

Description

Mobile device

The present invention relates to a portable terminal equipped with a pointing device such as a touch pad or a touch panel.

A mobile terminal such as a mobile phone is equipped with various input devices for receiving operation instructions from a user. Among these input devices, one that can input an operation instruction by an intuitive operation such as a touch pad or a touch panel is known (see, for example, JP-A-2008-258805). The touchpad and the touch panel are configured to accept an operation instruction based on input position information obtained by sensing a change in capacitance or contact pressure accompanying contact with the operation surface.

One of the input devices is an operation key that receives an operation instruction when pressed. When the user inputs an operation instruction with the operation key, the user can determine whether or not the input has been appropriately performed based on a click feeling obtained when the operation key is pressed.

Also, in the case of a touch panel or a touch pad, the user performs an operation instruction input operation by applying a contact pressure to the operation surface by moving or touching a finger or the like on the operation surface. At this time, when the contact pressure on the operation surface is insufficient, the touch panel or the like cannot sense the contact.

Furthermore, unlike the above-described operation keys, the touch panel or the like is difficult to obtain a pressing feeling, and thus it is difficult for the user himself / herself to determine whether or not an operation instruction has been correctly input.

For this reason, the process executed on the mobile terminal in response to the user's input operation may be different from the process expected by the user, or the process expected by the user may not be executed. In addition, the occurrence of a discrepancy between the input operation and the processing to be performed in this manner causes a user to feel poor operability.

DISCLOSURE OF THE INVENTION The present invention has been made in view of such circumstances, and an object of the present invention is to provide a portable terminal that can suitably perform a complementing process on a user's operation instruction and improve operability. And

In order to solve the above-described problem, a mobile terminal according to the present invention includes a display unit that displays a predetermined image, and a detection unit that receives an instruction for the image via an operation surface and detects the instruction as input position information. And a time acquisition unit that acquires a time from when the detection unit ends detection of the input position information to when detection of the input position information starts next, and when the time is less than a predetermined time Complementary position information that complements input position information from the end of the detection to the start of the detection based on the input position information at the end of the detection and the input position information at the start of the detection. A complement processing unit to be obtained, and a control unit that performs display control of the image based on the input position information and the complementary position information detected by the detection unit.

The mobile terminal according to the present invention can suitably perform a complementing process on the user's operation instruction to improve operability.

It is an external appearance perspective view which shows embodiment of the portable terminal which concerns on this invention. It is a schematic functional block diagram which shows the main functional structures of the portable terminal in this embodiment. It is a figure which illustrates notionally the case where the movement instruction | indication with respect to the image displayed on the touch panel is input. It is a figure which illustrates notionally the operation which inputs into an operation pad, and the example of a cursor display based on the input. It is a figure which illustrates notionally the display example of the other operation | movement which inputs into an operation pad, and the input based on the input. It is a flowchart explaining the complementary process of the input position information performed by the main control part of the portable terminal in this embodiment. It is a figure which illustrates notionally the example of a display of the image (cursor) when the complementation process of FIG. 6 is performed with respect to input operation | movement.

Embodiments of a portable terminal according to the present invention will be described with reference to the accompanying drawings. As a portable terminal to which the present invention is applied, a portable terminal that is formed in a card shape and that allows a user to input an operation instruction by touching the display with a finger will be described as an example.

FIG. 1 is an external perspective view showing an embodiment of a portable terminal according to the present invention.

The mobile terminal 1 includes a rectangular plate-shaped casing 11. A touch panel 14 occupies most of one surface of the casing 11.

The touch panel 14 has functions of both a display unit and a detection unit.

The touch panel 14 as a display unit is a display (display 35 in FIG. 2) provided with an area for displaying a display screen composed of characters, images, and the like. This display is composed of, for example, an LCD (Liquid Crystal Display).

The touch panel 14 as a detection unit is a touch sensor (touch sensor 33 in FIG. 2) that detects a contact operation on the operation surface as input position information. The touch sensor includes a plurality of elements for detecting a contact operation arranged on the upper surface of the display, and a transparent operation surface laminated thereon. As a method for detecting the contact operation on the touch panel 14, a pressure-sensitive method for detecting a change in pressure, an electrostatic method for detecting an electric signal due to static electricity, or other methods can be applied.

Further, a receiver 15 for outputting sound and a microphone 16 for inputting sound are disposed on the housing 11 at positions opposed to each other in the longitudinal direction via the touch panel 14.

FIG. 2 is a schematic functional block diagram showing the main functional configuration of the mobile terminal 1 in the present embodiment. The mobile terminal 1 is configured by connecting a main control unit 30, a power supply circuit unit 31, an input control unit 32, a display control unit 34, a voice control unit 36, a communication control unit 37, and a storage unit 39 so that they can communicate with each other via a bus. Has been.

The main control unit 30 includes a CPU (Central Processing Unit). The main control unit 30 operates based on various programs stored in the storage unit 39 and performs overall control of the mobile terminal 1.

The power supply circuit unit 31 includes a power supply source (not shown). The power supply circuit unit 31 switches the power supply ON / OFF state of the mobile terminal 1 based on an operation of turning on the power supply. The power supply circuit unit 31 supplies power from the power supply source to each unit when the power supply is in an ON state, thereby enabling the mobile terminal 1 to operate.

The input control unit 32 includes an input interface for the touch sensor 33. The input control unit 32 receives the detection signal from the touch sensor 33 as input position information indicating the coordinates of the input position every predetermined time (for example, every 10 ms), generates a signal indicating the input, and transmits the signal to the main control unit 30. To do.

The display control unit 34 includes a display interface for the display 35. The display control unit 34 causes the display 35 to display an image based on the document data and the image signal based on the control of the main control unit 30.

The sound control unit 36 generates an analog sound signal from the sound collected by the microphone 16 based on the control of the main control unit 30, and converts the analog sound signal into a digital sound signal. Further, when acquiring the digital audio signal, the audio control unit 36 converts the digital audio signal into an analog audio signal based on the control of the main control unit 30 and outputs the analog audio signal as audio from the receiver 15.

The communication control unit 37 restores data by performing a spectrum despreading process on the received signal received from the base station via the antenna 38 based on the control of the main control unit 30. This data is transmitted to the voice control unit 36 and output from the receiver 15 according to an instruction from the main control unit 30, transmitted to the display control unit 34 and displayed on the display 35, or recorded in the storage unit 39. To do. When the communication control unit 37 acquires the voice data collected by the microphone 16, the data input via the touch panel 14, or the data stored in the storage unit 39 based on the control of the main control unit 30, Is spread over the data and transmitted to the base station via the antenna 38.

The storage unit 39 is a ROM (Read Only Memory) that stores a processing program for processing performed by the main control unit 30 and data necessary for the processing, a hard disk, a non-volatile memory, a database, and is used when the main control unit 30 performs processing. RAM (Random Access Memory) that temporarily stores data to be stored.

The mobile terminal 1 in the present embodiment includes the touch panel 14 as described above. The touch panel 14 receives an instruction for an image or the like displayed on the display 35 of the touch panel 14 via the operation surface. The user inputs to the touch panel 14 via the user's finger or stylus pen. In the present embodiment, an example in which input is mainly performed on the touch panel 14 with a finger will be described. However, the present invention can also be applied to a case other than a finger.

FIG. 3 is a diagram conceptually illustrating a case where a movement instruction for an image displayed on the touch panel 14 is input. The example illustrated in FIG. 3 is described by applying a cursor 41 used to point an operation target on the touch panel 14 as an example of an image displayed on the touch panel 14.

On the touch panel 14, a cursor 41 used to indicate an operation target is displayed. In addition, an area assigned as an operation pad 40 that exclusively receives an operation instruction for the cursor 41 is displayed at a predetermined position on the touch panel 14. The operation pad 40 detects input position information at predetermined time intervals (for example, 10 ms) based on the input operation of the user who moves the finger F in contact with the operation pad 40. The main control unit 30 performs display processing for moving the cursor 41 based on the detected input position information.

For example, when the finger F is moved on the operation pad 40 in the direction of the illustrated arrow A, the cursor 41 is moved in the direction of the illustrated arrow B based on the direction and movement amount corresponding to the input operation. .

FIG. 4 is a diagram conceptually illustrating an operation for inputting to the operation pad 40 and a display example of the cursor 41 based on the input. FIG. 5 is a diagram for conceptually explaining another operation for inputting to the operation pad 40 and a display example of the cursor 41 based on the input. FIG. 4A and FIG. 5A show the locus of input operations performed on the operation panel 40 displayed on the touch panel 14. 4B and 5B show display examples of the cursor 41 displayed on the touch panel 14 based on the input operation. 4 and 5, the operation of the finger F performed on the operation pad 40 (FIGS. 4A and 5A) and the display processing of the cursor 41 corresponding to this operation (FIG. 4). (B) and FIG. 5 (B)) are individually shown, but actually, the operation of the finger F and the display process of the cursor 41 are simultaneously performed on the touch panel 14 as shown in FIG. .

When the user performs an input operation of an operation instruction for moving the cursor 41 (FIG. 4B) displayed on the touch panel 14, the user presses the finger F against the operation pad 40, and the finger F by a desired operation amount is obtained therefrom. The operation to move is performed. FIG. 4A shows a case where the finger F is operated so as to draw a waveform.

Here, when the user can apply a sufficient contact pressure from the finger F to the operation pad 40 and the operation pad 40 can continuously detect the contact of the finger F, the mobile terminal 1 is configured as shown in FIG. As shown in (B), a display is performed in which the cursor 41 is moved while drawing a locus having substantially the same shape as the waveform drawn by the finger F. Note that the trajectory drawn in FIG. 4B is a trajectory having the cursor 41a position as the start point and the cursor 41b position as the end point, and shows a state in which the cursor 41 continuously moves on the display.

On the other hand, even if the user intends to move the finger F on the operation pad 40 while drawing the same waveform as in FIG. 4A, sufficient contact pressure is applied from the finger F to the operation pad 40. If not, it can happen. For example, this may occur when the contact pressure of the user's finger F is smaller than a detectable pressure. In such a case, as shown in FIG. 5A, the operation pad 40 cannot continuously detect the contact of the finger F, and detects an intermittent trajectory.

Then, based on the detected locus, the mobile terminal 1 performs a display of moving the cursor 41 while drawing a locus having the cursor 41a position shown in FIG. 5B as the start point and the cursor 41b position as the end point. That is, the mobile terminal 1 performs display processing for moving the cursor 41 based on a locus detected from the operation pad 40 and not intended by the user.

For this reason, the mobile terminal 1 makes the user feel the poor operability that the intended operation is not performed on the operation pad 40 operated by the finger F.

On the other hand, the portable terminal 1 according to the present embodiment performs input position information complementation processing even when the contact pressure is insufficient and the touch panel 14 (touch sensor 33) cannot detect an input operation associated with the contact. Thus, the display process accompanying the operation intended by the user can be performed.

FIG. 6 is a flowchart for explaining the input position information complementing process executed by the main control unit 30 of the mobile terminal 1 in the present embodiment.

In step S1, the main control unit 30 determines whether a touch event has occurred after a release event has occurred. The release event is an event that occurs when the input position information detected by the touch panel 14 as the detection unit every predetermined time cannot be acquired (when the detection is finished). The touch event is an event that occurs when the touch panel 14 detects input position information next (when detection is started) after the occurrence of a release event.

The case where the touch panel 14 cannot acquire the input position information means that when the touch sensor 33 is pressure sensitive, the detected contact pressure is less than a predetermined pressure (for example, 100 g / cm ² ≈9806 Pa). If it is an equation, it means a case where the detected capacitance is equal to or less than a predetermined capacitance.

When it is determined that the release event and the touch event have not occurred (NO in step S1), the main control unit 30 waits for processing until it occurs.

On the other hand, when it is determined that a release event and a touch event have occurred (YES in step S1), in step S2, the main control unit 30 as a time acquisition unit acquires the time from the release event occurrence to the touch event occurrence. The mobile terminal 1 is provided with a dedicated timer for measuring the time between events, and the main control unit 30 acquires the time between events from this timer.

In step S3, the main control unit 30 determines whether or not the time between events acquired in the time acquisition step S2 is less than a predetermined time (for example, 60 ms). The predetermined time is determined by a value that allows the release event to be regarded as an event that has occurred due to an operation not intended by the user.

Note that the time used for the determination in step S3 may have a range in value. For example, when the time between events is within a range of 20 ms to 60 ms, it may be determined that the release event is not intended by the user. When the time between events is 60 ms or more, the time between events is long, and it can be considered that the user has intentionally generated a release event. Further, when the time between events is 20 ms or less, the operation is negligibly discontinued and cannot be recognized by the user. If the time between events is less than 60 ms, all of them may be subjected to complement processing.

If the main control unit 30 determines that the time between events is not less than the predetermined time (NO in step S3), the main control unit 30 ends the process because it is not necessary to perform the complement process.

On the other hand, when it is determined that the time between events is less than the predetermined time (YES in step S3), the main control unit 30 serving as a complement processing unit in step S4 ignores the release event and performs complementation for obtaining supplementary position information. Process.

The main control unit 30 complements the input position information at the time of occurrence of the touch event from the occurrence of the release event based on the input position information at the time of occurrence of the release event and the input position information at the time of occurrence of the touch event as complementary position information. . In other words, the release operation unintended by the user is ignored, and an input operation in which contact with the operation surface of the touch panel 14 continues is obtained, and the complementary position information is obtained so that the cursor is displayed on the touch panel 14 based on the input operation. Process.

Specifically, since it is considered that the input operation on the operation surface has been continuously detected, the complementary position information is obtained that linearly connects the input position information when the release event occurs and the input position information when the touch event occurs. . The interpolation method for the discontinuous period of the input operation is not limited to this, and other methods may be used.

In step S5, the main control unit 30 as the control unit displays a cursor on the touch panel 14 based on the input position information detected from the touch panel 14 and the complementary position information obtained in the complementary processing step S4.

FIG. 7 is a diagram conceptually illustrating a display example of an image (cursor 41) when the complementing process is performed on the input operation. FIG. 7A shows a trajectory of the input operation of the finger F performed on the touch panel 14. FIG. 7B shows a display example of the cursor 41 displayed based on the input operation of FIG. A solid line in FIG. 7A indicates a locus where the user performs an input operation on the touch panel 14 using the finger F, and a broken line indicates a portion where detection is not performed although the user intended the input operation. Show the trajectory.

As shown in FIG. 7A, when the touch panel 14 cannot detect the input position information corresponding to the operation intended by the user and a release event occurs, the mobile terminal 1 performs the complementing process of FIG. . Specifically, the portion that is not detected, which is the dotted line portion shown in FIG. 7A, is continuously connected based on the input position information when the release event occurs and the input position information when the touch event occurs. Complement processing is performed to obtain complementary position information.

The mobile terminal 1 displays the cursor 41 on the touch panel 14 based on the input position information and the complementary position information obtained from the touch panel 14. As shown in FIG. 7B, the mobile terminal 1 can continuously display the movement of the cursor 41 close to the input operation intended by the user. For this reason, the portable terminal 1 can perform display processing in consideration of the user's intention even when the contact pressure of the user on the touch panel 14 is not sufficient and the touch panel 14 cannot detect the input operation intended by the user. it can.

This completes the explanation of the supplement processing.

According to the portable terminal 1, even when a release event occurs because the input operation intended by the user cannot be detected, it is determined appropriately whether or not the release event is intentional. Complementary processing for display processing can be performed. For this reason, the portable terminal 1 can implement | achieve the display process which the user expected, without producing a habit with the operation instruction which the user intended, and an actual display process.

In the present embodiment, the description has been made by applying the example in which the complementary process is performed on the input operation accompanying the operation instruction for moving the cursor 41 displayed on the display 35 of the touch panel 14. However, the present invention is not limited to this, and the present invention may be applied to a complementary process for an input operation accompanying an operation instruction for an image other than the cursor. Specifically, the present invention can be applied to a case where the mobile terminal 1 performs a display process in which an image displayed on the display 35 is continuously changed with a continuous input operation on the touch panel 14. For example, the present invention can be applied to a case where display processing is performed in which the image change amount or the display time is changed depending on the contact time with the operation surface of the touch panel 14.

Moreover, although the portable terminal 1 in this embodiment applied and demonstrated the structure provided with the touchscreen 14 with which the display 35 and the touch sensor 33 were united, the touch sensor 33 is the touch comprised separately with the display 35. It may be a pointing device such as a pad.

Furthermore, the mobile terminal according to the present invention can be applied to a mobile phone, a PDA (Personal Digital Assistant), a personal computer, a portable game machine, a portable music player, a portable video player, and other portable terminals.

Claims

A display unit for displaying a predetermined image;
A detection unit that receives an instruction to the image via an operation surface, and detects the instruction as input position information;
A time acquisition unit that acquires a time from when the detection unit ends detection of the input position information to when detection of the input position information starts next;
When the time is less than a predetermined time, the input from the end of the detection to the start of the detection based on the input position information at the end of the detection and the input position information at the start of the detection A complementary processing unit for obtaining complementary position information that complements the position information;
A portable terminal comprising: a control unit that performs display control of the image based on the input position information and the complementary position information detected by the detection unit.
The predetermined image is a cursor that moves at least a part of the screen displayed on the display unit,
The instruction is an instruction to move the cursor on the screen,
The mobile terminal according to claim 1, wherein the control unit performs display control for moving the cursor based on the complementary position information.
The portable terminal according to claim 2, wherein the complementary position information is information that connects the input position information at the end of the detection and the input position information at the start of the detection substantially linearly.
The mobile terminal according to claim 1, wherein the display unit and the detection unit are a touch panel formed integrally.