JP2017120670A - Terminal device, input correction program, and input correction method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for reducing operation errors at a time of multi-touch detection.SOLUTION: A terminal device includes: means for acquiring a contact position relating to first contact input to a touch panel and pressing force relating to the first contact, and a contact position relating to second contact input to the touch panel and pressing force relating to the second contact; means for determining that the first contact satisfies a predetermined condition; means for determining degree of the pressing force relating to the first contact or the pressing force relating to the second contact; and means for performing processing according to input operations at the contact position relating to the first contact and the contact position relating to the second contact if the first contact satisfies a predetermined condition and the pressing force relating to the first contact is higher than that relating to the second contact.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a terminal device, an input correction program, and an input correction method.

In recent years, users (users) of information processing terminals such as smartphones, tablet PCs (PC: Personal Computer), and PDAs (Personal Data Assistance) are increasing. In information processing terminals, devices equipped with a touch panel as an input device have become widespread. The touch panel mounted on the information processing terminal is an input device that combines a display device such as an LCD (Liquid Crystal Display) and a device that detects coordinates of a contact position by a user operation such as a touch pad.

  For example, the user performs a predetermined touch operation via the touch panel to realize a function of scrolling the display area with respect to a display image displayed on the information processing terminal, and enlarging or reducing the display area.

  In addition, the following patent documents exist as prior art documents in which technologies related to the technologies described in this specification are described.

JP 2009-217814 A JP2011-237945A JP 2010-020405 A

  In the display screen of the information processing terminal described above, the size of the display area of content or the like is increased by disposing a touch panel on substantially the entire front surface of the information processing terminal. For this reason, when the finger of the hand holding the information processing terminal touches the touch panel, an erroneous operation may occur.

  For example, in a relatively large information processing terminal such as a tablet PC, the user supports the weight of the information processing terminal with a hand opposite to the hand performing the touch operation, and performs a touch operation such as scrolling, enlarging, or reducing the display area. . At this time, the thumb of the hand holding the information processing terminal is in a state of touching the end of the touch panel disposed on the surface.

  In this state, when the touch operation is performed with the finger of the other hand, the information processing terminal detects the finger of the hand already touching and the other finger performing the touch operation, and multi-touch is performed. In the information processing terminal that detects multi-touch, the user input to the touch panel is determined from the position of the finger touched to perform the touch operation and the position of the finger already touched. For example, a single touch operation for scrolling the display area is determined to be a movement of a distance between two points designated by a finger performing the touch operation and a finger already touched. A single touch operation performed for the purpose of scrolling the display area is determined to be a pinch-in or pinch-out operation for enlarging or reducing the display area that does not match the user's intention. For this reason, display images such as images and contents to be scrolled in the display region are subjected to enlargement or reduction of the display region unintended by the user.

In one aspect, an object of the present invention is to provide a technique for reducing erroneous operations during multi-touch detection.

  The above technique can be exemplified by the following configuration of the terminal device. That is, the terminal device receives the contact position related to the first contact and the pressing force related to the first contact, the contact position related to the second contact, and the pressing force related to the second contact, which are input to the touch panel. Means for acquiring, means for determining that the first contact satisfies a predetermined condition, means for determining the level of the pressing force related to the first contact and the pressing force related to the second contact, and the first And means for invalidating the contact position related to the first contact when the contact satisfies a predetermined condition and the pressing force related to the first contact is higher than the pressing force related to the second contact.

  According to said terminal device, the technique which reduces the misoperation at the time of multi-touch detection can be provided.

It is a figure explaining touch operation of a terminal device. It is a figure explaining the tendency of the multi-touch operation in which an erroneous operation occurs. It is a figure which shows the hardware structural example of the terminal device of this embodiment. It is a flowchart which illustrates the erroneous operation prevention process of the process example 1 of this embodiment. It is a flowchart which illustrates the erroneous operation prevention process of the process example 2 of this embodiment. It is a flowchart which illustrates the erroneous operation prevention process of the process example 3 of this embodiment. It is a flowchart which illustrates the erroneous operation prevention process of the process example 4 of this embodiment.

  Hereinafter, a terminal device according to an embodiment will be described with reference to the drawings. The configuration of the following embodiment is an exemplification, and the terminal device is not limited to the configuration of the embodiment.

Hereinafter, the terminal device will be described with reference to FIGS. 1 to 7.
<Comparative example>
FIG. 1 illustrates an explanatory diagram of a touch operation of an information processing terminal (terminal device) such as a tablet PC. In the explanatory diagram of FIG. 1, a terminal device 90 is an information processing terminal such as a tablet PC (PC: Personal Computer). The terminal device 90 has a touch panel 90a as an input device on the front side surface. The touch panel 90a is, for example, an LCD (Liquid Crystal
The display device is a combination of a display device such as Display) and a device that detects coordinates of a contact position such as a user's touch operation.

  In the terminal device 90 of FIG. 1, a display image such as content is displayed on a display device of the touch panel 90a. A user (user) of the terminal device 90 performs, for example, a single touch operation in which an operation finger 91 such as an index finger is brought into contact with and superimposed on a display image displayed on the display device of the touch panel 90a. For example, when the user performs a touch operation, the user touches the terminal device 90 with the other hand different from the hand of the operation finger 91 to fix the contact surface of the touch panel 90a with which the operation finger 91 contacts.

  The user superimposes the operation finger 91 on the display image displayed on the touch panel 90a in a state where the contact surface with which the operation finger 91 contacts is fixed. The contact position of the operation finger 91 superimposed on the display image displayed on the display device of the touch panel 90a is detected by a device that detects the coordinates of the contact position of the touch panel 90a. The terminal device 90 performs processing such as movement of the display position to the display image corresponding to the detected contact position and enlargement or reduction of the display image, for example, by a touch operation.

  For example, when scrolling the display area of the display image displayed on the terminal device 90, the user moves the operation finger 91 superimposed on the display image and touched in the scroll direction by a single touch operation. For example, the user performs a flick operation by moving the operation finger 91 superimposed on the display image so as to flick (pay) in the scroll direction in a state where the operation finger 91 is in contact with the touch panel 90a. Further, for example, the user slides and moves the operation finger 91 superimposed on the display image so as to slide in the scroll direction in a state where the operation finger 91 is in contact with the touch panel 90a. The terminal device 90 detects the contact position and movement direction of the operation finger 91 that is in contact with the touch panel 90a, and scrolls the display image displayed on the display device according to the movement direction of the operation finger 91.

  The explanatory example of FIG. 1 is an example of scrolling a display image by a user's swipe operation. In FIG. 1, a position A is a position where the user's operation finger 91 comes into contact with the display image displayed on the touch panel 90 a in a superimposed manner. Similarly, the position B is a position where the operation finger 91 of the user after the swipe operation comes into contact. In the swipe operation illustrated in FIG. 1, the display position of the display image superimposed at the position A is scrolled in the direction B where the operation finger 91 after the swipe operation contacts, and the display position of the display image at the position A is the position B. Move to.

  As illustrated in FIG. 1, a case may occur in which a finger 92 of a hand holding the terminal device 90 contacts the touch panel 90a during a single touch operation such as scrolling of a display image. In this case, the terminal device 90 detects the position C that is the contact position of the finger 92 that has touched the touch panel 90a, and also detects the position A of the operation finger 91 that has been touched in order to perform a single touch operation. That is, the terminal device 90 may determine that the contact of the operation finger 91 with the touch panel 90 a is a multi-touch operation by the contact of the finger 92 and the operation finger 91 and execute a corresponding process.

  For example, in the example of FIG. 1, the terminal device 90 calculates the distance between the position C where the finger 92 contacts and the position A where the operation finger 91 contacts. Then, for example, the terminal device 90 enlarges or reduces the display image displayed on the touch panel 90a according to the enlargement / reduction of the relative distance from the position C accompanying the movement of the contact position of the operation finger 91 from the position A to the position B. A pinch process is performed. That is, when the finger 92 is in contact with the touch panel 90a, the single touch operation for scrolling the display image is determined as a multi-touch operation. When it is determined that the operation is a multi-touch operation, the terminal device 90 performs a pinch process based on the contact positions of the finger 92 and the operation finger 91 detected as the multi-touch operation, and does not match the user's intention. Enlarged or reduced display is executed.

<Example>
As described in the comparative example, when the finger 92 of the hand holding the terminal device 90 comes into contact with the touch panel 90a and an erroneous operation occurs during the single touch operation, the following (1) to (3) tend to occur. FIG. 2 is an explanatory diagram for explaining a tendency related to the finger 92 when an erroneous operation occurs during a single touch operation. A tendency at the time of erroneous operation that occurs due to contact between the finger 92 of the hand held by the terminal device 90 and the operation finger 91 will be described with reference to FIG.

(1) In FIG. 2, for example, the contact of the finger 92 of the hand holding the terminal device 90 tends to occur at the end 90b of the touch panel 90a. And the area | region in the edge part 90b in which contact generate | occur | produces tends to have a predetermined width according to the length (for example, length of thumb) of the finger | toe 92 to contact. Further, the contact position (position C) of the contact generated at the end portion 90b tends to not move (stay at position C) at least during the period when the single touch operation is performed.

(2) As illustrated in FIG. 1, during a single touch operation, the user fixes the contact surface of the touch panel 90 a with which the operation finger 91 contacts while supporting the weight of the terminal device 90. For this reason,
There is a tendency for a pressure difference to occur between the finger 92 that contacts the end 90b of the touch panel 90a and the operation finger 91 that performs the touch operation, in the pressure that presses the touch panel 90a. With regard to this pressure difference, at least during a single touch operation, the pressure applied by the finger 92 that contacts the end 90b tends to be higher than the operation finger 91 that performs the touch operation.

(3) Further, as illustrated in FIG. 2, the distance between the position C and the position A tends to be relatively far apart with respect to the position where the finger 92 and the operation finger 91 are in contact with the end 90 b. It is in. For example, when a pinch process such as enlargement or reduction is performed on the display image displayed on the touch panel 90a, the user performs a multi-touch operation with one hand different from the hand holding the terminal device 90. Become. The multi-touch operation for executing the pinch processing is performed by, for example, overlapping or narrowing the interval between two touched fingers by superimposing the thumb and forefinger of one hand or the thumb and middle finger on the displayed display image. Or As illustrated in FIG. 2, a multi-touch erroneous operation that occurs during a single touch operation is different from a user's multi-touch operation intended for pinch processing. For this reason, for example, the distance between the position where the finger 92 that contacts the end 90b and the position where the operating finger 91 contacts tends to be relatively larger than the distance of the contact position during the multi-touch operation described above.

  In the multi-touch determination, the information processing terminal (hereinafter referred to as a terminal device) of the present embodiment detects one pressure that is in contact with the touch panel and the other pressure, and determines the relative magnitude of the detected pressure. To do. And the terminal device of this embodiment judges a user operation appropriately on the condition that the magnitude relationship of the detected pressure is a predetermined relationship. Here, the predetermined relationship is, for example, a relationship in which one detected pressure is higher than a predetermined threshold and higher (larger) than the other pressure. As a result, in the terminal device according to the present embodiment, for example, even when the finger of the hand holding the terminal device contacts the touch panel, erroneous operations due to the detected multi-touch can be reduced.

〔Device configuration〕
FIG. 3 illustrates a hardware configuration of the terminal device according to the present embodiment. The terminal device 10 in FIG. 1 is a portable information processing terminal such as a smartphone or a PDA (Personal Data Assistance) tablet PC. The terminal device 10 includes a CPU (Central Processing Unit) 11, a main storage unit 12, an auxiliary storage unit 13, and a communication unit 1 that are connected to each other via a connection bus B 1.
4, an input unit 15, and an output unit 16. The main storage unit 12 and the auxiliary storage unit 13 are recording media that can be read by the mobile terminal device 10.

  In the terminal device 10, the CPU 11 expands the program stored in the auxiliary storage unit 13 to be executable in the work area of the main storage unit 12, and controls peripheral devices through the execution of the program. Thereby, the terminal device 10 can implement a function that matches a predetermined purpose.

For example, the terminal device 10 is connected to a network such as the Internet via the communication unit 14 by the browser function, and receives various services provided on the network. As various services provided on the network, for example, transmission / reception of e-mail, participation of SNS (Social Networking Service), information distribution such as disaster information, download of games, images, videos, music, etc. can be presented.

  For example, the user of the terminal device 10 displays the downloaded display image on the output unit 16 of the terminal device 10 and browses the content provided on the network. For example, the user of the terminal device 10 performs a pinch operation such as scrolling, enlarging, or reducing the display image by superimposing a predetermined operation finger on the display image displayed when browsing the content.

The terminal device 10 according to the present embodiment detects contact of an operation finger related to a user operation through an input device such as an electrostatic touch panel 15a provided in the input unit 15. Further, the terminal device 10 according to the present embodiment detects the pressure (pressing force) of the operating finger via an input device such as a pressure-sensitive touch panel 15 b provided in the input unit 15. And the terminal device 10 of this embodiment judges appropriate operation along a user's intention from each pressure relationship at the time of multi-touch detection. The terminal device 10 of this embodiment reduces the erroneous operation at the time of multi-touch detection.

  In the terminal device 10 illustrated in FIG. 1, the CPU 11 is a central processing arithmetic device that controls the entire terminal device 10. The CPU 11 performs processing according to a program stored in the auxiliary storage unit 13. The main storage unit 12 is a storage medium in which the CPU 11 caches programs and data and expands a work area. The main storage unit 12 includes, for example, a RAM (Random Access Memory) and a ROM (Read Only Memory).

  The auxiliary storage unit 13 stores various programs and various data in a recording medium in a readable and writable manner. The auxiliary storage unit 13 stores an operating system (OS), various programs, various tables, and the like. The OS includes a communication interface program that exchanges data with an external device or the like connected via the communication unit 14. Examples of the external device include an information processing device such as another server on the connected network, an external storage device, a telephone, a terminal device having a communication function, and the like.

The auxiliary storage unit 13 is, for example, an EPROM (Erasable Programmable ROM), a USB (Universal Serial Bus) memory, a memory card, or the like. The auxiliary storage unit 13 includes, for example, a solid state drive device, a hard disk drive (HDD, Hard Disk Drive).
) Apparatus may be included. Further, it may include a CD drive device, a DVD drive device, a BD drive device and the like. Examples of the recording medium include a silicon disk including a nonvolatile semiconductor memory (flash memory), a hard disk, a CD, a DVD, and a BD.

  The communication unit 14 is, for example, an interface with a network or the like. The network to which the terminal device 10 is connected includes, for example, a public network such as the Internet and a wireless network such as a mobile phone network including a communication base station.

  The input unit 15 receives an operation instruction or the like from a user or the like. The input unit 15 is an input device such as a microphone, an input button, an input key, a pointing device, a touch panel, or a camera. The terminal device 10 of this embodiment includes an electrostatic touch panel 15a and a pressure sensitive touch panel 15b as input devices. Information input from the input unit 15 is notified to the CPU 11 via the connection bus B1.

  The electrostatic touch panel 15a is a capacitive touch panel. For example, the electrostatic touch panel 15a detects a change in electrostatic capacity between the conductive film of the electrostatic touch panel 15a and an operation finger in contact with the touch panel 15a. The contact position of the operating finger is detected.

  The pressure-sensitive touch panel 15b is a resistive film type touch panel, and detects a voltage (current) at a portion in contact with the touch panel 15a by using, for example, a resistive film applied by printing of the pressure-sensitive touch panel 15b. . For example, the control unit 101 stores a pressure value associated with a voltage value (current value) detected in advance by the pressure-sensitive touch panel in the auxiliary storage unit 13 in a table format, and by referring to the table, the control unit 101 stores Pressure can be detected.

The output unit 16 outputs data processed by the CPU 11 and data stored in the main storage unit 12. The output unit 16 includes an LCD (Liquid Crystal Display) 16a as a display device for displaying content such as a display image. The output unit 16 of the terminal device 10 has an EL (
Electroluminescence) panels, display devices such as organic EL panels, and output devices such as speakers may be included. The timer T1 is a timer function for measuring time provided in the mobile terminal 10.

  In the terminal device 10 of the present embodiment, the CPU 11 reads the OS, various programs, and various data stored in the auxiliary storage unit 13 into the main storage unit 12 and executes them. The terminal device 10 realizes the function of the control unit 101 along with the execution of the target program. Further, the auxiliary storage unit 13 has a predetermined storage area as a storage destination of data to be referred to or managed by the terminal device 10. The auxiliary storage unit 13 stores determination conditions (threshold values) for processing performed by the control unit 101, which will be described later with reference to FIGS.

  In the multi-touch determination, the control unit 101 functions to appropriately determine user operation and reduce erroneous operations when multi-touch is detected on condition that the detected pressure magnitude relationship is a predetermined relationship. The details of the control unit 101 will be described later in the description of the processing of FIGS.

[Process flow]
Hereinafter, with reference to FIGS. 4 to 7, a description will be given of an erroneous operation prevention process at the time of multi-touch detection of the terminal device 10 of the present embodiment. In the following description, the erroneous operation prevention processing at the time of multi-touch detection of the terminal device 10 according to the embodiment will be described separately in cases of processing examples 1 to 4.

(Processing example 1)
The terminal device 10 of Processing Example 1 detects, for example, the pressure difference between the finger 92 of the hand holding the terminal device 10 that is in contact with the touch panel illustrated in FIG. Perform prevention processing. FIG. 4 illustrates a flowchart of processing for reducing erroneous operations by detecting a pressure difference. In the flowchart of FIG. 4, a plurality of contacts detected by the electrostatic touch panel 15a and the pressure sensitive touch panel 15b are described as “first point” and “second point”, respectively.

  In the flowchart illustrated in FIG. 4, the start of the erroneous operation prevention process can be exemplified by, for example, the time of multi-touch detection after power-on. The terminal device 10 detects, for example, the contact of the finger 92 of the hand holding the terminal device 10 as the “first point” touch point via each of the electrostatic touch panel 15a and the pressure-sensitive touch panel 15b ( S1). Further, the terminal device 10 detects, for example, the contact of the operation finger 91 as the “second point” touch point via the electrostatic touch panel 15a and the pressure-sensitive touch panel 15b (S2). Then, the terminal device 10 detects multi-touch on the terminal device 10 (S3).

  The terminal device 10 temporarily stores, for example, the contact positions of the “first point” and “second point” touch points detected by the electrostatic touch panel 15 a in a predetermined area of the main storage unit 12. Similarly, the terminal device 10 temporarily stores the pressing force of the “first point” and “second point” touch points detected by the pressure-sensitive touch panel 15 b in, for example, a predetermined area of the main storage unit 12. . The terminal device 10 associates the touch point contact position detected by the electrostatic touch panel 15a with the touch point pressing force detected by the pressure sensitive touch panel 15b, and stores them in a predetermined area of the main storage unit 12. It is good.

  When the terminal device 10 detects multi-touch on the terminal device 10, the terminal device 10 executes a determination process for preventing an erroneous operation in S <b> 4-S <b> 5 based on the pressing force detected at each touch point.

The terminal apparatus 10 determines whether the pressing force of the “first point” touch point detected in the process of S1 is equal to or greater than a predetermined threshold (S4). As described with reference to FIG. 2, the pressing force of the finger of the hand that holds while supporting the weight of the terminal device 10 tends to be higher than the pressing force of the operating finger that performs the single touch operation. Therefore, the terminal device 10 can determine whether the touch point is a contact position generated when the terminal device 10 is gripped by determining whether the pressing force of the touch point is equal to or greater than a predetermined threshold. In addition, what is necessary is just to determine such a threshold value from the measured pressing force by previously measuring experimentally the pressing force of the finger | toe which contacts when holding the terminal device 10, for example. For example, the terminal device 10 may store the threshold value thus determined in a predetermined storage area of the auxiliary storage unit 13.

  In the flowchart illustrated in FIG. 4, when the terminal device 10 determines that the pressing force of the “first point” touch point detected in the processing of S1 in the processing of S4 is not equal to or greater than a predetermined threshold (S4, No ), The process proceeds to S7. In the process of S7, the terminal device 10 performs an operation process based on the multi-touch determination detected in S1 and S2.

  For example, the terminal device 10 performs pinch processing based on the contact position between the “first point” touch point detected in S <b> 1 and the “second point” touch point detected in S <b> 2. Note that the pinch processing includes, for example, pinch-out processing for enlarging a display image or the like and pinch-in processing for performing reduction processing of a display image or the like. The terminal device 10 of this embodiment performs a pinch-out process or a pinch-in process according to the expansion / contraction of the distance between the touch point contact positions detected in S1 and S2.

  On the other hand, when the terminal device 10 determines that the pressing force of the “first point” touch point detected in the process of S1 in the process of S4 is equal to or greater than a predetermined threshold (S4, Yes), the terminal device 10 performs the determination process of S5. Transition.

  In the process of S5, the terminal device 10 determines the relative magnitude (high / low) of the pressing force between the detected touch points. This is because, as described with reference to FIG. 2, the pressing force of the finger of the hand that holds the terminal device 10 while supporting the weight tends to be higher than the pressing force of the operating finger performing the single touch operation. The terminal device 10 can determine that a touch point having a high pressing force is a contact generated when the terminal device 10 is gripped by determining the relative magnitude (high or low) of the pressing force between the touch points. . For example, the terminal device 10 compares the pressing force of the “first point” touch point detected in S1 with the pressing force of the “second point” touch point detected in S2. Then, the terminal device 10 determines whether the pressing force at the “first point” touch point is higher than the pressing force at the “second point” touch point.

  The terminal device 10 determines that the pressing force of the “first point” touch point detected in the processing of S1 is not higher than the pressing force of the “second point” touch point detected in the processing of S2 in the processing of S5. In the case (S5, No), the process proceeds to S7. On the other hand, the terminal device 10 determines that the pressing force of the “first point” touch point detected in the processing of S1 is higher than the pressing force of the “second point” touch point detected in the processing of S2 in the processing of S5. If yes (S5, Yes), the process proceeds to S6.

  In the process of S6, the terminal device 10 performs a single touch operation process using the “second point” touch point detected in the process of S2. For example, the terminal device 10 detects a flick operation and a swipe operation of the “second point” touch point detected in the process of S <b> 2, and executes scrolling of the display image.

Here, the process of S1 performed by the terminal device 10 is an example of a step of acquiring the contact position related to the first contact and the pressing force related to the first contact. Further, the CPU 11 or the like of the terminal device 10 is an example of a unit that acquires the contact position related to the first contact and the pressing force related to the first contact.
Execute the process.

  Moreover, the process of S2 performed with the terminal device 10 is an example of the step which acquires the contact position which concerns on a 2nd contact, and the pressing force which concerns on a 2nd contact. Further, the CPU 11 or the like of the terminal device 10 executes the process of S2 as an example of a unit that acquires the contact position related to the second contact and the pressing force related to the second contact.

  Moreover, the process of S4 performed by the terminal device 10 is an example of a step of determining that the first contact satisfies a predetermined condition. Further, the CPU 11 or the like of the terminal device 10 executes the process of S4 as an example of means for determining that the first contact satisfies a predetermined condition.

  Moreover, the process of S5 performed by the terminal device 10 is an example of a step of determining the level of the pressing force related to the first contact and the pressing force related to the second contact. Further, the CPU 11 or the like of the terminal device 10 performs the process of S5 as an example of a unit that determines the level of the pressing force related to the first contact and the pressing force related to the second contact.

  Further, the process of S6 executed by the terminal device 10 is performed when the first contact satisfies a predetermined condition and the pressing force related to the first contact is higher than the pressing force related to the second contact. It is an example of the step which invalidates the contact position which concerns on contact. In addition, the CPU 11 or the like of the terminal device 10 relates to the first contact when the first contact satisfies a predetermined condition and the pressing force related to the first contact is higher than the pressing force related to the second contact. As an example of a means for invalidating the contact position, the process of S6 is executed.

  In addition, the process of S7 executed by the terminal device 10 is the first when the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact. It is an example of the step which performs the process according to input operation by the contact position which concerns on a contact, and the contact position which concerns on a 2nd contact. In addition, the CPU 11 or the like of the terminal device 10 relates to the first contact when the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact. The process of S7 is executed as an example of means for executing a process according to the input operation by the contact position and the contact position related to the second contact.

  As described above, when the terminal device 10 according to the present embodiment detects multi-touch, the terminal device 10 determines whether the pressing force at one touch point is equal to or greater than a threshold value. When the pressing force at one touch point is greater than or equal to the threshold value, the terminal device 10 further determines the magnitude of the pressing force with the other touch point. As a result, the terminal device 10 according to the present embodiment can specify the touch point of the finger of the hand to be held while supporting the weight of the terminal device 10. In the terminal device 10 of the present embodiment, when the pressing force of one touch point is equal to or higher than the threshold and is higher than the pressing force of the other touch point, for example, one touch point is invalidated and the other touch point is used. It can be processed as a single touch operation. In addition, even if the pressing force of one touch point is equal to or greater than the threshold value, the terminal device 10 executes a pinch process between two points as a multi-touch operation, for example, when the pressing force is lower than the pressing force of the other touch point. be able to. Furthermore, the terminal device 10 according to the present embodiment can identify the operation finger from the pressure relationship between the identified finger and the touch point by another operation finger. Since the terminal device 10 according to the present embodiment can appropriately determine a user operation even when a finger of a hand holding the terminal device touches the touch panel, erroneous operations can be reduced.

  Moreover, since the terminal device 10 of this embodiment can specify the finger and the operation finger of the hand holding the terminal device 10 with the pressing force of each touch point, for example, an operation for preventing an erroneous operation at the end of the display screen It is not necessary to set a non-target area. For this reason, the terminal device 10 of this embodiment can make the operation area | region at the time of touch operation the area | region of the same size as a display screen.

(Processing example 2)
Next, the erroneous operation prevention process at the time of multi-touch detection of the process example 2 will be described with reference to the flowchart illustrated in FIG. In the erroneous operation prevention process of Process Example 2, the terminal device 10 further performs a process of determining the detected contact position and movement of one touch point and the distance from the other touch point.

  The erroneous operation prevention process illustrated in FIG. 5 is different from the erroneous operation prevention process illustrated in FIG. 4 by including the processes of S11 to S14. Hereinafter, the process of S11-S14 different from the erroneous operation prevention process illustrated in FIG. 4 will be mainly described.

  In the flowchart illustrated in FIG. 5, in the process of S <b> 11, the terminal device 10 determines whether the position of the “first point” touch point detected in the process of S <b> 1 is within the end region of the display screen. The terminal device 10 determines whether the position of the “first point” touch point detected in the process of S1 is within the region of the end 90b illustrated in FIG. 2, for example. This is because, as described with reference to FIG. 2, the contact position of the finger of the hand gripped while supporting the weight of the terminal device 10 tends to occur in the end region of the display screen. The setting of the end area of the display screen may be stored in advance in a predetermined storage area of the auxiliary storage unit 13 as map information.

  In the flowchart illustrated in FIG. 5, when the terminal apparatus 10 determines that the position of the “first point” touch point detected in the process S <b> 1 in the process S <b> 11 is not within the end region of the display screen ( (S11, No), the process proceeds to S7. On the other hand, when the terminal device 10 determines that the position of the “first point” touch point detected in the process of S1 in the process of S11 is within the end region of the display screen (S11, Yes), The process proceeds to S12.

  In the process of S12, the terminal device 10 determines whether the detected distance between the touch points is equal to or greater than a predetermined threshold. As described with reference to FIG. 2, the distance between the contact position of the finger of the hand that holds the terminal device 10 while supporting the weight of the terminal device 10 and the contact position of the operation finger is larger than the multi-touch operation that executes the pinch process. Because it tends to be. Such a threshold value may be stored in advance in a predetermined storage area of the auxiliary storage unit 13 as determination information, for example, in the same manner as the end area of the process of S11.

  For example, the terminal device 10 calculates the distance between the touch points from the positions of the “first point” and “second point” touch points detected in the processes of S1 and S2. If the terminal device 10 determines that the distance between the touch points does not exceed the predetermined threshold (S12, No), the terminal device 10 proceeds to the process of S7. On the other hand, if the terminal device 10 determines in S12 that the distance between touch points is greater than or equal to a predetermined threshold value in S1 (S12, Yes), the terminal device 10 starts the timer in S13.

  Regarding the timer activation, as described with reference to FIG. 2, the contact position of the finger of the hand gripped while supporting the weight of the terminal device 10 does not move at least during the touch operation (stays at the touch point). This is because there is a tendency. Note that the set value of the timer may be determined from, for example, an operation time such as single touch previously measured and the measured operation time. For example, the terminal device 10 may store the timer setting value determined in this way in a predetermined storage area of the auxiliary storage unit 13.

For example, the terminal device 10 starts a timer in which a predetermined period is set, and proceeds to the determination process of S14. In the process of S14, the terminal device 10 determines whether the moving distance of the “first point” touch point detected in the process of S1 is equal to or less than a predetermined threshold. This is because even when the terminal device 10 is gripped, it can be assumed that the position of the touch point moves within a predetermined area range due to, for example, shaking or tilting of the moving vehicle or the like. For such a threshold value, for example, an allowable movement amount (distance) may be set in advance and stored in a predetermined storage area of the auxiliary storage unit 13 as a threshold value.

  When the terminal device 10 determines that the movement distance of the “first point” touch point detected in the process of S1 exceeds a predetermined threshold before the timer started in S13 expires in the process of S14 (S14, No), the process proceeds to S7. On the other hand, when the terminal device 10 determines that the movement distance of the “first point” touch point detected in the process of S1 is equal to or less than a predetermined threshold until the timer activated in S13 expires in the process of S14. (S14, Yes), the process proceeds to the determination process of S5 when the timer expires.

  Here, the process of S11-S14 performed by the terminal device 10 is an example of a step of determining that the first contact satisfies a predetermined condition. Further, the CPU 11 or the like of the terminal device 10 executes the processes of S11 to S14 as an example of a unit that determines that the first contact satisfies a predetermined condition.

  As described above, the terminal device 10 of the processing example 2 can identify the finger of the hand that holds the terminal device 10 or the operation finger by determining the contact area of one touch point. Further, the terminal device 10 according to the processing example 2 determines the distance between the touch points even when a touch point is detected in a predetermined contact area, so that the finger of the hand holding the terminal device 10 can operate. Can identify finger. Furthermore, the terminal device 10 of the processing example 2 determines the movement distance of the touch point for a certain period of time, so that even if the distance between the touch point detected in the predetermined contact area and the other touch point is far, the terminal device 10 It is possible to specify whether the finger of the hand holding the device 10 or the operation finger. And the terminal device 10 determines the magnitude relationship (high / low) of the pressing force between touch points. As a result, the terminal device 10 according to the present embodiment, for example, fixes the end of the display screen with one operation finger and the end of the display screen even when the operation is related to the pinch process of moving the other operation finger. It can be determined as a multi-touch operation between the operation finger that touches the other and the other touching operation finger.

(Processing example 3)
Next, the erroneous operation prevention process at the time of multi-touch detection of the process example 3 will be described with reference to the flowchart illustrated in FIG. In the processing examples 1 and 2, the erroneous operation prevention processing by multi-touch between two points is illustrated, but in the processing example 3, the erroneous operation prevention processing at the time of detecting the “third point” touch point is executed.

  The erroneous operation prevention process illustrated in FIG. 6 is different from the erroneous operation prevention process illustrated in FIG. 4 by including the processes of S21 to S24. Hereinafter, the processing of S21 to S24 that is different from the erroneous operation prevention processing illustrated in FIG. 4 will be mainly described.

  In the flowchart illustrated in FIG. 6, for example, the terminal device 10 maintains the “first point” and “second point” touches after the operation error prevention process illustrated in FIG. The touch point is detected (S21). Note that the processing in S21 is the same as the processing in S1 and S2.

  In the process of S22, the terminal device 10 that has detected the “third point” touch point determines whether the pressure of the “first point” touch point detected in the process of S1 is equal to or greater than a predetermined threshold. The terminal device 10 can determine that the “third” touch point has occurred with the finger of the hand holding the terminal device 10 still in contact by performing the process of S22. The threshold value for the determination process in S22 is preferably the same as the threshold value for the determination process in S4, for example.

  When the pressing force of the “first point” touch point detected in the process of S1 in the process of S22 is not equal to or greater than the predetermined threshold (No in S22), the terminal device 10 proceeds to the process of S7. On the other hand, when the pressing force of the “first point” touch point detected in the process of S1 in the process of S22 is equal to or greater than a predetermined threshold (S22, Yes), the terminal device 10 proceeds to the process of S23.

  When it is determined “No” in the process of S22, multi-touch is performed at three points, and the pressing force at the touch points “first point” and “second point” is less than the threshold value. Therefore, the terminal device 10 proceeds to the processing of S7 and executes processing by normal multi-touch detection. However, if “No” is determined in the determination of S22, for example, the terminal device 10 may continue the multi-touch operation process using the “first point” and the “second point” described in FIG. Good. Further, for example, the terminal device 10 may perform multi-touch operation processing using “second point” and “third point”, or “first point” and “third point”. In addition, the terminal device 10 further determines whether or not the pressing force of each touch point is equal to or greater than a threshold value, thereby identifying the touch point of the finger of the hand that holds the terminal device 10. Touch operation processing between two points other than the touch point may be performed. Note that the terminal device 10 may perform the multi-touch operation process between any two points described above when there is no touch point of the pressing force equal to or greater than the threshold as a result of the determination of the pressing force again. .

  In the process of S23, the terminal device 10 determines the magnitude (high / low) relationship of the pressing force between the touch points detected in S1, S2, and S21. For example, the terminal device 10 presses the pressing force of the “first point” touch point detected in the process of S1 and the pressing points of the “second point” and “third point” detected in the processes of S2 and S21. Compare with pressure. When the terminal device 10 determines in the process of S23 that the pressing force of the “first point” touch point is not higher than the pressing force of the “second point” and “third point” touch points. (S23, No), the process proceeds to S7.

  When it is determined “No” in the process of S23, touch points that are multi-touched at three points and that are equal to or greater than the threshold value exist at least other than the “first point” touch points. Also in this case, the terminal device 10 may move to the process of S7 and execute a process by normal multi-touch detection. For example, the terminal device 10 may continue the multi-touch operation process using the “first point” and the “second point” described in FIG. The terminal device 10 may perform multi-touch operation processing using “second point” and “third point” because at least the “first point” pressing force is equal to or greater than the threshold value. In addition, the terminal device 10 may invalidate the “first point” that is equal to or greater than the threshold and other points of the pressing force that is higher than the “first point”. In this case, for example, the terminal device 10 may maintain the single touch operation process or the process of S6 by another point lower than the “first point” equal to or higher than the threshold. Furthermore, as illustrated in FIG. 5, it is possible to start a timer, determine the moving distance of each touch point, invalidate the touch point with the smallest movement, and perform multi-touch operation processing with the remaining touch points. Good.

  On the other hand, when the terminal device 10 determines in step S23 that the pressing force of the “first point” touch point is higher than the pressing force of the “second point” and “third point” touch points. (S23, Yes), the process of S24 is executed. When it is determined “Yes” in the process of S23, the terminal device 10 proceeds to S24 assuming that the “third point” touch operation has occurred in the “second point” single touch operation determined in S6. The operation terminal 10 having shifted to S24 performs a multi-touch operation process between the “second point” touch point detected in the process of S2 and the “third point” touch point detected in the process of S21.

Here, the process of S21 performed by the terminal device 10 is an example of a step of acquiring the contact position related to the third contact and the pressing force related to the third contact. Further, the CPU 1 of the terminal device 10
1 etc. perform the process of S21 as an example of a means for acquiring the contact position related to the third contact and the pressing force related to the third contact.

  Moreover, the process of S23 performed by the terminal device 10 is an example of a step of determining the level of the pressing force related to the first contact and the pressing force related to the third contact. Further, the CPU 11 or the like of the terminal device 10 performs the process of S23 as an example of a unit that determines the level of the pressing force related to the first contact and the pressing force related to the third contact.

  Further, in the processing of S24 executed by the terminal device 10, the first contact satisfies a predetermined condition, and the pressing force related to the first contact is more than the pressing force related to the second contact and the third contact. If it is high, it is an example of a step of invalidating the contact position related to the first contact. Further, the CPU 11 or the like of the terminal device 10 determines that the first contact satisfies a predetermined condition and the pressing force related to the first contact is higher than the pressing force related to the second contact and the third contact. The process of S24 is executed as an example of a means for invalidating the contact position related to the first contact.

  As described above, when the “third” touch point is detected, the terminal device 10 of the processing example 3 can determine whether the touch point is newly generated by the user operation by performing the determination process of S22 to S23. When the terminal device 10 determines that the touch point is newly generated by a user operation through the determination processing in S22 to S23, the terminal device 10 can perform multi-touch operation processing with the newly generated touch point. . On the other hand, if the terminal device 10 makes a negative determination in the process of S22, or if the negative determination is made in the process of S23, the multi-touch using the “first point” and “second point” touch points that have already been subjected to the determination process. The operation process can be continued. As a result, the terminal device 10 according to the present embodiment can appropriately determine the user operation even when, for example, the third “touch point” is detected, so that erroneous operations can be reduced.

(Processing example 4)
Next, an erroneous operation prevention process at the time of multi-touch detection of the process example 4 will be described with reference to a flowchart illustrated in FIG. In the erroneous operation prevention process of the process example 4 illustrated in FIG. 7, the process of continuously monitoring the pressing force at one touch point is performed after the execution of the malfunction prevention process at the time of multi-touch detection illustrated in FIG. 4.

  The erroneous operation prevention process illustrated in FIG. 7 is different from the erroneous operation prevention process illustrated in FIG. 4 by including the process of S31. Hereinafter, the process of S31 different from the erroneous operation prevention process illustrated in FIG. 4 will be mainly described.

  In the flowchart illustrated in FIG. 7, in the process of S <b> 31, the terminal apparatus 10 determines whether the pressure of the “first point” touch point detected in the process of S <b> 1 is equal to or greater than a predetermined threshold value. The finger contact holding 10 is monitored. The terminal device 10 can determine that the finger holding the terminal device 10 continues to be in contact by determining that the pressure at the “first point” touch point is equal to or greater than a predetermined threshold. Note that the determination process in S31 is the same as the determination process in S4, for example.

  When the pressing force of the “first point” touch point detected in the process of S1 in the process of S31 is equal to or greater than a predetermined threshold (Yes in S31), the terminal device 10 proceeds to the process of S6, and “1 Continue the malfunction prevention process that ignores the “dot” touch. On the other hand, when the pressing force of the “first point” touch point detected in the process of S1 in the process of S31 does not exceed the predetermined threshold (No in S31), the terminal device 10 proceeds to the process of S7. . The terminal device 10 ends the malfunction prevention processing of this embodiment by shifting to the processing of S7, and executes normal multi-touch operation processing such as pinch processing, for example.

  In this way, the terminal device 10 of the processing example 4 performs the process of continuously monitoring the pressing force of one touch point, thereby preventing, for example, an erroneous operation that invalidates the finger that holds the terminal device 10 that is in contact. Processing can continue.

<Modification>
In the processing example 2 illustrated in FIG. 5, the erroneous operation prevention processing that invalidates the touch point due to the contact of the finger holding the terminal device 10 by performing the processing of S11 to S14 and S5 has been described. As a modification, for example, the terminal device 10 may execute only one of the process of S11 and the process of S14 illustrated in FIG. Further, the terminal device 10 invalidates the touch point by the contact of the finger holding the terminal device 10 by combining any two of the processing of S4 illustrated in FIG. 4 and the processing of S11, S14, and S5 illustrated in FIG. An erroneous operation prevention process may be performed.

<Computer-readable recording medium>
A program for causing a computer or other machine or device (hereinafter, a computer or the like) to realize any of the above functions can be recorded on a recording medium that can be read by the computer or the like. The function can be provided by causing a computer or the like to read and execute the program of the recording medium.

  Here, a computer-readable recording medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read from a computer or the like. Say. Examples of such a recording medium that can be removed from a computer or the like include a flexible disk, a magneto-optical disk, a CD-ROM, a CD-R / W, a DVD, a Blu-ray disk, a DAT, an 8 mm tape, a flash memory, and the like. There are cards. Moreover, there are a hard disk, a ROM, and the like as a recording medium fixed to a computer or the like.

<Others>
The above embodiment further includes an aspect called the following supplementary note. The components included in the following supplementary notes can be combined with the constituents included in the other supplementary notes.
(Appendix 1)
Means for acquiring a contact position related to the first contact, a pressing force related to the first contact, a contact position related to the second contact, and a pressing force related to the second contact, which are input to the touch panel; ,
Means for determining that the first contact satisfies a predetermined condition;
Means for determining the level of the pressing force related to the first contact and the pressing force related to the second contact;
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is higher than the pressing force related to the second contact, the contact position related to the first contact is invalidated. Means,
A terminal device comprising:
(Appendix 2)
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact, the contact position related to the first contact and the second contact The terminal device according to appendix 1, further comprising means for executing a process according to an input operation with a contact position related to the contact.
(Appendix 3)
Means for acquiring a contact position related to the third contact and a pressing force related to the third contact, which are input to the touch panel;
Means for determining the level of the pressing force related to the first contact and the pressing force related to the third contact;
When the first contact satisfies a predetermined condition, and the pressing force related to the first contact is higher than the pressing force related to the second contact and the third contact, the first contact The terminal device according to appendix 1 or 2, further comprising means for invalidating the contact position according to.
(Appendix 4)
The terminal device according to any one of supplementary notes 1 to 3, wherein the predetermined condition is that a pressing force related to the first contact is a predetermined value or more.
(Appendix 5)
The terminal device according to any one of supplementary notes 1 to 3, wherein the predetermined condition is that a contact position related to the first contact is within a predetermined region.
(Appendix 6)
The terminal device according to appendix 5, wherein the predetermined condition includes that a distance between a contact position related to the first contact and a contact position related to the second contact is a predetermined value or more.
(Appendix 7)
The terminal device according to appendix 6, wherein the predetermined condition includes that a moving distance of a contact position related to the first contact within a predetermined period is equal to or less than a predetermined value.
(Appendix 8)
On the computer,
Obtaining a contact position related to the first contact and a pressing force related to the first contact, a contact position related to the second contact, and a pressing force related to the second contact, which are input to the touch panel; ,
Determining that the first contact satisfies a predetermined condition;
Determining the level of the pressing force related to the first contact and the pressing force related to the second contact;
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is higher than the pressing force related to the second contact, the contact position related to the first contact is invalidated. Steps,
An input correction program for executing
(Appendix 9)
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact, the contact position related to the first contact and the second contact The input correction program according to appendix 8, for further executing a step of executing a process according to an input operation with a contact position related to the contact.
(Appendix 10)
Obtaining a contact position related to the third contact and a pressing force related to the third contact, which are input to the touch panel;
Determining the level of the pressing force related to the first contact and the pressing force related to the third contact;
When the first contact satisfies a predetermined condition, and the pressing force related to the first contact is higher than the pressing force related to the second contact and the third contact, the first contact The input correction program according to appendix 8 or 9, for further executing the step of invalidating the contact position according to.
(Appendix 11)
The input correction program according to any one of supplementary notes 8 to 10, wherein the predetermined condition is that a pressing force related to the first contact is equal to or greater than a predetermined value.
(Appendix 12)
The input correction program according to any one of Supplementary Notes 8 to 10, wherein the predetermined condition is that a contact position related to the first contact is within a predetermined region.
(Appendix 13)
The input correction program according to appendix 12, wherein the predetermined condition includes that a distance between a contact position related to the first contact and a contact position related to the second contact is a predetermined value or more.
(Appendix 14)
The input correction program according to appendix 13, wherein the predetermined condition includes that a moving distance of a contact position related to the first contact within a predetermined period is equal to or less than a predetermined value.
(Appendix 15)
Computer
Obtaining a contact position related to the first contact and a pressing force related to the first contact, a contact position related to the second contact, and a pressing force related to the second contact, which are input to the touch panel; ,
Determining that the first contact satisfies a predetermined condition;
Determining the level of the pressing force related to the first contact and the pressing force related to the second contact;
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is higher than the pressing force related to the second contact, the contact position related to the first contact is invalidated. Steps,
Input correction method to execute.
(Appendix 16)
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact, the contact position related to the first contact and the second contact The input correction method according to claim 15, further comprising a step of executing a process according to an input operation based on a contact position related to the contact.
(Appendix 17)
Obtaining a contact position related to the third contact and a pressing force related to the third contact, which are input to the touch panel;
Determining the level of the pressing force related to the first contact and the pressing force related to the third contact;
When the first contact satisfies a predetermined condition, and the pressing force related to the first contact is higher than the pressing force related to the second contact and the third contact, the first contact The input correction method according to supplementary note 15 or 16, further comprising: a step of invalidating the contact position according to. (Appendix 18)
The input correction method according to any one of supplementary notes 15 to 17, wherein the predetermined condition is that a pressing force related to the first contact is equal to or greater than a predetermined value.
(Appendix 19)
The input correction method according to any one of supplementary notes 15 to 17, wherein the predetermined condition is that a contact position related to the first contact is within a predetermined region.
(Appendix 20)
The input correction method according to appendix 19, wherein the predetermined condition includes that a distance between a contact position related to the first contact and a contact position related to the second contact is equal to or greater than a predetermined value.
(Appendix 21)
The input correction method according to appendix 20, wherein the predetermined condition includes that a moving distance of a contact position related to the first contact within a predetermined period is equal to or less than a predetermined value.

10 Terminal device 11 CPU
12 Main storage unit 13 Auxiliary storage unit 14 Communication unit 15 Input unit 15a Electrostatic touch panel, 15b Pressure sensitive touch panel 16 Output unit 16a LCD
90 terminal device 90a touch panel, 90b end 91 operation finger, 92 finger 101 control unit

Claims (8)

Means for acquiring a contact position related to the first contact, a pressing force related to the first contact, a contact position related to the second contact, and a pressing force related to the second contact, which are input to the touch panel; ,
Means for determining that the first contact satisfies a predetermined condition;
Means for determining the level of the pressing force related to the first contact and the pressing force related to the second contact;
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact, the contact position related to the first contact and the second contact A terminal device comprising means for executing processing according to an input operation with a contact position related to the contact. Means for acquiring a contact position related to the third contact and a pressing force related to the third contact, which are input to the touch panel;
Means for determining the level of the pressing force related to the first contact and the pressing force related to the third contact;
When the first contact satisfies a predetermined condition, and the pressing force related to the first contact is higher than the pressing force related to the second contact and the third contact, the first contact The terminal device according to claim 1, comprising means for invalidating the contact position according to claim 1.   The terminal device according to claim 1, wherein the predetermined condition is that a pressing force related to the first contact is a predetermined value or more.   The terminal device according to claim 1, wherein the predetermined condition is that a contact position related to the first contact is within a predetermined region.   The terminal device according to claim 4, wherein the predetermined condition includes that a distance between a contact position related to the first contact and a contact position related to the second contact is equal to or greater than a predetermined value.   The terminal device according to claim 5, wherein the predetermined condition includes that a moving distance of a contact position related to the first contact within a predetermined period is equal to or less than a predetermined value. On the computer,
Obtaining a contact position related to the first contact and a pressing force related to the first contact, a contact position related to the second contact, and a pressing force related to the second contact, which are input to the touch panel; Determining that the first contact satisfies a predetermined condition;
Determining the level of the pressing force related to the first contact and the pressing force related to the second contact;
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact, the contact position related to the first contact and the second contact Executing a process according to the input operation with the contact position related to the contact;
An input correction program for executing Computer
Obtaining a contact position related to the first contact and a pressing force related to the first contact, a contact position related to the second contact, and a pressing force related to the second contact, which are input to the touch panel; ,
Determining that the first contact satisfies a predetermined condition;
Determining the level of the pressing force related to the first contact and the pressing force related to the second contact;
When the first contact satisfies a predetermined condition and the pressing force related to the first contact is lower than the pressing force related to the second contact, the contact position related to the first contact and the second contact Executing a process according to the input operation with the contact position related to the contact;
Input correction method to execute.

Images