JP6421973B2 - Information processing device - Google Patents

Description

  The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus capable of a touch operation by multi-touch.

  In recent years, a display device using a touch panel that receives an operation input by a user by detecting a touch operation on a display surface by an indicator such as a finger has been widespread. A display device provided with a touch panel is applied to, for example, a portable information terminal such as a smartphone, a small information processing device such as a PC (Personal Computer), a large display system such as an electronic blackboard, etc. Operation input is possible.

  A display device that can perform a touch operation generally enables so-called multi-touch detection that detects touches at a plurality of different locations. Accordingly, the user can operate the display device including the touch panel in various modes by multi-touch. For example, when a plurality of users perform a touch operation at the same time, an input operation corresponding to the touch position of each user is performed. It can be performed.

  Regarding a display device capable of multi-touch operation as described above, for example, Patent Document 1 discloses a portable terminal intended to improve the operability of input via a touch pad. When the touch pad detects a press, the portable terminal analyzes the latest image data obtained by imaging the surface of the touch pad, and detects the number of user fingers existing on the surface of the touch pad at the time of the press. To do. Then, the user's operation command is determined based on the detected number of fingers, and the OS executes the determined operation command. Thereby, two types of operations (for example, operations corresponding to the left and right mouse clicks) on one object can be easily performed.

  Patent Document 2 discloses an input processing method for executing processing corresponding to a plurality of mouse input operations by a touch input operation. According to this input processing method, a plurality of mouse input operations are switched according to the touch time on the touch panel, and processing corresponding to the plurality of mouse input operations is selectively executed by one touch input operation. In addition, by switching the scroll direction of the screen according to the contact time with the touch panel, for example, an up scroll and a down scroll can be selectively executed by one touch input operation.

JP 2010-102381 A JP 2007-80291 A

The display screen of the touch panel has been improved in definition, and an operation screen capable of fine operations can be displayed. In addition, a small screen such as a portable terminal has a small operation area. It may be difficult to directly operate such an operation screen using a user's finger. For example, when operating the operation screen directly with a finger, the contact area of the fingertip to the touch panel is relatively large, so when performing detailed work such as software menu selection and setting, select items that the user does not expect May be misconfigured or misconfigured.
On the other hand, in order to perform more detailed operations, for example, an electromagnetic induction type touch panel is used to operate with a pen device, or a peripheral device such as a mouse is connected to display a mouse pointer for operation. Be taken.

However, when using a peripheral device such as a pen device or a mouse as described above, the user must prepare and carry these peripheral devices. In addition, these peripheral devices may be lost.
In the case of a pen device, a means for securing electric power is required for the pen device. Furthermore, it is necessary to use an electromagnetic induction type dedicated touch panel as a touch panel. In the case of a mouse, the code part may interfere with the operation. When the cordless type is used, a means for securing power in the mouse is required.

  On the other hand, when a fine input operation is possible with a finger, the operation can be performed without carrying a peripheral device such as a pen device or a mouse, and convenience is improved. In particular, in a terminal device having high portability such as a tablet PC, portability and mobility are improved. For these reasons, there is a need for a touch panel that allows a reliable operation using a finger even on an operation screen that requires a fine touch operation.

  The technologies described in Patent Documents 1 and 2 enable a plurality of operation inputs to be selectively executed according to a touch operation, but use a peripheral device such as a pen device or a mouse as described above. Therefore, detailed operation input is not possible.

  The present invention has been made in view of the above-described circumstances, and allows a fine input operation to be reliably and easily performed by a touch operation with a user's finger without requiring a peripheral device for the input operation. An object of the present invention is to provide an information processing apparatus.

In order to solve the above problem, a first technical means of the present invention includes a display unit, a touch operation unit that receives an operation input by a touch operation, and a control unit that controls an operation based on the operation input to the touch operation unit. The control unit detects a plurality of touch positions with respect to the touch operation unit by a touch operation with respect to the touch operation unit, and performs another touch for each of the plurality of touch positions. A mouse operation that can be operated with a mouse pointer when the distance between the plurality of touch positions is calculated using the distance information, and the relationship between the plurality of touch positions is determined; The mode shifts to a mode, a predetermined mouse pointer is displayed on the display unit, and the mouse pointer is moved in response to movement of a plurality of touch positions with respect to the touch operation unit. The display position of the moved and to enable an operation input corresponding to the display position of the mouse pointer, the control unit, based on information of the distance, the distance between the other touch position among the plurality of touch position The touch position with the largest sum is determined, and the touch position with the largest sum of the distances to the other touch positions and the touch positions other than the touch positions with the largest sum of the distances with the other touch positions are predetermined. In the case of the relationship, the operation mode is shifted to the mouse operation mode .

A second technical means is characterized in that, in the first technical means, a touch position having the largest total distance from the other touch positions is set as a thumb candidate touch position.
According to a third technical means, in the first technical means, when the four touch positions are detected by the touch operation on the touch operation part, the control unit detects each of the four touch positions. The distance from the other three touch positions is calculated, and the touch position having the largest sum of the distances from the other three touch positions is determined.
According to a fourth technical means, in the third technical means, the touch position having the largest total distance from the other three touch positions is set as the thumb candidate touch position, and the other three touches other than the thumb candidate touch position are used. The position is a three-finger candidate touch position, and when the thumb candidate touch position and the three-finger candidate touch position are in a predetermined relationship, the mouse operation mode is entered.

According to a fifth technical means, in any one of the first to fourth technical means, the predetermined relationship is that the touch position other than the touch position having the largest total distance from the other touch position, and the other The total of the distances to the touch positions is determined based on the distance to the touch position having the largest distance.

Sixth technical means is the first technical means of any one of the first to fifth , further, two touch positions having the longest distance among touch positions other than the touch position having the largest total distance to the other touch positions. When the shortest distance between a straight line connecting the touch positions and one touch position other than the two touch positions is equal to or shorter than a predetermined length, the predetermined relationship is satisfied.

A seventh technical means is the technical means according to any one of the first to sixth technical means, wherein the control unit includes a touch position other than the touch position having the largest total distance from the other touch position and the other touch. When a touch area is set based on the positional relationship with the touch position having the largest total distance to the position, and the touch position within the set touch area is detected by the touch operation unit, a click operation with the mouse is performed. It is characterized by executing a corresponding operation.

An eighth technical means is the technical means according to any one of the first to seventh technical means, wherein the control unit is configured such that the touch position other than the touch position having the largest total distance from the other touch position and the other touch. Based on the relative positional relationship with the touch position having the largest total distance to the position, it is determined whether the touch operation unit is touched with the right hand or the left hand, and the determined hand is identified. Assigning a right click operation with a mouse to a touch position of a finger, and performing an operation corresponding to the right click when only the touch of the specific finger is once released and the touch operation unit is touched again; It is characterized by.

A ninth technical means is the technical means according to any one of the first to eighth technical means, wherein the control unit performs the touch operation at the plurality of touch positions in a state where the plurality of touch positions are in the predetermined relationship. When the touch to the part is released and the predetermined relationship is restored again, the mouse pointer display in the mouse operation mode is continued if the released time is within a predetermined time. It is.

A tenth technical means according to any one of the first to eighth technical means, wherein when the control unit shifts to the mouse operation mode, a notification for notifying a user that the mouse operation mode is set. An icon is displayed on the display unit, and the mouse operation mode is ended when the touch operation unit on the notification icon is touched.

  According to the present invention, it is possible to provide an information processing apparatus capable of reliably and easily executing a fine input operation by a touch operation with a user's finger without requiring a peripheral device for the input operation.

It is a block diagram which shows the principal part structure of the information processing apparatus which concerns on this invention. It is a figure for demonstrating the example of a display control process of the information processing apparatus of this invention. It is a figure explaining the example of operation when touch operation to a touch operation surface is canceled in mouse operation mode. It is a figure for demonstrating the other example of control for performing the completion | finish process of a mouse operation mode. It is a figure for demonstrating the transfer determination processing example to the mouse operation mode based on a touch position. It is a flowchart explaining the example of a process at the time of transfer to the mouse operation mode in the information processing apparatus by this invention. It is a flowchart explaining the example of a process at the time of the mouse operation mode in the information processing apparatus by this invention. It is a figure for demonstrating the example of an end process of the mouse operation mode in the information processing apparatus by this invention.

FIG. 1 is a block diagram showing a main configuration of an information processing apparatus according to the present invention. The information processing apparatus 1 includes a control unit 2, a touch operation unit 3, a display unit 4, and a storage unit 5.
The control unit 2 is configured by a control processor such as a CPU (Central Processing Unit), and controls each unit of the information processing apparatus 1 using programs and data stored in the storage unit 5 to realize its functions.

  The touch operation unit 3 is configured as a touch panel having a touch panel sensor disposed on the surface of the display unit 4 and a detection circuit related thereto. As the touch panel sensor, a capacitance type sensor that detects a position by detecting a change in capacitance between the fingertip and the conductive film can be applied. In addition to this, a resistive film method that detects voltage as an analog quantity using a resistive film, a surface acoustic wave method (ultrasonic method) that detects rebound of vibration waves by generating a voltage of a piezoelectric element, and mainly transmitted light of an infrared LED light source Alternatively, an infrared method for detecting reflected light or the like may be employed.

  The display unit 4 is a display device such as a liquid crystal panel, and can display an operation screen or a setting screen for operation by the touch operation unit 3. The storage unit 5 includes a ROM (Read Only Memory) or a HDD (Hard Disk Drive) that stores programs and data for realizing each function of the information processing apparatus 1, and a RAM (Random Access Memory) that provides a work area to the control unit. ).

When the user touches the touch operation unit 3 installed on the display unit 4, the touch operation unit 3 detects an input and provides the control unit 2 with information (input coordinate information) for specifying the position where the input has been made. Alternatively, the control unit 2 monitors input to the touch operation unit 3 by polling processing or the like.
In response to detection of input by the touch operation unit 3, the control unit 2 acquires detected input coordinate information, determines which position on the display screen of the display unit 4 the input coordinate is, and Based on the determination result, processing corresponding to the display is performed on the display screen of the display unit 4. For example, when an operation button displayed on the display screen of the display unit 4 is operated, the control unit 2 executes a processing program corresponding to the operation of the operation button.

  In the embodiment according to the present invention, the control unit 2 uses a mouse pointer (cursor) to input an operation when a plurality of touch positions are in a predetermined relationship based on the detection result of the touch position by the touch operation unit 3. The operation mode is entered and a mouse pointer is displayed on the display unit 4. Then, the position on the front screen is pointed with the displayed mouse pointer, and processing corresponding to the display of the point position is performed. For example, when an operation button on the display screen is operated with the displayed mouse pointer, the control unit 2 executes a processing program corresponding to the operation of the operation button.

FIG. 2 is a diagram for explaining a display control processing example of the information processing apparatus according to the present invention, and shows a transition processing example to the mouse operation mode and a control example when the mouse pointer is operated. This will be described below with reference to the configuration of FIG.
The touch operation unit 3 is installed on the display unit 4 (the front side in the drawing) so that the display on the display unit 4 can be visually recognized through the transparent touch operation unit 3. In a normal operation mode, when a touch operation is performed on the touch operation unit 3, the control unit 2 acquires input coordinate information detected by the touch operation, and the input coordinate is located at any position on the display screen of the display unit 4. And the processing corresponding to the display is performed on the display screen of the display unit 4 based on the determination result. That is, processing corresponding to the touch position by the touch operation is executed.

In the embodiment according to the present invention, when a plurality of touch positions with respect to the touch operation unit 3 are detected by an operation input to the touch operation unit 3 and the plurality of touch positions have a predetermined relationship, the control unit 2 The operation mode is shifted to a mouse operation mode that can be operated with a mouse pointer.
For example, as shown in FIG. 2A, the above-mentioned predetermined relationship is that the fingertips of the four fingers (the thumb 11, the middle finger 12, the ring finger 13, and the little finger 14) of the user's hand 10 are placed on the touch operation unit 3. It is determined assuming that it is touched. Here, for example, when the user touches the touch operation unit 3 at a hand position where the user operates the mouse on the touch operation unit 3, it is possible to automatically shift to the mouse operation mode with a natural operation. A specific example of determination processing for determining that the touch position has a predetermined relationship will be described later.

  As shown in FIG. 2B, when the mouse operation mode is entered when a plurality of touch positions have a predetermined relationship, the control unit 2 causes the display unit 4 to display a mouse pointer 20 having a predetermined shape. The display position of the mouse pointer 20 can be determined in advance relative to the touch position. Alternatively, the initial display position of the mouse pointer 20 may be set at a predetermined position on the screen.

FIG. 2C shows a moving operation of the mouse pointer 20. Here, when a finger touching the touch operation unit 3 at a touch position with a predetermined relationship is moved on the touch operation unit 3 while maintaining the predetermined relationship, the mouse is interlocked with the movement of the touch position. The pointer 20 moves. For example, when the finger touching the touch operation unit 3 is moved in the right direction toward the screen, the mouse pointer 20 is moved in the right direction in conjunction with the movement. The movement speed of the mouse pointer 20 is set to be faster than the movement speed of the normal touch position (the movement amount of the mouse pointer is larger than the movement amount of the touch operation). It can be arbitrarily set by a predetermined user operation.
Thus, the user can arbitrarily move the mouse pointer 20 as if operating the mouse by moving the finger that is being touch-operated. Since the mouse pointer 20 can be specified in a fine position, the operability can be improved as compared with a case where the mouse pointer 20 is directly operated with a finger.

2D, the user moves the mouse pointer 20 to an arbitrary position, and touches the touch operation unit 3 with the index finger 15 in that state. By this operation, the control unit 2 performs the same operation as a mouse click (left click). The click is for selecting a display object. In addition, operations such as double-click and triple-click can be performed according to the number of clicks. The recognition interval of the click with the index finger 15 is set as appropriate.
Here, the control unit 2 acquires the point position of the mouse pointer 20 in response to the click operation by the touch operation unit 3, and performs processing according to the display screen displayed at the point position. For example, when the mouse pointer 20 points to an operation button displayed on the display screen of the display unit 4, the control unit 2 executes a processing program corresponding to the operation of the operation button.

  Further, the middle finger 12 touching the touch operation surface is once released from the touch operation unit 3 and touched again, so that the same operation as a right click of the mouse can be performed. The right click operation may differ depending on the OS (Operating System) and application software, but for example, a process for displaying a menu related to the object pointed to by the mouse pointer 20 is performed. For example, if you point to a file and right-click, a list of operations that can be performed on the file, such as "Open", "Copy", "Delete", "Cut", "Rename", etc. will be displayed. Can be selected by left-clicking.

Further, the same operation as that of the mouse wheel can be performed by moving the thumb 11 touching the touch operation surface while touching on the touch operation unit 3. By this operation, operations such as scrolling the display screen of the display unit 4 and changing the size of the display font can be performed.
In addition, a predetermined action can be assigned to each touch position corresponding to each finger. At this time, as will be described later, when it is determined whether the operation is performed with the right hand or the left hand, it is possible to determine the touch of the finger according to any of the hands.

FIG. 3 is a diagram for explaining an operation example when the touch operation on the touch operation surface is released (the finger being touched is released from the touch operation unit) in the mouse operation mode.
As described above, in the mouse operation mode, when a plurality of fingers are touched on the touch operation unit 3 so as to have a predetermined relationship, the mouse pointer 20 is displayed and the operation by the mouse pointer 20 is enabled. Here, as shown in FIG. 3A, when the finger touching the touch operation unit 3 is released from the touch operation unit 3, the mouse pointer 20 disappears as shown in FIG. Ends and the operation mode is changed to the normal operation mode.

  At this time, when the finger touching the touch operation surface on the display unit 4 as described above leaves the touch operation surface and does not satisfy the predetermined relationship, the mouse operation mode is canceled and the normal operation is performed. You can enter mode.

  In another control example (Embodiment 2), the control unit 2 releases the touch when the touches at the plurality of touch positions are released and returned to the predetermined relation again in a state where the plurality of touch positions are in the predetermined relation. If the set time is within the predetermined time, the display of the mouse pointer 20 in the mouse operation mode is continued. Here, while the touch is released, until the predetermined time elapses from the release of the touch, the mouse pointer 20 is displayed as it is at the position when the touch is released, and again in a predetermined relationship within the predetermined time. When a touch operation is performed in a certain state, the operation with the mouse pointer 20 is continued.

  Thereby, for example, when the mouse pointer 20 has moved under the finger touching the touch operation unit 3, or the finger has moved to the end of the touch operation unit 3, and the finger cannot move further outside. In some cases, the operability of the mouse pointer 20 can be improved by once releasing the touch and touching the touch operation unit 3 again at a position where the mouse pointer 20 can move.

FIG. 4 is a diagram for explaining another control example (third embodiment) for performing the termination process of the mouse operation mode. When a touch operation is performed by the user as described above and the touch position in the touch operation has a predetermined relationship, the mode is shifted to the mouse operation mode.
As another example of control at this time, as shown in FIG. 4, the control unit 2 notifies the user that the mouse operation mode is in the display screen of the display unit 4 by shifting to the mouse operation mode. A predetermined notification icon 21 is displayed.

  To end the mouse operation mode, in this example, the touch operation unit 3 on the notification icon 21 is touched as shown in FIG. As a result, the mouse operation mode is terminated and the normal operation mode is entered. In this case, even if the finger touching the touch operation unit 3 is released from the touch operation unit 3, the mouse operation mode is not terminated. When the notification icon 21 is displayed, the user can recognize that the mouse operation mode is selected, and can touch the notification icon 21 to end the mouse operation mode.

Next, a specific example of the process for determining whether or not the touch position has a predetermined relationship will be described. FIG. 5 is a diagram for explaining an example of the transition determination process to the mouse operation mode based on the touch position. As described above, when the plurality of touch positions have a predetermined relationship, the control unit 2 shifts from the normal operation mode to the mouse operation mode in which an operation with the mouse pointer is possible.
FIG. 5A shows a touch position with respect to the touch operation unit 3. Here, it is assumed that four touch positions A1, A2, A3, and A4 are detected by the touch operation unit 3. The touch position of A1 is indicated by coordinates (x1, x2), the touch position of A2 is indicated by coordinates (x2, y2), the touch position of A3 is indicated by coordinates (x3, y3), and the touch position of A4 is indicated by It is assumed to be indicated by coordinates (x4, y4).

At this time, the control unit 2 calculates the distance from each of the four touch positions to the other three touch positions, and determines the touch position having the largest total distance from the three touch positions as the thumb candidate touch position. The other three touch positions other than the thumb candidate touch positions are set as the three-finger candidate touch positions. The three fingers are assumed to be a middle finger, a ring finger, and a little finger.
For example, the distance L (A1, A2) between the touch A1 and A2 is calculated by the following formulas.

Similarly, the distance L (A1, A3) between A1 and A3 and the distance L (A1, A4) between A1 and A4 are calculated, and these distances are summed to obtain a total value L1.
L1 = L (A1, A2) + L (A1, A3) + L (A1, A4)

Similarly, regarding the touch position A2, the distance between A2 and A1, the distance between A2 and A3, and the distance between A2 and A4 are calculated and summed to obtain a total value L2. Further, for each of the touch positions A3 and A4, the distances from the other three touch positions are similarly calculated and summed to obtain total values L3 and L4.
Then, the total values L1, L2, L3, and L4 are compared, and the touch position with the largest total value is set as the thumb candidate touch position, and the other two touch positions are set as the three-finger candidate touch positions. In the example of FIG. 5A, the touch position A1 is a thumb candidate touch position, and the touch positions A2, A3, A4 are three-finger candidate touch positions.

  When these touch positions are in a predetermined relationship, the control unit 2 shifts to the mouse operation mode. The predetermined relationship can be determined based on the distance between the three-finger candidate touch position and the thumb candidate touch position, for example. For example, when the touch position closest to the thumb candidate touch position among the three-finger candidate touch positions is the middle finger candidate touch position, and the distance between the thumb candidate touch position and the middle finger candidate touch position is within a predetermined range In addition, it can be determined that the mouse operation mode is in a predetermined relationship.

Also, as shown in FIG. 5B, when a three-finger candidate touch position is detected, whether or not there is a predetermined relationship for shifting to the mouse operation mode based on the relative relationship between the three touch positions. Can be determined.
In this example, among the three-finger candidate touch positions A2, A3 and A4, the shortest distance between the straight line m connecting the two longest touch positions A2 and A4 and the other one touch position A3 is determined in advance. When the length is equal to or shorter than the predetermined length, it can be determined that the three-finger candidate touch position corresponds to a predetermined relationship for shifting to the mouse operation mode.

In detecting the touch position, whether the user is touching the touch operation unit 3 with the right hand based on the relative positional relationship between the thumb candidate touch position and the three-finger candidate touch position detected in the above processing. Determine if you are touching with your left hand.
For example, FIG. 5C shows an example of the touch position when the left hand is touched. Further, FIG. 5A described above shows an example of a touch position when touching with the right hand.

  For example, when the touch position of the touch operation unit 3 is indicated by coordinate values in the horizontal direction and the vertical direction, the coordinate of the thumb candidate touch position is in the horizontal direction toward the touch operation unit 3 rather than the coordinate of the three-finger candidate touch position. When it is on the left side, it can be determined that the user's right hand is touching. Similarly, when the coordinate of the thumb candidate touch position is on the right side in the horizontal direction toward the touch operation unit 3 with respect to the coordinate of the three-finger candidate touch position, it can be determined that the user's left hand is touching. .

  Then, after shifting to the mouse operation mode, the control unit 2 sets an index finger touch area to be touched by the right or left index finger in the touch operation unit 3. When a touch operation is performed within the index finger touch area, the control unit 2 determines that the touch operation has been performed with the user's index finger, and performs a predetermined operation. For example, as a predetermined operation, an operation corresponding to a click (left click) operation by a mouse device is executed.

  The index finger touch area can be set based on the positional relationship between the three-finger candidate touch position and the thumb candidate touch position. As an example, among the three-finger candidate touch positions, the touch position closest to the thumb candidate touch position is defined as the middle finger candidate touch position, and a predetermined distance is provided with respect to the line connecting the thumb candidate touch position and the middle finger candidate touch position. A region within a circle having a predetermined radius centered on a point equidistant from the thumb candidate touch position and the middle finger candidate touch position can be set as the index finger touch region. The one-pointer finger touch area can be appropriately set as an area where the other index finger is supposed to be touched.

  When determining the predetermined area, the control unit 2 has a plurality of touch positions with respect to the touch operation unit 3 in a predetermined relationship. When the control unit 2 shifts to the mouse operation mode, other than the plurality of touch positions having the predetermined relationship, When the touch position is detected, when the touch position is not the index finger touch area, it is determined that the touch operation is a normal touch operation, and an operation corresponding to the touch position can be executed. In this case, even in the mouse operation mode, an operation corresponding to the touch position can be executed separately from the displayed mouse pointer.

  As another example of control (Embodiment 4), when another touch is made outside the index finger touch area, the touch operation may be ignored. For example, when five or more touch positions are detected and four of the touch positions are in a predetermined relationship, the control unit 2 ignores the detection results of the other touch positions and has a predetermined relationship. Control can be performed to move the mouse pointer 20 in accordance with the movement of the touch position.

FIG. 6 is a flowchart for explaining a processing example when shifting to the mouse operation mode in the information processing apparatus according to the present invention.
When the information processing apparatus 1 is operating in the normal operation mode, when the user performs a touch operation on the touch operation unit 3 at the four touch positions (step S1), the control unit 2 displays the four touch positions. Is in a predetermined relationship to shift to the mouse operation mode (step S2). The predetermined relationship is determined in advance assuming the position of the finger of the user's hand. Here, when the four touch positions are not in a predetermined relationship, the control unit 2 performs an operation corresponding to the touch positions on the assumption that the four positions are touched by multi-touch (step S5).

  On the other hand, when the four touch positions correspond to the predetermined relationship (step S2-Yes), the control unit 2 determines whether the touch operation is an operation with the right hand (step S3). If it is determined that the operation is performed with the right hand, the operation proceeds to the mouse operation mode, and control is performed assuming that the touch operation is performed with the right hand by the right-handed user (step S4). Here, an index finger touch area is set between the thumb and the middle finger, or a control operation associated with a specific finger is executed. Similarly, when it is determined that the operation is performed with the left hand, the operation is shifted to the mouse operation mode, and control is performed assuming that the touch operation is performed with the left hand by the left-handed user (step S6).

FIG. 7 is a flowchart for explaining a processing example in the mouse operation mode in the information processing apparatus according to the present invention.
When transitioning to the mouse operation mode, a predetermined operation is executed according to the state of the touch operation. For example, when the touch position by multi-touch having a predetermined relationship has moved (step S11), the control unit 2 moves the mouse pointer displayed on the display unit 4 according to the movement of the touch position (step 12).

  In addition, in the mouse operation mode, when the touch position of the four points satisfies a predetermined relationship, if the fifth touch position is detected, the control unit 2 touches the predetermined index finger touch area. It is determined whether or not it is an operation (step S14). Here, in the case of a touch operation in the index finger touch area, an operation corresponding to a left click of the mouse device is executed (step S15).

On the other hand, when the touch operation is not within the mouse pointer operation index finger touch area, it is determined that the touch operation is a normal touch operation, and an operation corresponding to the touch position is executed (step S16). In this case, an operation corresponding to the touch position can be executed separately from the displayed mouse pointer.
In addition, when a touch to a region other than the index finger touch area is performed instead of the above processing, the touch operation may be ignored.

In the mouse operation mode, when the four touch positions satisfy a predetermined relationship, when the touch at the touch position corresponding to the middle finger is once released and touched again (step S17), the control unit 2 Then, an operation corresponding to a right click of the mouse is executed (step S18).
In the mouse operation mode, when the four touch positions satisfy a predetermined relationship, when the slide operation is performed at the thumb touch position while the thumb is in the touched state (step S19), the mouse wheel operation is performed. Can be executed (step S20). Wheel operations enable operations such as screen scrolling and font size changes.

As described above, by performing a predetermined touch operation in the mouse operation mode, it is possible to execute a predetermined operation associated with the touch operation. Here, in addition to the above operations, operations such as pressing to keep the mouse button pressed, dragging to move the mouse while pressing, and dropping to release the mouse button from the dragged state can be assigned.
In this case, a predetermined action can be assigned to each touch position corresponding to each finger, and when it is determined whether the operation is performed with the right hand or the left hand, the touch of the finger according to any of the hands can be determined. Like that.

FIG. 8 is a diagram for explaining an example of the end processing of the mouse operation mode in the information processing apparatus according to the present invention.
In the mouse operation mode, when all the touches at a plurality of touch positions satisfying the predetermined relationship are released (the finger is released from the touch operation unit 3) (step S21), the control unit 2 is set to maintain the mouse operation mode. Is determined (step S22). The setting for maintaining the mouse operation mode refers to, for example, displaying a notification icon for notifying the mouse operation mode on the display unit 4 in the mouse operation mode, and maintaining the mouse operation mode unless the notification icon is operated. The setting to be done.

  If the setting for maintaining the mouse operation mode is made in step S22 (step S22-Yes), the mouse operation mode is not ended even if the touch operation is canceled. Then, when the user touches the notification icon for notifying the mouse operation mode (step S23), the mouse operation mode is terminated and the normal operation mode is entered (step S24). If the setting for maintaining the mouse operation mode is not made in step S22, the mouse operation mode is terminated and the normal operation mode is entered (step S25).

With the above processing, it is possible to reliably and easily execute a fine input operation by a touch operation with a user's finger without requiring a peripheral device for the input operation.
The technical features (components) described in each of the above embodiments can be combined with each other, and new technical features can be formed by combining them.

DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 2 ... Control part, 3 ... Touch operation part, 4 ... Display part, 5 ... Memory | storage part, 10 ... Hand, 11 ... Thumb, 12 ... Middle finger, 13 ... Ring finger, 14 ... Little finger, 15 ... Index finger 20 ... mouse pointer, 21 ... notification icon.

Claims (10)

An information processing apparatus comprising: a display unit; a touch operation unit that receives an operation input by a touch operation; and a control unit that controls an operation based on the operation input to the touch operation unit,
The control unit detects a plurality of touch positions on the touch operation unit by a touch operation on the touch operation unit, calculates a distance from each of the plurality of touch positions to another touch position, The relationship between the plurality of touch positions is determined using information, and when the determined plurality of touch positions are in a predetermined relationship, a transition is made to a mouse operation mode in which an operation with a mouse pointer is possible, and a predetermined value is displayed on the display unit. Display a mouse pointer, move the display position of the mouse pointer according to the movement of a plurality of touch positions with respect to the touch operation unit, enabling operation input according to the display position of the mouse pointer ,
The control unit determines a touch position having a maximum total distance from the other touch positions among the plurality of touch positions based on the distance information;
When the touch position having the largest distance to the other touch position and the touch position other than the touch position having the largest distance to the other touch position have a predetermined relationship, the mouse operation mode is set. An information processing apparatus characterized by migrating . The information processing apparatus according to claim 1 ,
An information processing apparatus characterized in that a touch position having the largest total distance from the other touch positions is a thumb candidate touch position. The information processing apparatus according to claim 1 ,
When the four touch positions are detected by the touch operation on the touch operation unit, the control unit calculates a distance from each of the four touch positions to the other three touch positions, An information processing apparatus that determines a touch position having a maximum total distance from the other three touch positions. The information processing apparatus according to claim 3 .
The touch position having the largest total distance from the other three touch positions is a thumb candidate touch position, and the other three touch positions other than the thumb candidate touch position are three-finger candidate touch positions,
When the thumb candidate touch position and the three-finger candidate touch position have a predetermined relationship, the information processing apparatus shifts to the mouse operation mode. The information processing apparatus according to any one of claims 1 to 4 ,
The predetermined relationship is determined based on a distance between a touch position other than the touch position having the largest total distance to the other touch position and a touch position having the largest total distance from the other touch position. An information processing apparatus characterized by The information processing apparatus according to any one of claims 1 to 5 ,
Further, among touch positions other than the touch position having the largest distance to the other touch positions, the shortest line between the straight line connecting the two touch positions with the longest distance and one touch position other than the two touch positions. An information processing apparatus characterized by satisfying the predetermined relationship when the distance is equal to or less than a predetermined length. The information processing apparatus according to any one of claims 1 to 6 ,
The control unit determines a touch area based on a positional relationship between a touch position other than the touch position having the largest distance to the other touch position and a touch position having the largest distance between the other touch positions. An information processing apparatus configured to perform an operation corresponding to a click operation with a mouse when the touch position within the set touch area is detected by the touch operation unit. In the information processing apparatus according to any one of claims 1 to 7 ,
The control unit is based on a relative positional relationship between a touch position other than the touch position having the largest distance to the other touch position and a touch position having the largest distance between the other touch positions, It is determined whether the touch operation unit is touched with a right hand or a left hand, a right-click operation with a mouse is assigned to the determined finger touch position of the determined hand, and only the touch of the specific finger is performed. An information processing apparatus that performs an operation corresponding to the right-click when is released once and is touched again by the touch operation unit. The information processing apparatus according to any one of claims 1 to 8 ,
In a state where the plurality of touch positions are in the predetermined relationship, the control unit releases the touch when the touch operation unit at the plurality of touch positions is released and returns to the predetermined relationship again. An information processing apparatus characterized by continuing to display a mouse pointer in the mouse operation mode if a certain time is within a predetermined time. The information processing apparatus according to any one of claims 1 to 8 ,
When the control unit shifts to the mouse operation mode, the control unit displays a notification icon for notifying the user that the mouse operation mode is on the display unit,
The information processing apparatus, wherein the mouse operation mode is terminated when the touch operation unit on the notification icon is touched.

Images