JP6136630B2 - Destination determination apparatus, destination determination method, and destination determination program - Google Patents

Description

  The present invention relates to a destination determination apparatus, a destination determination method, and a destination determination program.

  Electronic devices equipped with touch panels such as smartphones and tablet terminals are used. The touch panel is an electronic component that outputs an information signal indicating information of a contact position to the outside when a finger or a dedicated pen contacts the image displayed on the touch panel.

  Examples of the method for specifying the contact position of the contact object with respect to the touch panel include a resistance film method and a capacitance method. The resistance film method is a method for specifying a contact position based on a voltage generated in a metal resistance film. The electrostatic capacity method is a method for specifying a contact position based on static electricity when a finger approaches the touch panel device.

  As an operation method via the touch panel, there is a flick (slide) operation. The slide operation refers to an operation of sliding the finger while the finger is in contact with the touch panel. The flick operation can provide the user with an operational feeling that is difficult to obtain with, for example, a cellular phone button or a keyboard or mouse connected to a PC (Personal Computer).

Special table 2011-501263 gazette

  However, when the user performs a flick operation with a wet hand, such as when the user is sweating, the finger may stick on the contact surface of the touch panel and may not move. In this case, the touch panel is likely not to recognize the flick operation intended by the user.

  Therefore, an object of one aspect is to improve the operability through the contact surface.

  In one plan, the movement destination determination apparatus includes a first detection unit that detects a contact position of an object with respect to a contact surface, a second detection unit that detects a pressure applied to the contact surface by the object, and the second detection unit. When the pressure detected by the detection unit or the amount of change in pressure exceeds the first threshold, based on the moving direction of the contact position detected by the first detection unit and the amount of change in the pressure or pressure, A determination unit that determines a destination of the contact position.

  According to one aspect, operability via the contact surface can be improved.

It is a figure which shows the hardware structural example of the portable terminal in this Embodiment. It is a figure which shows the example of arrangement | positioning of a pressure sensor. It is a figure which shows the function structural example of the electronic device in this Embodiment. It is a figure which shows the process outline | summary which an event process part performs. It is a flowchart for demonstrating an example of the process sequence which an event process part performs. It is a figure for demonstrating an example of a movement amount and a pressure difference. It is a figure which shows the structural example of a corresponding | compatible information storage part.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating a hardware configuration example of an electronic device according to the present embodiment. In FIG. 1, an electronic device 10 includes a CPU 11, a memory 12, an auxiliary storage device 13, a touch panel 14, a pressure sensor 18, and the like.

  The auxiliary storage device 13 stores a program installed in the electronic device 10. The memory 12 reads the program from the auxiliary storage device 13 and stores it when there is an instruction to start the program. The CPU 11 implements functions related to the electronic device 10 according to the program stored in the memory 12.

  The touch panel 14 is an electronic component having both an input function and a display function, and displays information, accepts input from a user, and the like. The touch panel 14 includes a display device 15, an input device 16, a touch control IC 17, and the like.

  The display device 15 is a liquid crystal panel or the like, and bears the display function of the touch panel 14. The input device 16 is an electronic component including a sensor that detects contact of a contact object with the surface (contact surface) of the touch panel 14. The contact detection method may be any known method such as a capacitance method, a resistance film method, or an optical method. The input device 16 inputs a set of sensor coordinates (hereinafter referred to as “sensor coordinate group”) that has reacted to the contact object (that is, detected contact) to the touch control IC 17. The contact object refers to an object that contacts the touch panel 14. Examples of such an object include a user's finger and a dedicated or general pen.

  The touch control IC 17 is an IC (Integrated Circuit) that specifies the shape of the contact area of the contact object based on the sensor coordinate group input from the input device 16. The pressure sensor 18 is an electronic component that detects the magnitude of pressure acting on the contact surface when the contact object contacts the contact surface of the touch panel 14.

  Examples of the electronic device 10 include portable terminals such as smartphones or tablet terminals, vehicle-mounted devices, digital cameras, home appliances, and other various electronic devices having a touch panel.

  FIG. 2 is a diagram illustrating an arrangement example of pressure sensors. As shown in FIG. 2, the pressure sensor 18 has a sheet-like planar shape and is disposed in the lower layer of the touch panel 14. For example, the pressure sensor 18 can detect pressure on the entire contact surface of the touch panel 14 or substantially the entire surface.

  FIG. 3 is a diagram illustrating a functional configuration example of the electronic device according to the present embodiment. In FIG. 3, the same parts as those in FIG. 3, the electronic device 10 includes a touch panel control unit 101, a pressure sensor control unit 102, an event processing unit 103, a correspondence information storage unit 104, and the like. The touch panel control unit 101, the pressure sensor control unit 102, and the event processing unit 103 are realized by processing that is stored in the auxiliary storage device 13 and executed by the CPU 11 by a program loaded in the memory 12. The correspondence information storage unit 104 can be realized using the auxiliary storage device 13 or the like, for example.

  The touch panel control unit 101 provides an API (Application Program Interface) for operating the touch panel 14, and notifies the event processing unit 103 of an event indicating contact of a contact object with the touch panel 14, movement of a contact position, or the like. Further, the touch panel control unit 101 calculates a contact position based on the shape of the contact area specified by the touch control IC 17. The contact position is, for example, the center of gravity of the contact area. The pressure sensor control unit 102 provides an API for operating the pressure sensor 18. The pressure sensor control unit 102 notifies the event processing unit 103 of a value indicating the magnitude of pressure detected by the pressure sensor 18 (hereinafter referred to as “pressure value”) via the API.

  The event processing unit 103 executes processing corresponding to the event notified from the touch panel control unit 101 and notifies an event corresponding to an operation via the touch panel 14 to a higher-level application or the like. In the present embodiment, when the event processing unit 103 detects that an object has been prevented from slipping on the contact surface of the touch panel 14, the event processing unit 103 determines the position estimated by the user as the destination position of the contact position. As shown in FIG. When the user sees the situation, for example, when trying to perform a slide operation or a flick operation (hereinafter referred to as “flick operation”), a fingertip or the like is stuck on the contact surface. A situation that does not move. Therefore, according to the present embodiment, even when a fingertip or the like is stuck on the contact surface, the electronic device 10 can recognize the flick operation and can perform an operation according to the flick operation. .

  The correspondence information storage unit 104 stores information indicating the relationship between the change amount of the pressure value detected by the pressure sensor 18 and the estimated value of the movement amount of the contact position on the contact surface.

  The program that causes the electronic device 10 to function as the touch panel control unit 101 or the pressure sensor control unit 102 may be, for example, a device driver for the touch panel 14 or a device driver for the pressure sensor. The program that causes the electronic device 10 to function as the event processing unit 103 may be a program that constitutes an operating system (OS) of the electronic device 10.

  Next, an outline of processing executed by the event processing unit 103 will be described. FIG. 4 is a diagram illustrating an outline of processing executed by the event processing unit. Hereinafter, the user's finger will be described as an example of a contact object.

  (1) of FIG. 4 shows the flick operation intended by the user. When performing the flick operation, the user touches a desired position on the contact surface of the touch panel 14 with the finger F1 (S1). This position is referred to as “initial position”. At this time, for example, the pressure value p <b> 1 is detected by the pressure sensor 18. Subsequently, the user slides the finger F1 from the initial position to a desired position with the finger F1 in contact with the contact surface (S2).

  FIG. 4 (2) shows a case where the finger F1 does not slip after touching the finger F1 (when it is stuck). When the finger F1 strikes, the user increases the force in the sliding direction in an attempt to slide the finger. As a result, for example, the pressure p2 works in the direction of the arrow indicating the pressure p2. In FIG. 4, assuming that the direction perpendicular to the touch panel 14 is the Z axis, a component p 3 in the Z axis direction of the pressure p 2 is detected by the pressure sensor 18.

  The event processing unit 103 estimates the position intended by the user for the movement destination of the finger F1 based on the amount of change from the pressure p1 to the pressure p3 and the movement direction of the finger F1. Specifically, the amount of movement from the initial position is determined by the amount of change from the pressure p1 to the pressure p3. It is determined that the position shifted in the movement direction of the finger F1 by the movement amount is the movement destination intended by the user. The moving direction of the finger F1 is specified based on the change in the coordinate value of the contact position notified from the touch panel control unit 101. That is, even when the finger F1 is not moved by the user's sense, the contact area by the finger F1, that is, the sensor coordinate group, changes in a state where the finger F1 is slid. As the sensor coordinate group changes, the coordinate value of the contact position notified from the touch panel control unit 101 also changes.

  Hereinafter, a processing procedure executed by the electronic device 10 will be described. FIG. 5 is a flowchart for explaining an example of a processing procedure executed by the event processing unit.

  When the Down event is notified from the touch panel control unit 101 (S101), the event processing unit 103 acquires the coordinate value of the initial position and the pressure value currently detected by the pressure sensor 18 (S102). That is, when the state (1) in FIG. 6 occurs, step S102 is executed. The Down event is an event that is notified when a contact object contacts the contact surface. Note that the coordinate value of the initial position is acquired from the touch panel control unit 101. The pressure value is acquired from the pressure sensor control unit 102. The coordinate value acquired in step S102 is referred to as “initial coordinate value”, and the pressure value is referred to as “initial pressure value”.

  Subsequently, when a Move event is notified from the touch panel control unit 101, the event processing unit 103 acquires the coordinate value of the current contact position from the touch panel control unit 101, and acquires the current pressure value from the pressure sensor control unit 102. (S104). The Move event is an event that is notified when the sensor coordinate group (contact area) moves. If the movement of the sensor coordinate group is detected even when the finger is not moving as per the user's sense, the Move event is notified. The coordinate value acquired in step S104 is referred to as “post-movement coordinate value”, and the pressure value is referred to as “post-movement pressure value”.

  Subsequently, the event processing unit 103 calculates a movement amount and a movement direction from the initial coordinate value to the post-movement coordinate value (S105). The movement amount and the movement direction may be represented by a vector having an initial coordinate value as a start point and a post-movement coordinate value as an end point. The magnitude of the vector is the movement amount, and the direction of the vector is the movement direction.

  Subsequently, the event processing unit 103 calculates a difference (hereinafter referred to as “pressure difference”) between the initial pressure value and the post-movement pressure value (S106). That is, the pressure difference is the amount of change in pressure before and after the movement of the contact position.

  FIG. 6 is a diagram for explaining an example of the movement amount and the pressure difference. In FIG. 6, (1) shows changes in the contact position and the pressure value in the process in which the Down event is notified and the Move event is notified. (2) shows the locus of the contact position detected by the touch panel 14. The position Pos1 is a position corresponding to the initial coordinate value. The position Pos2 is a position corresponding to the coordinate value after movement. The position Pos3 is a destination position intended by the user.

  In the example of FIG. 6, the moving amount and moving direction from the position Pos1 to the position Pos2 are calculated in step S105. Further, the difference between the pressure value p1 at the position Pos1 and the pressure value p2 at the position Pos2 is calculated in step S106.

  Subsequently, the event processing unit 103 determines whether or not the movement amount is equal to or less than the threshold value α (S107). Here, the threshold value α is a threshold value that defines a chattering or play range. To put it more simply, the threshold value α is a threshold value for ignoring the change in the coordinate value of the contact object that is not intended by the user. That is, for example, even when the user intends to touch one point, the sensor coordinate group changes due to a minute fluctuation of a fingertip or the like. Even when such a change is detected as a movement and notified to the upper application, the upper application may cause the electronic device 10 to execute a process not intended by the user. The threshold value α is a threshold value for avoiding such inconvenience.

  When the movement amount exceeds the threshold value α (No in S107), the event processing unit 103 executes normal event processing (S108). For example, a Move event is notified to the upper application. This is because there is a high possibility that the finger is moving smoothly.

  On the other hand, when the movement amount is equal to or less than the threshold value α, that is, when the change in the coordinate value of the contact position is within the chattering range (Yes in S107), the event processing unit 103 has the pressure difference exceeding the threshold value β. It is determined whether or not (S109). The threshold value β is a threshold value for determining the presence or absence of occurrence of a contact object. Note that the determination in step S109 is performed in a period in which the movement amount is within the threshold value α. Therefore, in step S109, this corresponds to determination as to whether or not the pressure difference during the period in which the movement amount is within the threshold value α exceeds the threshold value β.

  When the pressure difference is equal to or less than the threshold value β (No in S109), Step S103 and subsequent steps are repeatedly executed. Note that, in the process of repetition after step S103, when the contact position is no longer detected due to the finger moving away from the contact surface, normal event processing is executed. For example, a down event for the initial coordinate value is notified to the upper application.

  When the pressure difference exceeds the threshold value β (Yes in S109), the event processing unit 103 determines that a finger strike has occurred. Specifically, the occurrence of the state in (2) of FIG. 4 is detected. That is, when the movement amount shown in FIG. 6 is less than the threshold value α, if the pressure difference shown in FIG. 6 exceeds the threshold value β, it is determined that the finger is stuck at Pos2. When the movement amount in FIG. 6 is less than the threshold value α, the position Pos1 and the position Pos2 are separated from each other in the figure, but the position Pos1 and the position Pos2 are almost the same position in the sense of the user. Note that even when the movement amount exceeds the threshold value α, it may be determined that a finger strike has occurred when the pressure difference exceeds the threshold value β.

  In the case of Yes in step S109, the event processing unit 103 specifies the estimated movement amount corresponding to the pressure difference with reference to the correspondence information storage unit 104 (S110). The estimated movement amount means an estimated value of the movement amount from the position related to the post-movement coordinate value up to the movement destination intended by the user.

  FIG. 7 is a diagram illustrating a configuration example of the correspondence information storage unit. In FIG. 7, the correspondence information storage unit 104 stores the estimated movement amount in association with the pressure difference. For example, a larger estimated movement amount may be associated with a larger pressure difference.

  In step S109, the event processing unit 103 identifies the estimated movement amount associated with the pressure difference calculated in step S106. In addition, when the record corresponding to the said pressure difference is not memorize | stored in the corresponding | compatible information storage part 104, the information memorize | stored in the corresponding | compatible information storage part 104 respond | corresponds to the said pressure difference by performing linear interpolation etc., for example. The estimated movement amount may be calculated. Or the information memorize | stored in the corresponding | compatible information storage part 104 may be a parameter etc. which comprise a function formula or a function formula. In this case, in step S109, the estimated movement amount may be calculated by applying the pressure value calculated in step S106 to the function equation.

  Subsequently, the event processing unit 103 calculates the coordinate value of the destination that the user intended (hereinafter referred to as “estimated destination”) based on the direction of movement and the estimated amount of movement (S111). The moving direction here is the moving direction calculated in step S105. That is, in step S111, the coordinate value of the position shifted by the estimated movement amount in the movement direction with respect to the post-movement coordinate value is calculated as the estimated movement destination coordinate value. The coordinate value of the estimated movement destination is notified to the upper application or the like. As a result, the host application or the like can cause the electronic device 10 to execute processing according to the flick operation intended by the user.

  As described above, according to the present embodiment, it is possible to detect the impingement of a contact object such as a finger and to estimate the intended destination of the contact object. As a result, the operability through the contact surface can be improved.

  Moreover, when the pressure difference in the period within the threshold value α exceeds the threshold value β, it is determined that the contact object has been stuck. Therefore, before the Move event is notified to the higher-level application or the like, the movement destination by the flick operation can be notified to the higher-level application. As a result, it is possible to increase the possibility that execution of processing according to a Move event that is not intended by the user can be avoided.

  In the above description, the pressure difference (pressure change amount) exceeding the threshold value β is the detection requirement for the contact object bumping. However, the pressure value is not the pressure change amount but the predetermined threshold value. When exceeding, it may be set as the detection requirement of the protrusion of a contact object. In this case, the correspondence information storage unit 104 may store the estimated movement amount in association with the pressure value.

  Note that the present embodiment may be applied to an input device other than the touch panel, such as a touch pad provided in a notebook PC or the like, as long as the input device has a contact surface. In other words, the present embodiment may be applied to an electronic component that does not include a display device and includes an input device having a contact surface.

  In the present embodiment, electronic device 10 is an example of a movement destination determination device. The touch panel 14 is an example of a first detection unit. The pressure sensor 18 is an example of a second detection unit. The event processing unit 103 is an example of a determination unit. The threshold value β is an example of a first threshold value. The threshold value α is an example of a second threshold value.

  As mentioned above, although the Example of this invention was explained in full detail, this invention is not limited to such specific embodiment, In the range of the summary of this invention described in the claim, various deformation | transformation・ Change is possible.

Regarding the above description, the following items are further disclosed.
(Appendix 1)
A first detection unit for detecting a contact position of the object with respect to the contact surface;
A second detection unit for detecting pressure on the contact surface by the object;
When the pressure or the amount of change in pressure detected by the second detector exceeds a first threshold, the moving direction of the contact position detected by the first detector and the amount of change in the pressure or pressure And a determination unit that determines a destination of the contact position based on the destination.
(Appendix 2)
In the period in which the amount of movement of the contact position detected by the first detection unit is equal to or less than a second threshold, the determination unit determines whether the pressure detected by the second detection unit or the amount of change in pressure is the first amount. The movement destination determination apparatus according to supplementary note 1, wherein a movement destination position of the contact position is determined based on a movement direction of the contact position and the pressure or a change amount of the pressure during the period when the threshold value is exceeded.
(Appendix 3)
The destination determination apparatus according to supplementary note 2, wherein the second threshold is a value in a range not recognized as the movement of the object.
(Appendix 4)
A storage unit that stores information indicating the relationship between the pressure or the amount of change in pressure and the amount of movement;
The determination unit is based on the amount of change of the pressure or pressure and the storage unit in the moving direction with respect to the contact position when the pressure or the amount of change of the pressure exceeding the first threshold is detected. 4. The destination determination apparatus according to any one of supplementary notes 1 to 3, wherein a position shifted by an amount of movement specified in this way is determined as a destination position of the contact position.
(Appendix 5)
Electronics
Detect the contact position of the object to the contact surface,
Detecting pressure on the contact surface by the object;
When the detected pressure or the amount of change in pressure exceeds a first threshold value, the movement position of the contact position is determined based on the detected moving direction of the contact position and the amount of change in the pressure or pressure.
A destination determination method for executing processing.
(Appendix 6)
The determination process is performed when the detected pressure or the amount of change in pressure exceeds the first threshold in a period in which the detected movement amount of the contact position is equal to or less than the second threshold. The destination determination method according to appendix 5, wherein the position of the destination of the contact position is determined based on a moving direction of the position and the pressure or a change amount of the pressure.
(Appendix 7)
The destination determination method according to appendix 6, wherein the second threshold value is a value in a range that is not recognized as the movement of the object.
(Appendix 8)
In the determination process, the pressure or pressure change amount and the pressure or pressure change amount in the movement direction with respect to the contact position at which the pressure or pressure change amount exceeding the first threshold is detected. Additional Notes 5 to 7 for determining a position shifted by a movement amount specified based on a storage unit that stores information indicating a relationship between the change amount and the movement amount as a movement destination position of the contact position The destination determination method described.
(Appendix 9)
Electronic equipment,
Detect the contact position of the object to the contact surface,
Detecting pressure on the contact surface by the object;
When the detected pressure or the amount of change in pressure exceeds a first threshold value, the movement position of the contact position is determined based on the detected moving direction of the contact position and the amount of change in the pressure or pressure.
A destination determination program that executes processing.
(Appendix 10)
The determination process is performed when the detected pressure or the amount of change in pressure exceeds the first threshold in a period in which the detected movement amount of the contact position is equal to or less than the second threshold. The destination determination program according to supplementary note 9, wherein a destination position of the contact position is determined based on a moving direction of the position and the pressure or a change amount of the pressure.
(Appendix 11)
The destination determination program according to supplementary note 10, wherein the second threshold is a value in a range not recognized as the movement of the object.
(Appendix 12)
In the determination process, the pressure or pressure change amount and the pressure or pressure change amount in the movement direction with respect to the contact position at which the pressure or pressure change amount exceeding the first threshold is detected. Additional remarks 9 to 11 for determining a position shifted by a movement amount specified based on a storage unit that stores information indicating a relationship between the change amount and the movement amount as a movement destination position of the contact position. The destination determination program described.

10 Electronic device 11 CPU
12 Memory 13 Auxiliary Storage Device 14 Touch Panel 15 Display Device 16 Input Device 17 Touch Control IC
18 Pressure sensor 101 Touch panel control unit 102 Pressure sensor control unit 103 Event processing unit 104 Corresponding information storage unit

Claims (6)

A first detection unit for detecting a contact position of the object with respect to the contact surface;
A second detection unit for detecting pressure on the contact surface by the object;
When the pressure or the amount of change in pressure detected by the second detector exceeds a first threshold, the moving direction of the contact position detected by the first detector and the amount of change in the pressure or pressure And a determination unit that determines a position related to a movement amount larger than the movement amount of the contact position as a movement destination of the contact position based on the above. A first detection unit for detecting a contact position of the object with respect to the contact surface;
A second detection unit for detecting pressure on the contact surface by the object;
When the pressure or the amount of change in pressure detected by the second detector exceeds a first threshold, the moving direction of the contact position detected by the first detector and the amount of change in the pressure or pressure based on, possess a determination unit for determining the destination of the contact position,
In the period in which the amount of movement of the contact position detected by the first detection unit is equal to or less than a second threshold, the determination unit determines whether the pressure detected by the second detection unit or the amount of change in pressure is the first amount. A movement destination determination device that determines a position of a movement destination of the contact position based on a movement direction of the contact position and the pressure or a change amount of the pressure during the period when a threshold value is exceeded .   The destination determination apparatus according to claim 2, wherein the second threshold is a value in a range that is not recognized as the movement of the object. A storage unit that stores information indicating the relationship between the pressure or the amount of change in pressure and the amount of movement;
The determination unit is based on the amount of change of the pressure or pressure and the storage unit in the moving direction with respect to the contact position when the pressure or the amount of change of the pressure exceeding the first threshold is detected. The movement destination determination apparatus according to claim 2 or 3 , wherein a position shifted by an amount of movement specified in this way is determined as a movement destination position of the contact position. Electronics
Detect the contact position of the object to the contact surface,
Detecting pressure on the contact surface by the object;
When the detected pressure or the amount of change in pressure exceeds a first threshold value, the movement position of the contact position is determined based on the detected moving direction of the contact position and the amount of change in the pressure or pressure.
Execute the process ,
In the determination process, the pressure or the amount of change in the pressure detected in the pressure detection process is a period in which the movement amount of the contact position detected in the process of detecting the contact position is equal to or less than a second threshold. A movement destination determination method for determining a movement destination position of the contact position based on a movement direction of the contact position and the pressure or a change amount of the pressure in the period when the first threshold value is exceeded . Electronic equipment,
Detect the contact position of the object to the contact surface,
Detecting pressure on the contact surface by the object;
When the detected pressure or the amount of change in pressure exceeds a first threshold value, the movement position of the contact position is determined based on the detected moving direction of the contact position and the amount of change in the pressure or pressure.
Let the process run ,
In the determination process, the pressure or the amount of change in the pressure detected in the pressure detection process is a period in which the movement amount of the contact position detected in the process of detecting the contact position is equal to or less than a second threshold. A movement destination determination program for determining a movement destination position of the contact position based on a movement direction of the contact position and the pressure or a change amount of the pressure in the period when the first threshold value is exceeded .

Images