WO2018216760A1

WO2018216760A1 - Touch controller, host device, and method

Info

Publication number: WO2018216760A1
Application number: PCT/JP2018/019961
Authority: WO
Inventors: 学雍楊; 哲夫種村
Original assignee: シナプティクス・ジャパン合同会社
Priority date: 2017-05-25
Filing date: 2018-05-24
Publication date: 2018-11-29
Also published as: JP2018200494A

Abstract

A touch controller comprising an analog front end for acquiring a detection signal from a touch detection device having a touch detection surface, and a computation device configured so as to detect, on the basis of the detection signal, the position of a force application point where force acts on the touch detection surface and the force with which an object acts on the touch detection surface at the force application point. The touch controller is set to a pressing detection state when the magnitude of the force with which the object acts on the touch detection surface exceeds a prescribed threshold value. The computation device is configured such that when the touch controller is in the pressing detection state, direction data corresponding to the direction of shear force acting on the touch detection surface is generated in accordance with a change in the position of the force application point.

Description

Touch controller, host device and method

The present disclosure relates to a touch controller, a display system, and a host device, and more particularly, to touch detection that detects contact of an object with a desired touch detection surface (for example, the surface of a touch panel).

A display module that combines a display panel and a touch panel is one of the most widely used user interfaces. By combining a touch panel as an input device with a display panel which is an output device, a highly convenient user interface can be realized.

A general touch panel is configured to detect contact of an object such as a human finger on a touch detection surface, but in recent years, not only contact of an object to the touch detection surface but also touch detection surface by contact. Technology has been developed to sense the pressure acting on the surface. Sensing the pressure acting on the touch detection surface is suitable for providing an advanced user interface. US Patent Application Publication No. 2016/0334917 discloses such a technique.

In an example of touch detection, a normal force (Normal Force) acting in a direction perpendicular to the touch detection surface is detected, and an operation based on the magnitude of the detected normal force is performed. If information on the shearing force (Shear Force) acting on the touch detection surface is acquired and an operation corresponding to this information is performed, a more advanced user interface can be provided.

US Patent Application Publication No. 2016/0077638 discloses detection of shear force using a capacitive sensor.

US Patent Application Publication No. 2016/0334917 US Patent Application Publication No. 2016/0077638

In one embodiment, the touch controller touches an analog front end that obtains a detection signal from a touch detection device having a touch detection surface, and the position and force point of the force point at which a force acts on the touch detection surface based on the detection signal. And an arithmetic unit configured to detect a force acting on the detection surface by the object. The touch controller is set to the indentation detection state when the magnitude of the force acting on the touch detection surface exceeds a predetermined threshold. The arithmetic device is configured to generate direction data corresponding to the direction of the shearing force acting on the touch detection surface in accordance with the change in the position of the applied force point when the touch controller is in the indentation detection state.

In still another aspect of the present invention, an interface for receiving touch detection data generated based on a detection signal acquired from a touch detection device having a touch detection surface, and display by user interface processing in response to the touch detection data And a processor for generating image data corresponding to an image displayed on the module. The touch detection data includes action force data indicating the position of the force application point acting on the touch detection surface by the contact of the object and the magnitude of the force acting on the force application point. The processor generates direction data indicating the direction of the shear force acting on the touch detection surface generated according to the change in position of the applied force point described in the applied force data, and image data according to the applied force data. Is configured to do.

In another embodiment, the method obtains a detection signal from a touch detection device having a touch detection surface and, based on the detection signal, touch detection at the position of the force point on which the force acts on the touch detection surface and the force point Generate action force data indicating the force that the object acts on the surface, and push the arithmetic device into the detection state in response to the magnitude of the force that the object acts on the touch detection surface exceeds a predetermined threshold And generating direction data corresponding to the direction of the shearing force acting on the touch detection surface in accordance with a change in the position of the applied force point when the arithmetic device is in the indentation detection state.

It is a block diagram which shows the structure of the display system in one Embodiment. It is a figure which illustrates the structure of the display panel in a display area. It is a figure which shows the structure of the touchscreen in this embodiment. It is a figure which shows notionally the touch detection in this embodiment. It is a figure explaining calculation of the x coordinate of an applied point. The state transition of the touch controller in the touch detection of this embodiment is shown. It is a figure which shows an example of operation | movement of the touch controller in a touch detection state and a pushing detection state. It is a figure which shows an example of the pointer displayed on a display area.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

As shown in FIG. 1, in one embodiment, the display system 100 includes a display module 1, a touch controller built-in driver IC 2, and a host device 3.

The display module 1 includes a display panel 11 and a touch panel 12.

The display panel 11 includes a display area 13 and a scan driver circuit 14. The display area 13 is an area where an image is displayed. As shown in FIG. 2, the display area 13 is provided with scanning lines 15, data lines 16, and pixel circuits 17. The scan driver circuit 14 drives the scanning lines 15 provided in the display area 13. The scan driver circuit 14 may be integrated on the display panel 11 using SOG (system-on-glass) technology.

The touch panel 12 is a touch detection device having a touch detection surface. When an object touches the touch detection surface, the touch panel 12 is configured to detect not only the fact of contact but also the force acting on the touch detection surface. . As shown in FIG. 3, the touch panel 12 includes detection capacitors 18 arranged in a matrix. The detection capacitors 18 are arranged close to the touch detection surface 12a, and each detection capacitor 18 is configured such that the capacitance changes when a force is applied to the touch detection surface 12a at a position where the detection capacitors 18 are close to each other. In one embodiment, the detection capacitor 18 has a pair of capacitor electrodes, and when a force is applied to a position close to the touch detection surface 12a, the distance between the capacitor electrodes changes. The capacity is configured to change. As will be described later, in the present embodiment, the force acting on the touch detection surface 12a is detected from the capacitance of each detection capacitor 18.

An xy orthogonal coordinate system is defined on the touch detection surface 12a of the touch panel 12. In FIG. 3, the x axis is defined in the horizontal direction of the touch panel 12, and the y axis is defined in the vertical direction. The position on the touch detection surface 12a of the touch panel 12 can be specified by the x coordinate and the y coordinate.

Although FIG. 1 shows the display module 1 in which the display panel 11 and the touch panel 12 formed separately are combined, the display panel 11 and the touch panel 12 may be integrally formed. For example, the display module 1 in which the detection capacitor 18 is integrated on the display panel 11 may be used.

Referring to FIG. 1 again, the touch controller built-in driver IC 2 drives the display panel 11 to display an image in the display area 13 of the display panel 11 and is based on a detection signal obtained from the detection capacitor 18 of the touch panel 12. The semiconductor device is configured to perform touch detection. Hereinafter, the driver IC 2 with a built-in touch controller is simply referred to as “driver IC 2”.

The driver IC 2 includes a display driver 21 and a touch controller 22. In the present embodiment, the display driver 21 and the touch controller 22 are monolithically integrated, that is, integrated on the same semiconductor chip. However, the display driver 21 and the touch controller 22 may be integrated on separate semiconductor chips.

The display driver 21 includes a data driver circuit 23 and a panel interface circuit 24. The data driver circuit 23 drives the data lines 16 of the display panel 11 in response to the image data received from the host device 3. The panel interface circuit 24 generates a scan control signal for controlling the scan driver circuit 14 of the display panel 11 and supplies the scan control signal to the scan driver circuit 14.

The touch controller 22 includes an analog front end 25 and an arithmetic device 26. The analog front end 25 acquires an analog detection signal from the detection capacitor 18 of the touch panel 12 and performs analog-digital conversion on the acquired analog detection signal to generate ADC data that is digital data. In the present embodiment, the ADC data includes capacitance data indicating the capacitance of each detection capacitor 18. The generated ADC data is supplied to the arithmetic unit 26. The arithmetic device 26 performs arithmetic processing for touch detection on the ADC data received from the analog front end 25, and generates touch detection data indicating the result of touch detection. As the arithmetic unit 26, for example, an MCU (micro control unit) can be used. The touch detection data generated by the arithmetic device 26 is transmitted to the host device 3.

The host device 3 supplies image data to the display driver 21 of the driver IC 2 and performs user interface processing based on the touch detection data received from the touch controller 22. The user interface process includes, for example, a process for recognizing an operation performed by the user on the touch panel 12 and a process for generating an image to be presented to the user on the display panel 11. The host device 3 includes a processor 31, a storage device 32, and an interface 33.

The processor 31 executes control software 34 stored in the storage device 32, and performs various operations for controlling the display system 100, for example, generation of image data supplied to the display driver 21.

The storage device 32 stores control software 34. The control software 34 includes a UI control module 34a, and user interface processing is realized by the processor 31 executing the UI control module 34a.

The interface 33 transmits and receives data between the driver IC 2 and the host device 3. Specifically, the interface 33 transmits image data generated by the processor 31 to the driver IC 2 and receives touch detection data from the driver IC 2.

Subsequently, the operation of the display system 100 of the present embodiment will be described. As shown in FIG. 4, the display system 100 according to the present embodiment is configured to perform touch detection that senses contact of an object 4, for example, a human finger, with respect to the touch detection surface 12 a of the touch panel 12. . In the touch detection according to the present embodiment, the magnitude of the force that the object 4 acts by touching the touch detection surface 12a based on the capacity data included in the ADC data generated by the analog front end 25, and the touch detection surface 12a The coordinates of the force application point (force application point), which is the point where the force acts, are detected.

In one embodiment, the coordinates of the force point may be detected by function fitting. As shown in FIG. 5, in one embodiment, the x coordinate of the force point performs function fitting on the capacitance data of a predetermined number of adjacent detection capacitors 18 including the detection capacitors 18 having the maximum capacitance data value. You may calculate by.

FIG. 5 shows a technique for calculating the x-coordinate of the applied force from the (n−1) th, nth, and n + 1th detection capacitors 18 from the left in a specific row of the detection capacitors 18. Here, it is assumed that the value of the capacitance data of the nth detection capacitor 18 takes a maximum value. (n-1) th, n th, the value of the capacity data of the (n + 1) th detection capacitor 18, _{respectively,} and Z _n-1, Z _n, and _{Z n + 1,} n-1-th, n-th, (n + 1) th detection capacitor 18 Assuming that the coordinates are x _n−1 , x _n , and x _{n + 1} , respectively, the x coordinate x _F of the applied point is represented by the following function f (x):

about,
f (x _n-1 ) = Z _n-1
f (x _n ) = Z _n
f (x _{n + 1} ) = Z _{n + 1}
It may be calculated as x _F as to establish. Here, A is a constant corresponding to the width of the range of the capacity data, and w _x is a constant corresponding to the peak width of f (x). The number of detection capacitors 18 used for calculating the x-coordinate of the force point is not limited to 3, but may be 4 or more. In this case, x coordinates x _F fitting is performed force application point using function f (x) by a suitable technique is calculated.

The y-coordinate of the force point can be calculated by the same method.

In the present embodiment, the normal force acting in a direction perpendicular to the touch detection surface 12a of the touch panel 12 (Normal Force) not F _N Information only, the shear force acting on the plane direction of the touch detection surface 12a (Shear Force ) Information about F _S is acquired. Analog detection signals obtained from the detection capacitor 18 of the touch panel 12 is dependent on the capacitance of each of the detection capacitor 18, the capacitance of each detection capacitor 18 is dependent on the normal force F _N. Thus, the touch detection is performed based on the volume data included in the ADC data generated from the analog detection signals obtained from the detection capacitor 18, basically, that the information about the normal force F _N is obtained Become. In addition, in the touch detection of the present embodiment, information on the shear force F _S is acquired from the change in the coordinates of the force application point. If the coordinates of the force applied point is changed temporally, change of coordinates is generally represents the direction acting shear force F _S, also the force acting on the touch detection surface 12a in this case is the shear force F _S You may think that it contains. In the present embodiment, a change in the coordinates of the force applied points, and the force acting on the touch detection surface 12a when the coordinates of the force applied point is changed, is acquired as the information about the shear force F _S. By performing user interface processing based on such information, an advanced user interface can be provided.

With reference to FIG. 6 which shows the touch detection method in this embodiment, and more specifically, the state transition of the touch controller 22 in touch detection, in this embodiment, the object 4, for example, the finger of a human body, is touch detection surface 12a. after contact with the further case it pushed into the touch detection surface 12a, a shear force acting on the touch detection surface 12a infos (shear force) F _S is obtained.

In a state where no object is in contact with the touch panel 12, the touch controller 22 is set to a touch non-detection state. In the non-touch detection state, the computing device 26 monitors the contact of an object with the touch detection surface 12a of the touch panel 12 based on the ADC data received from the analog front end 25. During this time, the touch controller 22 transmits touch detection data indicating that the touch controller 22 is in a touch non-detection state to the host device 3.

When the computing device 26 detects that an object has touched the touch panel 12 based on the ADC data generated from the analog detection signal, the touch controller 22 shifts to a touch detection state. In the touch detection state, the magnitude F of the force acting when the object 4 is in contact with the touch detection surface 12a and the coordinates (x, y) of the position of the force point where the force acts are detected based on the ADC data. The The arithmetic device 26 generates action force data describing the magnitude F of force and the coordinates (x, y) of the position of the force point, and transmits touch detection data including the action force data to the host device 3. The touch detection data transmitted to the host device 3 at this time may include data indicating that the touch controller 22 has shifted to the touch detection state.

In the operation example of the touch controller 22 in the touch detection state illustrated in the left diagram of FIG. 7, the force acting on the touch detection surface 12 a when it is detected that the human finger 5 has touched the touch detection surface 12 a of the touch panel 12. The size F is 2.86 N, and the coordinates (x, y) of the position of the applied force point at which the force acts are detected as (506, 823).

In this embodiment, after the human finger 5 comes into contact with the touch detection surface 12a, an operation of further pressing is detected. Specifically, when the arithmetic device 26 detects that the magnitude F of the force acting on the touch detection surface 12a when the touch controller 22 is in the touch detection state exceeds the predetermined threshold Th1, the touch controller 22 Shifts to the push-in detection state. The push detection state, the arithmetic unit 26, in response to changes in the coordinates of the position of the force applied points (x, y), information related to the shear force F _S acting on the touch detection surface 12a, and more specifically, shear Direction data indicating the direction of the force F _S is generated, and touch detection data including the generated direction data is generated.

More specifically, in the push detection state, touch detection is performed as follows. The coordinates of the position of the force point at the current time t _i are (x _i , y _i ), and the coordinates of the position of the force point at the time t _i-1 prior to the current time t _i are (x _i−1 , y _{i). -1} ). Here, the current time t _i is a time when the touch controller 22 is in the push detection state, but if the time t _i-1 is before the current time t _i , the time when the touch controller 22 is in the push detection state. However, it should be noted that it may be a time in the touch detection state.

Arithmetic unit 26, the change in position of the force applied points, more specifically, the coordinates of the position of the force applied point at the current time _{_{_{t i (x i, y i}}} ) and before the current time _{t i} the time _{t i-} The difference (Δx, Δy) between the coordinates of the position of the applied force point at ₁ and (x _i−1 , y _i−1 ) is calculated. here,
Δx = x _i −x _i−1 (2a)
Δy = y _i −y _i−1 (2b)
It is.

If any one of the absolute values | Δx | and | Δy | of the differences Δx and Δy is larger than the predetermined threshold Th2, it may be considered that the shear force F _S is acting on the touch detection surface 12a. In this case, the arithmetic unit 26 generates direction data in addition to the acting force data describing the magnitude F of force and the coordinates (x, y) of the applied point. Direction data includes information corresponding to the direction of the shear force F _S, is generated based on the difference (Δx, Δy). In one embodiment, the direction data may be generated as data describing θ calculated from the difference (Δx, Δy) according to the following equation (3):
θ = arctan (Δy / Δx) (3)
Here, arctan is an arc tangent function. In other embodiments, the direction data may be generated as data describing the difference (Δx, Δy) itself.

The computing device 26 generates touch detection data including the generated action force data and direction data, and transmits the generated touch detection data to the host device 3. The touch detection data transmitted to the host device 3 at this time may include data indicating that the touch controller 22 has shifted to the push-in detection state.

On the other hand, the difference [Delta] x, the absolute value of Δy | Δx |, | Δy | both is smaller than a predetermined threshold value Th2, it may be considered that the shear force _{F S} acting on the touch detection surface 12a is small. In this case, the arithmetic unit 26 does not generate the direction data, but generates only the force data describing the magnitude F of the force and the coordinates (x, y) of the force point. The arithmetic device 26 transmits touch detection data including the action force data and not including the direction data to the host device 3.

In the operation example of the touch controller 22 shown in the right diagram of FIG. 7, the touch controller 22 shifts from the touch detection state to the push detection state. The threshold value Th1 is 5.00N, and the threshold value Th2 is 15. As shown in FIG. 7, when the magnitude F of the force acting on the touch detection surface 12a exceeds the threshold Th1 from 2.86N and increases to 10.00N, the touch controller 22 shifts to the push-in detection state. . After shifting to the indentation detection state, the difference (Δx, Δy) in the coordinates of the force points is calculated. In the example of FIG. 7, the differences (Δx, Δy) are calculated as follows.
Δx = 492-506 = -14
Δy = 825-823 = 2

In the example of FIG. 7, the absolute value | Δx | of Δx is larger than the threshold Th2. Such an event occurs, for example, when the human finger 5 is pressed to the left after contacting the touch detection surface 12a. Since the absolute value | Δx | is larger than the threshold Th2, the direction data is generated by the arithmetic unit 26 in addition to the acting force data. Touch detection data including the generated action force data and direction data is transmitted to the host device 3.

The host device 3 receives touch detection data from the touch controller 22 and performs user interface processing based on the touch detection data. As described above, the user interface process is executed by the processor 31 executing the UI control module 34a.

When touch detection data including direction data is transmitted to the host device 3, the direction data is used in user interface processing in the host device 3. One useful application of the direction data included in the touch detection data is movement of a pointer displayed in the display area 13 of the display panel 11. Referring to FIG. 8 illustrating an example of the pointer 13a displayed in the display area 13, when the user performs an operation of pushing the touch detection surface 12a, the pointer 13a is moved in response to the action force data and the direction data. Thus, a highly convenient user interface can be realized.

In one embodiment, when the human finger 5 is further pressed after contacting the touch detection surface 12a, the moving direction in which the pointer 13a moves is determined according to the direction data, and the moving speed at which the pointer 13a moves is determined. It may be determined by the magnitude F of the force described in the applied force data. The processor 31 of the host apparatus 3 determines the image element, for example, the pointer 13a in the moving direction determined according to the direction data, according to the magnitude F of the force described in the applied force data. Image data is generated so as to move at the moving speed, and is transmitted to the display driver 21 of the driver IC 2.

In one embodiment, the moving speed v of the pointer 13a may be determined so as to increase monotonously with respect to the force magnitude F described in the acting force data. For example, the moving speed v of the pointer 13a may be determined as being proportional to the magnitude F of force. Specifically, the moving speed v may be determined according to the following formula (4).
v = K _V F (4)
Here, _{K V} is a constant.

In the above, an embodiment is described in which the touch controller 22 detects an operation of pushing the touch detection surface 12a, and further generates touch detection data including action force data and direction data when the push operation is detected. However, the detection of the operation of pushing the touch detection surface 12a and the generation of the subsequent direction data may be performed in the user interface process in the host device 3. In this case, the state transition illustrated in FIG. 6 is performed in a user interface process executed in the host device 3. More specifically, the display system 100 operates as follows.

In a state where no object is in contact with the touch panel 12, the touch controller 22 transmits touch detection data indicating that no object is in contact to the host device 3. In this case, the user interface process is set to a touch non-detected state.

When the touch controller 22 detects contact of an object with the touch detection surface 12a of the touch panel 12, the touch controller 22 generates action force data describing the magnitude F of force and the coordinates (x, y) of the force point, and the action force data. Is transmitted to the host device 3. In response to the touch detection data including the action force data, the user interface process is set to the touch detection state. Thereafter, as long as contact of an object with the touch detection surface 12a of the touch panel 12 is detected, the touch controller 22 continues to transmit touch detection data including action force data to the host device 3.

The processor 31 of the host device 3 detects an operation of pushing the touch detection surface 12a after an object, for example, a human finger 5 comes into contact with the touch detection surface 12a, based on the action force data included in the touch detection data. Specifically, when the processor 31 detects that the magnitude F of the force acting on the touch detection surface 12a when the user interface process is in the touch detection state exceeds the predetermined threshold Th1, the user interface process is , Transition to the push-in detection state. The push detection state, the processor 31, in response to changes in the force applied point of coordinates (x, y), information related to the shear force F _S acting on the touch detection surface 12a, and more specifically, the shearing force F _S The direction data indicating the direction of the is generated.

More specifically, in the indent detection state, user interface processing is performed as follows. The coordinates of the force point at the current time t _i are (x _i , y _i ), and the coordinates of the force point at the time t _i-1 before the current time t _i are (x _i-1 , y _i-1 ). To do. Here, the current time t _i is the time when the user interface process is in the indentation detection state, but if the time t _i-1 is before the current time t _i , the time when the user interface process is in the indentation detection state However, the time in the touch detection state may be used.

The processor 31 changes the coordinates (x, y) of the force point, more specifically, the coordinates of the force point at the current time t _i (x _i , y _i ) and the time t before the current time t _i. the coordinates of the force application point in _i-1 to calculate the _(x _{i-1, y i-1)} and the difference (Δx, Δy). As described above, the difference (Δx, Δy) is calculated according to equations (2a) and (2b).

If any one of the absolute values | Δx | and | Δy | of the differences Δx and Δy is larger than the predetermined threshold Th2, it may be considered that the shear force F _S is acting on the touch detection surface 12a. In this case, the processor 31 generates direction data based on the difference (Δx, Δy). In one embodiment, the direction data may be generated as data describing θ calculated according to the above equation (3) from the difference (Δx, Δy). In other embodiments, the direction data may be generated as data describing the difference (Δx, Δy) itself. As described above, the generated direction data may be used to move the pointer 13a displayed on the display panel 11, for example.

Although the embodiment of the present disclosure has been specifically described above, those skilled in the art will understand that the technology described in the present disclosure can be implemented with various modifications.

This application claims priority based on Japanese Patent Application No. 2017-103450 filed on May 25, 2017, the entire disclosure of which is incorporated herein by reference.

Claims

An analog front end for obtaining a detection signal from a touch detection device having a touch detection surface;
A touch controller comprising: an arithmetic unit configured to detect a position of an applied force point at which a force acts on the touch detection surface based on the detection signal and a force applied by an object to the touch detection surface at the applied force point Because
The touch controller is set to a push detection state in response to the magnitude of the force acting on the touch detection surface exceeding a predetermined threshold,
The arithmetic unit generates direction data corresponding to a direction of a shearing force acting on the touch detection surface according to a change in the position of the applied force point when the touch controller is in the indentation detection state. Configured touch controller.
The computing device has a first position and a first time that are positions of the force points detected at a first time when the touch controller is in the push detection state when the touch controller is in the push detection state. The touch controller according to claim 1, configured to generate the direction data based on a second position that is a position of the applied force point detected at a second time before the second time.
When the touch controller is in the indentation detection state, the arithmetic device is configured to be perpendicular to the first direction and a first difference that is a difference between the coordinates of the first position and the coordinates of the second position in the first direction. The touch controller according to claim 2, wherein the direction data is generated based on a second difference that is a difference between the coordinates of the first position and the coordinates of the second position in the second direction.
The arithmetic unit outputs the direction data when at least one of the absolute value of the first difference and the absolute value of the second difference is greater than a predetermined threshold, and the absolute value of the first difference The touch controller according to claim 3, wherein the direction data is not output when both of the absolute values of the second differences are smaller than a predetermined threshold.
5. The touch controller according to claim 1, wherein the arithmetic device is configured to output action force data indicating a position of the force application point and a magnitude of a force acting on the force application point. 6.
The touch controller is set to a touch non-detection state when contact of the object with the touch detection surface is not detected by the arithmetic device;
When the arithmetic device detects the contact of the object with the touch detection surface based on the detection signal, the touch controller shifts to a touch detection state,
The touch controller shifts to the indentation detection state in response to a force acting on the touch detection surface exceeding the predetermined threshold when the touch controller is in the touch detection state. The touch controller according to any one of 1 to 5.
An interface for receiving touch detection data generated based on a detection signal acquired from a touch detection device having a touch detection surface;
A processor that generates image data corresponding to an image displayed on a display module by user interface processing in accordance with the touch detection data, and the touch detection data is a force acting on the touch detection surface by an object contact. Action force data indicating the position of the force point and the magnitude of the force acting on the force point;
The processor is responsive to direction data indicating a direction of a shearing force acting on the touch detection surface generated according to a change in the position of the applied force point described in the acting force data, and the acting force data. A host device configured to generate the image data.
The processor generates the image data to display image elements on the display module;
The processor is configured such that a moving speed at which the image element moves depends on a magnitude of a force acting on the applied force point described in the acting force data, and a moving direction in which the image element moves is included in the direction data. The host device according to claim 7, configured to generate the image data so as to depend on the host device.
The processor according to claim 8, wherein the processor is configured to generate the image data so that a moving speed at which the image element moves increases monotonically with respect to a magnitude of a force acting on the applied force point. Host device.
The host device according to claim 8, wherein the processor is configured to generate the image data so that a moving speed at which the image element moves is proportional to a magnitude of a force acting on the applied force point.
The host device according to claim 7, wherein the direction data is included in the touch detection data.
The user interface process is set to a push detection state in response to the magnitude of the force acting on the touch detection surface exceeding a predetermined threshold,
The host device according to claim 7, wherein the processor is configured to generate the direction data when the user interface process is in the indent detection state.
The processor includes a first position that is a position of the force point detected at a first time when the user interface process is in the indentation detection state when the user interface process is in the indentation detection state, and the first position. The host device according to claim 12, configured to generate the direction data based on a second position that is a position of the force point detected at a second time before the time.
The processor includes a first difference that is a difference between the coordinates of the first position and the second position in a first direction, the coordinates of the first position in a second direction perpendicular to the first direction, and the first position. The host device according to claim 13, wherein the direction data is generated based on a second difference that is a difference between coordinates of two positions.
Obtaining a detection signal from a touch detection device having a touch detection surface;
Generating, based on the detection signal, action force data indicating a position of an application point at which a force acts on the touch detection surface and a force at which the object acts on the touch detection surface at the application point;
In response to the magnitude of the force that the object acts on the touch detection surface exceeding a predetermined threshold value, pushing the arithmetic device into a detection state;
Generating direction data corresponding to a direction of a shearing force acting on the touch detection surface in response to a change in the position of the applied force point when the computing device is in the indentation detection state.
The direction data includes the first position that is the position of the force point detected at the first time when the arithmetic unit is in the indentation detection state, and the force that is detected at a second time before the first time. The method according to claim 15, wherein the method is generated based on a second position that is a position of a point.
The direction data includes a first difference that is a difference between the coordinates of the first position and the second position in a first direction, the coordinates of the first position in a second direction perpendicular to the first direction, and the The method according to claim 16, wherein the method is generated based on a second difference that is a difference in coordinates of the second position.
Furthermore,
16. The method according to claim 15, comprising generating image data corresponding to an image displayed on a display module in response to the acting force data and the direction data.
The moving speed at which the image element displayed on the display module moves depends on the magnitude of the force acting on the applied force point described in the acting force data, and the image element moves. The method of claim 18, wherein a direction is generated to depend on the direction data.
The method according to claim 19, wherein the image data is generated such that a moving speed at which the image element moves increases monotonically with respect to a magnitude of a force acting on the applied force point.