JP7317730B2 - Information processing device, information processing method and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and an information processing program that receive a user's input operation via a touch sensor.

2. Description of the Related Art Conventionally, there is an information processing apparatus that accepts a user's input operation via a touch sensor and executes a process (event) according to the input operation. Such an information processing device detects a tap action of an operating object on a touch surface of a touch sensor, and accepts a single tap action by one tap action and a double tap action by two tap actions as different input operations. (See Patent Document 1, for example).

JP-A-2002-323955

In the information processing apparatus described above, after the tap motion is detected once, the single tap is detected depending on whether or not the second tap motion is detected within a predetermined time during which the second tap motion may be detected. and a double-tap are determined. However, such determination processing increases the delay of events corresponding to single taps.
For example, when the input operation is a double-tap, the information processing device can identify the double-tap immediately after the second tap action is detected, so the event delay time corresponding to the double-tap is about 100 msec. On the other hand, when the input operation is a single tap, the information processing device waits for a predetermined time (for example, about 300 msec) from the time when the first tap operation is detected, and after that, to identify the single tap, an event corresponding to the single tap is generated. is about 400 msec. Such a single-tap delay time makes the user aware of the processing delay.

An object of the present invention is to provide an information processing apparatus, an information processing method, and an information processing program capable of reducing the delay time of an event corresponding to a single tap.

The information processing apparatus of the present invention includes a current value acquisition unit that acquires the current value from a touch sensor that outputs a current value according to the proximity of the operating body to the touch surface, and a period detection unit that detects a tap period during which a value changes; a parameter calculation unit that calculates a parameter related to a change in the current value based on the current value acquired during the tap period; and a tap determination unit that determines whether the tap operation is a single tap or a first tap operation constituting a double tap.

In the present invention, the current value output from the touch sensor changes as the operating body taps the touch surface. Therefore, the period during which the current value changes due to one tap operation (determination target tap operation) is detected as the tap period, a parameter related to the current value change in the tap period is calculated, and based on the parameter, the determination target tap operation is detected. is a single tap or the first tap operation constituting a double tap.
Here, the current value in the tap period changes differently depending on whether the tap operation to be judged is a single tap or the first tap operation of a double tap. , the determination target tap operation can be preferably determined. Moreover, since this determination process can be performed immediately after one tap operation is finished, it is not necessary to provide a waiting time unlike the conventional one. This makes it possible to significantly reduce the delay time of a single tap event compared to the prior art.

1 is a block diagram showing a touch input device according to an embodiment of the invention; FIG. FIG. 2 is a schematic diagram showing the electrode structure of the touch sensor of the embodiment; 4 is a flowchart for explaining the flow of an information processing method according to the embodiment; The graph which shows the time change of the electric current value of the said embodiment. 4 is a time chart for explaining the timing of determination processing in the embodiment; 4 is a time chart for explaining the timing of determination processing in a comparative example;

A first embodiment of the present invention will be described with reference to the drawings.
As shown in FIG. 1, the touch input device 1 of the present embodiment includes a touch sensor 2 having a touch surface 210 that can be touched by an operating object, and receives a user's input operation via the touch sensor 2, and responds to the input operation. and an information processing device 10 that executes a corresponding process (event).
Note that the touch input device 1 is used in electronic devices such as personal computers and smartphones, for example. The touch sensor 2 may constitute a touch panel that is superimposed on the display section of the electronic device, or may constitute a touch pad that is arranged separately from the display section.

[Touch sensor]
The touch sensor 2 of the present embodiment adopts a mutual capacitance method among projected capacitive methods as a touch detection method, and includes a touch unit 21 having an electrode structure arranged along a touch surface 210, It has a transmission unit 22 that transmits the drive signal Sa to the touch unit 21 and a reception unit 23 that receives the drive signal Sa via the touch unit 21 .

FIG. 2 is a schematic diagram showing a specific structure of the touch sensor 2. As shown in FIG.
As shown in FIG. 2, the touch unit 21 has a plurality of transmission electrodes Tx (x=1, 2, . . . n) arranged along one direction and arranged along a direction orthogonal to the one direction. and a plurality of receiving electrodes Rx (x=1, 2, . . . n). An electrode intersection point Pi at which the transmission electrode Tx and the reception electrode Rx intersect corresponds to a unit area of the touch surface 210, and a capacitance _C0 is formed at each electrode intersection point Pi.

The transmitter 22 sequentially transmits the drive signal Sa, which is an AC signal, to the plurality of transmission electrodes Tx.
The receiver 23 sequentially receives the drive signal Sa from the plurality of reception electrodes Rx while the drive signal Sa is being transmitted to one of the transmission electrodes Tx. As a result, the receiver 23 sequentially receives the drive signal Sa transmitted from the transmission electrode Tx to the reception electrode Rx via each electrode intersection point Pi.

Here, when a grounded operation object such as a finger approaches the electrode intersection point Pi, a capacitance corresponding to the operation object interrupts and couples with the capacitance _C0 , and the drive signal Sa is transmitted from the electrode intersection point Pi through the operation object. Some of the current flows out to ground. As a result, the level (potential) of the drive signal Sa received by the receiver 23 decreases.
Therefore, the receiving unit 23 detects the voltage of the driving signal Sa received via each electrode intersection point Pi, and the difference between the detected voltage of the driving signal Sa and the oscillation voltage of the driving signal Sa by the transmitting unit 22, that is, the driving signal A level change amount of Sa is calculated. Then, the receiving unit 23 generates a detection signal Sd indicating an output value corresponding to the level change amount of the drive signal Sa for each electrode intersection point Pi, and outputs the detection signal Sd to the information processing device 10 .

[Information processing device]
The information processing apparatus 10 is configured by a computer, and includes a storage section 11, a control section 12, and the like.
The storage unit 11 is a data recording device configured by a memory, hard disk, or the like. The storage unit 11 stores an information processing program (software) for controlling the information processing apparatus 10 and a judgment model 110 which will be described later.

The control unit 12 includes an arithmetic circuit such as a CPU (Central Processing Unit) and a recording circuit such as a RAM (Random Access Memory). The control unit 12 expands the information processing program recorded in the storage unit 11 or the like into the RAM, and executes various processes in cooperation with the program expanded into the RAM. By reading and executing the information processing program recorded in the storage unit 11, the control unit 12 obtains a current value acquisition unit 121, a touch detection unit 122, a period detection unit 123, a parameter calculation unit 124, a tap determination unit 125, It functions as an operation determination unit 126 , an output control unit 127 and a model generation unit 128 .

The current value acquiring unit 121 samples the detection signal Sd output from the receiving unit 23 at predetermined intervals, and obtains the output value (current value Ia) of the detection signal Sd and the coordinate information of the unit area corresponding to the current value Ia. get. That is, the current value acquisition unit 121 acquires the current value Ia for each unit area of the touch surface 210 .

Based on the current value Ia and the coordinate information of the unit area corresponding to the current value Ia from the current value acquisition unit 121, the touch detection unit 122 detects the touch coordinates, which are the coordinates at which the operating body touches the touch surface 210. To detect.
The period detection unit 123 detects a contact period during which the operating body touches the touch surface 210, and detects a contact period that satisfies a tap operation condition as a tap period Tt. Here, the conditions for the tap operation are, for example, that the contact period is a predetermined time or less and the amount of movement of the touch coordinates during the contact period is a predetermined amount or less.

Based on the current value Ia obtained during the tap period Tt, the parameter calculator 124 calculates one or more parameters (hereinafter sometimes referred to as current parameters) relating to changes in the current value Ia. Details of the current parameters will be described later.

Based on the time of the tap period Tt and the current parameter calculated by the parameter calculation unit 124, the tap determination unit 125 determines whether the tap operation is a single tap or the first tap operation constituting a double tap. judge.
Note that a single tap corresponds to an operation in which the operating body performs a tap motion once. A double-tap corresponds to an operation in which the operating body performs two consecutive tap operations.

The operation determination unit 126 determines whether the user's input operation is a single tap based on whether the second tap period Tt is detected within a predetermined time (waiting time) after the first tap period Tt. Alternatively, it is determined whether it is a double tap.

The output control unit 127 executes an event corresponding to a single tap (single tap event) or an event corresponding to a double tap (double tap event) according to the determination result of the tap determination unit 125 or the operation determination unit 126. . This output control unit 127 is capable of processing double tap events in the background.

The model generator 128 builds the determination model 110 by machine learning the relationship between the time of the tap period Tt, the current parameter, and the type of input operation (single tap, double tap). For example, the model generation unit 128 creates teacher data by combining the type of input operation determined by the operation determination unit 126 with the time of the tap period Tt and the current parameter as correct data. Then, the model generation unit 128 learns based on the teacher data accumulated over a predetermined period of time, and generates the judgment model 110 .
This judgment model 110 is a model for judging whether or not a tap action is performed following a tap action performed by an operating body. Outputs a score that indicates the likelihood that a tap action will be performed. The higher the score output by the determination model 110, the higher the possibility that the input operation is a double-tap, and the lower the score output by the determination model 110, the higher the possibility that the input operation is a single-tap.

[Information processing method]
A flow of tap motion determination processing by the information processing apparatus 10 will be described with reference to the flowchart of FIG. 3 .
During operation of the information processing apparatus 10, the current value acquisition unit 121 samples the detection signal Sd output from the reception unit 23 at predetermined intervals, and the output value (current value Ia) of the detection signal Sd and the current value Ia Get the coordinate information of the corresponding unit area.

First, the period detection unit 123 determines whether or not the tap period Tt due to the tap motion of the operating body has been detected (step S1).
Specifically, as shown in FIG. 4, a threshold Ith for preventing erroneous detection due to noise is set in advance. is detected as the start time ts, and the time when the current value Ia becomes less than the threshold value Ith is detected as the end time te.
If the contact period from the start time ts to the end time te is equal to or less than a predetermined time and the amount of movement of the touch coordinates during the contact period is equal to or less than a predetermined amount, the period detection unit 123 determines the tap period Tt. It determines that it has been detected, and acquires the time of the tap period Tt.
Hereinafter, the tap operation corresponding to the tap period Tt detected in step S1 will be referred to as a determination target tap operation.

Note that FIG. 4 shows changes in the current value Ia corresponding to a specific unit area during the tap period Tt for the single tap operation and the first double tap operation.
Here, the current value Ia corresponding to a specific unit area is, for example, the current value Ia of the unit area corresponding to the center of gravity of the touch coordinates, or the total current value Ia in the unit area of the entire touch surface 210 .

When the tap period Tt is detected (Yes in step S1), the period detector 123 proceeds to step S2, and when No in step S1, repeats step S1 until the tap period Tt is detected.

In step S2, the parameter calculator 124 calculates current parameters in the tap period Tt detected in step S1. This current parameter is described below with reference to FIG.

As shown in FIG. 4, in general, in the first tap operation of double-tapping, the speed of the operating body performing the tapping operation is faster than in the tap operation of single-tapping. The contact area for 210 increases quickly.
In addition, the first tap operation of double tap tends to increase the maximum value of the current value Ia within the tap period Tt compared to the tap operation of single tap.
Therefore, the parameter calculator 124 can calculate the maximum change rate of the current value Ia within the tap period Tt or the maximum value of the current value Ia within the tap period Tt as the current parameter.

When using an elastic operating body such as a finger, the contact area of the finger of the operating body with respect to the touch surface 210 may vary depending on the difference in force between the first double-tap operation and the single-tap operation. tend to be different.
Therefore, the parameter calculation unit 124 calculates, as a current parameter, the distribution of the current value Ia for each unit region within the tap period Tt, or the number of unit regions corresponding to the current value Ia equal to or greater than a predetermined value within the tap period Tt. can do.

Furthermore, in the first tap motion of the double tap, the speed of the operating body performing the tap motion is faster than in the tap motion of the single tap. The contact position of the operating body may shift slightly.
Therefore, the parameter calculation unit 124 calculates, as a current parameter, the displacement amount of the operating body with respect to the touch surface 210 within the tap period Tt, based on the change in the distribution of the current value Ia for each unit area within the tap period Tt. can be done. Note that the amount of positional deviation may be an amount that is not detected as a change in touch coordinates.

After calculating the current parameters as described above, the tap determination unit 125 inputs the time of the tap period Tt and one or more current parameters calculated by the parameter calculation unit 124 to the determination model 110, and the next tap operation is performed. A score indicating the possibility of being performed is obtained from the judgment model 110 (step S3).
Then, the tap determination unit 125 determines whether or not the score acquired from the determination model 110, that is, the score indicating the possibility of the next tap action being performed, is equal to or greater than the threshold th1 (step S4). Here, the threshold th1 is set in advance as a lower limit value indicating that there is a sufficiently high possibility that the tap motion to be determined is the first tap motion of the double tap.

If the score is less than the threshold th1 (No in step S4), the tap determination unit 125 determines whether the score obtained from the determination model 110 is less than or equal to the threshold th2 (step S5). Here, the threshold th2 is a value smaller than the threshold th1, and is set in advance as an upper limit value indicating that the tap operation to be determined is highly likely to be a single-tap tap operation.

If the score is equal to or less than the threshold th2 (Yes in step S5), the tap determination unit 125 determines that the tap motion to be determined is a single-tap tap motion, and the output control unit 127 executes the single-tap event. (step S6).

On the other hand, if the score is equal to or greater than the threshold th1 (Yes in step S4), the tap determination unit 125 determines that the tap motion to be determined is the first tap motion of the double tap, and the output control unit 127 A double tap event is executed in the background (step S7).

After step S7 or in the case of No in step S5 (when the score is greater than the threshold th2 and less than the threshold th1), the operation determination unit 126 determines whether the tap duration Tt is within a predetermined standby time from the end time te of the tap period Tt. Then, it is determined whether or not the period detector 123 detects the tap period Tt (second time) (step S8). The method of detecting the tap period Tt in step S8 is the same as in step S1. Also, the waiting time in step S8 is set to a time (for example, about 300 msec) during which the second tap operation of the double tap can be detected, as in the conventional case.

If the tap period Tt (second time) is detected within the standby time (step S8; Yes), the operation determination unit 126 determines that the input operation is a double tap, and the output control unit 127 determines that the input operation is a double tap. Execute the event (step S9). Note that the output control unit 127 outputs the execution result when the double tap event is being executed in the background.
On the other hand, when the tap period Tt (second time) is not detected within the standby time (step S8; No), the operation determination unit 126 determines that the input operation is a single tap, and the output control unit 127 performs step Go to S6 and execute a double tap event.
Thus, the tap motion determination process by the information processing apparatus 10 is completed.

The determination result (type of input operation) by the operation determination unit 126 in step S8 described above is combined with the time of the tap period Tt detected in step S1 and the current parameter calculated in step S2. form the data. The model generator 128 can update the judgment model 110 based on this teacher data.

〔effect〕
In the present embodiment, as described above, the current value Ia of the detection signal Sd output from the touch sensor 2 changes as the operating body taps the touch surface 210 . Therefore, the period in which the current value Ia changes due to one tap operation (determination target tap operation) is detected as the tap period Tt, the current parameter in the tap period Tt is calculated, and based on the current parameter, the determination target tap operation is detected. is a single tap or the first tap operation constituting a double tap.
Here, the current parameter in the tap period Tt indicates a different value depending on whether the tap operation to be determined is a single tap or the first tap operation of double tap, so such a current parameter is used. Thus, it is possible to suitably determine the tap motion to be determined. In addition, since the process of determining the tap motion to be determined can be performed immediately after the tap motion to be determined is completed, it is not necessary to provide a waiting time unlike the conventional one. This makes it possible to significantly reduce the delay time of a single tap event compared to the prior art.

Further, in the present embodiment, when it is determined that the tap motion to be determined is the first tap motion constituting a double tap, the output control unit 127 outputs an event corresponding to the double tap (double tap event) to the background. Run with This makes it possible to reduce the delay time of the double tap event compared to the prior art.

For example, a double tap and a single tap are illustrated for each of the example of the present embodiment (see FIG. 5) and the comparative example (see FIG. 6). Note that in the comparative example, as in the conventional art, the input operation is a single tap or a double tap based on whether or not the second tap motion is detected within the waiting time after the first tap motion is detected. It is determined whether it is any of

As shown in FIG. 6, when single tapping is performed in the comparative example, the time of determination processing is time t12 when a predetermined waiting time has elapsed from tap end time t11. A tap event is executed.

On the other hand, as shown in FIG. 5, when single tapping is performed in the embodiment, the time of the determination process using the current parameter is substantially the same as the tap end time t1, and the time t2 immediately after the tap end time t1. , a single tap event can be performed.
Therefore, the single-tap event delay time Td1 (see FIG. 5) of the embodiment is significantly reduced compared to the single-tap event delay time Td2 (see FIG. 6) of the comparative example.

Further, as shown in FIG. 6, when the double tap is performed in the comparative example, the time of the determination process is the second tap end time t14, and the double tap event is executed at time t15 after this time t14. be.

On the other hand, as shown in FIG. 5, when double tapping is performed in this embodiment, the time of the determination process using the current parameter is substantially the same time as the tap end time t3. Since the double-tap event can be processed in the background during the period from the tap end time t3 to the second tap end time t4, the processing result of the double-tap event can be output at almost the same time as the time t4. .
Therefore, the execution time of the double-tap event of the embodiment can be made earlier than the execution time of the single-tap event of the comparative example.

The current parameters and the time of the tap period Tt exemplified in this embodiment show different tendencies between the first tap operation of the double tap and the tap operation of the single tap for each user or among multiple users. Therefore, by using the determination model 110 with input of the current parameter and the tap period Tt to determine the tap operation, it is possible to perform a highly accurate determination suitable for the user's tendency.

[Modification]
Although the information processing apparatus 10 has the model generation unit 128 in the above embodiment, the present invention is not limited to this. For example, if the touch input device 1 including the information processing device 10 is configured as a user terminal device and there is a server device that can communicate with a plurality of terminal devices, even if this server device has the model generation unit 128 good. In this case, the model generator 128 can generate the judgment model 110 by using data acquired from a plurality of users as learning data. In addition, the model generation unit 128 may generate the determination model 110 that matches the attributes of the user (gender, age group, etc.). The server device can transmit the judgment model 110 generated by the model generation unit 128 to each terminal device.

In the above embodiment, both the current parameter and the time of the tap period Tt are input to the judgment model 110, but only the current parameter may be input.
Further, in the above-described embodiment, the tap determination unit 125 uses the determination model 110 to determine the type of tap action to be determined, but the present invention is not limited to this. For example, the tap determination unit 125 may determine the type of tap operation to be determined by comparing each of the current parameter and the time of the tap period Tt with a threshold value.

In the above-described embodiment, the touch surface 210 has a plurality of unit areas due to the touch portion 21 having a plurality of electrode intersection points Pi. ).

In addition, the specific structure and procedure for carrying out the present invention can be appropriately changed to another structure within the scope of achieving the object of the present invention.

Reference Signs List 1 touch input device 10 information processing device 11 storage unit 110 determination model 12 control unit 121 current value acquisition unit 122 touch detection unit 123 period detection unit 124 parameter calculation Unit 125 Tap determination unit 126 Operation determination unit 127 Output control unit 128 Model generation unit 2 Touch sensor 21 Touch unit 210 Touch surface 22 Transmitter 23 Receiving unit , Ia... Current value, Pi... Electrode intersection point, Rx... Receiving electrode, Tx... Transmitting electrode, Sa... Drive signal, Sd... Detection signal, Tt... Tap period.

Claims (8)

a current value acquisition unit that acquires the current value from a touch sensor that outputs a current value according to the proximity of the operating body to the touch surface;
a period detection unit that detects a tap period, which is a period during which the current value is changed by one tap operation of the operating body;
a parameter calculation unit that calculates a parameter related to a change in the current value based on the current value acquired during the tap period;
a tap determination unit that uses the parameter to determine whether the tap operation is a single tap or a first tap operation constituting a double tap ;
The current value acquisition unit acquires the current value for each unit area of the touch surface from the touch sensor,
The parameter calculation unit calculates, as the parameter, a displacement amount of the operating body with respect to the touch surface within the tap period, based on a change in the current value distribution for each unit area within the tap period.
An information processing device characterized by: In the information processing device according to claim 1,
wherein the parameter calculation unit calculates at least one of a maximum value of the current value within the tap period and a maximum rate of change of the current value within the tap period as the parameter. processing equipment. In the information processing apparatus according to claim 1 or claim 2,
The current value acquisition unit acquires the current value for each unit area of the touch surface from the touch sensor,
The parameter calculator calculates at least one of the distribution of the current values for each of the unit regions within the tap period, or the number of the unit regions corresponding to the current value equal to or greater than a predetermined value within the tap period. is calculated as the parameter. In the information processing apparatus according to any one of claims 1 to 3 ,
The tap determination unit uses the parameter and the time of the tap period to determine whether the tap operation is the single tap or the first tap operation constituting the double tap. An information processing device characterized by: In the information processing apparatus according to any one of claims 1 to 4 ,
further comprising an output control unit that executes an event corresponding to the double tap in the background when the tap determination unit determines that the tap operation is the first tap operation constituting the double tap. An information processing device characterized by: In the information processing apparatus according to any one of claims 1 to 5 ,
The tap determination unit determines whether the tap motion is the single tap or the first tap motion constituting the double tap, using a determination model having at least the parameter as an input. and information processing equipment. An information processing method for determining the type of input operation input via a touch sensor by a computer,
The computer includes a current value acquisition unit, a period detection unit, a parameter calculation unit, and a tap determination unit,
a step in which the current value acquiring unit acquires the current value from a touch sensor that outputs a current value corresponding to the proximity of the operating body to the touch surface;
a step in which the period detection unit detects a tap period, which is a period during which the current value changes due to one tap operation of the operating body;
a step in which the parameter calculation unit calculates a parameter related to a change in the current value based on the current value acquired during the tap period;
the step of determining whether the tap operation is a single tap or a first tap operation constituting a double tap, using the parameter , and
The current value acquisition unit acquires the current value for each unit area of the touch surface from the touch sensor,
The parameter calculation unit calculates, as the parameter, a displacement amount of the operating body with respect to the touch surface within the tap period based on a change in the current value distribution for each unit area within the tap period. An information processing method characterized by: A computer readable and executable information processing program comprising:
An information processing program causing the computer to function as the information processing apparatus according to any one of claims 1 to 6 .

Images