JP6716050B1 - Operation support device, touch panel input system, operation determination method, and program - Google Patents

Abstract

The operation support device (100) is electrically connected to the first lower conductor portion (111), the second lower conductor portion (121, 122), and the first lower conductor portion (111), An upper conductor part (130) switchable to either a first state in which the second lower conductor part (121, 122) does not conduct and a second state in which it conducts. .. If the upper conductor portion (130) is in the first state during the input operation, the first lower conductor portion (111) is in the area of the touch panel (11) facing the first lower conductor portion (111). When the capacitance is changed and the upper conductor portion (130) is in the second state during the input operation, the first lower conductor portion (111) and the second lower conductor portion (121, 122) are The capacitance in the area of the touch panel (11) facing the first lower conductor section (111) and the second lower conductor section (121, 122) is changed.

Description

The present invention relates to an operation support device, a touch panel input system, an operation determination method, and a program.

2. Description of the Related Art A touch panel input system including a touch panel device having a touch panel (also referred to as “touch screen”) and an operation support device that supports an input operation on the touch panel has been proposed (for example, see Patent Documents 1 and 2). In this touch panel input system, it is determined based on a contact area between the touch panel and the deformable member of the operation support device whether the operation of the operation support device by the user is an input operation with push-in or an input operation without push-in. It

JP, 2010-136265, A Japanese Patent No. 6342105

However, in the touch panel input system described in Patent Documents 1 and 2, since the change in the contact area between the deforming member and the touch panel due to the deformation of the deforming member of the operation support device is detected, the operation by the user is input with pressing. In some cases, it was not possible to accurately determine whether the operation was an input operation without pushing.

The present invention has been made to solve the above problems, and an object of the present invention is to improve the accuracy of determination of a touch input operation by a user.

An operation support device according to an aspect of the present invention is an operation support device that supports an input operation on a touch panel that detects a change in capacitance, and includes a first lower conductor portion and a second lower conductor portion. And can be switched to either a first state in which the first lower conductor portion is in conduction and a second state in which the second lower conductor portion is not in conduction and a second state in which the second lower conductor portion is in conduction. And an elastic body that gives a force to separate the upper conductor portion and the second lower conductor portion from each other, and the upper conductor portion is in the first state during the input operation. In this case, the first lower conductor portion changes the capacitance in the area of the touch panel corresponding to the first lower conductor portion and resists the force of the elastic body during the input operation. Then, by switching the upper conductor portion to the second state , the first lower conductor portion and the second lower conductor portion become the first lower conductor portion and the second lower conductor portion. It is characterized in that the capacitance in the area of the touch panel corresponding to the lower conductor portion is changed.

ADVANTAGE OF THE INVENTION According to this invention, the determination precision of a touch input operation by a user can be improved.

It is a top view which shows roughly the structure of the touchscreen input system which concerns on Embodiment 1 of this invention. FIG. 3 is an exploded perspective view schematically showing the structure of an operation knob as the operation support device according to the first embodiment. FIG. 3 is a bottom view schematically showing the structure of the operation knob according to the first embodiment. It is sectional drawing which cuts the operation knob shown in FIG. 3 by the A4-A4 line. It is sectional drawing which cuts the operation knob shown by FIG. 3 by the A5-A5 line. It is sectional drawing which cuts the operation knob shown by FIG. 3 by the A6-A6 line. FIG. 3 is a diagram schematically showing a configuration of a rotation detection unit of the operation knob according to the first embodiment. FIG. 3 is a functional block diagram schematically showing a main configuration of the touch panel device according to the first embodiment. 1 is a diagram schematically showing a hardware configuration of a touch panel device according to Embodiment 1. FIG. FIG. 6 is a schematic diagram schematically showing the principle of detecting, in the touch panel input system according to the first embodiment, an operation that does not involve pressing the operation knob during an input operation. (A) is a graph which shows the detection result of the electrostatic capacitance in the electrode of the 1st group of a touch panel at the time of the input operation which is not accompanied by pushing in of an operation assistance device in the touch panel input system which concerns on Embodiment 1. is there. (B) is a graph which shows the detection result of the electrostatic capacitance in the electrode of the 2nd group of a touch panel, when the input operation which is not accompanied by pushing in of an operation assistance device is performed in the touch panel input system which concerns on Embodiment 1. is there. FIG. 6A is a schematic diagram schematically showing the principle of detecting that there is an operation involving pressing of the operation knob during an input operation in the touch panel input system according to the first embodiment. FIG. 6B is a cross-sectional view showing the internal structure of the operation knob 100 during an input operation involving pushing of the operation knob according to the first embodiment. (A) is a graph which shows the detection result of the electrostatic capacitance in the electrode of the 1st group of a touch panel, when the input operation accompanied with pushing of an operation assistance device is performed in the touch panel input system which concerns on Embodiment 1. .. (B) is a graph which shows the detection result of the electrostatic capacitance in the electrode of the 2nd group of a touch panel, when the input operation accompanied with pushing of an operation assistance device is performed in the touch panel input system which concerns on Embodiment 1. .. 3 is a flowchart showing the operation of the touch panel device according to the first embodiment. FIG. 7 is a bottom view schematically showing the structure of the operation knob according to the modified example of the first embodiment. 7 is a functional block diagram schematically showing a main configuration of a touch panel input system according to a second embodiment. FIG. FIG. 9 is a diagram showing an example of a classifier generated in a machine learning unit of the touch panel device according to the second embodiment. 7 is a flowchart showing the operation of the touch panel device according to the second embodiment. FIG. 9 is a plan view schematically showing a configuration of a touch panel device according to a third embodiment. FIG. 11 is a schematic diagram schematically showing the principle of detecting, in the touch panel input system according to the third embodiment, that there is an operation that does not involve pressing the operation knob during an input operation. FIG. 11 is a schematic diagram schematically showing the principle of detecting that there is an operation involving pressing of the operation knob during an input operation in the touch panel input system according to the third embodiment. 9 is a flowchart showing the operation of the touch panel device according to the third embodiment. (A) And (B) is a schematic diagram which shows roughly the principle which detects that there was operation accompanied with pushing down of the operation knob at the time of input operation in the touch panel input system concerning Embodiment 4. (A) And (B), in the touch panel input system according to the fourth embodiment, the detection result of the capacitance in the electrodes of the first group of the touch panel when the input operation accompanied by pushing down the operation support device is performed. It is a graph shown. 9 is a flowchart showing the operation of the touch panel device according to the fourth embodiment.

Hereinafter, the operation support device, the touch panel input system, the operation determination method, and the program according to the embodiment of the present invention will be described with reference to the drawings. The following embodiments are merely examples, and various modifications can be made within the scope of the present invention.

In the drawings, coordinate axes of an XYZ rectangular coordinate system are shown for easy understanding of the description. The X axis and the Y axis are coordinate axes parallel to the touch surface of the touch panel, that is, the surface. Therefore, the position on the touch panel can be represented by XY coordinates. The Z axis is a coordinate axis perpendicular to the surface of the touch panel.

<<Embodiment 1>>
<Configuration of touch panel input system>
FIG. 1 is a plan view schematically showing the configuration of the touch panel input system 1 according to the first embodiment. As shown in FIG. 1, the touch panel input system 1 includes a touch panel device 10 including a touch panel 11, and an operation knob 100 as an operation support device that assists an input operation on the touch panel 11. The touch panel input system is also called “knob on touch display”.

The touch panel device 10 has a display function on the touch panel 11 and an input function on the touch panel 11. The touch panel 11 includes a first group of electrodes 11a and a second group of electrodes 11b extending along the touch surface. The electrodes 11a of the first group and the electrodes 11b of the second group are orthogonal to each other. The electrodes 11a of the first group extend in the Y-axis direction at different positions in the X-axis direction and are X-coordinate detection electrodes. The second group of electrodes 11b extends in the X-axis direction at different positions in the Y-axis direction and is a Y-coordinate detection electrode.

A drive signal is applied to the first group of electrodes 11a and the second group of electrodes 11b by a capacitance detection unit 12 (see FIG. 8) described later. Based on this drive signal, a detection signal corresponding to a change in capacitance at each position of the touch panel 11 is obtained from the first group of electrodes 11a and the second group of electrodes 11b. The touch panel device 10 can detect the position on the touch panel 11 (hereinafter, also referred to as “touch position” or “touch coordinate”) based on the change in capacitance of the electrodes 11 a and 11 b of the touch panel 11.

The touch panel device 10 can accept an input operation performed by bringing a user's finger into contact with the touch surface of the touch panel 11. The touch panel device 10 can also receive an input operation using the operation knob 100 placed on the touch surface of the touch panel 11. For example, when the user's finger touches the operation knob 100, an increase in capacitance in the contact area between the touch panel 11 and the operation knob 100 is detected. In the following embodiments, the touch panel device 10 detects a change in capacitance on the touch panel 11, so that the input operation by the user is an operation that involves pushing the operation knob 100 or an operation that does not involve pushing the operation knob 100. An example of determining whether or not is described. The operation that involves pushing the operation knob 100 and the operation that does not involve pushing the operation knob 100 will be described later.

<Operation support device>
FIG. 2 is an exploded perspective view schematically showing the structure of operation knob 100 according to the first embodiment. As shown in FIG. 2, the operation knob 100 has a first lower conductor portion 111, second lower conductor portions 121 and 122, an upper conductor portion 130, and a grip portion 140.

The first lower conductor portion 111 is a contact portion that contacts the touch surface of the touch panel 11. The first lower conductor portion 111 is fixed to the touch surface of the touch panel 11 with an adhesive member (for example, an adhesive or a double-sided tape). The operation knob 100 has one first lower conductor portion 111. The first lower conductor portion 111 is made of a conductor. The shape of the first lower conductor portion 111 is a fan shape that is long in the X-axis direction in plan view. The first lower conductor portion 111 may have any other shape as long as it has a size that ensures the detection sensitivity of the capacitance in the touch panel 11.

The operation knob 100 has a plurality of (two in FIG. 2) second lower conductor portions 121 and 122. The second lower conductor portions 121 and 122 have second conductor contact portions 123 and 124 and lower electrode portions 125 and 126. The second conductor contact portions 123 and 124 and the lower electrode portions 125 and 126 are made of a conductor. The second conductor contact portions 123 and 124 are contact portions that come into contact with the touch surface of the touch panel 11. The second conductor contact portions 123 and 124 are fixed to the touch surface of the touch panel 11 with an adhesive member (for example, adhesive or double-sided tape). The shape of the second conductor contact portions 123 and 124 is a fan shape that is long in the Y-axis direction in plan view. The second conductor contact portions 123 and 124 may have other shapes as long as the second conductor contact portions 123 and 124 have a size that ensures the capacitance detection sensitivity of the touch panel 11.

The lower electrode portions 125 and 126 are arranged on the +Z axis side of the second conductor contact portions 123 and 124. The lower electrode portions 125 and 126 have, for example, a C shape in a plan view. The lower electrode part 125 and the lower electrode part 126 may be connected to each other. The lower electrode portions 125 and 126 have connecting portions 125a and 126a that come into contact with the +Z-axis side surface of the second conductor contact portion 124. The second conductor contact portions 123, 124 and the lower electrode portions 125, 126 are electrically connected to each other via the connecting portions 125a, 126a.

The upper conductor portion 130 is arranged on the +Z axis side of the lower electrode portions 125 and 126. The upper conductor portion 130 is an electrode made of a conductor. The upper conductor portion 130 and the first lower conductor portion 111 are electrically connected. Specifically, the upper conductor portion 130 and the first lower conductor portion 111 are electrically connected via the metal spring 150. The upper conductor part 130 has an annular shape in a plan view. The upper conductor part 130 is attached to the inside of the grip part 140 to be gripped by the user, thereby being covered by the grip part 140.

The grip 140 is made of a conductor. The grip 140 has, for example, a cylindrical side wall 141 and an annular upper surface 142. The shape of the grip portion 140 is not limited to the illustrated shape, and may be any other shape as long as it can be gripped by the user. The grip 140 is rotatable with respect to the upper conductor 130 about an axis J1 extending in the Z-axis direction. When the grip portion 140 is rotated, the first lower conductor portion 111 and the second lower conductor portions 121 and 122 are fixed to the touch surface of the touch panel 11 and do not rotate. Further, when the grip portion 140 is rotated, the upper conductor portion 130 connected to the first lower conductor portion 111 via the spring 150 also does not rotate.

The input operation using the operation knob 100 includes, for example, an operation that involves pressing the operation knob 100, an operation that does not involve pressing the operation knob 100, and a rotation operation of the grip 140.

Here, the “operation involving pressing of the operation knob 100” refers to an operation in which the user applies a pressing force in a direction in which the upper conductor section 130 is brought closer to the touch panel 11 (that is, −Z axis side). In the following description, an operation that involves pressing the operation knob 100 in the user's input operation is also referred to as a “pushing operation”.

The “operation without pushing the operation knob 100” means that the user does not apply a pressing force in a direction of bringing the upper conductor part 130 closer to the touch panel 11, that is, the user's finger only touches the operation knob 100. Refers to operations. The operation not applying the pressing force means an operation in which the upper conductor portion 130 and the second lower conductor portions 121 and 122 are not brought into contact with each other. Further, in the following description, an operation that does not involve pressing the operation knob 100 in the user's input operation is also referred to as a “contact operation”.

When the input operation by the user is a touch operation, a change in capacitance occurs between the first lower conductor portion 111 and the touch panel 11, and the second lower conductor portions 121, 122 and the touch panel 11 are changed. There is no change in capacitance. In other words, when the contact operation is performed, the first lower conductor section 111 changes the capacitance in the area of the touch panel 11 corresponding to the first lower conductor section 111. In the first embodiment, the first lower conductor section 111 changes the capacitance in the area of the touch panel 11 facing the first lower conductor section 111. On the other hand, when the input operation by the user is a push-in operation, the capacitance between the first lower conductor portion 111 and the touch panel 11 and between the second lower conductor portions 121 and 122 and the touch panel 11 is reduced. Change occurs. In other words, when the pushing operation is performed, the first lower conductor portion 111 and the second lower conductor portions 121 and 122 are the first lower conductor portion 111 and the second lower conductor portion 121, The capacitance in the area of the touch panel 11 corresponding to 122 is changed. In the first embodiment, the first lower conductor section 111 and the second lower conductor sections 121, 122 are touch panels facing the first lower conductor section 111 and the second lower conductor sections 121, 122. The capacitance in the area 11 is changed. That is, the first lower conductor portion 111 is a conductor portion for contact operation detection, and the second lower conductor portions 121, 122 are conductor portions for pressing operation detection.

FIG. 3 is a bottom view schematically showing the structure of the operation knob 100. FIG. 3 is a diagram of the operation knob 100 viewed from the −Z axis side. As shown in FIG. 3, the surface (that is, the lower surface) of the operation knob 100 on the −Z axis side is in contact with the second conductor of the first lower conductor portion 111 and the second lower conductor portions 121 and 122. The parts 123 and 124, and the first non-conductor part 161. The first non-conductor portion 161 is a member that does not have conductivity. The first non-conductor portion 161 is fixed to the touch surface of the touch panel 11 shown in FIG. 2 with an adhesive member (for example, adhesive or double-sided tape). The first lower conductor portion 111 and the second conductor contact portions 123 and 124 are arranged in the circumferential direction around the axis J1. The first lower conductor portion 111 is arranged between the second lower conductor portions 121 and 122. The second conductor contact portions 123 and 124 are opposed to each other in the radial direction around the axis J1. The operation knob 100 may not have the second conductor contact portions 123 and 124 that face each other in the radial direction around the axis J1. That is, the operation knob 100 may have a plurality of second conductor contact portions that do not face each other in the radial direction around the axis J1.

FIG. 4 is a cross-sectional view of the operation knob 100 shown in FIG. 3, taken along the line A4-A4. In addition, in FIG. 4, the illustration of the grip 140 is omitted. As shown in FIG. 4, the operation knob 100 has a spring 150 arranged between the upper conductor portion 130 and the first lower conductor portion 111. The spring 150 is a conductive spring, and is, for example, a metal coil spring. Both ends of the spring 150 are respectively connected to a first upper fixing portion 130a provided in the upper conductor portion 130 and a first lower fixing portion 161a provided in the first non-conductor portion 161. The −Z-axis side end of the spring 150 is in contact with the +Z-axis side surface of the first lower conductor section 111. Thereby, the spring 150 is electrically connected to the upper conductor portion 130 and the first lower conductor portion 111. That is, the upper conductor portion 130 and the first lower conductor portion 111 are electrically connected via the spring 150. Since the spring 150 does not contact the lower electrode parts 125 and 126, the upper conductor part 130 and the second lower conductor parts 121 and 122 are not electrically connected via the spring 150.

FIG. 5 is a cross-sectional view of the operation knob 100 shown in FIG. 3, taken along line A5-A5. Note that the illustration of the grip 140 is omitted in FIG. 5. As shown in FIG. 5, the connecting portion 125 a of the lower electrode portion 125 projects toward the −Z axis side from a region of the surface of the lower electrode portion 125 on the −Z axis side facing the second conductor contact portion 123. ing. Since the connecting portion 125a of the lower electrode portion 125 and the +Z-axis side surface of the second conductor contact portion 123 are in contact with each other, the lower electrode portion 125 and the second conductor contact portion 123 are electrically connected. There is.

The operation knob 100 has an elastic body 171 that applies a force to separate the upper conductor portion 130 and the second lower conductor portion 121 in the Z-axis direction. The elastic body 171 is, for example, a spring. The elastic body 171 is arranged so as not to electrically connect the upper conductor portion 130 and the second lower conductor portion 121. Both ends of the elastic body 171 are respectively connected to a second upper fixing portion 130b provided in the upper conductor portion 130 and a second lower fixing portion 161b provided in the first non-conductor portion 161. Note that FIG. 5 shows a configuration in which one second lower conductor portion 121 of the plurality of second lower conductor portions 121 and 122 is separated from the upper conductor portion 130 in the Z-axis direction. However, the other second lower conductor portion 122 is also separated from the upper conductor portion 130 in the Z-axis direction by the elastic body 172.

When the upper conductor part 130 and the second lower conductor parts 121, 122 are separated from each other by the elastic bodies 171, 172 in the Z-axis direction, the upper conductor part 130 is electrically connected to the first lower conductor part 111. And is not electrically connected to the second lower conductor portions 121 and 122. This state is called "first state". As will be described later, when the user presses the operation knob 100, the elastic bodies 171 and 172 are deformed so as to contract, the upper conductor portion 130 is electrically connected to the first lower conductor portion 111, and the second conductor portion The lower conductors 121 and 122 are electrically connected. This state is called "second state". In this way, the upper conductor portion 130 can be switched to either the first state or the second state.

FIG. 6 is a cross-sectional view of the operation knob 100 shown in FIG. 3, taken along line A6-A6. Note that FIG. 6 shows the internal structure of the operation knob 100 when the user performs a pressing operation. As shown in FIG. 6, the conductor member 135 is arranged on the +Z axis side of the upper conductor portion 130. The conductor member 135 is made of a conductor. The upper conductor portion 130 is electrically connected to the conductor member 135 via the conductive connecting member 155. When the user's finger contacts the grip 140, the grip 140, the conductor member 135, the connecting member 155, the upper conductor 130, and the first lower conductor 111 are electrically connected. That is, the conductor member 135 is a conductor member for detecting a contact operation.

The second non-conductor portion 162 is arranged between the upper conductor portion 130 and the conductor member 135. The second non-conductor portion 162 is a non-conductive member. The second non-conductor portion 162 supports the conductor member 135. The conductor member 135 and the second non-conductor portion 162 are covered by the grip portion 140. The operation knob 100 further includes a rotation detection unit 180 that detects a signal corresponding to the rotation operation of the grip 140. The rotation detector 180 is attached to the grip 140 via a support member 190 provided in the grip 140.

FIG. 7 is a diagram schematically showing the configuration of the rotation detection unit 180 of the operation knob 100. As shown in FIG. 7, the rotation detection unit 180 includes, for example, a rotary encoder 181, a light emitting unit 182, and a light receiving unit 183. The rotary encoder 181 has a non-reflection pattern 181a and a reflection pattern 181b. The non-reflective pattern 181a is a pattern that absorbs the light emitted to the rotary encoder 181 (that is, the detection light L1 described below). The reflection pattern 181b is a pattern that reflects the light emitted to the rotary encoder 181.

The light emitting unit 182 irradiates the non-reflection pattern 181a and the reflection pattern 181b of the rotary encoder 181 with the detection light L1. The light emitting unit 182 is, for example, a light emitting element. The light receiving unit 183 receives the reflected light L2 reflected by the reflection pattern 181b. The light receiving unit 183 is, for example, a light receiving element such as a photodiode. The detection signal corresponding to the reflected light L2 detected by the light receiving unit 183 is output to the encoder circuit 185 serving as a rotation detection circuit. The rotation detector 180 is not limited to the optical rotation detector, and may be a magnetic rotation detector using a magnetic sensor.

The encoder circuit 185 outputs an electric signal for driving the light emitting unit 182. That is, the encoder circuit 185 has a function as a drive circuit for driving the light emitting unit 182. In FIG. 7, the encoder circuit 185 is arranged outside the operation knob 100. This prevents the drive signals input to the first group electrodes 11a and the second group electrodes 11b of the touch panel 11 shown in FIG. 1 from interfering with the electrical signals input from the encoder circuit 185 to the light emitting unit 182. To be done. The encoder circuit 185 may be arranged inside the operation knob 100. Further, the encoder circuit 185 amplifies and A/D-converts the detection signal output from the light receiving unit 183, and information (for example, a rotation angle, a rotation position, a rotation speed, etc.) corresponding to the rotation operation of the gripping unit 140 by the user. To generate.

<Touch panel device>
FIG. 8 is a functional block diagram showing a main configuration of touch panel device 10 according to the first embodiment. As shown in FIG. 8, the touch panel device 10 includes a touch panel 11, a capacitance detection unit 12, and an operation determination unit 13. The capacitance detection unit 12 applies a drive signal to the electrodes 11a and 11b of the touch panel 11 and detects the capacitance based on the change in the waveform of the drive signal. The electrostatic capacitance detection unit 12 outputs information about the detected electrostatic capacitance to the operation determination unit 13 as detection information.

The operation determination unit 13 determines whether the operation by the user is an operation that involves pressing the operation knob 100 or an operation that does not involve pressing based on the detected value of the electrostatic capacitance output from the electrostatic capacitance detection unit 12. judge. As described above, in the touch panel device 10, when there is an operation using the operation knob 100, the operation by the user is an operation that involves pressing the operation knob 100 or does not involve the operation based on the change in capacitance. It can be determined whether it is an operation.

FIG. 9 is a diagram schematically showing the hardware configuration of the touch panel device 10. As shown in FIG. 9, the touch panel device 10 is realized by using a memory 51 as a storage device that stores a program as software and a processor 52 as an information processing unit that executes the program stored in the memory 51. can do. A part of touch panel device 10 may be realized by memory 51 shown in FIG. 9 and processor 52 that executes a program. The touch panel device 10 may be realized by an electric circuit.

The display device 53 displays the operation screen by overlaying it on the touch surface of the touch panel 11. The operation knob 100 is fixed to the touch surface of the touch panel 11.

The touch panel 11 detects a change in capacitance and transmits touch information to the processor 52 via the bus 54. In the first embodiment, the touch information is, for example, the identification number or coordinates of the touch position, the contact state of the touch position, the detected value of the electrostatic capacitance at the touch position, the contact area at the touch position, and the like. The processor 52 stores the touch information acquired from the touch panel 11 in the memory 51, and based on the history information of the touch information stored in the memory 51, whether the input operation by the user is a push operation of the operation knob 100 or a touch operation. To judge.

<motion>
FIG. 10 is a schematic diagram for explaining the principle of detecting that the input operation by the user is a touch operation in the touch panel input system 1. As shown in FIG. 10, the upper conductor portion 130 is electrically connected to the grip portion 140 via the capacitance C. Further, the upper conductor part 130 is in a state of being electrically connected to the first lower conductor part 111 and not being electrically connected to the second lower conductor parts 121 and 122. At this time, when the user's finger contacts the grip portion 140, the upper conductor portion 130, the spring 150, and the first lower conductor portion 111 are connected to the ground (that is, GND). As a result, the capacitance of the touch panel 11 changes before and after the touch operation is performed by the user.

FIG. 11A is a graph showing the detection result of the capacitance of the first group of electrodes 11a (see FIG. 1) of the touch panel 11 when the contact operation is performed. In the graph shown in FIG. 11A, the horizontal axis represents the X sensor number, which is the sensor number of the electrode 11a of the first group, and the vertical axis represents the capacitance detection value. As shown in FIG. 11(A), among the electrodes 11a of the first group, the electrodes 11a with X sensor numbers “6 to 22” have large capacitance detection values. However, among the plurality of detection values shown in FIG. 11A, a detection value that is significantly larger than the other detection values is not included. This is because, as shown in FIG. 2, the first lower conductor portion 111 has a shape elongated in the X-axis direction. That is, the detection value of the X sensor number “6 to 22” shown in FIG. 11A corresponds to the position on the touch surface of the touch panel 11 with which the first lower conductor portion 111 is in contact. ..

FIG. 11B is a graph showing the detection result of the capacitance of the second group of electrodes 11b of the touch panel 11 when the contact operation is performed. In the graph shown in FIG. 11B, the horizontal axis represents the Y sensor number, which is the sensor number of the second group of electrodes 11b, and the vertical axis represents the capacitance detection value. As shown in FIG. 11B, the detection value of the capacitance is large in the electrode 11b of the second group of electrodes 11b having the Y sensor number “1 to 16”. Here, as indicated by the symbol P1, the detection value of the Y sensor number "10" is significantly larger than the detection values of the other Y sensor numbers. Here, the detection value of the Y sensor number “10” corresponds to the position on the touch surface of the touch panel 11 with which the first lower conductor portion 111 is in contact. Therefore, the fact that the input operation accompanied by the touch operation is performed can be confirmed by the detection result of the electrostatic capacitance in the second group of electrodes 11b of the touch panel 11.

FIG. 12A is a schematic diagram for explaining the principle of detecting that the input operation by the user is a push operation in the touch panel input system 1. FIG. 12B is a cross-sectional view showing the internal structure of the operation knob 100 during the pushing operation. Note that, in FIG. 12B, the illustration of the grip portion 140 is omitted. As shown in FIGS. 12A and 12B, when the pushing operation is performed, the user applies a pressing force F1 in the −Z-axis direction to the grip portion 140 and the upper conductor portion 130. The pressing force F1 is a force that resists the restoring force of the elastic bodies 171 and 172 and the restoring force of the spring 150 that separate the upper conductor portion 130 and the second lower conductor portions 121 and 122 from each other in the Z-axis direction. When the pressing force F1 is applied, the elastic bodies 171, 172 and the spring 150 contract, and the −Z axis side surface of the upper conductor section 130 contacts the +Z axis side surface of the lower electrode sections 125, 126. As a result, the upper conductor part 130 is electrically connected to the first lower conductor part 111 and is also electrically connected to the second lower conductor parts 121 and 122. At this time, the upper conductor portion 130, the spring 150, the first lower conductor portion 111, and the second lower conductor portions 121 and 122 are connected to the ground (that is, GND). As a result, the capacitance of the touch panel 11 changes before and after the pressing operation is performed by the user.

FIG. 13A is a graph showing the detected value of the capacitance of the first group of electrodes 11a of the touch panel 11 when the pressing operation is performed. In FIG. 13A, the horizontal axis and the vertical axis are similar to those in FIG. Further, in FIG. 13A, similarly to FIG. 11A, the detection value of the capacitance is large in the electrodes 11a of the first group of electrodes 11a whose X sensor numbers are “6 to 22”. Here, the detection value of the X sensor number "9" as indicated by the reference symbol P2 and the detection value of the X sensor number "19" as indicated by the reference symbol P3 are the detection values of other X sensor numbers. Remarkably larger than the value. The detection values of X sensor numbers “9” and “19” correspond to the positions on the touch surface of the touch panel 11 with which the second lower conductor portions 121 and 122 (see FIG. 2) are in contact.

FIG. 13B is a graph showing the detection value of the capacitance of the second group of electrodes 11b of the touch panel 11 when the pressing operation is performed. In FIG. 13B, the horizontal axis and the vertical axis are similar to those in FIG. 11B. Further, in FIG. 13B, similarly to FIG. 11B, in the electrode 11b of the second group of electrodes 11b with the Y sensor number “1 to 16”, the detected capacitance value is large. Here, as indicated by reference numeral P3, the detection value of the Y sensor number "10" is significantly larger than the detection values of the other Y sensor numbers. Here, the detection value of the Y sensor number “10” corresponds to the position on the touch surface of the touch panel 11 with which the first lower conductor portion 111 is in contact. Therefore, when the pushing operation is performed, unlike the case where the contact operation is performed, the electrostatic capacitance detection result of the first group electrode 11a and the electrostatic capacitance result of the second group electrode 11b of the touch panel 11 It can be confirmed by both.

FIG. 14 is a flowchart showing the operation of the touch panel device 10. First, in step ST11, the electrostatic capacitance detection unit 12 applies a drive signal to the touch panel 11, detects a change in electrostatic capacitance on the touch panel 11, and notifies the operation determination unit 13 of touch information.

In step ST12, the operation determination unit 13 acquires the detected value of the capacitance as the touch information notified from the capacitance detection unit 12. In addition, in step ST12, when the operation determination unit 13 acquires the detection value of the electrostatic capacitance, a filter may be set as necessary.

In step ST13, the operation determination unit 13 determines whether or not the detected value of the electrostatic capacitance is greater than or equal to a predetermined first threshold value, and the detected value of the electrostatic capacitance is less than the first threshold value. If determined (that is, No in step ST13), the process proceeds to step ST14. When the operation determination unit 13 determines that the detected value of the electrostatic capacitance is equal to or larger than the first threshold value (that is, Yes in step ST13), the process proceeds to step ST15.

In step ST14, the operation determination unit 13 determines that the input operation by the user is neither the contact operation nor the push operation of the operation knob 100, that is, the input operation by the user is not performed by the processor as an external application. 52 is notified.

In step ST15, the operation determination unit 13 determines whether or not the detected value of the electrostatic capacitance is equal to or larger than a second threshold value set in advance, and the detected value of the electrostatic capacitance is less than the second threshold value. If determined (that is, No in step ST15), the process proceeds to step ST16. If the operation determination unit 13 determines that the detected value of the electrostatic capacitance is equal to or larger than the second threshold value (that is, Yes in step ST15), the process proceeds to step ST17.

In step ST16, the operation determination unit 13 notifies the processor 52 of the determination result that the input operation by the user is a contact operation.

In step ST17, the operation determination unit 13 notifies the processor 52 of the determination result that the input operation by the user is the push operation. Note that, in the flowchart shown in FIG. 14, a process of removing chattering may be performed when the input operation by the user is switched to the push operation or the contact operation.

When the operation knob 100A has a plurality of first lower conductor portions 111A and 112A as shown in FIG. 17 described later, in step ST15 shown in FIG. The fact that the plurality of electrodes 11b facing the parts 111A and 112A detect the electrostatic capacitance at the same timing may be used as the determination condition of “there is a contact operation”. This is because the first lower conductor portions 111A and 112A become at the same potential as the ground through the user's finger almost at the same time as the contact operation by the user.

Further, in step ST16 shown in FIG. 14, the capacitance may be detected in any one electrode 11a of the plurality of electrodes 11a facing the second lower conductor portions 121 and 122 in the touch panel 11. It may be used for the determination condition of “there is a pushing operation”. This allows the determination to be performed even if all of the plurality of electrodes 11a facing the second lower conductor portions 121 and 122 do not react to each other due to the pushing operation by the user. Furthermore, in steps ST15 and ST16 shown in FIG. 14, whether or not the touch coordinates by the user's finger are detected may be used as a determination condition. For example, when the detected capacitance is larger than the detection values indicated by the reference sign P1 in FIG. 11B and the reference signs P2 and P3 in FIGS. 13A and 13B, the X sensor number corresponding to the touch coordinates. Alternatively, a process is performed in which the Y sensor number is calculated and the electrodes 11a and 11b having that sensor number are not used as the determination conditions for the contact operation and the push operation. This prevents erroneous detection because the self-capacity of the user's finger is not used for the operation determination.

<Effect of Embodiment 1>
As described above, according to the first embodiment, (1) the upper conductor portion 130 is electrically connected to the first lower conductor portion 111 and the second lower conductor portions 121 and 122 are connected at the time of input operation. In the non-conductive state (that is, the first state), the capacitance in the area of the touch panel 11 facing the first lower conductor section 111 changes, and (2) the upper conductor section 130 at the time of input operation. Is in a state of conducting to the first lower conductor portion 111 and conducting to the second lower conductor portions 121 and 122 (that is, the second state), the first lower conductor portion 111. And the electrostatic capacitance in the area of the touch panel 11 facing the second lower conductor portions 121 and 122 changes. Therefore, it is possible to determine whether the input operation by the user is an operation that involves pressing the operation knob 100 or an operation that does not involve pressing the operation knob 100, without incorporating a special circuit into the operation knob 100.

Further, according to the first embodiment, it is possible to improve the determination accuracy of the input operation by the user. Specifically, in the conventional configuration that determines the input operation by the user based on the contact area between the touch panel and the deformable member of the operation knob, when the contact area of the deformable member of the operation knob with the touch panel is narrowed, Since the change in the contact area before and after the operation is small, the determination accuracy is reduced. However, according to the first embodiment, since a small change in the contact area between the touch panel 11 and the deformable member of the operation knob 100 is not used, it is possible to improve the determination accuracy of the input operation by the user.

<<Modification of Embodiment 1>>
FIG. 15 is a plan view schematically showing the structure of operation knob 100A according to the modification of the first embodiment. As shown in FIG. 15, the operation knob 100A may include a plurality of (two in FIG. 15) first lower conductor portions 111A and 112A. In addition, the operation knob 100A may have one second lower conductor portion 122. In this case, the lower electrode portion of the second lower conductor portion 122 may be annular in plan view.

In addition, except for the points described above, the operation knob 100A according to the modification of the first embodiment is the same as the operation knob 100 according to the first embodiment.

<<Embodiment 2>>
In the first embodiment described above, the detected value of the electrostatic capacitance is compared with a predetermined threshold value to determine whether the input operation by the user is an operation that involves pressing the operation knob 100 or an operation that does not involve pressing. The example of determination has been described.

In the second embodiment, it is determined by machine learning whether the input operation by the user is a push operation or a contact operation by using the identification label of the discriminator that associates the detected value of the capacitance with the input operation of the user. judge.

<Structure of Embodiment 2>
FIG. 16 is a functional block diagram schematically showing a main configuration of the touch panel input system 2 according to the second embodiment. 16, constituent elements that are the same as or correspond to the constituent elements illustrated in FIG. 1 are denoted by the same reference numerals as those illustrated in FIG. 8. As shown in FIG. 16, touch panel input system 2 differs from touch panel input system 1 according to the first embodiment in that machine learning unit 25 is included. The machine learning unit 25 generates a discriminator that discriminates whether the input operation by the user is an operation that involves pressing the operation knob 100 or an operation that does not involve pressing based on the change in the capacitance on the touch panel 11. .. The machine learning unit 25 can be realized by using, for example, a support vector machine (also referred to as “SVM”) or a neural network.

In the machine learning unit 25, the detected value of the electrostatic capacitance obtained when a plurality of users who are subjects perform an input operation using the operation knob 100 is used as a characteristic amount (hereinafter, also referred to as “input data”). It is entered in advance. Before the input data is input to the machine learning unit 25, preprocessing such as standardization may be performed on the input data. Then, the labeling process is performed based on the input data. The labeling process is to generate a discriminator (hereinafter, also referred to as a “table”) in which an identification label that is correct data is attached to a detection value of capacitance that is input data. The machine learning unit 25 estimates the correct answer data based on the input data by learning the discriminator. The labeling process described above can be performed manually.

FIG. 17 is a diagram illustrating an example of a table learned by the machine learning unit 25. In FIG. 17, the input data (that is, the detected value of the electrostatic capacitance) as the characteristic amount is shown as “X1” to “YM”, and the correct answer data corresponding to the input data is shown as “label”. As shown in FIG. 17, for example, when the input capacitance detection value is a detection value corresponding to a contact operation, an identification label of “knob contact” is attached as a first identification label. There is. Further, when the input detection value of the electrostatic capacitance is the detection value corresponding to the pushing operation, the identification label “knob pushing” is attached as the second identification label. Furthermore, when the input detection value of the electrostatic capacitance is a detection value that does not correspond to either the contact operation or the push operation, an identification label “no knob contact/no push” is attached.

<Operation of Second Embodiment>
FIG. 18 is a flowchart showing the operation of touch panel device 20 according to the second embodiment. The hardware configuration of touch panel device 20 according to the second embodiment is similar to that shown in FIG. 9. The operation knob according to the second embodiment is similar to the operation knob 100 according to the first embodiment.

Steps ST21 to ST22 shown in FIG. 18 are the same as steps ST11 to ST12 shown in FIG. 14, so description thereof will be omitted. In step ST23, the operation determination unit 13 inputs the detected value of the electrostatic capacitance detected by the electrostatic capacitance detection unit 12 to the machine learning unit 25 as a feature amount.

In step ST24, the operation determination unit 13 acquires the identification label estimated by the machine learning unit 25.

In step ST25, when the identification label acquired by the operation determination unit 13 is “no knob contact/push-in”, the operation determination unit 13 determines that the input operation by the user is not the contact operation or the push-in operation, that is, the input by the user. The processor 52 is notified of the determination result that the operation is not performed.

In step ST26, when the identification label acquired by the operation determination unit 13 is “knob contact”, the operation determination unit 13 notifies the processor 52 of the determination result that the input operation by the user is a contact operation.

In step ST27, when the identification label acquired by the operation determination unit 13 is “knob pressing”, the operation determination unit 13 notifies the processor 52 of the determination result that the input operation by the user is the pressing operation.

<Effects of Second Embodiment>
As described above, according to the second embodiment, as in the first embodiment, a small change in the contact area between the touch panel 11 and the deformable member of the operation knob 100 is not used. The accuracy can be increased. Except for the points described above, the second embodiment is the same as the first embodiment.

<<Embodiment 3>>
In the first embodiment, an example has been described in which the detected value of the change in capacitance is used to determine whether the input operation by the user is an operation that involves pressing the operation knob 100 or an operation that does not involve pressing.

In the third embodiment, the touch coordinates at the time of the input operation are used to determine whether the input operation by the user is an operation that involves pressing the operation knob 100 or an operation that does not involve pressing.

<Structure of Embodiment 3>
FIG. 19 is a plan view schematically showing the configuration of touch panel device 30 according to the third embodiment. As shown in FIG. 19, the touch panel 31 of the touch panel device 30 is different from the touch panel 11 of the touch panel device 10 according to the first embodiment in that it has electrodes 31 a arranged in a matrix of a plurality of rows and a plurality of columns. Since the touch panel 31 has the electrodes 31a arranged in a matrix of a plurality of rows and a plurality of columns, the touch position can be accurately detected when there are two or more touch positions, and the position of the operation knob 100 is also accurate. Can be detected. Further, the functional blocks of the touch panel device 30 are the same as those shown in FIG. Note that in the touch panel device 30 according to the third embodiment, the electrostatic capacitance detection unit 12 differs from the touch panel device 10 according to the first embodiment in that the electrostatic capacitance detection unit 12 acquires touch coordinates based on the detected value of the electrostatic capacitance. That is, in the third embodiment, the electrostatic capacitance detection unit 12 also has a function as a touch coordinate acquisition unit.

<Operation of Third Embodiment>
FIG. 21 is a schematic diagram for explaining the principle of detecting that the input operation by the user is a touch operation in the touch panel input system according to the third embodiment. In the touch panel input system according to the third embodiment, the structure of operation knob 100 is the same as that shown in FIGS. As shown in FIG. 21, when the contact operation is performed, the touch coordinates C11 are detected. The touch coordinates C11 are included in the first region R11 of the touch panel 31 and not included in the second regions R21 and R22. Here, the first region R11 is a region of the touch panel 31 that faces the first lower conductor portion 111 (see FIG. 2) of the operation knob 100. The second regions R21 and R22 are regions of the touch panel 31 that face the second lower conductor portions 121 and 122 (see FIG. 2) of the operation knob 100. Note that, in FIG. 21, the touch coordinate C11 is located at the center in the X-axis direction in the first region R11, but if the touch coordinate C11 is included in the first region R11, the touch coordinate C11 is the first coordinate. Need not be located in the center of the region R11.

FIG. 22 is a principle diagram schematically showing the principle of detecting that the input operation by the user is the pushing operation in the touch panel input system according to the third embodiment. As shown in FIG. 22, when a contact operation is performed, touch coordinates C11 and touch coordinates C21 and C22 are detected. The touch coordinates C11 are included in the first area R11, and the touch coordinates C21 and C22 are included in the second areas R21 and R22. Note that, in FIG. 22, the touch coordinates C21 and C22 are located at the centers of the second regions R21 and R22, but if they are included in the second regions R21 and S22, the touch coordinates C21 and C22 become the second coordinates. Need not be located in the center of the regions R21 and R22.

FIG. 23 is a flowchart showing the operation of the touch panel device 30. The hardware configuration of touch panel device 30 according to the third embodiment is similar to that shown in FIG. 9. Furthermore, the operation knob according to the third embodiment is similar to the operation knob 100 according to the first embodiment.

First, in step ST31, the electrostatic capacitance detection part 12 detects the electrostatic capacitance in the touch panel 31, and is in contact with the touch panel 31, the first lower conductor part 111 and the second lower conductor part 121, The touch coordinates of 122 are acquired.

In step ST32, the operation determination unit 13 acquires the touch coordinates as the touch information notified from the capacitance detection unit 12.

In step ST33, the operation determination unit 13 determines whether or not the acquired touch coordinates are included in the first area R11 on the touch surface of the touch panel 31, and determines that the touch coordinates are not included in the first area R11. If so (that is, No in step ST33), the process proceeds to step ST34. If the operation determination unit 13 determines that the touch coordinates are included in the first region R11 (that is, Yes in step ST33), the process proceeds to step ST35.

In step ST34, the operation determination unit 13 notifies the processor 52 as an external application of the determination result that the input operation by the user is neither the contact operation nor the push operation of the operation knob 100, that is, the normal touch operation. To do.

In step ST35, the operation determination unit 13 determines whether or not the acquired touch coordinates are included in the second areas R21 and R22 on the touch surface of the touch panel 31, and the touch coordinates are included in the second areas R21 and R22. If not determined (that is, No in step ST35), the process proceeds to step ST36. If the operation determination unit 13 determines that the touch coordinates are included in the second regions R21 and R22 (that is, Yes in step ST35), the process proceeds to step ST37.

In step ST36, the operation determination unit 13 notifies the processor 52 of the determination result that the input operation by the user is a contact operation.

In step ST37, the operation determination unit 13 notifies the processor 52 of the determination result that the input operation by the user is the push operation.

<Effect of Embodiment 3>
As described above, according to the third embodiment, similar to the first embodiment, since a small change in the contact area between the touch panel 31 and the deformable member of the operation knob 100 is not used, the determination of the input operation by the user is performed. The accuracy can be increased. Further, according to the third embodiment, even when the touch panel device 30 cannot obtain the detection value of the capacitance, whether the input operation by the user is an operation that involves pressing the operation knob based on the touch coordinates, It is possible to determine whether or not the operation is accompanied by. Further, according to the third embodiment, it is possible to reduce the calculation amount required for the operation determination. Except for the points described above, the third embodiment is the same as the first embodiment. Note that the touch panel 31 of the touch panel device 30 according to the third embodiment has an X coordinate detection electrode and a Y coordinate detection electrode, as in the first embodiment, instead of having the matrix-shaped electrodes 31a. May be

<<Embodiment 4>>
In the first to third embodiments, an example has been described in which whether the input operation by the user is a push operation or a contact operation of the operation knob 100 is described based on the detected value of the capacitance. In addition, in Embodiments 1 to 3, an example in which the pushing operation is an operation of bringing the upper conductor portion 130 into contact with both of the second lower conductor portions 121 and 122 has been described (for example, FIG. 12A and FIG. (See (B)).

In the fourth embodiment, an example in which the user's input operation includes an operation of bringing the upper conductor portion 130 into contact with only one of the plurality of second lower conductor portions 121 and 122 (hereinafter, referred to as “push-down operation”). Will be explained. That is, in the fourth embodiment, an example will be described in which, based on the detected value of the capacitance, it is determined whether the input operation by the user is a contact operation of the operation knob, a push operation, or a push down operation. The configuration of the touch panel input system according to the fourth embodiment is similar to that shown in FIG. The structure of the operation knob 400 according to the fourth embodiment is similar to that shown in FIGS.

In the following description, an operation of bringing the upper conductor portion 130 into contact with the second lower conductor portion 121 and not bringing it into contact with the second lower conductor portion 122 is “first pushing down operation”, and the upper conductor portion 130 The operation of bringing the second lower conductor portion 122 into contact with the second lower conductor portion 121 and not bringing it into contact with the second lower conductor portion 121 is referred to as a “second pushing down operation”.

<Operation of Fourth Embodiment>
FIG. 23A is a schematic diagram schematically illustrating the principle of detecting that the input operation by the user is the first push-down operation of the operation knob 400 in the touch panel input system according to the fourth embodiment.

As shown in FIG. 23(A), the pressing force F2 in the -Z-axis direction is applied to the portion of the gripping portion 140 that faces the second lower conductor portion 121 (that is, the portion on the -X-axis side of the axis J1). Is given, the portion of the upper conductor portion 130 facing the second lower conductor portion 121 is lowered to the −Z axis side, and the upper conductor portion 130 is inclined to the left side in FIG. 23(A). As a result, the elastic body 171 and the spring 150 shown in FIG. 5 contract, and the upper conductor portion 130 comes into contact with the second lower conductor portion 121 and does not come into contact with the second lower conductor portion 122. That is, the upper conductor part 130 is in a state of being electrically connected to the first lower conductor part 111 and the second lower conductor part 121 and not being electrically connected to the second lower conductor part 122. This state is called a "third state".

When the upper conductor portion 130 is in the third state, the upper conductor portion 130, the spring 150, the first lower conductor portion 111, and the second lower conductor portion 121 are connected to the ground (that is, GND). It As a result, the capacitance of the touch panel 11 changes before and after the user performs the first push-down operation. In the following description, the first push-down operation is also referred to as “left push-down operation”.

FIG. 23B is a schematic diagram schematically showing the principle of detecting, in the touch panel input system according to the fourth embodiment, that the input operation by the user is the second push-down operation of the operation knob 400.

As shown in FIG. 23(B), the pressing force F3 in the −Z-axis direction is applied to the portion of the grip portion 140 that faces the second lower conductor portion 122 (that is, the portion on the +X-axis side of the axis J1). When applied, the portion of the upper conductor portion 130 facing the second lower conductor portion 122 is lowered to the −Z axis side, and the upper conductor portion 130 is inclined to the right side in FIG. 23(B). As a result, the elastic body 172 and the spring 150 shown in FIG. 6 contract, and the upper conductor portion 130 comes into contact with the second lower conductor portion 122 and does not come into contact with the second lower conductor portion 121. That is, the upper conductor portion 130 is in a state of being electrically connected to the first lower conductor portion 111 and the second lower conductor portion 122, and not being electrically connected to the second lower conductor portion 121. This state is called the "fourth state".

When the upper conductor portion 130 is in the fourth state, the upper conductor portion 130, the spring 150, the first lower conductor portion 111, and the second lower conductor portion 122 are connected to the ground (that is, GND). It As a result, the capacitance of the touch panel 11 changes before and after the user performs the second pushing operation. In the following description, the second push-down operation is also referred to as “right push-down operation”. As described above, the upper conductor portion 130 of the operation knob 100 according to the fourth embodiment is in the third state and the fourth state in addition to the first state and the second state described in the first embodiment. Can also be switched.

FIG. 24A is a graph showing the detected value of the capacitance of the electrodes 11a of the first group of the touch panel 11 when the left push-down operation is performed. In FIG. 24A, the horizontal axis and the vertical axis are similar to those in FIG. In FIG. 24(A), the detection value of the X sensor number "9" is significantly larger than the detection values of the other X sensor numbers, as indicated by reference sign P4. The detection value with the X sensor number “9” corresponds to the position on the touch surface of the touch panel 11 with which the second lower conductor portion 121 is in contact.

FIG. 24B is a graph showing the detected value of the capacitance of the first group of electrodes 11a of the touch panel 11 when the right push-down operation is performed. In FIG. 24B, the horizontal axis and the vertical axis are similar to those in FIG. In FIG. 24(B), as indicated by reference numeral P5, the detected value of the X sensor number "19" is significantly larger than the detected values of the other X sensor numbers. The detection value with the X sensor number “19” corresponds to the position on the touch surface of the touch panel 11 with which the second lower conductor portion 122 is in contact. Further, the detection value of the X sensor number “19” is smaller than the detection value of the X sensor number “9” shown in FIG.

As shown in FIGS. 24A and 24B, when the left push-down operation and the right push-down operation are performed, in the electrode 11a of the first group of the touch panel 11, the X of the electrode 11a having a significantly large detection value is shown. The sensor number and the capacitance detection value are different. Accordingly, it is possible to determine whether the input operation by the user is the left pushing operation and the right pushing operation.

FIG. 25 is a flowchart showing the operation of the touch panel device according to the fourth embodiment. The functional blocks of the touch panel device according to the fourth embodiment are the same as those shown in FIG. Further, the hardware configuration of the touch panel device according to the fourth embodiment is similar to that shown in FIG.

Since steps ST41 to ST42 shown in FIG. 25 are the same as steps ST21 to ST22 shown in FIG. 18, description thereof will be omitted. In step ST43, the operation determination unit 13 inputs the detected value of the electrostatic capacitance detected by the electrostatic capacitance detection unit 12 to the machine learning unit 25 as a feature amount. When the input detection value of the electrostatic capacitance is the detection value corresponding to the push-down operation to the left, an identification label “Knob left-turn” is attached as the fourth identification label. Further, when the input detection value of the electrostatic capacitance is the detection value corresponding to the push-down operation to the right, an identification label "knob push-down" is attached as the fifth identification label.

Since steps ST44 to ST47 are the same as steps ST24 to ST27 shown in FIG. 18, description thereof will be omitted.

In step ST48, when the label acquired from the machine learning unit 25 is "knob left tilt", the operation determination unit 13 notifies the processor 52 of the determination result that the input operation by the user is left push down operation. At this time, the capacitance in the area of the touch panel 11 corresponding to the first lower conductor portion 111 and the second conductor contact portion 121 is changing. Specifically, the capacitance in the area of the touch panel 11 facing the first lower conductor portion 111 and the second conductor contact portion 121 is changing. The capacitance in the area of the touch panel 11 that does not face the first lower conductor portion 111 and the second conductor contact portion 121 may change.

In step ST49, when the identification label acquired from the machine learning unit 25 is “knob right tilt”, the operation judgment unit 13 notifies the processor 52 of the judgment result that the input operation by the user is right push down operation. At this time, the capacitance in the area of the touch panel 11 corresponding to the first lower conductor portion 111 and the second conductor contact portion 122 is changing. Specifically, the capacitance in the area of the touch panel 11 facing the first lower conductor section 111 and the second conductor contact section 122 changes. The capacitance in the area of the touch panel 11 that does not face the first lower conductor portion 111 and the second conductor contact portion 122 may change.

Note that the flow chart shown in FIG. 25 is an example, and the input operation by the user is the contact operation of the operation knob 400 by comparing the detected value of the electrostatic capacitance with a predetermined threshold value as shown in FIG. It may be determined whether the operation is a pushing operation or a pushing operation. Further, as shown in FIG. 22, the touch coordinates at the time of the input operation may be used to determine whether the input operation by the user is a contact operation, a push operation, or a push down operation of the operation knob 400. As an example of discriminating a push-in operation and a push-down operation using touch coordinates, when a plurality of touch coordinates corresponding to the areas of the second conductor contact portions 123 and 124 are detected, the user's input operation is a push operation. If it is determined that one touch coordinate corresponding to the area of the second conductor contact portions 123 and 124 is detected, it may be determined that the user's input operation is a push-down operation.

23 to 25, an example in which the leftward pushing operation and the rightward pushing operation of the operation knob 400 are determined has been described, but the upper conductor portion 130 has the +Y axis side or the −Y axis in FIGS. 23(A) and 23(B). The operation knob 400 may have four second lower conductor portions in order to determine a push-down operation caused by tilting to the side. That is, as the number of the second conductor contact portions included in the operation knob 400 increases, whether the upper conductor portion is in one of the N states from the first state to the Nth state during the input operation. It becomes possible to determine whether or not. Here, N is an integer of 3 or more.

<Effect of Embodiment 4>
As described above, according to the fourth embodiment, as in the first embodiment, a small change in the contact area between the touch panel 11 and the deformable member of the operation knob 400 is not used. The accuracy can be increased. Further, according to the fourth embodiment, it is possible to determine whether the input operation by the user is a contact operation, a push operation, or a push down operation, based on the detected value of the electrostatic capacitance.

1, 2 touch input system, 10, 20, 30 touch panel device, 11, 31 touch panel, 12 capacitance detection unit, 13 operation determination unit, 25 machine learning unit, 100, 100A, 400 operation support device, 111, 111A, 112A 1st lower side conductor part, 121,122 2nd lower side conductor part, 130 Upper side conductor part, 140 Grip part, 150 Spring, 171,172 elastic body, 180 Rotation detection part, J1 axis line.

Claims (22)

An operation support device that supports an input operation on a touch panel that detects a change in capacitance,
A first lower conductor portion,
A second lower conductor portion,
It is possible to switch between a first state in which the first lower conductor portion is in conduction and a state in which the second lower conductor portion is not in conduction and a second state in which the second lower conductor portion is in conduction. An upper conductor part,
An elastic body that applies a force to separate the upper conductor portion and the second lower conductor portion from each other ,
If the upper conductor portion is in the first state during the input operation, the first lower conductor portion changes the capacitance in the area of the touch panel corresponding to the first lower conductor portion. Let
By switching the upper conductor portion to the second state against the force of the elastic body during the input operation , the first lower conductor portion and the second lower conductor portion are The operation support device, wherein the capacitance in a region of the touch panel corresponding to the first lower conductor portion and the second lower conductor portion is changed. Further comprising a spring disposed between the upper conductor portion and the first lower conductor portion,
The operation support device according to claim 1 , wherein the upper conductor portion and the first lower conductor portion are electrically connected via the spring. An operation support device that supports an input operation on a touch panel that detects a change in capacitance,
A first lower conductor portion,
A second lower conductor portion,
It is possible to switch between a first state in which the first lower conductor portion is in conduction and a state in which the second lower conductor portion is not in conduction and a second state in which the second lower conductor portion is in conduction. An upper conductor part,
A spring arranged between the upper conductor part and the first lower conductor part ;
Have,
The upper conductor portion and the first lower conductor portion are electrically connected via the spring ,
If the upper conductor portion is in the first state during the input operation, the first lower conductor portion changes the capacitance in the area of the touch panel corresponding to the first lower conductor portion. Let
When the upper conductor portion is in the second state during the input operation, the first lower conductor portion and the second lower conductor portion are the first lower conductor portion and the second lower conductor portion. operation support apparatus characterized by changing the capacitance in the region of the touch panel corresponding to the lower conductor portion. The second lower conductor portion, the operation support device according to any one of claims 1 3, characterized in that it comprises a plurality of conductors contact portion in contact with the touch panel. Wherein the plurality of conductors contact portion, the operation support device according to claim 4, characterized in that opposite the each other physician. Said second state, said upper conductor portion is conducted to the first lower conductor portion, and a state in which conductive with the plurality of conductors contact portions are opposed to each other The operation support device according to claim 5, which is characterized in that: The upper conductor portion is switchable to a third state conducts one not conducting the other of said first of said plurality of conductors contact portion is electrically connected to the lower conductor portion,
If the upper conductor portion said third state when the input operation, the electrostatic in the region of the touch panel corresponding to the one of the first lower conductor portion and the plurality of conductors contact portion The operation support device according to claim 6 , wherein the capacity changes. The upper conductor portion is switchable to a fourth state not conducting the first conducting said other of said plurality of conductors contact portion is electrically connected to the lower conductor portion to the one Yes,
If the upper conductor portion said fourth state when said input operation, the electrostatic in the region of the touch panel corresponding to the other of said first lower conductor portion and the plurality of conductors contact portion The operation support device according to claim 7 , wherein the capacity changes. An operation support device that supports an input operation on a touch panel that detects a change in capacitance,
A first lower conductor portion,
A second lower conductor part having first and second conductor parts that are not electrically connected to each other;
An upper conductor portion that can be switched to any one of a first state, a second state, and a third state;
Have
The first state is a state in which the upper conductor portion is electrically connected to the first lower conductor portion and is not electrically connected to either the first conductor portion or the second conductor portion. ,
In the second state, the upper conductor portion is electrically connected to the first lower conductor portion, and the upper conductor portion is pushed to the touch panel side so that the upper conductor portion becomes the first conductor portion. Is in a state of being electrically connected to the second conductor portion,
In the third state, the upper conductor portion is electrically connected to the first lower conductor portion, and the portion of the upper conductor portion corresponding to the first conductor portion is inclined toward the touch panel. The upper conductor part is electrically connected to the first conductor part and is not electrically connected to the second conductor part by being pushed in,
If the upper conductor portion is in the first state during the input operation, the first lower conductor portion changes the capacitance in the area of the touch panel corresponding to the first lower conductor portion. Let
If the upper conductor portion is in the second state during the input operation, the first lower conductor portion, the first conductor portion, and the second conductor portion are the first lower conductor portion. Changing the capacitance in a region of the touch panel corresponding to the first conductor portion and the second conductor portion,
If the upper conductor portion is in the third state during the input operation, the first lower conductor portion and the first conductor portion are the first lower conductor portion and the first conductor portion. Changing the capacitance in the area of the touch panel corresponding to
An operation support device characterized by the above. The upper conductor portion is further switchable to any one of the first state, the second state, the third state, and the fourth state,
In the fourth state, the upper conductor portion is electrically connected to the first lower conductor portion, and the portion of the upper conductor portion corresponding to the second conductor portion is inclined toward the touch panel. A state in which the upper conductor portion is pushed to be electrically connected to the second conductor portion and not to be electrically connected to the first conductor portion,
If the upper conductor portion is in the fourth state during the input operation, the first lower conductor portion and the second conductor portion are the first lower conductor portion and the second conductor portion. Changes the capacitance in the area of the touch panel corresponding to
The operation support device according to claim 9, wherein The operation support device according to any one of claims 1 to 10 , further comprising: a gripping part that covers the upper conductor part and that is gripped by a user. The operation support device according to claim 11 , wherein the grip portion has a ring shape. The operation support device according to claim 12 , wherein the first lower conductor portion and the second lower conductor portion are arranged in a circumferential direction around an axis of the grip portion. The operation support device according to claim 13 , wherein the grip portion is rotatable with respect to the upper conductor portion around the axis. The operation support device according to claim 14 , further comprising a rotation detection unit that is provided in the grip unit and that detects a signal corresponding to a rotation operation of the grip unit. An operation support device according to any one of claims 1 to 15 ,
A touch panel device including the touch panel, the input support being supported by the operation support device;
A touch panel input system, comprising: The touch panel device,
A capacitance detection unit for detecting the capacitance in the touch panel,
When the capacitance in the area facing the first lower conductor portion detected in the first state is smaller than a predetermined threshold value, the input operation is the pushing of the operation support device. It is determined that the operation is not accompanied by, and the electrostatic capacitance in a region facing the first lower conductor portion and the second lower conductor portion detected in the second state is the threshold value. If it is larger, an operation determination unit that determines that the input operation is an operation that involves pushing the operation support device,
The touch panel input system according to claim 16 , further comprising: A machine learning unit that further generates a discriminator that discriminates whether the input operation is an operation involving a push of the operation support device or an operation without a push based on a change in the capacitance on the touch panel. Have,
The touch panel device,
The first identification label acquired from the discriminator in the first state determines that the input operation is an operation that involves pushing the operation support device, and the second state identifies the identification. An operation determination unit that determines that the input operation is an operation that does not involve pressing of the operation support device, based on the second identification label acquired from the container,
The touch panel input system according to claim 16 , further comprising: The touch panel device,
A capacitance detection unit that detects a change in the capacitance on the touch panel, and that acquires touch coordinates on the touch panel based on the detected change in the capacitance,
When the touch coordinates detected in the first state are included in a first area of the touch panel that faces the first lower conductor portion, the input operation causes the pressing of the operation support device. If it is determined that the operation is not accompanied, and the touch coordinates detected in the second state are included in a second region of the touch panel that faces the second lower conductor portion, the input is performed. An operation determination unit that determines that the operation is an operation that involves pressing the operation support device,
The touch panel input system according to claim 16 , further comprising: An operation support device according to claim 15 ;
A touch panel device including the touch panel, the input support being supported by the operation support device;
A drive circuit for driving the rotation detection unit, and a touch panel input system. An operation determination method for a touch panel device, comprising the touch panel for detecting a change in the electrostatic capacitance, wherein an input operation is supported by the operation support device according to claim 1 .
A change in the capacitance in the area of the touch panel corresponding to the first lower conductor portion when the upper conductor portion is in the first state at the time of the input operation , and the elastic body at the time of the input operation. The electrostatic charge in the area of the touch panel corresponding to the first lower conductor portion and the second lower conductor portion when the upper conductor portion is switched to the second state against the force. On the basis of a change in capacity, it is determined whether the input operation is an operation that involves pressing the operation support device or an operation that does not involve pressing.
An operation determination method characterized by the above. A program for causing a computer to execute the process of the operation determination method according to claim 21 .

Images