JP2016133907A - Operation input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation input device configured to easily estimate load applied on an operation surface, on the basis of pressure detected.SOLUTION: An operation input device 1 includes: a touch sensor section 10 which detects an operation of an operation finger 9 operating an operation surface 100; a pressure sensor section 12 which detects pressure P based on a push operation of the operation finger 9 depressing the operation surface 100; an area estimation section 16 which estimates contact area of the operation finger 9 in contact with the operation surface 100, on the basis of the operation on the operation surface 100 detected by the touch sensor section 10; and a load estimation section 18 which estimates load based on the push operation of the operation finger 9, by multiplying the contact area estimated by the area estimation section 16 by the pressure detected by the pressure sensor section 12.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an operation input device.

  As a conventional technique, a recognition unit that recognizes the shape of an object that is in contact with the operation surface of the operation unit, a pressure detection unit that detects pressure from the object on the operation surface, and an object shape recognized by the recognition unit Based on the threshold value setting unit that sets a threshold value for the pressure for determining the pressing operation on the operation surface, and the threshold value set by the pressure detection unit and the threshold value setting unit. There is known an information processing apparatus including a determination unit that determines whether or not a pressing operation has been performed (for example, see Patent Document 1).

  This information processing device estimates the pressure from the object from the shape of the object in contact with the operation surface, for example, even if the pressure that pushes the operation surface differs due to differences in grip strength depending on gender, differences in finger pressing, etc. Since the threshold value is set lower as the estimated pressure from the object is smaller, a threshold value suitable for the pressing force of the operator who performs the pressing operation can be set.

JP 2010-211399 A

  However, the conventional information processing apparatus discriminates the pressing operation based on the pressure, not the load due to the object in contact with the operation surface. Therefore, when the operation is performed with an object having a large contact area such as a finger belly, Thus, compared with a small object, it is difficult to detect the pressing operation unless the pressure for pressing the operation surface is increased, and the pressing operation may not be detected even though the operation surface is pressed with the same load.

  Accordingly, an object of the present invention is to provide an operation input device that can easily estimate a load applied to an operation surface based on a detected pressure.

  One embodiment of the present invention includes a detection unit that detects an operation performed on an operation surface by a detection target, a pressure detection unit that detects a pressure based on an operation of pushing down the operation surface performed by the detection target, and an operation surface by the detection unit The area estimation unit that estimates the contact area of the detection target with respect to the operation surface based on the detection of the operation performed on the operation surface is multiplied by the contact area estimated by the area estimation unit and the pressure detected by the pressure detection unit. An operation input device is provided that includes a load estimation unit that estimates a load based on an operation of pushing down the operation surface.

  According to the present invention, it is possible to easily estimate the load applied to the operation surface based on the detected pressure.

FIG. 1A is a schematic diagram illustrating an example of the inside of a vehicle in which the operation input device according to the embodiment is mounted, and FIG. 1B is a cross-sectional view illustrating an example of the operation input device. 1 (c) is a block diagram illustrating an example of an operation input device. 2A to 2F are schematic diagrams illustrating an example of the relationship between the number of electrostatic couplings and the contact area of the operation input device according to the embodiment, and FIG. It is a graph which shows an example of the relationship between the number of coupling | bondings and a contact area. FIG. 3 is a flowchart regarding the operation of the operation input device according to the embodiment.

(Summary of embodiment)
An operation input device according to an embodiment includes a detection unit that detects an operation performed on an operation surface by a detection target, a pressure detection unit that detects a pressure based on an operation of pushing down the operation surface performed by the detection target, and a detection unit Based on the detection of the operation performed on the operation surface by the area, the area estimation unit that estimates the contact area of the detection target to the operation surface, the contact area estimated by the area estimation unit and the pressure detected by the pressure detection unit are multiplied and detected A load estimation unit configured to estimate a load based on an operation of depressing the operation surface made by the object.

[Embodiment]
(Overall configuration of operation input device 1)
FIG. 1A is a schematic diagram illustrating an example of the inside of a vehicle in which the operation input device according to the embodiment is mounted, and FIG. 1B is a cross-sectional view illustrating an example of the operation input device. 1 (c) is a block diagram illustrating an example of an operation input device. Note that, in each drawing according to the embodiment described below, the ratio between figures may be different from the actual ratio. Moreover, in FIG.1 (c), the flow of the main signal and information is shown by the arrow. Furthermore, “A to B” indicating a numerical range is used in the meaning of A or more and B or less.

  The operation input device 1 is mounted on a vehicle 8 as shown in FIG. For example, the operation input device 1 is arranged such that the operation surface 100 is exposed on a floor console 80 extending between a driver seat and a passenger seat of the vehicle 8.

  The operation input device 1 can operate an electronic device that is electromagnetically connected, for example. The operation input device 1 performs instructions such as movement and selection of the cursor displayed on the display device 85, selection of the displayed icon, determination, dragging, dropping, and the like, for example, by operation with a conductive pen or finger. It is configured to be able to. In the present embodiment, an operation with an operation finger as a detection target will be described.

  As shown in FIG. 1B and FIG. 1C, the operation input device 1 mainly includes a touch sensor unit 10 as a detection unit that detects an operation performed on the operation surface 100 by the operation finger 9, A pressure sensor unit 12 as a pressure detection unit that detects a pressure P based on an operation of depressing the operation surface 100 performed by the operation finger 9, and an operation surface based on detection of an operation performed on the operation surface 100 by the touch sensor unit 10. The area estimation unit 16 that estimates the contact area of the operation finger 9 with respect to 100, the contact area estimated by the area estimation unit 16 and the pressure detected by the pressure sensor unit 12 are multiplied, and the operation surface 100 made by the operation finger 9 is obtained. And a load estimation unit 18 that estimates a load based on a pressing operation.

  The contact area is, for example, an area (contact area 90) where the operation finger 9 and the operation surface 100 are in direct contact as shown in FIG. The area estimation unit 16 is configured to estimate this area (contact area 90).

  In addition, the operation input device 1 further includes an actuator 20 as a vibration applying unit that applies vibration to the operation surface 100, and a load threshold value 221, and when the estimated load is larger than the load threshold value 221, And a control unit 22 that receives an input by a pressing operation and controls the actuator 20 to vibrate the operation surface 100.

  As shown in FIG. 1B, the touch sensor unit 10 and the pressure sensor unit 12 are arranged on a panel 14 formed in a plate shape using a resin material such as polycarbonate. The touch sensor unit 10, the pressure sensor unit 12, and the panel 14 are disposed on the installation surface 800 of the floor console 80 via the support member 19, for example.

  This operation input device 1 makes the operator recognize a click feeling or an operation feeling in response to an operation of pushing down the operation surface 100, that is, gives tactile feedback to the operator. Hereinafter, an operation of pushing down the operation surface 100 is referred to as a push operation.

(Configuration of touch sensor unit 10)
2A to 2F are schematic diagrams illustrating an example of the relationship between the number of electrostatic couplings and the contact area of the operation input device according to the embodiment, and FIG. It is a graph which shows an example of the relationship between the number of coupling | bondings and a contact area. In FIG. 2G, the vertical axis represents the number of electrostatic couplings (number), and the horizontal axis represents the contact area (mm ² ).

  The touch sensor unit 10 is, for example, a capacitance type sensor having a plurality of X electrodes 105 and Y electrodes 106 arranged so as to cross below the operation surface 100. As an example, the touch sensor unit 10 is configured by laminating a film-like base material on which an X electrode 105 and a Y electrode 106 are separately provided so that the X electrode 105 and the Y electrode 106 are insulated. .

  For example, the X electrode 105 and the Y electrode 106 are formed using a conductive metal such as copper. In the case where the operation input device 1 is disposed on the display device, the X electrode 105 and the Y electrode 106 are configured by transparent electrodes such as ITO (Indium Tin Oxide) as an example.

  The touch sensor unit 10 is, for example, a coordinate system in which the upper left of the operation surface 100 indicated by a dotted line on the paper surface of FIGS. 2A to 2F is the origin, the horizontal axis is the X axis, and the vertical axis is the Y axis. Is set. For example, the X electrodes 105 are arranged at equal intervals according to the coordinates X1 to X10 of the X axis. The Y electrodes 106 are arranged at regular intervals according to the Y-axis coordinates Y1 to Y4 as an example.

  One X electrode 105 has, for example, five detection electrodes 105a. The detection electrode 105a has a rectangular shape and is electrically connected to another adjacent detection electrode 105a.

  One Y electrode 106 has ten detection electrodes 106a as an example. The detection electrode 106a has a rectangular shape and is electrically connected to another adjacent detection electrode 106a.

The detection electrode 105a and the detection electrode 106a have the same shape and the same area. As an example, the detection electrode 105a and the detection electrode 106a have a square shape with one side of about 1 to 3 mm. In this embodiment, it is assumed that the areas of the detection electrode 105a and the detection electrode 106a are 1 mm ² as an example.

  The Y electrode 106 is a driven electrode, for example. The X electrode 105 is an electrode from which capacitance is read, for example. For example, as shown in FIG. 2A, when the area of the operating finger that has touched the operation surface 100 is the contact area 107, the Y electrode 106 of Y2 is driven, and the capacitance is read from the X electrode 105 of X3. As a result, a capacitance different from the combination of driving and reading of the other X electrode 105 and Y electrode 106 is obtained. This change in capacitance is due to electrostatic coupling. In the present embodiment, the number of electrode combinations in which the amount of change in capacitance is greater than the touch threshold value 220 described later is referred to as the electrostatic coupling number.

(Configuration of pressure sensor unit 12)
The pressure sensor unit 12 is, for example, a sheet-like sensor. As an example, the pressure sensor unit 12 includes two film-like sheets. One sheet includes a plurality of elongated first electrodes arranged in the first direction, and the other sheet includes a first sheet. A plurality of elongated second electrodes arranged in a second direction intersecting with the first direction are arranged. The two sheets are bonded so that the first electrode and the second electrode are in contact with each other.

When the operator performs an operation on the operation surface 100, pressure is applied to the pressure sensor unit 12 via the touch sensor unit 10, and the first electrode and the second electrode are pressed and pressed according to the pressure. The resistance value of the part will decrease. The pressure sensor 12 outputs a change in resistance is converted into pressure, to the control unit 22 generates a pressure information S ₂ is the information of the pressure.

(Configuration of area estimation unit 16)
The area estimation unit 16 is configured to estimate the contact area based on the number of electrostatic couplings generated when the operation finger contacts the operation surface 100. Specifically, the area estimation unit 16 includes a table 160 that associates the number of electrostatic couplings with the contact area, and is configured to estimate the contact area from the number of electrostatic couplings based on the table 160.

For example, the area estimation unit 16 determines the number of electrostatic couplings based on the coupling information S ₃ acquired from the control unit 22. This binding information _{S 3} will be described later. Hereinafter, the relationship between the number of electrostatic couplings and the contact area will be described.

As shown in FIG. 2A, when the area (contact area 107) where the operation finger is in contact with the operation surface 100 is, for example, a region surrounded by a solid line, electrostatic coupling is performed within the contact area 107. The number of X3 detection electrodes 105a and Y2 detection electrodes 106a, that is, (X3, Y2) is one set. Therefore, in FIG. 2A, the contact area 107 is 2 (mm ² ) and the electrostatic coupling number is 1.

As shown in FIG. 2B, when the contact area 107 where the operation finger is in contact with the operation surface 100 is, for example, a region surrounded by a solid line, electrostatic coupling is performed within the contact area 107. The number is a set of (X3, Y2). Therefore, in FIG. 2B, the contact area 107 is 4 (mm ² ), but the electrostatic coupling number is 1.

As shown in FIG. 2C, when the contact area 107 where the operating finger is in contact with the operation surface 100 is, for example, a region surrounded by a solid line, electrostatic coupling is performed within the contact area 107. The number is four sets of (X3, Y2), (X3, Y3), (X4, Y2) and (X4, Y3). Accordingly, in FIG. 2C, the contact area 107 is 6 (mm ² ) and the number of electrostatic couplings is 4.

As shown in FIG. 2D, when the contact area 107 where the operating finger is in contact with the operation surface 100 is, for example, a region surrounded by a solid line, electrostatic coupling is performed within the contact area 107. The number is six sets of (X2, Y2), (X2, Y3), (X3, Y2), (X3, Y3), (X4, Y2) and (X4, Y3). Accordingly, in FIG. 2D, the contact area 107 is 9 (mm ² ) and the number of electrostatic couplings is 6.

As shown in FIG. 2E, when the contact area 107 where the operating finger is in contact with the operation surface 100 is, for example, a region surrounded by a solid line, electrostatic coupling is performed within the contact area 107. The numbers are (X2, Y2), (X2, Y3), (X2, Y4), (X3, Y2), (X3, Y3), (X3, Y4), (X4, Y2) and (X4, Y3) Eight pairs. Therefore, in FIG. 2E, the contact area 107 is 12 (mm ² ) and the number of electrostatic couplings is 8.

As shown in FIG. 2F, when the contact area 107 where the operation finger is in contact with the operation surface 100 is an area surrounded by a solid line as an example, electrostatic coupling is performed within the contact area 107. The numbers are (X2, Y2), (X2, Y3), (X2, Y4), (X3, Y2), (X3, Y3), (X3, Y4), (X4, Y2), (X4, Y3) And nine groups of (X4, Y4). Therefore, in FIG. 2F, the contact area 107 is 16 (mm ² ) and the number of electrostatic couplings is 9.

When the relationship between the number of electrostatic couplings and the contact area 107 is graphed, a graph indicated by a solid line in FIG. This graph can be approximated by a conversion line 161 indicated by a dotted line. The table 160 described above is created so that the contact area can be estimated from the electrostatic coupling number based on the conversion line 161. Thus the area estimation unit 16, the binding information read contact area corresponding to the electrostatic bond number obtained from S ₃ from the table 160, and the contact area estimated contact area was read. The area estimation unit 16 generates estimated area information S ₄ regarding the estimated contact area and outputs the estimated area information S ₄ to the control unit 22.

  As a modification, the area estimation unit 16 is not limited to the configuration in which the contact area is estimated from the number of electrostatic couplings, and may be a configuration in which the detection target is estimated from the detected region.

(Configuration of load estimation unit 18)
The pressure P detected by the pressure sensor unit 12 is not a load applied to the operation surface 100 by the operating finger, but is considered to be obtained by dividing the load by the contact area. Therefore, the push operation is determined based on the pressure P. If comprised in this way, even if it pushes similarly, it may be determined by the difference in a contact area, or may not be determined.

Therefore, the load estimation unit 18 multiplies the pressure P detected by the pressure sensor unit 12 and the contact area estimated by the area estimation unit 16 to estimate the load applied to the operation surface 100 by the operation finger. The load estimation unit 18 generates estimated load information S ₅ regarding the estimated load and outputs the estimated load information S ₅ to the control unit 22.

(Configuration of actuator 20)
As shown in FIG. 1B, the actuator 20 is disposed on the back surface 141 of the panel 14, and applies vibration to the operation finger that contacts the operation surface 100 via the panel 14, the pressure sensor unit 12, and the touch sensor unit 10. It is configured as follows.

  The actuator 20 is configured using a piezoelectric element, a motor, or the like. As an example, the actuator 20 of the present embodiment is an actuator using a piezoelectric element.

  Examples of the material for the piezoelectric element include lithium niobate, barium titanate, lead titanate, lead zirconate titanate (PZT), lead metaniobate, polyvinylidene fluoride (PVDF), polylactic acid, and the like.

  The actuator 20 is, for example, a single-layer bimorph type in which a film formed using the above material is formed on both surfaces of a metal plate, and a film formed using the above material is formed on one surface of the metal plate. Single layer unimorph type, laminated unimorph type formed by laminating a film formed using the above material on one side of a metal plate, formed using the above material on both sides of a metal plate It is possible to use a stacked bimorph actuator formed by stacking films.

(Configuration of control unit 22)
The control unit 22 includes, for example, a CPU (Central Processing Unit) that performs operations and processes on acquired data according to a stored program, a RAM (Random Access Memory) that is a semiconductor memory, a ROM (Read Only Memory), and the like. Microcomputer. For example, a program for operating the control unit 22, a touch threshold value 220, and a load threshold value 221 are stored in the ROM. For example, the RAM is used as a storage area for temporarily storing calculation results and the like.

The control unit 22 determines whether an operation has been detected based on the detection information S ₁ acquired from the touch sensor unit 10 and the touch threshold value 220. Control unit 22, if the operation is determined to be detected, on the basis of the detected information S _1, to calculate the coordinates operation is detected, obtains the electrostatic bond number above. As an example, the calculation of the coordinates is performed by a weighted average.

Control unit 22 generates operation information S ₇ about the calculated coordinates, and outputs the connected electronic equipment. In addition, the control unit 22 generates coupling information S ₃ regarding the obtained number of electrostatic couplings and outputs it to the area estimation unit 16.

The control unit 22, based on and the load threshold 221 estimates load information S ₅ obtained from the load estimating unit 18 determines whether the push operation on the operation surface 100 is performed. Control unit 22, when estimated is larger than the load threshold 221 load, determines that the push operation is performed, generates and outputs the operation information S ₇ indicating that a push operation is performed.

Here, the control unit 22 is information of an image displayed on the display device 85 from the connected electronic device acquires image information S _8. Control unit 22, based on the image information S _8, to determine the area of the image to be presented vibrations based on the push operation, the coordinates pushing operation is performed is determined to be within the region of the image, the actuator predetermined period and generates a drive signal S ₆ to vibrate the 20 outputs.

  Below, operation | movement of the operation input apparatus 1 is demonstrated according to the flowchart of FIG. Here, a case will be described in which the operator selects a push-operable image displayed on the display device 85 by a cursor operation and performs a push operation.

(Operation)
Control unit 22 of the operation input device 1, when the power supply of the vehicle 8 is turned on, obtains the detection information S ₁ periodically from the touch sensor unit 10, obtains the pressure information S ₂ from the pressure sensor portion 12 ( S1). The control unit 22 acquires the image information S ₈ from the connected electronic apparatus.

Control unit 22 determines whether an operation has been performed on the basis of the detected information S ₁ and the touch threshold value 220. Control unit 22, when determining that the operation has been performed (S2: Yes), generates a binding information _{S 3} based on the detected information _{S 1,} and outputs to the area estimation unit 16.

Area estimation unit 16 determines the electrostatic coupling rate based on the binding information S ₃ acquired. The area estimation unit 16 estimates the contact area based on the determined number of electrostatic couplings and the table 160 (S3). Area estimation unit 16 generates an estimated area information S ₄ based on the contact area was estimated, and outputs the load estimation unit 18 via the control unit 22.

Load estimation unit 18 estimates the pressure based on the pressure information S ₂ acquired from the pressure sensor portion 12, and the contact area based on the estimated area information S ₄ obtained from the area estimation unit 16, a load by multiplying (S4 ). The load estimation unit 18 generates estimated load information S ₅ regarding the estimated load and outputs the estimated load information S ₅ to the control unit 22.

Control unit 22, a load based on the estimated load information _{S 5} obtained, the load threshold 221, compares, when the load exceeds the load threshold 221 (S5: Yes), the push operation is carried out It determined, thereby presenting a vibration to the actuator 20 and outputs a drive signal _{S 6} (S6).

Control unit 22 generates operation information S ₇ based on the push operation and output to the electronic device (S7), and terminates the operation associated with the push operation.

  Here, in Step 2, when it is determined that the operation is not performed (S2: No), the control unit 22 advances the process to Step 1.

In step 5, the control unit 22, when the estimated load is a load threshold value 221 or less (S5: No), generates and outputs to the electronic device operation information S ₇ about the detected coordinate operations finger To do.

(Effect of embodiment)
The operation input device 1 according to the present embodiment can easily estimate the load applied to the operation surface based on the detected pressure. Specifically, the operation input device 1 estimates the contact area from the detected number of electrostatic couplings, and estimates the load by multiplying the estimated contact area and the detected pressure. The load can be estimated more easily than when not employed.

  The operation input device 1 is configured not to determine the push operation based on the pressure detected by the pressure sensor unit 12, but to determine the push operation based on the load obtained from the pressure and the estimated contact area. Has been. When the push operation is determined based on the pressure, even if the operator intends to push the operation surface 100 with a load in the same manner, there is a possibility that it is not determined due to the difference in the contact area. However, since the operation input device 1 determines the push operation based on the load instead of the pressure, the determination uncertainty due to the contact area of the push operation performed in the same manner is suppressed as compared with the case where the push operation is determined based on the pressure. The operational feeling is improved.

  Since the operation input device 1 includes the table 160 that associates the number of electrostatic couplings with the estimated contact area, compared with the case where the contact area is calculated from the region where the detection target is detected, The contact area can be easily estimated from the number, and as a result, the load can be easily estimated.

  Since the uncertainties in the determination of the push operation are suppressed, the operation input device 1 presents a vibration that accompanies the push operation, and has a pseudo operation feeling such as performing a push operation on a modest mechanical switch. Can be provided to the operator appropriately.

  The operation input device 1 according to the above-described embodiment and modification is, for example, a program executed by a computer, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like depending on applications. It may be realized by.

  As mentioned above, although embodiment of this invention was described, these embodiment is only an example and does not limit the invention which concerns on a claim. These novel embodiments can be implemented in various other forms, and various omissions, replacements, changes, and the like can be made without departing from the scope of the present invention. In addition, not all the combinations of features described in these embodiments are essential to the means for solving the problems of the invention. Furthermore, these embodiments are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... Operation input apparatus, 8 ... Vehicle, 9 ... Operation finger, 10 ... Touch sensor part, 12 ... Pressure sensor part, 14 ... Panel, 16 ... Area estimation part, 18 ... Load estimation part, 19 ... Support member, 20 ... Actuator, 22 ... Control unit, 80 ... Floor console, 85 ... Display device, 90 ... Contact area, 100 ... Operating surface, 105 ... X electrode, 105a ... Detection electrode, 106 ... Y electrode, 106a ... Detection electrode, 107 ... Contact Area 141, back surface, 160 ... table, 161 ... conversion line, 220 ... touch threshold, 221 ... load threshold, 800 ... installation surface

Claims (4)

A detection unit for detecting an operation performed on the operation surface by the detection target;
A pressure detector that detects pressure based on an operation of pushing down the operation surface made by the detection target;
An area estimation unit that estimates a contact area of the detection target with respect to the operation surface based on detection of an operation performed on the operation surface by the detection unit;
A load estimation unit that multiplies the contact area estimated by the area estimation unit and the pressure detected by the pressure detection unit, and estimates a load based on the operation of pushing down the operation surface made by the detection target;
An operation input device comprising: A vibration applying unit for applying vibration to the operation surface;
A control unit that has a threshold value and receives the input by the pressing operation when the estimated load is larger than the threshold value, and controls the vibration adding unit to vibrate the operation surface;
The operation input device according to claim 1, further comprising: The detection unit is a capacitive sensor having a plurality of detection electrodes arranged so as to intersect below the operation surface,
The area estimation unit estimates the contact area based on the number of electrostatic couplings caused by the detection target coming into contact with the operation surface.
The operation input device according to claim 1 or 2. The area estimation unit has a table that associates the number of electrostatic couplings with the contact area, and estimates the contact area from the number of electrostatic couplings based on the table.
The operation input device according to claim 3.

Images