JP2019160026A - Operation device - Google Patents

Abstract

To provide an operation device which comprises optimization means for enabling optimal vibration feedback depending on a user state.SOLUTION: An operation device 1 is constituted of an operation unit 10 operated with fingers or the like, a vibration actuator 40 serving as a vibration presentation unit which performs vibration feedback to operation, a user state determination information detecting unit 20 for detecting user state determination information for determining the state of a user who operates the operation unit 10 and a control unit 30 having optimization means for optimizing algorithm of vibration feedback control by the vibration actuator 40 on the basis of the user state determination information. Thus, the operation device enables optimal vibration feedback depending on a user state.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an operation device, and more particularly, to an operation device that presents a tactile sensation by vibration feedback for an operation.

  As a conventional technique, an operation device that performs a tactile sensation by vibration feedback when a finger performs a touch operation in a switch device is disclosed (for example, see Patent Document 1).

  The operation device includes a touch panel on which a switch that is operated by a user touching a finger is displayed, a touch sensor that detects that the finger is in contact with the touch panel, and vibration when the touch sensor detects contact. And a notification control means for controlling the operation of the notification means so as to change the vibration generation mode according to the separation distance between the finger contact position on the touch panel and the center position of the switch. And is configured.

JP 2013-175045 A

  The prior art uses a fixed algorithm in the manner of vibration generation. However, vibration transmission and the sensibility effect on people change depending on the contact state with vibrating devices such as fingers that give vibration, so fixed vibration feedback control feels too strong or too weak and vibration feedback There was a problem that the user's uncomfortable feeling sometimes increased.

  Accordingly, an object of the present invention is to provide an operating device including an optimization unit that enables optimal vibration feedback according to a user state.

[1] In order to achieve the above object, an operation unit that performs an operation with fingers and the like, a vibration presenting unit that performs vibration feedback on the operation, and a user state for determining a state of a user who operates the operation unit An operation device comprising: a user state determination information detection unit that detects determination information; and a control unit that includes an optimization unit that optimizes a vibration feedback control algorithm by the vibration presenting unit based on the user state determination information. I will provide a.
[2] The operating device according to [1] may be the optimization unit using AI, deep learning, or machine learning.
[3] The optimization unit may be the operation device according to [1] or [2], which is selectable by the user.
[4] The operation unit may be the operation device according to any one of [1] to [3], which is an in-vehicle switch mounted on a vehicle.

  According to the operating device according to the embodiment of the present invention, it is possible to provide optimization means that enables optimal vibration feedback according to the user state.

FIG. 1 is an overall configuration diagram of an operating device according to an embodiment of the present invention. FIG. 2 is a waveform diagram showing the relationship between acceleration and time indicating an example of an optimized vibration feedback waveform in the operating device according to the embodiment of the present invention. FIG. 3 is a schematic perspective view of the passenger compartment when the operating device according to the embodiment of the present invention is mounted on a vehicle. FIG. 4 is a schematic diagram of an operating device in which a steering switch is mounted on a steering as an operating unit. FIG. 5A is a plan view of a steering switch that includes a steering touch pad and a touch pad outer peripheral area detection unit provided in the outer peripheral area of the steering touch pad, and FIG. It is AA sectional drawing of (a).

(Embodiment of the present invention)
The operation device 1 according to the embodiment of the present invention includes an operation unit 10 that performs an operation with fingers and the like, a vibration actuator 40 that serves as a vibration presenting unit that performs vibration feedback on the operation, and a user who operates the operation unit 10. A control including a user state determination information detection unit 20 that detects user state determination information for determining a state, and an optimization unit that optimizes an algorithm of vibration feedback control by the vibration actuator 40 based on the user state determination information. Part 30.

  In the controller device 1 according to the present embodiment, the optimization of the vibration feedback control algorithm means that an optimal algorithm is selected as an algorithm for performing vibration feedback control based on the user state determination information. The vibration feedback control is performed by the selected algorithm while changing the parameters of the above based on the user state determination information. The controller device 1 according to the present embodiment can apply AI or the like to an algorithm for selecting an optimal algorithm, and can apply AI or the like to the selected algorithm itself.

(Outline of this embodiment)
FIG. 1 is an overall configuration diagram of an operating device according to an embodiment of the present invention. The operation device 1 includes a plurality of operation units (touch pad 12, touch panel 14 (screen touch input device), steering touch pad 16) as the operation unit 10. These operation units function as an input device and an input switch, and function as an in-vehicle switch when mounted on a vehicle. In addition, when the vibration actuator 40 to be described later is configured by a piezo element, a load acting on the piezo element can be detected, and the operation unit 10 includes the vibration actuator 40 so that it can be used as a push switch. Can function.

  The operation device 1 includes a steering grip detection unit 21, a steering grip position detection unit 22, a driver monitor information detection unit 23, a user information unit 24, and a seat position detection unit as a user state determination information detection unit 20 that detects user state determination information. 25, various types of discrimination information such as a touch pad outer peripheral area detection unit 26, and a discrimination information detection unit. Moreover, the vibration actuator 40 as a vibration presentation part is provided, This vibration actuator 40 gives vibration feedback with respect to detection target objects, such as a finger | toe which operated the operation part 10 (touch pad 12, touch panel 14, steering touch pad 16). It is placed where it can be done.

  In addition, the control unit 30 has one or a plurality of algorithms used for vibration feedback control, and the vibration feedback control algorithm of the vibration actuator 40 is converted into user state determination information by AI, deep learning, machine learning, or the like. Select and run based on. Further, the control unit 30 corrects the parameter in the algorithm selected based on the user state determination information by AI, deep learning, machine learning, or the like. By providing such optimization means, it is possible to provide an operating device including optimization means that enables optimal vibration feedback control by the vibration actuator 40 in accordance with the user state.

  In the operating device 1 according to the present embodiment, as an algorithm for vibration feedback control of the vibration actuator 40, as shown in FIG. 2, the sine wave is a predetermined one cycle time, drive (vibration) time, vibration time, amplitude. A drive algorithm that defines a vibration waveform with a square wave, a drive algorithm that defines a vibration waveform with a predetermined period of time, drive (vibration) time, vibration time, and amplitude of a rectangular wave, and user state determination information regarding the drive with the sine wave There is an algorithm for changing the vibration parameter value based on the vibration, an algorithm for changing the vibration parameter value based on the user state determination information, and the like.

  In the controller device 1 according to the present embodiment, the above-described algorithm selection, parameter value change in the selected algorithm, and the like can be performed using AI, deep learning, machine learning, or the like.

AI (Artificial Intelligence) is an expert system that obtains a conclusion by applying an inference function. Expert systems can process large amounts of known information and provide conclusions based on them. For example, the operation unit 10 is a steering touchpad 16, when the user status judgment information is the steering grip position information S _P, recognizes certain features from the steering grip position information S _P, on the basis of this, the steering touchpad In response to the touch operation on 16, the vibration form (vibration time (1 period time, driving (vibration) time, vibration time, amplitude, etc.)) can be corrected. The fixed feature is a feature learned in advance as a fixed feature of the relationship between the steering grip position and the vibration feedback to the fingers on the steering touch pad 16.

  Machine learning is one of AI methods, and is a technology / method that attempts to realize functions similar to the learning ability that humans naturally perform on a computer. Analyzes are performed by inputting a certain number of sample data sets from sensors, databases, etc., and useful rules, rules, knowledge expressions, judgment criteria, etc. are extracted from the data, and the algorithm is developed. Machine learning is a research field that gives computers the ability to learn without explicit programming, or that computer programs learn from experience in certain tasks and evaluation measures, as assessed by their performance in tasks In some cases, it is defined as a case where it has been improved by experience. Machine learning algorithms are classified as follows according to required results. Many techniques such as neural networks, genetic programming, inductive logic programming, clustering, reinforcement learning, etc. have been developed.

  Deep learning (deep learning) is a machine learning technique using a multilayer neural network.

(Operation unit 10)
The operation unit 10 can include a plurality of devices such as a touch pad 12, a touch panel 14 (screen touch input device), and a steering touch pad 16 as an operation unit.

As shown in FIG. 1, the touch pad 12 outputs the touch-operated position by a finger as a detection signal S _1, for performing a remote operation by performing display of the cursor or the like on the display unit based on the positional information Input device. The touch panel 14, the display unit and the touch pad is mounted on top, it outputs the touched position by the finger as the detection signal S _2, the menu displayed on the display unit, touch an icon or the like, the tracing operation or the like Thus, the screen touch input device can display a cursor or the like at the operated position on the display unit. The steering touch pad 16 is a touch pad attached to the steering of the vehicle. Steering touchpad 16, a touch pad described above is mounted on a steering, and outputs the touch-operated position by a finger as a detection signal S _3, the driver for the touch operation with the thumb in a state of gripping the steering with fingers It is an input device.

  The touch pad 12, the touch panel 14, and the steering touch pad 16 function as input devices as described above. Further, when the vibration actuator 40 is configured by a piezo element and is configured to overlap the touch pad 12, the touch panel 14, and the steering touch pad 16, a load acting on the piezo element can be detected. Accordingly, the touch pad 12, the touch panel 14, and the steering touch pad 16 can function as a switch device capable of vibration feedback with respect to a touch operation and a pressing operation.

(User state determination information detection unit 20)
As a user state determination information detection unit 20 for detecting user state determination information, a steering grip detection unit 21, a steering grip position detection unit 22, a driver monitor information detection unit 23, a user information unit 24, a sheet position detection unit 25, a touch pad outer periphery Various discrimination information such as the area detection unit 26 and a discrimination information detection unit can be provided.

The steering grip detection unit 21 is a steering grip detection signal S _H , the steering grip position detection unit 22 is a steering grip position detection signal S _P , the driver monitor information detection unit 23 is a driver monitor information detection signal S _D , and the user information unit 24 is user information. The signal S _U , the sheet position detector 25 outputs the sheet position detection signal S _S , and the touch pad outer periphery area detector 26 outputs the touch pad outer periphery area detection signal S _A to the controller 30.

  By the above various detections, in the controller device 1 according to the present embodiment, as the user state determination information, steering grip presence / absence information, steering grip position information, sheet position information, touch pad outer peripheral area information, user information (user physique information, Age information, etc.), driver monitor information (biological information), etc. can be acquired.

(Control unit 30)
The control unit 30 is configured by, for example, a microcomputer including a position detection control unit 34, a load detection control unit 35, an optimization execution unit 36 that executes optimization means, and the like. The controller device 1 includes a CPU (Central Processing Unit) that performs operations and processing on acquired data according to a stored program, a RAM (Random Access Memory) that is a semiconductor memory, a ROM (Read Only Memory), and the like. . As illustrated in FIG. 1, the controller device 1 does not need to be configured integrally with the position detection control unit 34, the load detection control unit 35, the optimization execution unit 36, and the like. For example, the position detection control unit 34 The load detection control unit 35 and the optimization execution unit 36 may be configured to use an external chip, and the storage unit may use an external memory.

  The position detection control unit 34 performs processing for detecting a touch position on the touch pad 12, the touch panel 14, and the steering touch pad 16. The load detection control unit 35 performs a process of detecting a load acting on the touch pad 12, the touch panel 14, and the steering touch pad 16 based on a voltage generated by the vibration actuator 40 that is a piezo element. Further, the optimization execution unit 36 performs processing for optimizing the algorithm of vibration feedback control based on various user state determination information detected by the user state determination information detection unit 20.

  FIG. 3 is a schematic perspective view of the passenger compartment when the operating device 1 according to the embodiment of the present invention is mounted on a vehicle. FIG. 4 is a schematic diagram of the operating device 1 in which the steering switch 18 is mounted on the steering 83 as the operating unit. For example, as shown in FIG. 3, the touch pad 12 is attached to an instrument panel 81 of the vehicle 8. The touch panel 14 (screen touch input device) is attached to the center console 82 of the vehicle 8. The steering switch 18 is mounted on the steering 83 as an in-vehicle switch mounted on a portion that can be operated even when the driver (driver) holds the steering 83. The steering switch 18 has a structure in which the steering touch pad 16 and the vibration actuator 40 are mounted so as to be touched or pressed, and vibration feedback can be performed in response to the touch or pressing operation.

  As the user state determination information detection unit 20, a steering grip detection unit 21, a steering grip position detection unit 22, a driver monitor information detection unit 23, and a seat position detection unit 25 are provided in the driver's seat and its surroundings.

  FIG. 5A is a plan view of the steering switch 18 including the steering touch pad 16 and the touch pad outer peripheral area detecting unit 26 provided in the outer peripheral area of the steering touch pad 16, and FIG. These are AA sectional drawing of Fig.5 (a). As shown in FIG. 5B, the vibration actuator 40 is mounted on the back surface of the steering switch 18 so as to overlap. The vibration actuator 40 includes a piezo element, and can detect a load acting on the piezo element. Further, the vibration actuator 40 is subjected to vibration feedback with respect to the touch operation and the press operation of the steering touch pad 16 by being applied with a voltage by the control unit 30 using a predetermined control algorithm and an optimized control algorithm. With these configurations and functions, the steering switch 18 can be an in-vehicle switch mounted on the vehicle 8.

The steering touch pad 16 is arranged so as to intersect by periodically switching connection of detection electrodes (not shown) while a drive signal is supplied to one drive electrode (not shown) constituting the two-dimensional touch sensor. A capacitance value (mutual capacitance value) generated at a point where the drive electrode and the detection electrode intersect is read out. As an example, a capacitance signal S ₃ is generated as a capacitance count value obtained by performing analog-digital conversion processing on the read capacitance, and is output to the control unit 30. Accordingly, the capacitance at the two-dimensional position (x, y) of the two-dimensional touch sensor can be detected as a capacitance distribution, and the contact (touch) or proximity of the finger to the steering touch pad 16 can be detected. Can do. The coordinates of the center or the center of gravity of the area that is equal to or greater than the touch threshold can be used as the touch point.

The touch pad outer peripheral area detector 26 provided on the outer peripheral area of the steering touchpad 16 outputs a touch pad periphery area detection signal S _A to the control unit 30. The touch pad outer peripheral area detection unit 26 can detect a finger or a palm other than the operation by means such as electrostatic. The touch pad outer peripheral area detection signal S _A can be used, for example, to estimate how the operator is operating the steering touch pad 16, and the optimization execution unit 36 performs such estimation. However, the algorithm of vibration feedback control can be optimized.

As shown in FIG. 5B, the vibration actuator 40 is mounted on the back surface of the steering switch 18 so as to overlap. Vibration actuator 40 is constituted by a piezoelectric element, is displaced by applying a control signal S _f in the piezoelectric element can generate any vibration. In addition, since a voltage is generated by deformation caused by a load acting on the piezo element, the load acting on the vibration actuator 40, that is, the steering switch 18 can be detected.

  The vibration actuator 40 is a unimorph type in which electrodes (not shown) are attached to both surfaces of a piezo element, and are bonded and fixed to a metal shim larger than the diameter of the piezo element. When a voltage is applied to the electrodes, the piezo element expands and contracts. Therefore, the metal shim is warped, and the piezo element and the metal shim as a whole are deflected to be displaced and vibrated. Examples of the material for the piezoelectric element include lithium niobate, barium titanate, lead titanate, lead zirconate titanate (PZT), lead metaniobate, and polyvinylidene fluoride (PVDF).

(Example of operation of operating device 1)
As shown in FIG. 4, a steering grip position detector 22 for detecting a position where the driver grips the steering wheel 83 with his / her finger 100 is mounted on the steering wheel 83. As shown in FIG. 4, the steering grip position detection unit 22 is configured such that, for example, the touch electrodes 22 a, 22 b, 22 c, 22 d, and 22 e for detecting the grip position of the right hand are behind the steering 83, that is, the driver When the hand is gripped, the finger 100 is attached to a place where the finger 100 is in contact with or close to the finger.

As shown in FIG. 4, consider a case where the driver touches the steering touch pad 16 with the thumb 101 while the driver grips the steering 83 with the finger 100. Steering touchpad 16, as described above, as the touch position of the thumb 101, for example, it is possible to detect the coordinates of the largest value in the distribution of the electrostatic capacitance value based on the electrostatic capacitance signal S _3. When the steering switch 18 (steering touch pad 16) is touched, the control signal _Sf is applied to the applied vibration actuator 40, and vibration feedback is performed. The control signal S _f is, AI, deep learning, or can be made which are optimized by utilizing machine learning and the like.

On the other hand, the steering grip position detection unit 22 can detect the steering grip position using the touch electrodes 22a, 22b, 22c, 22d, and 22e. Steering grip position detection signal _{S P} is 1 or 2 or more touch electrodes 22a, 22b, 22c, 22d, as 22e of the ON signal is outputted to the control unit 30.

The optimization execution unit 36 is, for example, various signals (steering grip detection signal S _H , steering grip position detection signal S _P , driver monitor information detection signal S _D , user information signal acquired by the user state determination information detection unit 20. Based on S _U , the sheet position detection signal S _S , and the touch pad outer peripheral area detection signal S _A ), an algorithm for vibration feedback control is optimized.

For example, the optimization execution unit 36 performs optimization to weaken the vibration feedback in the case of state information such as when the body is fixed such as when the steering 83 is held. When there is a touch pad periphery area detection signal S _A from the touch pad outer peripheral area detector 26 provided on the outer peripheral area of the steering touchpad 16 performs an optimization to increase the vibration feedback.

The control unit 30 receives various signals (steering grip detection signal S _H , steering grip position detection signal S _P , driver monitor information detection signal S _D) acquired by the optimization execution unit 36 by the user state determination information detection unit 20. Based on the user information signal S _U , the sheet position detection signal S _S , and the touch pad outer periphery area detection signal S _A ), an algorithm can be selected, and parameters in the algorithm can be corrected. This algorithm selection and algorithm parameter change can be performed by utilizing the above-described AI, deep learning, machine learning, or the like.

  Note that the above-described AI, deep learning, machine learning, or the like, which is an optimization unit, may be configured to be selectable by the user.

These optimizations are performed in advance by a steering grip detection signal S _H , a steering grip position detection signal S _P , a driver monitor information detection signal S _D , a user information signal S _U , a seat position detection signal S _S , and a touch pad outer periphery area detection signal. it can be set on the basis of the S _a.

As another example of optimization, optimization using a driver monitor information detection signal S _D (biological information) is also possible. The biometric information based on the driver monitor information detection signal _SD is used as an evaluation function, and an optimal solution is obtained while selecting an algorithm for calculating a result that maximizes or minimizes the evaluation function and changing parameters used in the algorithm. It is a technique to search for. As the biological information related to the driver, for example, biological information such as a heart rate is measured, and a value based on a difference from the reference value (steady value) of the heart rate is defined as an evaluation function. For example, the control unit 30 can optimize the evaluation function detected from the biological information of the driver that reacts to the vibration feedback at the time of the switch operation so that the evaluation function is minimized.

(Effect of embodiment)
The embodiment of the present invention has the following effects.
(1) The operating device 1 according to the embodiment of the present invention operates the operating unit 10 that operates with fingers and the like, the vibration actuator 40 that serves as a vibration presenting unit that performs vibration feedback on the operation, and the operating unit 10 A user state discriminating information detecting unit 20 for detecting user state discriminating information for discriminating a user state, and an optimization means for optimizing an algorithm of vibration feedback control by the vibration actuator 40 based on the user state discriminating information. And a control unit 30 provided. The control unit 30 selects an optimal algorithm as an algorithm for performing vibration feedback control based on the user state determination information by AI, deep learning, machine learning, or the like, and sets parameters in the selected algorithm to the user state The vibration feedback control is performed by the selected algorithm while changing based on the discrimination information. Thereby, the optimization means which enables the optimal vibration feedback according to a user state can be provided.
(2) Optimization can derive, store and output each optimum control value in all states of the discrimination state. Deriving optimal control values in discrete states, which are a combination of several patterns for each state, and outputting them using an output algorithm that outputs optimal control values for all states using AI, deep learning, and machine learning Can do. Thereby, the optimization means which enables the optimal vibration feedback according to a user state can be provided.

  As mentioned above, although some embodiment of this invention was described, these embodiment is only an example and does not limit the invention which concerns on a claim. Moreover, these novel embodiments can be implemented in various other forms, and various omissions, replacements, changes, and the like can be made without departing from the scope of the present invention. In addition, not all the combinations of features described in these embodiments are essential to the means for solving the problems of the invention. Furthermore, these embodiments are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... Operation apparatus, 8 ... Vehicle, 10 ... Operation part, 12 ... Touch pad, 14 ... Touch panel, 16 ... Steering touch pad, 18 ... Steering switch, 20 ... User state discrimination information detection part, 21 ... Steering grip detection part, 22 ... Steering grip position detection unit, 22a, 22b, 22c, 22d, 22e ... Touch electrode, 23 ... Driver monitor information detection unit, 24 ... User information unit, 25 ... Sheet position detection unit, 26 ... Touch pad outer peripheral area detection unit , 30 ... control unit, 34 ... position detection control unit, 35 ... load detection control unit, 36 ... optimization execution unit, 40 ..., vibration actuator, 81 ... instrument panel, 82 ... center console, 83 ... steering, 100 ... Finger, 101 ... thumb

Claims (4)

An operation unit for performing operations with fingers and the like;
A vibration presenting unit for performing vibration feedback on the operation;
A user state determination information detection unit for detecting user state determination information for determining a state of a user who operates the operation unit;
Based on the user state determination information, a control unit comprising optimization means for optimizing an algorithm of vibration feedback control by the vibration presenting unit;
An operating device.   The operating device according to claim 1, wherein the optimization unit is based on AI, deep learning, or machine learning.   The operating device according to claim 1, wherein the optimization unit is selectable by the user.   The operating device according to any one of claims 1 to 3, wherein the operating unit is an in-vehicle switch mounted on a vehicle.

Images