JP2017049698A - Input device, display device, control method of input device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide in input device that suppresses obstacles to a voice input system due to vibration of the input device, a display device, a control method of the input device, and a program.SOLUTION: An input device 1 comprises: a detection part 11; at least one vibration element 30; an operation receiving part 12; a vibration control part 15; a voice receiving part 13; and an exclusive control part 14. The detection part 11 detects a position at which a user has contacted an operation surface. The vibration element vibrates the operation surface. The operation receiving part 12 receives a predetermined input operation based on a result of detection performed by the detection part 11. The vibration control part 15 controls the vibration element to be a vibration state according to the input operation received by the operation receiving part 12. The voice receiving part 13 receives the input of a voice. The exclusive control part 14 exclusively controls the reception of the input operation by the operation receiving part and reception of voice by the voice receiving part 13.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an input device, a display device, an input device control method, and a program.

  2. Description of the Related Art Conventionally, there is known an input device that notifies a user that an input has been accepted by giving a tactile sensation. In such an input device, for example, vibration is generated according to the pressing force by the user, thereby informing the user that the input has been accepted (see, for example, Patent Document 1).

JP 2013-235614 A

  However, in the conventional input device, the generated vibration may adversely affect a voice call system such as a telephone call or a voice recognition function. For example, when a user performs a phone call or input operation using a voice recognition function using a smartphone or the like in the vicinity of the input device, the vibration of the input device propagates to the air, resulting in noise during the call or voice recognition. There is a risk that the rate will decrease.

  The present invention has been made in view of the above, and provides an input device, a display device, an input device control method, and a program capable of suppressing troubles in a voice input system due to vibration of the input device. Objective.

  In order to solve the above-described problems and achieve the object, an input device of the present invention includes a detection unit, at least one vibration element, an operation reception unit, a vibration control unit, a voice reception unit, and an exclusive control unit. With. The detection unit detects a contact position of the user with respect to the operation surface. At least one vibration element vibrates the operation surface. The operation reception unit receives a predetermined input operation based on the detection result of the detection unit. The vibration control unit controls the vibration element so as to be in a vibration state according to the input operation received by the operation receiving unit. The voice receiving unit receives voice input. The exclusive control unit exclusively controls reception of the input operation by the operation reception unit and reception of the voice input by the voice reception unit.

  According to the present invention, it is possible to provide an input device, a display device, an input device control method, and a program capable of suppressing a trouble in a voice input system due to vibration of the input device.

FIG. 1 is a diagram illustrating an example of mounting an input device according to the first embodiment. FIG. 2 is a diagram illustrating an outline of the input device according to the first embodiment. FIG. 3 is a block diagram illustrating the configuration of the input device according to the first embodiment. FIG. 4 is a diagram illustrating an example of operation information. FIG. 5 is a diagram illustrating an example of a vibration state. FIG. 6 is a timing chart showing an example of the input method. FIG. 7 is an example of a display image. FIG. 8 is a flowchart illustrating an example of a first exclusive processing procedure of the input device according to the first embodiment. FIG. 9 is a flowchart illustrating an example of a second exclusive processing procedure of the input device according to the first embodiment. FIG. 10 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of the input device according to the embodiment. FIG. 11 is a block diagram illustrating a configuration of an input device according to the second embodiment.

  Hereinafter, embodiments of an input device, a display device, an input device control method, and a program disclosed in the present application will be described in detail with reference to the accompanying drawings. In addition, this invention is not limited by embodiment shown below.

[First embodiment]
<1. Outline of input device>
First, the outline | summary of the input device which concerns on 1st Embodiment is demonstrated using FIG. 1 and FIG. FIG. 1 is a diagram illustrating an example of mounting an input device according to the first embodiment. FIG. 2 is a diagram illustrating an outline of the input device according to the first embodiment.

  As shown in FIG. 1, the input device 1 according to the present embodiment is mounted on a vehicle. And the input device 1 shall be connected with the vehicle-mounted apparatus 2 (refer FIG. 3) via the network, for example. The input device 1 includes an operation unit 5 having an operation receiving member (hereinafter, referred to as an operation surface) such as a touch pad that receives a user's operation, and a microphone 3 that acquires a voice uttered by the user. For example, the driver can operate the in-vehicle device 2 by performing an input operation by contact operation or voice input on the input device 1.

  That is, the input device 1 can execute an input operation by a contact operation in which the user presses the operation surface and an input operation by inputting a voice to the microphone 3. Moreover, in the input device 1 according to the present embodiment, as will be described in detail later, an input operation by a contact operation and an input operation by voice are exclusively received.

  The in-vehicle device 2 is connected to a speaker 4 provided in the vehicle and can output audio data corresponding to the input operation from the speaker 4.

  The operation unit 5 of the input device 1 is disposed at a position where it can be easily operated by the driver, for example, near the shift lever S of the center console. In the example of FIG. 1, the operation unit 5 is disposed between the armrest R and the shift lever S. Therefore, the user can operate the operation surface with the arm placed on the armrest R. Thereby, the user can easily operate the input device 1 without changing the driving posture.

  The in-vehicle device 2 is, for example, a device such as a car navigation system, an air conditioner, and audio, and the in-vehicle device 2 includes a display unit 2A that displays a predetermined image. The image displayed on the display unit 2A is an image for performing vehicle navigation such as a map, a moving image on a television or the Internet, or an image representing the status of an air conditioner or audio. In addition, 2 A of display parts are provided in appropriate positions, such as the center position of a dashboard, for example.

  The in-vehicle device 2 can be connected to a mobile terminal such as a smartphone by short-range wireless communication such as Blue tooth (registered trademark). Therefore, the user can also operate the smartphone via the in-vehicle device 2 with the input device 1. As an example of the operation of the smartphone, for example, the user can make a hands-free call through the input device 1.

  Here, for example, when a user tries to perform an input operation with the input device 1 during driving, there is a possibility that the attention to driving may be diminished by visually recognizing the input device 1. Therefore, the input device 1 notifies the user's finger operating the input device 1 that the input operation has been accepted by giving a predetermined tactile sensation using vibration.

  The user can also input a desired operation with the input device 1 by voice input. Thereby, the user can easily perform an input operation without visually recognizing the input device 1.

  Here, the configuration of the input device 1 will be described with reference to FIG. As shown in FIG. 2, the input device 1 includes, as main components, an operation unit 5 and vibration elements 31 a and 31 b that vibrate an operation surface 5 </ b> A provided on the surface of the operation unit 5.

  The operation unit 5 is configured by, for example, a panel having an electrostatic capacity type information input function. When the user touches the operation surface 5A with a pointing device such as a finger or a touch pen, the input device 1 touches the user on the operation surface 5A. Detect position. The input device 1 receives the movement of the contact position by an operation based on a pressing force or the like.

  The vibration elements 31a and 31b are, for example, piezoelectric elements (piezo elements), and can vibrate the operation surface 5A of the operation unit 5 at high frequency. For example, when the vibration element 31a, 31b is vibrated with the user's finger pressing the operation surface 5A, air is drawn between the finger and the operation surface 5A due to pressure fluctuation due to the vibration, and an air layer is formed. And the frictional force between the operation surface 5A change. When the finger is moved in such a state, a tactile sensation corresponding to the changed frictional force can be given to the finger. Further, by changing the vibration state of the vibration elements 31a and 31b, the magnitude of the frictional force between the finger and the operation surface 5A can be changed, and the tactile sensation applied to the finger can be changed.

  Thus, the input device 1 according to the present embodiment is an input device that gives a tactile sensation to the user by vibrating the operation surface 5A using the vibration elements 31a and 31b. In the following description, the vibration elements 31a and 31b may be collectively referred to as the vibration element 31 in some cases.

  By the way, in the input device 1, if the contact operation and the voice input are performed simultaneously, the vibration of the vibration element 31 may propagate to the air, which may interfere with the voice input. Such obstacles to voice input include, for example, a reduction in recognition rate in voice recognition of voice input, noise generation in a telephone, and the like.

  Therefore, the input device 1 according to the present embodiment exclusively controls the touch operation and voice input of the input device 1. As an example, the input device 1 stops the reception of the contact operation when the voice input is being received, and stops the vibration of the vibration element 31. Thereby, the trouble to the voice input due to the vibration of the input device can be suppressed.

  Further, the input device 1 may attenuate a noise component generated by the vibration of the vibration element 31 instead of exclusively controlling the contact operation and the voice input. This point will be described later.

  In addition, although the case where the input apparatus 1 and the vehicle-mounted apparatus 2 are separate bodies was demonstrated here, it is not restricted to this. You may comprise the input device 1 and the vehicle equipment 2 integrally. Further, for example, instead of the display unit 2A of the in-vehicle device 2 provided on the dashboard, a head-up display projected onto a predetermined region L of the vehicle windshield may be used. Further, the input device 1 may be configured with a touch panel, for example, and the input device 1 may include a display unit.

  Moreover, although the description about the input device 1 demonstrated and demonstrated the case where it connected with the vehicle-mounted apparatus 2, it can also be directly connected with a smart phone, a tablet terminal, a personal computer etc., for example. Hereinafter, the input device 1 will be further described.

<2. Configuration of input device>
FIG. 3 is a block diagram illustrating a configuration of the input device 1 according to the first embodiment. The input device 1 includes an operation unit 5, a vibration unit 30, a microphone 3, a control unit 10, and a storage unit 20. The input device 1 is connected to the in-vehicle device 2 and the speaker 4.

<2.1. Operation unit>
The operation unit 5 is a flat plate sensor such as a touch pad or a touch panel. The operation unit 5 includes an operation surface 5A that receives an input operation by a contact operation by a user. When the user touches the operation surface 5 </ b> A, the operation unit 5 outputs a sensor value corresponding to the contact position of the user to the control unit 10.

<2.2. Vibration unit>
The vibration unit 30 includes at least one vibration element 31. In the example illustrated in FIG. 2, the vibration unit 30 includes two vibration elements 31 a and 31 b. The vibration elements 31 a and 31 b are piezoelectric actuators such as piezoelectric elements (piezo elements), for example, and vibrate the operation unit 5 by expanding and contracting according to a voltage signal given from the control unit 10. The vibration elements 31a and 31b are disposed so as to be in contact with the operation unit 5 at a position where the user cannot visually recognize, for example, an end of the operation unit 5.

  In the example of FIG. 2, the vibration elements 31 a and 31 b are disposed on the left and right outer regions of the operation surface 5 </ b> A and on the surface facing the operation surface 5 </ b> A of the operation unit 5. The number and arrangement of the vibration elements 31a and 31b shown in FIG. 2 are merely examples, and the present invention is not limited to this. For example, the operation surface 5A may be vibrated by one vibration element 31a. As described above, the number and arrangement of the vibration elements 31a and 31b are arbitrary, but it is desirable that the number and arrangement be such that the entire operation surface 5A is vibrated uniformly.

  Although the case where piezoelectric elements are used as the vibration elements 31a and 31b has been described here, the present invention is not limited to this, and any element that vibrates the operation surface 5A in the ultrasonic frequency band may be used. The vibration elements 31a and 31b may be elements that vibrate in the same frequency band, or may be elements that vibrate in different frequency bands. Further, an element that vibrates outside the ultrasonic frequency band may be further provided. Thereby, the input device 1 can vibrate not only the operation surface 5A but also the input device 1 itself.

<2.3. Microphone and Speaker>
The microphone 3 is a voice input unit that acquires the voice of the user. The audio data acquired by the microphone 3 is output to the control unit 10. The speaker 4 is an audio output unit that outputs audio based on audio data input from the control unit 10. When the in-vehicle device 2 includes the microphone 3, the input device 1 may be configured not to include the microphone 3.

<2.4. Control unit>
The control unit 10 controls each unit of the input device 1. Further, the control unit 10 outputs a signal corresponding to the input operation received via the operation unit 5 and the microphone 3 to the in-vehicle device 2 and the speaker 4. The control unit 10 includes a detection unit 11, an operation reception unit 12, a voice reception unit 13, an exclusive control unit 14, a vibration control unit 15, and an information processing unit 16.

<2.4.1. Detector>
Based on the sensor value output by the operation unit 5, the detection unit 11 detects the contact position of the user with respect to the operation surface 5A. For example, when the detection unit 11 detects the contact position of the user at a predetermined cycle, even when the user's finger moves on the operation surface 5A and the contact position changes, the detection unit 11 follows the change. Thus, the contact position can be detected. The detection unit 11 outputs information regarding the contact position, which is a detection result, to the operation reception unit 12.

<2.4.2. Operation reception unit>
The operation reception unit 12 receives a predetermined input operation based on the detection result of the detection unit 11 and the operation information 21 stored in the storage unit 20 when the exclusive control unit 14 permits the input operation. Information relating to the vibration state of the input operation is output to the exclusive control unit 14 in association with each other.

  Here, the operation information 21 stored in the storage unit 20 will be described with reference to FIGS. 4 and 5. FIG. 4 is an example of operation information. FIG. 5 is a diagram illustrating an example of a vibration state. In FIG. 5, for the sake of brevity, the virtual dial D that does not actually exist is shown on the operation surface 5 </ b> A.

  As shown in FIG. 4, for example, “operation”, “device”, “mode”, and “vibration state” are associated and stored in the operation information 21. “Operation” indicates an input operation performed on the operation surface 5A by the user, and the movement direction, movement distance, or movement speed of the finger is associated with the vibration state (vibration characteristics) of the operation surface 5A by the vibration element 31. . The “device” indicates a device operated by the “operation”, and the “mode” is information regarding the mode of the operated device. “Vibration state” indicates the vibration state of the operation surface 5A in each mode.

  In the example illustrated in FIG. 4, when the user draws “◯” on the operation surface 5 </ b> A with, for example, a finger, the input device 1 determines that the user's input operation is an air conditioner temperature adjustment mode transition request, and displays the determination result. While outputting to the vehicle-mounted apparatus 2, the operation part 5 vibrates in the vibration state (in this case, 1st vibration state) corresponding to a determination result.

  Specifically, the detection unit 11 of the control unit 10 outputs to the operation reception unit 12 a detection result corresponding to the movement of the finger that draws “◯” as an input operation by the user. Based on the acquired detection result and the operation information 21 stored in the storage unit 20, the operation reception unit 12 determines that the user's input operation is a request for shifting to the temperature adjustment mode of the air conditioner. Then, the determination result is output to the in-vehicle device 2. Further, the operation reception unit 12 outputs a signal indicating a vibration state (in this case, the first vibration state) corresponding to the determination result to the vibration control unit 15.

  When receiving the determination result from the control unit 10 of the input device 1, the in-vehicle device 2 shifts to the temperature adjustment mode of the air conditioner. On the other hand, the vibration control unit 15 of the control unit 10 controls the vibration element 31 to vibrate in the first vibration state when the user's finger comes into contact with the operation surface 5A after obtaining the determination result.

  For example, assume that the user touches the operation surface 5A shown in FIG. 5 and rotates the finger while imagining an actual dial. That is, when the finger is moved in the direction of the arrow in the figure so as to rotate the virtual dial D as shown, the operation surface 5A vibrates in the first vibration state, and the user feels as if the user is turning the dial. can get.

  Specifically, the vibration control unit 15 switches on / off the vibration of the vibration element 31 at a predetermined cycle in conjunction with the operation of the user rotating the virtual dial D. As a result, the frictional force between the operation surface 5A and the finger fluctuates with the ON / OFF cycle of the vibration element 31, so that, for example, a tactile sensation in which the click feeling continues in a very short cycle, that is, an actual dial is turned The user can be given a tactile sensation.

  In this way, the user performs an input operation (input operation for rotating the virtual dial D) for rotating the finger in a predetermined direction on the operation surface 5A with the feeling that the actual dial is operated with the finger. Can be adjusted. For example, in this case, when the user's finger comes into contact with the operation surface 5A, the vibration control unit 15 selects the first vibration state and, for example, changes the temperature by 0.5 degrees to change one dial. The vibration unit 30 is controlled to vibrate the operation surface 5A so that a tactile sensation to be rotated is obtained.

  At this time, the input device 1 may output a sound effect such as “click” in conjunction with the rotation of the virtual dial D from the speaker 4. This makes it easier for the user to recognize the operation by hearing due to the synergistic effect with the sound effect.

  In FIG. 5, for the sake of brevity, a virtual dial D that does not actually exist is displayed. However, a dial image imitating an actual dial may be displayed on the input device 1. . When displaying such a dial image, the input device 1 includes a display unit such as a touch panel.

  As shown in FIG. 4, the operation information 21 is associated with information corresponding to an operation that can be easily input by the user such as “T”, “?”, “G”, etc. in addition to “◯”. Remembered. As a result, the user can easily make a desired mode transition request.

  In the example of FIG. 4, for example, the operation “T” corresponds to the telephone directory calling mode, the operation “?” Corresponds to the Internet search mode, and the operation “G” corresponds to the destination setting mode by car navigation.

  Further, the operation information 21 is associated with an input operation common to all devices in addition to the mode transition request. For example, the operation “x” cancels the mode transition. In addition, common input operations include operations such as a “pinch (pinch in / pinch out) operation” for reducing and enlarging an image and a “rotate operation” for rotating an image.

  In addition, the vibration control unit 15 controls, for example, a so-called “gritty” tactile sensation in the second vibration state and a vibration intensity, period and frequency of the vibration element 31 such as “smooth” tactile sensation in the third vibration state. By doing so, various tactile sensations can be given to the user. Note that the operation information 21 illustrated in FIG. 4 is an example, and can be customized by the user.

  Returning to the description of FIG. 3, the description of the operation receiving unit 12 is continued. In the arrangement example of the input device 1 shown in FIG. 1, when the user places his arm on the armrest R, the user's hand may unintentionally touch the operation surface 5A.

  Therefore, the operation reception unit 12 may invalidate the operation based on the contact area of the operation detected by the detection unit 11. That is, it can be assumed that the user's input operation is performed with a finger or a touch pen, and the contact area for receiving the input operation can be set within a predetermined allowable range.

  Therefore, for example, when the entire palm of the user is in contact with the operation surface 5A, the contact area may exceed the allowable range because the user may consider the contact state not intended for the contact operation. The contact operation can be determined to be invalid.

<2.4.3. Voice reception>
The voice reception unit 13 receives voice input of voice data acquired by the microphone 3 when the exclusive control unit 14 permits reception of voice input, converts the received voice data into text data, and the text. Data is output to the exclusive control unit 14.

  When the user is making a telephone call, for example, via the input device 1 in a hands-free state, the voice receiving unit 13 is acquired by the microphone 3 without executing the above-described processing. Audio data is output to the speaker 4.

<2.4.4. Exclusive control unit>
The exclusive control unit 14 exclusively controls reception of an input operation by the operation reception unit 12 and reception of a voice input by the voice reception unit 13, and turns on / off vibration of the vibration element 31 via the vibration control unit 15. Controls OFF and amplitude.

  Specifically, when the operation receiving unit 12 is receiving an input operation, the exclusive control unit 14 stops receiving voice input by the voice receiving unit 13 and causes the vibration control unit 15 to vibrate the vibration element 31. On the other hand, when the voice reception unit 13 is receiving voice input, the operation reception by the operation reception unit 12 is stopped.

  In other words, the exclusive control unit 14 performs control so that the operation receiving unit 12 and the voice receiving unit 13 are not receiving inputs at the same time. Further, the exclusive control unit 14 causes the vibration control unit 15 to stop the vibration of the vibration element 31 when the voice input by the voice receiving unit 12 is being received. Thereby, when the voice reception unit 13 is receiving voice input, the vibration element 31 does not vibrate. Therefore, the input device 1 according to the present embodiment can suppress troubles in the voice input system due to the vibration of the vibration element 31.

  Moreover, the exclusive control part 14 is good also as switching the input reception by the operation reception part 12 and the audio | voice reception part 13 with a predetermined period. For example, if the exclusive control unit 14 switches the input reception by the operation reception unit 12 and the voice reception unit 13 with a very short cycle, the input operation by the operation reception unit 12 and the vibration of the vibration element 31 are substantially reduced. Is not blocked.

  On the other hand, for example, if the voice reception unit 13 acquires voice data from the microphone 3 through a low-pass filter, the voice reception unit 13 may supplement and acquire voice data during a period in which input reception by the voice reception unit 13 is blocked. it can.

  Therefore, the input reception by the operation reception unit 12 and the sound reception unit 13 is not substantially blocked. Thereby, the user can simultaneously perform a touch operation and voice input on the input device 1.

  As an example of the exclusive control process, the exclusive control unit 14 causes the vibration control unit 15 to stop the reception of the input operation by the operation reception unit 12 when the voice reception unit 13 is receiving the voice input. An instruction to reduce the amplitude of the vibration element 31 may be output.

  It is preferable to reduce the amplitude of the vibration element 31 to such an extent that it does not hinder the voice input system described above, and it is determined by experimentation in consideration of the mounting position of the vibration element 31 and the microphone 3 at the time of design. Good. Thereby, even if the operation reception part 12 and the audio | voice reception part 13 are receiving input, the trouble to the audio | voice input system by the vibration of the vibration element 31 can be reduced.

<2.4.5. Vibration control unit>
The vibration control unit 15 controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation receiving unit 12. First, the vibration control unit 15 acquires vibration state information based on the input operation from the exclusive control unit 14. Subsequently, when an operation input is performed on the operation surface 5A, the vibration control unit 15 controls the vibration element 31 of the vibration unit 30 so that the operation surface 5A enters a vibration state based on the vibration state information.

<2.4.6. Information Processing Department>
The information processing unit 16 acquires input operation information and text data from the operation receiving unit 12 and the voice receiving unit 13 via the exclusive control unit 14, executes processing corresponding to the information, and outputs the processing result to the in-vehicle device 2. And output to the speaker 4.

<2.5. Storage unit>
The storage unit 20 stores, for example, the operation information 21 described above as information necessary for processing performed by the operation reception unit 12, and stores various processing results. The storage unit 20 is a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. Note that the input device 1 may acquire part or all of the information stored in the storage unit 20 via a network such as the Internet.

<3. Input processing>
Subsequently, an input method of the input device 1 will be described with reference to FIGS. 6 and 7. FIG. 6 is a timing chart showing an example of the input method. FIG. 7 is an example of a display image. Here, a case where the user uses the input device 1 to set, for example, Tokyo Sky Tree as a destination for car navigation will be described. Further, in the following description, the state in which the exclusive control unit 14 permits the input reception by the operation reception unit 12 or the voice reception unit 13 is “ON state”, and the state in which reception is stopped is “OFF state”. It describes.

  As shown in FIG. 6, for example, when the user has not performed any touch operation or voice input on the input device 1 (input operation accepted: OFF, voice input accepted: OFF), the operation accepting unit 12. Is in the ON state, and the voice reception unit 13 is in the OFF state (time t0 to t1). In this state, when the user writes “G” with the finger on the operation surface 5A from the time t1, for example, the vibration control unit 15 vibrates the operation surface 5A in a vibration state corresponding to the input operation (time). t1-t2).

  The operation reception unit 12 determines the input operation as a car navigation destination setting mode transition request (see FIG. 4), and outputs the determination result to the exclusive control unit 14 and the in-vehicle device 2.

  When acquiring the determination result, the exclusive control unit 14 waits for a predetermined time (time t2 to t3), for example, and shifts the operation receiving unit 12 to the OFF state and the voice receiving unit 13 to the ON state (time t3). ). When the in-vehicle device 2 acquires the determination result from the input device 1, the in-vehicle device 2 shifts to the car navigation destination setting mode.

  During the period from time t2 to time t3, the input device 1 outputs a voice guidance such as “Where do you want to set the destination?” From the speaker 4. Here, since the voice reception unit 13 is in the OFF state during the voice guidance, erroneous input due to the voice guidance can be prevented. Further, since the operation accepting unit 12 is in the ON state during this period, for example, when the user draws “x” on the operation surface 5A, the operation accepting unit 12 accepts the contact operation and cancels the mode transition request. (See FIG. 4).

  When the exclusive control unit 14 switches between the ON / OFF states of the operation reception unit 12 and the voice reception unit 13, the input device 1 notifies the user of such a state. Such a notification method is, for example, vibration of the operation surface 5A, voice by the speaker 4, a navigation image displayed on the display unit 2A, or the like.

  Alternatively, for example, a light emitter may be provided at a position (for example, a handle) visible to the user, and the state of the operation reception unit 12 and the sound reception unit 13 may be notified by the color of the light emitter. Thereby, the user can easily grasp the ON / OFF state of the operation reception unit 12 and the voice reception unit 13.

  Upon receiving the voice guidance, the user utters “Tokyo Sky Tree” so as to interact with the voice guidance during the period of time t4 to t5, so that the voice reception unit 13 converts the voice data into text data. To the in-vehicle device 2.

  Thereby, for example, the in-vehicle device 2 starts searching for candidate sites corresponding to the Tokyo Sky Tree from the map information stored in the in-vehicle device 2, and outputs the search result to the display unit 2A (see FIG. 7).

  When the reception of the voice input by the voice receiving unit 13 is completed, the exclusive control unit 14 shifts the voice receiving unit 13 to the OFF state and the operation receiving unit 12 to the ON state (after time t6).

  In the example shown in FIG. 7, there are 20 candidate sites corresponding to the Tokyo Sky Tree, and a list of some candidate sites is displayed on the display unit 2A of the in-vehicle device 2. For example, a pointer P and an operation button B are displayed on the display unit 2A. The user selects a destination from the candidate locations according to the position of the pointer P, and operates the pointer P by a touch operation on the operation surface 5A. Here, for example, the operation button B and the vibration state of the operation surface 5A may be interlocked.

  That is, when the user moves his / her finger up and down with the finger touching the operation surface 5A, a tactile sensation to operate the operation button B is obtained. Specifically, the vibration control unit 15 controls ON / OFF of vibration of the vibration element 31 in accordance with a contact operation in which the user moves the position of the pointer P by one, and actually operates the button B to the user. A tactile sensation is given (t7 to t8).

  When the pointer P reaches a desired candidate location, the user determines a destination by performing a predetermined operation (for example, a tap operation). Then, the operation reception unit 12 outputs the input operation to the in-vehicle device 2. Here, the input device 1 outputs a voice guidance such as “Are you sure you want the destination here?” From the speaker 4.

  When the user performs a predetermined operation (for example, a tap operation), the input device 1 determines a destination and outputs a message to that effect to the in-vehicle device 2. Thereby, the destination setting of the car navigation is completed.

  As described above, the exclusive control unit 14 exclusively controls the ON / OFF states of the operation receiving unit 12 and the voice receiving unit 13 in accordance with a user input operation. Thereby, the user can properly use the contact operation and the voice input appropriately. Therefore, the user can easily perform a desired input operation. Further, the input device 1 can narrow down the purpose of the user's utterance to be continued by performing a mode transition by an input operation in advance. This increases the accuracy of the voice input process.

  In addition, when the voice reception unit 13 is in an ON state (for example, times t3 to t6), if the user performs a contact operation without performing voice input, the exclusive control unit 14 sets the voice reception unit 13 in the OFF state and operates The reception unit 12 may be shifted to the ON state, and the operation reception unit 12 may receive the contact operation.

  Alternatively, when the voice reception unit 13 is in the ON state (for example, times t3 to t6), if the user does not input a voice for a predetermined period, the exclusive control unit 14 turns the voice reception unit 13 in the OFF state and the operation reception unit 12 May be shifted to the ON state.

  In addition, when the user performs a predetermined operation (for example, a double tap operation) while the operation reception unit 12 is in the ON state (for example, after time t6), the exclusive control unit 14 sets the voice reception unit 13 to the ON state. The operation receiving unit 12 may be shifted to the OFF state. Thereby, the user looks at the displayed candidate list, and the user sets a destination by uttering a voice corresponding to a display screen such as “second” or “Tokyo Skytree first parking lot”, for example. be able to.

  In addition, although the case where the exclusive control unit 14 switches between the ON / OFF states of the operation receiving unit 12 and the voice receiving unit 13 has been described here, the present invention is not limited thereto. For example, the exclusive control unit 14 sets both the operation receiving unit 12 and the voice receiving unit 13 to the ON state, and when the operation receiving unit 12 receives the touch operation, only the voice receiving unit 13 is shifted to the OFF state. You may decide to control.

<4. Control processing>
Next, an exclusive processing procedure executed by the input device 1 according to the present embodiment will be described with reference to FIGS. 8 and 9. FIG. 8 is a flowchart illustrating an example of a first exclusive processing procedure of the input apparatus 1 according to the first embodiment. FIG. 9 is a flowchart illustrating an example of the second exclusive processing procedure of the input apparatus 1 according to the first embodiment.

  Here, the exclusive processing procedure when the touch operation is performed on the input device 1 is described as the first exclusive processing procedure, and the exclusive processing procedure when the voice input is performed is described as the second exclusive processing procedure. Do.

  As shown in FIG. 8, in the first exclusion process, the exclusion controller 14 of the input device 1 determines whether or not the operation acceptance unit 12 is ON when the detection unit 11 detects contact with the operation surface 5A. (Step S101). Here, when the operation reception unit 12 is ON (step S101, Yes), the exclusive control unit 14 prohibits reception of audio by the audio reception unit 13 (step S102).

  Subsequently, the exclusive control unit 14 controls the in-vehicle device 2 and the speaker 4 via the information processing unit 16, notifies the user that the voice reception is prohibited (step S103), and ends the process. On the other hand, if it is determined in step S101 that the operation reception unit 12 is OFF (step S101, No), the exclusive control unit 14 permits the voice reception by the voice reception unit 13 (step S104) and performs processing. Exit.

  Next, the second exclusive processing procedure of the input device 1 will be described with reference to FIG. As shown in FIG. 9, first, the exclusive control unit 14 of the input device 1 determines whether or not the voice reception unit 13 is turned on when voice input is performed on the microphone 3 (step S <b> 201). Here, the exclusive control unit 14 prohibits the reception of the operation by the operation reception unit 12 when the voice reception unit 13 is ON (step S201, Yes) (step S202).

  Subsequently, the exclusive control unit 14 controls the in-vehicle device 2 and the speaker 4 via the information processing unit 16, notifies the user that the operation reception is prohibited (step S203), and ends the process. On the other hand, if it is determined in step S201 that the voice reception unit 13 is OFF (step S201, No), the exclusive control unit 14 permits the operation reception by the operation reception unit 12 (step S204), and the process Exit.

<5. Hardware configuration>
The input device 1 according to the present embodiment can be realized by a computer 600 having a configuration shown as an example in FIG. FIG. 10 is a hardware configuration diagram illustrating an example of a computer that implements the functions of the input device 1.

  The computer 600 includes a CPU (Central Processing Unit) 610, a ROM (Read Only Memory) 620, a RAM (Random Access Memory) 630, and an HDD (Hard Disk Drive) 640. The computer 600 also includes a media interface (I / F) 650, a communication interface (I / F) 660, and an input / output interface (I / F) 670.

  The computer 600 may include an SSD (Solid State Drive), and the SSD may execute a part or all of the functions of the HDD 640. Further, an SSD may be provided instead of the HDD 640.

  The CPU 610 operates based on a program stored in at least one of the ROM 620 and the HDD 640 and controls each unit. The ROM 620 stores a boot program executed by the CPU 610 when the computer 600 starts up, a program depending on the hardware of the computer 600, and the like. The HDD 640 stores a program executed by the CPU 610, data used by the program, and the like.

  The media I / F 650 reads programs and data stored in the storage medium 680 and provides them to the CPU 610 via the RAM 630. The CPU 610 loads such a program from the storage medium 680 onto the RAM 630 via the media I / F 650, and executes the loaded program. Alternatively, the CPU 610 executes a program using such data. The storage medium 680 is, for example, a magneto-optical recording medium such as a DVD (Digital Versatile Disc), an SD card, or a USB memory.

  The communication I / F 660 receives data from other devices via the network 690 and sends the data to the CPU 610, and transmits the data generated by the CPU 610 to other devices via the network 690. Alternatively, the communication I / F 660 receives a program from another device via the network 690, sends the program to the CPU 610, and the CPU 610 executes the program.

  The CPU 610 controls a display unit 2A such as a display, an output unit such as a speaker 4, and an input unit such as a keyboard, a mouse, a button, and an operation unit 5 via an input / output I / F 670. The CPU 610 acquires data from the input unit via the input / output I / F 670. In addition, the CPU 610 outputs the generated data to the display unit or the output unit via the input / output I / F 670.

  For example, when the computer 600 functions as the input device 1, the CPU 610 of the computer 600 executes the program loaded on the RAM 630, so that the detection unit 11, the operation reception unit 12, and the voice reception unit 13 are exclusive. Each function of the control unit 14, the vibration control unit 15, and the information processing unit 16 is realized.

  For example, the CPU 610 of the computer 600 reads these programs from the storage medium 680 and executes them, but as another example, these programs may be acquired from other devices via the network 690. Further, the HDD 640 can store information stored in the storage unit 20.

  As described above, the input device 1 according to this embodiment includes the detection unit 11, at least one vibration element 31, the operation reception unit 12, the vibration control unit 15, the voice reception unit 13, and the exclusive control unit. 14. The detection unit 11 detects the contact position of the user with respect to the operation surface 5A. At least one vibration element 31 vibrates the operation surface 5A. The operation reception unit 12 receives a predetermined input operation based on the detection result of the detection unit 11. The vibration control unit 15 controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation receiving unit 12. The voice reception unit 13 receives a voice input. The exclusive control unit 14 exclusively controls reception of an input operation by the operation reception unit 12 and reception of a voice input by the voice reception unit 13. Thereby, it is possible to prevent the voice input from being hindered by the vibration of the input device 1 caused by the vibration element 31.

[Second Embodiment]
Subsequently, a modification of the present embodiment will be described with reference to FIG. FIG. 11 is a block diagram illustrating a configuration of the input device 1 according to the second embodiment.

  As illustrated in FIG. 11, the input device 1 according to the second embodiment includes a rear stage of the microphone 3 instead of the exclusive control unit 14 (see FIG. 3) of the configuration of the input device 1 according to the first embodiment. That is, the attenuation unit 17 is provided between the microphone 3 and the voice reception unit 13. The same components as those of the display device 1 shown in FIG.

  When the sound data acquired from the microphone 3 includes a noise component generated by the vibration of the vibration elements 31a and 31b, the attenuation unit 17 attenuates the noise component. For example, when the noise component is detected from the audio data acquired from the microphone 3, the attenuation unit 17 generates a pulse having a phase opposite to that of the noise component. Subsequently, the attenuator 17 superimposes such pulses on the audio data, thereby obtaining audio data with a noise component attenuated. Such audio data is input to the audio reception unit 13.

  The input device 1 may be configured to include a filter that cuts a specific frequency band as the attenuation unit 17. Such a filter is, for example, a filter that cuts the frequency band of the noise component, and is provided, for example, at the subsequent stage of the microphone 3.

  Thereby, the voice reception unit 13 can acquire voice data in which noise components generated by vibration of the vibration element 31 are attenuated or cut. Therefore, in the input device 1 according to the present embodiment, even if the vibration element 31 vibrates, and the vibration propagates and is input to the microphone 3, it is possible to suppress troubles in voice input.

  For example, the user can simultaneously perform an input operation and a voice input with the input device 1. For example, the user can perform an input operation using the input device 1 even during a hands-free call.

  As described above, the input device 1 according to this embodiment includes the detection unit 11, at least one vibration element 31, the operation reception unit 12, the vibration control unit 15, the voice reception unit 13, and the attenuation unit 17. With. The detection unit 11 detects the contact position of the user with respect to the operation surface 5A. At least one vibration element 31 vibrates the operation surface 5A. The operation reception unit 12 receives a predetermined input operation based on the detection result of the detection unit 11. The vibration control unit 15 controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation receiving unit 12. The voice reception unit 13 receives a voice input. The attenuation unit 17 attenuates a noise component generated by the vibration of the vibration element 31. Thereby, the trouble to the voice input due to the vibration of the input device 1 can be suppressed.

  By the way, in the embodiment described above, the input device 1 has been described as including the microphone 3 for inputting voice and the attenuation unit 17 provided between the microphone 3 and the voice receiving unit 13. However, the input device 1 has a configuration in which the microphone 3 and the attenuation unit 17 are provided outside the input device 1 and can be connected to the input device 1 by, for example, wired or wireless line input, that is, function as an input system. It may be configured to.

  In the above-described embodiment, the case where the exclusive control unit 14 stops receiving the input operation by the operation receiving unit 12 when the voice receiving unit 13 is receiving the voice input has been described. When 13 is accepting a voice input, an input operation by the operation accepting unit 12 is accepted, but a tactile sensation using vibration may not be given to the input operation.

  In the above-described embodiment, the case where the user performs input using only the input device 1 has been described. However, when the display unit 2A of the in-vehicle device 2 serves as a display device such as a touch panel, the user can input It is good also as performing input operation using the apparatus 1 and 2 A of display parts together.

  According to the embodiment described above, the following input device 1, display device, control method of the input device 1, and program can be realized.

  (1) A detection unit 11 that detects a contact position of the user with respect to the operation surface 5A, at least one vibration element 31 that vibrates the operation surface 5A, and an operation reception unit that receives a predetermined input operation based on the detection result of the detection unit 11. 12, a vibration control unit 15 that controls the vibration element 31 to be in a vibration state according to an input operation received by the operation reception unit 12, a voice reception unit 13 that receives voice input, and an input by the operation reception unit 12 An input device 1 including an exclusive control unit 14 that exclusively controls operation reception and voice input reception by the voice reception unit 13.

  (2) In the input device 1 of the above (1), the exclusive control unit 14 causes the operation receiving unit 12 to stop receiving an input operation when the voice receiving unit 13 is receiving a voice input, and the vibration control unit An input device 1 that causes the vibration element 31 to stop at 15.

  (3) In the input device 1 of the above (2), the exclusive control unit 14 restarts the reception of the input operation by the operation reception unit 12 when the reception of the voice input by the voice reception unit 13 is completed.

  (4) In the input device 1 of (1) to (3) above, the exclusive control unit 14 causes the voice receiving unit 13 to stop receiving voice input when the operation receiving unit 12 is receiving input operation. Input device 1.

  (5) In the input device 1 of the above (4), the exclusive control unit 14 causes the voice receiving unit 13 to resume receiving voice input when the input receiving by the operation receiving unit 12 is completed.

  (6) In the input device 1 of (1), the exclusive control unit 14 causes the vibration control unit 15 to reduce the amplitude of the vibration element 31 when the voice receiving unit 13 is receiving a voice input. An input device 1.

  According to the input device 1 of (1) to (6) above, it is possible to suppress troubles in the voice input system due to vibration of the input device 1.

  (7) The detection unit 11 that detects the contact position of the user with respect to the operation surface 5A, at least one vibration element 31 that vibrates the operation surface 5A, and the operation reception unit that receives a predetermined input operation based on the detection result of the detection unit 11 12, a vibration control unit 15 that controls the vibration element 31 to be in a vibration state according to the input operation received by the operation reception unit 12, and an attenuation unit 17 that attenuates a noise component generated by the vibration of the vibration element 31. An input device 1 comprising:

  According to the input device 1 of the above (7), even if the input device 1 vibrates, and the vibration propagates and is input to the input device 1, it is possible to suppress troubles in voice input.

  (8) A display device comprising: the input device 1 according to any one of (1) to (7) above; and a display unit that displays an image corresponding to the input operation and voice input received by the input device 1. .

  According to the display device of (8) above, the user can confirm the input operation also from the image displayed on the display unit. Thereby, user operability is improved.

  (9) A control method of the input device 1, which includes a detection step of detecting a contact position of the user with respect to the operation surface 5 </ b> A, a vibration step of vibrating the operation surface 5 </ b> A by at least one vibration element 31, and detection of the detection unit 11. An operation reception step for receiving a predetermined input operation based on the result, a vibration control step for controlling the vibration element 31 to be in a vibration state according to the input operation received by the operation reception step, and a voice reception step for receiving voice input And an exclusive control step for exclusively controlling reception of an input operation in the operation reception step and reception of a voice input in the voice reception step.

  According to the control method of the input device 1 of (9) above, it is possible to provide a control method of the input device 1 that can suppress troubles in the voice input system due to vibration of the input device 1.

  (10) A control method of the input device 1, which is a detection step of detecting a contact position of the user with respect to the operation surface 5A, a vibration step of vibrating the operation surface 5A by at least one vibration element 31, and a detection result of the detection step An operation reception step for receiving a predetermined input operation based on the above, a vibration control step for controlling the vibration element 31 to be in a vibration state according to the input operation received by the operation reception step, and noise generated by vibration of the vibration element 31 An input device control method including an attenuation step of attenuating a component.

  According to the control method of the input device 1 of the above (10), even if the input device 1 vibrates and the vibration propagates and is input to the input device 1, it is possible to suppress troubles in voice input. Therefore, it is possible to provide a method for controlling the input device 1 capable of performing

  (11) A control program for the input device 1, which is a detection step for detecting a contact position of the user with respect to the operation surface 5 </ b> A, a vibration step for vibrating the operation surface 5 </ b> A by at least one vibration element 31, and a detection result of the detection step An operation reception step for receiving a predetermined input operation based on the above, a vibration control step for controlling the vibration element 31 to be in a vibration state according to the input operation received by the operation reception step, and a voice reception step for receiving a voice input A program that causes a computer to execute an input operation reception by the operation reception step and an exclusive control step that exclusively controls reception of the voice input by the voice reception step.

  According to the program of the above (11), it is possible to provide a program that can suppress troubles in the voice input system due to vibration of the input device 1.

  (12) A program of the input device 1, which includes a detection step for detecting a contact position of the user with respect to the operation surface 5 </ b> A, a vibration step for vibrating the operation surface 5 </ b> A by at least one vibration element 31, and a detection result of the detection step. An operation reception step for receiving a predetermined input operation based on the vibration, a vibration control step for controlling the vibration element 31 to be in a vibration state according to the input operation received by the operation reception step, a voice reception step for receiving voice input, A program for causing a computer to execute an attenuation step for attenuating a noise component generated by vibration of the vibration element 31.

  According to the program of the input device 1 of the above (12), even if the input device 1 vibrates and the vibration propagates and is input to the input device 1, it is possible to suppress troubles in voice input. The program of the input device 1 which can be provided can be provided.

  Further effects and modifications can be easily derived by those skilled in the art. Thus, the broader aspects of the present invention are not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications can be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

DESCRIPTION OF SYMBOLS 1 Input device 2 Car-mounted apparatus 3 Microphone 4 Speaker 5 Operation part 10 Control part 11 Detection part 12 Operation reception part 13 Voice reception part 14 Exclusive control part 15 Vibration control part 16 Information processing part 17 Attenuation part 20 Storage part 21 Operation information 30 Vibration Part 31 Vibration element

Claims (12)

A detection unit for detecting a contact position of the user with respect to the operation surface;
At least one vibration element that vibrates the contact surface;
An operation receiving unit that receives a predetermined input operation based on the detection result of the detection unit;
A vibration control unit that controls the vibration element to be in a vibration state according to the input operation received by the operation reception unit;
A voice reception unit for receiving voice input;
An input device comprising: an exclusive control unit that exclusively controls reception of the input operation by the operation reception unit and reception of the voice input by the voice reception unit. The exclusive control unit includes:
2. The vibration control unit stops the vibration element by stopping reception of the input operation by the operation reception unit when the voice reception unit is receiving the voice input. The input device described. The exclusive control unit includes:
The input device according to claim 2, wherein when the reception of voice input by the voice reception unit is completed, the operation reception unit restarts reception of the input operation. The exclusive control unit includes:
4. The input device according to claim 1, wherein the voice receiving unit stops receiving the voice input when the operation receiving unit is receiving the input operation. 5. The exclusive control unit includes:
The input device according to claim 4, wherein when receiving the input operation by the operation receiving unit ends, the voice receiving unit restarts receiving the voice input. The exclusive control unit includes:
2. The input device according to claim 1, wherein when the voice receiving unit is receiving the voice input, the vibration control unit reduces the amplitude of the vibration element. A detection unit for detecting a contact position of the user with respect to the operation surface;
At least one vibration element for vibrating the operation surface;
An operation receiving unit that receives a predetermined input operation based on the detection result of the detection unit;
A vibration control unit that controls the vibration element to be in a vibration state according to the input operation received by the operation reception unit;
A voice reception unit for receiving voice input;
An input device comprising: an attenuation unit that attenuates a noise component generated by vibration of the vibration element. The input device according to any one of claims 1 to 7,
A display device comprising: a display unit configured to display an image corresponding to the input operation received by the input device and the voice input. An input device control method comprising:
A detection step of detecting a contact position of the user with respect to the operation surface;
A vibration step of vibrating the operation surface by at least one vibration element;
An operation reception step for receiving a predetermined input operation based on the detection result of the detection step;
A vibration control step of controlling the vibration element so as to be in a vibration state according to the input operation received by the operation reception step;
A voice reception process for receiving voice input;
A method for controlling an input device, comprising: receiving the input operation in the operation receiving step; and exclusive control step for exclusively controlling reception of the voice input in the voice receiving step. An input device control method comprising:
A detection step of detecting a contact position of the user with respect to the operation surface;
A vibration step of vibrating the operation surface by at least one vibration element;
An operation reception step for receiving a predetermined input operation based on the detection result of the detection step;
A vibration control step of controlling the vibration element so as to be in a vibration state according to the input operation received by the operation reception step;
A voice reception process for receiving voice input;
And a damping step for attenuating a noise component generated by vibration of the vibrating element. A detection step for detecting a contact position of the user with respect to the operation surface;
A vibration step of vibrating the operation surface by at least one vibration element;
An operation reception step for receiving a predetermined input operation based on the detection result of the detection step;
A vibration control step of controlling the vibration element so as to be in a vibration state according to the input operation received by the operation reception step;
A voice reception step for receiving voice input;
A program for causing a computer to execute the input operation reception by the operation reception step and the exclusive control step of exclusively controlling reception of the voice input by the voice reception step. A detection step for detecting a contact position of the user with respect to the operation surface;
A vibration step of vibrating the operation surface by at least one vibration element;
An operation reception step for receiving a predetermined input operation based on the detection result of the detection step;
A vibration control step of controlling the vibration element so as to be in a vibration state according to the input operation received by the operation reception step;
A voice reception step for receiving voice input;
A program for causing a computer to execute an attenuation step for attenuating a noise component generated by vibration of the vibration element.

Images