JP6960716B2 - Input device, display device, input device control method and program - Google Patents

Description

The present invention is an input device, a display device, a control method and a program of the input device.

Conventionally, there is known an input device that notifies a user that an input has been received by giving a tactile sensation. In such an input device, for example, by generating vibration in response to a pressing force by the user, the user is notified that the input has been accepted (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2013-235614

However, in the conventional input device, the generated vibration may adversely affect the telephone call and the voice input system such as the voice recognition function. For example, when a user performs a call or an input operation using a voice recognition function using a smartphone or the like in the vicinity of an input device, the vibration of the input device propagates to the air and causes noise during a call or voice recognition. The rate may decrease.

The present invention has been made in view of the above, and provides an input device, a display device, a control method and a program of the input device capable of suppressing an obstacle to the voice input system due to the vibration of the input device. The purpose.

In order to solve the above-mentioned problems and achieve the object, the input device of the present invention includes a detection unit, at least one vibration element, an operation reception unit, a vibration control unit, a voice reception unit, and an exclusive control unit. And. The detection unit detects the contact position of the user with respect to the operation surface. At least one vibrating element vibrates the operating surface. The operation receiving unit receives a predetermined input operation based on the detection result of the detection unit. The vibration control unit controls the vibration element so that the vibration state corresponds to the input operation received by the operation reception unit. The voice reception unit accepts voice input. The exclusive control unit exclusively controls the reception of the input operation by the operation reception unit and the reception of the voice input by the voice reception unit.

According to the present invention, it is possible to provide an input device, a display device, a control method and a program of the input device capable of suppressing an obstacle to the voice input system due to the vibration of the input device.

FIG. 1 is a diagram showing an example of mounting an input device according to the first embodiment. FIG. 2 is a diagram showing an outline of the input device according to the first embodiment. FIG. 3 is a block diagram showing a configuration of an input device according to the first embodiment. FIG. 4 is a diagram showing an example of operation information. FIG. 5 is a diagram showing an example of a vibration state. FIG. 6 is a timing chart showing an example of the input method. FIG. 7 is an example of a display image. FIG. 8 is a flowchart showing an example of the first exclusive processing procedure of the input device according to the first embodiment. FIG. 9 is a flowchart showing an example of a second exclusive processing procedure of the input device according to the first embodiment. FIG. 10 is a hardware configuration diagram showing an example of a computer that realizes the function of the input device according to the embodiment. FIG. 11 is a block diagram showing a configuration of an input device according to a second embodiment.

Hereinafter, with reference to the accompanying drawings, the input device, the display device, the control method of the input device, and the embodiment of the program disclosed in the present application will be described in detail. The present invention is not limited to the embodiments shown below.

[First Embodiment]
<1. Overview of input device>
First, the outline of the input device according to the first embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a diagram showing an example of mounting an input device according to the first embodiment. FIG. 2 is a diagram showing an outline of the input device according to the first embodiment.

As shown in FIG. 1, the input device 1 according to the present embodiment is mounted on a vehicle. Then, it is assumed that the input device 1 is connected to the in-vehicle device 2 (see FIG. 3) via a network, for example. The input device 1 includes an operation unit 5 having an operation reception member (hereinafter, referred to as an operation surface) such as a touch pad for receiving the user's operation, and a microphone 3 for acquiring the sound emitted by the user. For example, the driver) can operate the in-vehicle device 2 by performing a contact operation or a voice input input operation on the input device 1.

That is, the input device 1 can execute an input operation by a contact operation in which the user presses the operation surface and an input operation by voice input to the microphone 3. Moreover, the input device 1 according to the present embodiment exclusively accepts the input operation by the contact operation and the input operation by the voice, which will be described in detail later.

Then, the in-vehicle device 2 is connected to the speaker 4 provided in the vehicle, and the voice data corresponding to the input operation can be output from the speaker 4.

Further, the operation unit 5 of the input device 1 is arranged at a position that is easy for the driver to operate, such as near the shift lever S of the center console. In the example of FIG. 1, the operation unit 5 is arranged between the armrest R and the shift lever S. Therefore, the user can operate the operation surface with the arm placed on the armrest R. As a result, the user can easily operate the input device 1 without changing the driving posture.

The in-vehicle device 2 is, for example, a device such as a car navigation system, an air conditioner, or an audio system, and the in-vehicle device 2 includes a display unit 2A for displaying a predetermined image. The image displayed on the display unit 2A is an image for navigating a vehicle such as a map, a moving image on a television or the Internet, or an image showing the status of an air conditioner or audio. The display unit 2A is provided at an appropriate position such as the center position of the dashboard.

Further, the in-vehicle device 2 can be connected to a mobile terminal such as a smartphone by short-range wireless communication such as Bluetooth (registered trademark). Therefore, the user can also operate the smartphone via the in-vehicle device 2 by the input device 1. As an example of the operation of the smartphone, for example, the user can make a hands-free call via the input device 1.

Here, for example, when the user tries to perform an input operation with the input device 1 during driving, the attention to driving may be distracted by visually recognizing the input device 1. Therefore, the input device 1 notifies the user's finger operating the input device 1 that the input operation has been accepted by giving a predetermined tactile sensation using vibration.

The user can also input a desired operation with the input device 1 by voice input. As a result, the user can easily execute the input operation without visually recognizing the input device 1.

Here, the configuration of the input device 1 will be described with reference to FIG. As shown in FIG. 2, the input device 1 has an operation unit 5 and vibration elements 31a and 31b for vibrating the operation surface 5A provided on the surface of the operation unit 5 as main components.

The operation unit 5 is composed of, for example, a panel having a capacitance type information input function, and when the user touches the operation surface 5A with a pointing device such as a finger or a touch pen, the input device 1 touches the user on the operation surface 5A. Detect the position. Then, the input device 1 accepts the movement of the contact position by an operation based on a pressing force or the like.

The vibrating elements 31a and 31b are, for example, piezoelectric elements (piezo elements), and the operation surface 5A of the operation unit 5 can be vibrated at high frequencies. For example, when the vibrating elements 31a and 31b are vibrated while the user's finger presses the operation surface 5A, air is drawn between the finger and the operation surface 5A due to the pressure fluctuation due to the vibration to form an air layer, and the finger is formed. The frictional force between the operation surface 5A and the operation surface 5A changes. When the finger is moved in such a state, the tactile sensation corresponding to the changed frictional force can be given to the finger. Further, by changing the vibration state of the vibrating elements 31a and 31b, the magnitude of the frictional force between the finger and the operation surface 5A can be changed, and the tactile sensation given to the finger can be changed.

As described above, the input device 1 according to the present embodiment is an input device that gives a tactile sensation to the user by vibrating the operation surface 5A using the vibrating elements 31a and 31b. In the following description, the vibrating elements 31a and 31b may be collectively referred to as the vibrating element 31.

By the way, in the input device 1, if the contact operation and the voice input are performed at the same time, the vibration of the vibrating element 31 may propagate to the air and interfere with the voice input. The hindrance to such voice input is, for example, a decrease in the recognition rate in voice recognition of voice input, noise generation in a telephone, or the like.

Therefore, the input device 1 according to the present embodiment exclusively controls the contact operation of the input device 1 and the voice input. As an example, the input device 1 stops the acceptance of the contact operation when the voice input is being accepted, and stops the vibration of the vibrating element 31. As a result, it is possible to suppress the hindrance to the voice input due to the vibration of the input device.

Further, the input device 1 may attenuate the noise component generated by the vibration of the vibrating element 31 instead of exclusively controlling the contact operation and the voice input. This point will be described later.

Although the case where the input device 1 and the in-vehicle device 2 are separate bodies has been described here, the present invention is not limited to this. The input device 1 and the vehicle-mounted device 2 may be integrally configured. Further, for example, instead of the display unit 2A of the vehicle-mounted device 2 provided on the dashboard, a head-up display projected on a predetermined area L of the windshield of the vehicle may be used. Further, the input device 1 may be configured by, for example, a touch panel, and the input device 1 may have a display unit.

Further, although the description of the input device 1 has been described by exemplifying the case where it is connected to the in-vehicle device 2, for example, it can be directly connected to a smartphone, a tablet terminal, a personal computer, or the like. Hereinafter, the input device 1 will be further described.

<2. Input device configuration>
FIG. 3 is a block diagram showing the configuration of the input device 1 according to the first embodiment. The input device 1 includes an operation unit 5, a vibration unit 30, a microphone 3, a control unit 10, and a storage unit 20. Further, the input device 1 is connected to the in-vehicle device 2 and the speaker 4.

<2.1. Operation unit>
The operation unit 5 is a flat-plate sensor such as a touch pad or a touch panel. The operation unit 5 includes an operation surface 5A that receives an input operation by a contact operation by the user. When the user comes into contact with the operation surface 5A, the operation unit 5 outputs a sensor value corresponding to the contact position of the user to the control unit 10.

<2.2. Vibration part ＞
The vibrating unit 30 includes at least one vibrating element 31. In the example shown in FIG. 2, the vibrating unit 30 includes two vibrating elements 31a and 31b. The vibrating elements 31a and 31b are piezoelectric actuators such as a piezoelectric element (piezo element), and vibrate the operating unit 5 by expanding and contracting according to a voltage signal given from the control unit 10. The vibrating elements 31a and 31b are arranged so as to be in contact with the operation unit 5 at a position invisible to the user, such as the end of the operation unit 5.

In the example of FIG. 2, the vibrating elements 31a and 31b are arranged on the left and right outer regions of the operation surface 5A and on the surface of the operation unit 5 facing the operation surface 5A. The number and arrangement of the vibrating elements 31a and 31b shown in FIG. 2 is an example, and is not limited to this. For example, one vibrating element 31a may vibrate the operation surface 5A. As described above, the number and arrangement of the vibrating elements 31a and 31b are arbitrary, but it is desirable that the number and arrangement are such that the entire operation surface 5A is uniformly vibrated.

Further, here, the case where the piezoelectric element is used as the vibrating elements 31a and 31b has been described, but the present invention is not limited to this, and any element that vibrates the operation surface 5A in the ultrasonic frequency band may be used. The vibrating elements 31a and 31b may be elements that vibrate in the same frequency band, or may be elements that vibrate in different frequency bands. Further, an element that vibrates in a frequency band other than the ultrasonic frequency band may be further provided. As a result, the input device 1 can vibrate not only the operation surface 5A but also the input device 1 itself.

<2.3. Microphone and speaker>
The microphone 3 is a voice input unit that acquires the user's voice. The voice data acquired by the microphone 3 is output to the control unit 10. Further, the speaker 4 is a voice output unit that outputs a voice based on the voice data input from the control unit 10. When the in-vehicle device 2 is provided with the microphone 3, the input device 1 may not be provided with the microphone 3.

<2.4. Control unit>
The control unit 10 controls each unit of the input device 1. Further, the control unit 10 outputs a signal corresponding to the input operation received via the operation unit 5 and the microphone 3 to the vehicle-mounted device 2 and the speaker 4. The control unit 10 includes a detection unit 11, an operation reception unit 12, a voice reception unit 13, an exclusive control unit 14, a vibration control unit 15, and an information processing unit 16.

<2.4.1. Detector>
The detection unit 11 detects the contact position of the user with respect to the operation surface 5A based on the sensor value output by the operation unit 5. For example, the detection unit 11 detects the user's contact position at a predetermined cycle, so that even if the user's finger moves on the operation surface 5A and the contact position changes, the detection unit 11 follows the change. The contact position can be detected. The detection unit 11 outputs the information regarding the contact position, which is the detection result, to the operation reception unit 12.

<2.4.2. Operation reception section>
When the exclusive control unit 14 permits the reception of input operations, the operation reception unit 12 accepts a predetermined input operation based on the detection result of the detection unit 11, and is based on the operation information 21 stored in the storage unit 20. Information about the vibration state of the input operation is associated and output to the exclusive control unit 14.

Here, the operation information 21 stored in the storage unit 20 will be described with reference to FIGS. 4 and 5. FIG. 4 is an example of operation information. FIG. 5 is a diagram showing an example of a vibration state. In FIG. 5, for the sake of brevity of the following description, a virtual dial D that does not actually exist is shown on the operation surface 5A.

As shown in FIG. 4, the operation information 21 stores, for example, "operation", "equipment", "mode", and "vibration state" in association with each other. “Operation” indicates an input operation on the operation surface 5A of the user, and the movement direction, movement distance, movement speed, etc. of the finger are associated with the vibration state (vibration characteristic) of the operation surface 5A by the vibrating element 31. .. The "device" indicates a device operated by such "operation", and the "mode" is information regarding the mode of the device to be operated. The "vibration state" indicates the vibration state of the operation surface 5A in each mode.

In the example shown in FIG. 4, when the user draws "○" on the operation surface 5A with a finger, for example, the input device 1 determines that the user's input operation is a temperature adjustment mode transition request for the air conditioner, and determines the determination result. While outputting to the in-vehicle device 2, the operation unit 5 vibrates in a vibration state (in this case, the first vibration state) corresponding to the determination result.

Specifically, the detection unit 11 of the control unit 10 outputs the detection result corresponding to the movement of the finger drawing “◯”, which is an input operation of the user, to the operation reception unit 12. Based on the acquired detection result and the operation information 21 stored in the storage unit 20, the operation reception unit 12 determines that the user's input operation is the temperature adjustment mode transition request of the air conditioner. Then, the determination result is output to the in-vehicle device 2. Further, the operation receiving unit 12 outputs a signal indicating a vibration state (in this case, the first vibration state) corresponding to the determination result to the vibration control unit 15.

When the in-vehicle device 2 receives the determination result from the control unit 10 of the input device 1, the in-vehicle device 2 shifts to the temperature adjustment mode of the air conditioner. On the other hand, the vibration control unit 15 of the control unit 10 controls the vibration element 31 so that it vibrates in the first vibration state when the user's finger comes into contact with the operation surface 5A after the determination result is acquired.

For example, suppose that a user brings a finger into contact with the operation surface 5A shown in FIG. 5 and rotates the finger while imagining an actual dial. That is, when the finger is moved in the direction of the arrow in the drawing so as to rotate the virtual dial D as shown in the figure, the operation surface 5A vibrates in the first vibration state, and the user feels as if he / she turns the dial. can get.

Specifically, the vibration control unit 15 switches ON / OFF of the vibration of the vibration element 31 at a predetermined cycle in conjunction with the operation of the user rotating the virtual dial D. As a result, the frictional force between the operation surface 5A and the finger fluctuates in the ON / OFF cycle of the vibrating element 31, so that, for example, the tactile sensation that the click feeling continues in an extremely short cycle, that is, the actual dial is turned. It is possible to give the user a tactile sensation.

In this way, the user performs an input operation (input operation for rotating the virtual dial D) for rotating the finger in a predetermined direction on the operation surface 5A as if operating the actual dial with a finger, thereby operating the temperature of the air conditioner. Can be adjusted. For example, in this case, when the user's finger comes into contact with the operation surface 5A, the vibration control unit 15 selects the first vibration state and, for example, changes one dial as the temperature is changed by 0.5 degrees. The vibrating unit 30 is controlled to vibrate the operation surface 5A so that a tactile sensation of turning can be obtained.

At this time, the input device 1 may output a sound effect such as "click" from the speaker 4 in conjunction with the rotation of the virtual dial D. As a result, the user can easily recognize the operation by hearing due to the synergistic effect with the sound effect.

Although the virtual dial D that does not actually exist is displayed in FIG. 5 for the sake of brevity, a dial image imitating the actual dial may be displayed on the input device 1. .. When displaying such a dial image, the input device 1 is provided with a display unit such as a touch panel.

Further, as shown in FIG. 4, the operation information 21 is associated with information corresponding to an operation that can be easily input by the user, such as “T”, “?”, “G”, in addition to “○”. Be remembered. This allows the user to easily make the desired mode transition request.

In the example of FIG. 4, for example, the operation "T" corresponds to the telephone directory calling mode, the operation "?" Corresponds to the Internet search mode, and the operation "G" corresponds to the destination setting mode by car navigation.

In addition to the mode transition request, the operation information 21 is also associated with an input operation common to all devices. For example, the operation "x" cancels the mode transition. In addition, common input operations include operations such as "pinch (pinch in / pinch out) operation" for reducing and enlarging an image and "rotate operation" for rotating an image.

Further, the vibration control unit 15 controls the strength, period and frequency of vibration of the vibrating element 31 such as a so-called "rough" tactile sensation in the second vibration state and a "smooth" tactile sensation in the third vibration state. By doing so, various tactile sensations can be given to the user. The operation information 21 shown in FIG. 4 is an example and can be customized by the user.

Returning to the explanation of FIG. 3, the explanation of the operation reception unit 12 will be continued. In the arrangement example of the input device 1 shown in FIG. 1, when the user places his / her arm on the armrest R, the user's hand may unintentionally come into contact with the operation surface 5A.

Therefore, the operation reception unit 12 may invalidate such an operation based on the contact area of the operation detected by the detection unit 11. That is, it can be assumed that the user's input operation is performed with a finger or a touch pen, and the contact area for accepting the input operation can be set within a predetermined allowable range.

Therefore, for example, when the entire palm of the user is in contact with the operation surface 5A, it may be considered that the contact state is not intended by the user, and the contact area exceeds the permissible range. The contact operation can be determined to be invalid.

<2.4.3. Voice reception department ＞
When the exclusive control unit 14 permits the reception of voice input, the voice reception unit 13 receives the voice input of the voice data acquired by the microphone 3, converts the received voice data into text data, and performs such text. The data is output to the exclusive control unit 14.

When the user makes, for example, a telephone call via the input device 1 in a hands-free state, the voice reception unit 13 is acquired by the microphone 3 without executing the above-mentioned process. The audio data is output to the speaker 4.

<2.4.4.4. Exclusive control unit>
The exclusive control unit 14 exclusively controls the reception of input operations by the operation reception unit 12 and the reception of voice input by the voice reception unit 13, and turns on / from the vibration of the vibration element 31 via the vibration control unit 15. Control OFF and amplitude.

Specifically, when the operation reception unit 12 is accepting an input operation, the exclusive control unit 14 stops the reception of voice input by the voice reception unit 13 and causes the vibration control unit 15 to vibrate the vibration element 31. On the other hand, when the voice input unit 13 is accepting voice input, the operation reception unit 12 stops the operation reception.

That is, the exclusive control unit 14 controls the operation reception unit 12 and the voice reception unit 13 so that they are not accepting inputs at the same time. Further, the exclusive control unit 14 causes the vibration control unit 15 to stop the vibration of the vibration element 31 when the voice input unit 12 is accepting the voice input. As a result, the vibrating element 31 does not vibrate when the voice receiving unit 13 is accepting voice input. Therefore, the input device 1 according to the present embodiment can suppress the hindrance to the voice input system due to the vibration of the vibrating element 31.

Further, the exclusive control unit 14 may switch the input reception by the operation reception unit 12 and the voice reception unit 13 at a predetermined cycle. For example, if the exclusive control unit 14 switches the input reception by the operation reception unit 12 and the voice reception unit 13 to each other in a very short cycle, the input operation by the operation reception unit 12 and the vibration of the vibrating element 31 are substantially. Not blocked by.

On the other hand, if the voice reception unit 13 acquires voice data from the microphone 3 via a low-pass filter, for example, the voice reception unit 13 can complement and acquire the voice data during the period when the input reception by the voice reception unit 13 is blocked. can.

Therefore, the reception of input by the operation reception unit 12 and the voice reception unit 13 is not substantially blocked. As a result, the user can simultaneously perform the contact operation and the voice input to the input device 1.

Further, as an example of the exclusive control process, when the voice input unit 13 is accepting the voice input, the exclusive control unit 14 causes the vibration control unit 15 instead of stopping the reception of the input operation by the operation reception unit 12. An instruction for reducing the amplitude of the vibrating element 31 may be output.

The amplitude of the vibrating element 31 is preferably reduced to such an extent that it does not interfere with the voice input system described above, and is determined by an experiment or the like in consideration of the mounting positions of the vibrating element 31 and the microphone 3 at the time of design. good. As a result, even when the operation reception unit 12 and the voice reception unit 13 are accepting inputs, it is possible to reduce the hindrance to the voice input system due to the vibration of the vibrating element 31.

<2.4.5. Vibration control unit>
The vibration control unit 15 controls the vibration element 31 so that the vibration state corresponds to the input operation received by the operation reception unit 12. First, the vibration control unit 15 acquires vibration state information based on the input operation from the exclusive control unit 14. Subsequently, the vibration control unit 15 controls the vibration element 31 of the vibration unit 30 so that when the operation input is performed on the operation surface 5A, the operation surface 5A is in a vibration state based on the vibration state information.

<2.4.6.6. Information Processing Department>
The information processing unit 16 acquires input operation information and text data from the operation reception unit 12 and the voice reception unit 13 via the exclusive control unit 14, executes processing corresponding to the information, and outputs the processing result to the in-vehicle device 2. And output to the speaker 4.

<2.5. Memory>
The storage unit 20 stores, for example, the above-mentioned operation information 21 as information necessary for the processing performed by the operation reception unit 12, and also stores various processing results. The storage unit 20 is, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The input device 1 may acquire a part or all of the data stored in the storage unit 20 via a network such as the Internet.

<3. Input processing>
Subsequently, the input method of the input device 1 will be described with reference to FIGS. 6 and 7. FIG. 6 is a timing chart showing an example of the input method. FIG. 7 is an example of a display image. Here, a case where the user sets the destination of the car navigation by using the input device 1 to, for example, the Tokyo Sky Tree will be described. Further, in the following description, the state in which the exclusive control unit 14 permits the reception of input by the operation reception unit 12 or the voice reception unit 13 is the “ON state”, and the state in which the reception is stopped is the “OFF state”. It is described as.

As shown in FIG. 6, for example, when the user has not performed any contact operation or voice input to the input device 1 (input operation is being accepted: OFF, voice input is being accepted: OFF), the operation reception unit 12 Is in the ON state, and the voice reception unit 13 is in the OFF state (time t0 to t1). In this state, when the user writes "G" on the operation surface 5A with a finger from the time t1 for example, the vibration control unit 15 vibrates the operation surface 5A in a vibration state corresponding to the input operation (time). t1 to t2).

The operation reception unit 12 determines such an input operation as a car navigation destination setting mode shift request (see FIG. 4), and outputs the determination result to the exclusive control unit 14 and the in-vehicle device 2.

When the exclusive control unit 14 acquires such a determination result, for example, it waits for the elapse of a predetermined time (time t2 to t3) and shifts the operation reception unit 12 to the OFF state and the voice reception unit 13 to the ON state (time t3). ). When the in-vehicle device 2 acquires the determination result from the input device 1, the in-vehicle device 2 shifts to the destination setting mode of the car navigation.

During the period of time t2 to t3, the input device 1 outputs voice guidance such as "Where do you want to set the destination?" From the speaker 4. Here, since the voice reception unit 13 is in the OFF state during the voice guidance, it is possible to prevent erroneous input by the voice guidance. Further, since the operation reception unit 12 is in the ON state during this period, for example, when the user draws "x" on the operation surface 5A, the operation reception unit 12 accepts such a contact operation and cancels the mode transition request. It can also be done (see Figure 4).

When the exclusive control unit 14 switches the ON / OFF state of the operation reception unit 12 and the voice reception unit 13, the input device 1 notifies the user of such a state. Such a notification method is, for example, vibration of the operation surface 5A, voice by the speaker 4, a navigation image displayed on the display unit 2A, or the like.

Alternatively, for example, a light emitting body may be provided at a position (for example, a steering wheel) visible to the user, and the state of the operation reception unit 12 and the voice reception unit 13 may be notified by the color of the light emitting body. As a result, the user can easily grasp the ON / OFF state of the operation reception unit 12 and the voice reception unit 13.

Upon receiving the voice guidance, the user utters "Tokyo Sky Tree" so as to interact with the voice guidance during the period from time t4 to t5, and the voice reception unit 13 converts the voice data into text data. , Output to the in-vehicle device 2.

As a result, the vehicle-mounted device 2 starts searching for a candidate site corresponding to the Tokyo Sky Tree from the map information stored in the vehicle-mounted device 2, and outputs the search result to the display unit 2A (see FIG. 7).

When the reception of the voice input by the voice reception unit 13 is completed, the exclusive control unit 14 shifts the voice reception unit 13 to the OFF state and the operation reception unit 12 to the ON state (after time t6).

In the example shown in FIG. 7, there are 20 candidate sites corresponding to the Tokyo Sky Tree, and a list of some of the candidate sites is displayed on the display unit 2A of the in-vehicle device 2. Further, for example, the pointer P and the operation button B are displayed on the display unit 2A. The user selects a destination from the candidate sites according to the position of the pointer P, and operates the pointer P by a contact operation with respect to the operation surface 5A. Here, for example, the operation button B and the vibration state of the operation surface 5A may be interlocked with each other.

That is, when the user raises or lowers the finger while the finger is in contact with the operation surface 5A, the tactile sensation of operating the operation button B can be obtained. Specifically, the vibration control unit 15 controls ON / OFF of the vibration of the vibration element 31 in accordance with a contact operation such that the user moves the position of the pointer P by one, and the user actually operates the button B. Gives a tactile sensation (t7 to t8).

Then, when the pointer P reaches the desired candidate site, the user determines the destination by performing a predetermined operation (for example, a tap operation). Then, the operation reception unit 12 outputs such an input operation to the in-vehicle device 2. Here, the input device 1 outputs voice guidance such as "Are you sure you want to go here?" From the speaker 4.

When the user performs a predetermined operation (for example, a tap operation), the input device 1 determines the destination and outputs the fact to the in-vehicle device 2. This completes the car navigation destination setting.

In this way, the exclusive control unit 14 exclusively controls the ON / OFF state of the operation reception unit 12 and the voice reception unit 13 according to the input operation of the user. As a result, the user can appropriately use the contact operation and the voice input. Therefore, the user can easily perform the desired input operation. Further, in the input device 1, the user's utterance purpose can be narrowed down by performing the mode transition by the input operation in advance. As a result, the accuracy of voice input processing is improved.

Further, when the user performs a contact operation without inputting voice while the voice reception unit 13 is in the ON state (for example, at times t3 to t6), the exclusive control unit 14 operates the voice reception unit 13 in the OFF state. The reception unit 12 may be shifted to the ON state, and the operation reception unit 12 may accept such a contact operation.

Alternatively, when the user does not input voice for a predetermined period while the voice reception unit 13 is in the ON state (for example, at times t3 to t6), the exclusive control unit 14 turns the voice reception unit 13 in the OFF state and operates the operation reception unit 12. May be shifted to the ON state.

Further, when the user performs a predetermined operation (for example, double tap operation) while the operation reception unit 12 is in the ON state (for example, after time t6), the exclusive control unit 14 turns the voice reception unit 13 into the ON state. , The operation reception unit 12 may be shifted to the OFF state. As a result, the user sees the displayed candidate list, and the user sets the destination by emitting a voice corresponding to the display screen such as "second" or "Tokyo Skytree No. 1 parking lot". be able to.

Further, here, the case where the exclusive control unit 14 switches the ON / OFF state of the operation reception unit 12 and the voice reception unit 13 to each other has been described, but the present invention is not limited to this. For example, the exclusive control unit 14 sets both the operation reception unit 12 and the voice reception unit 13 to the ON state, and when the operation reception unit 12 receives a contact operation, only the voice reception unit 13 is shifted to the OFF state. It may be controlled.

<4. Control processing>
Next, the exclusive processing procedure executed by the input device 1 according to the present embodiment will be described with reference to FIGS. 8 and 9. FIG. 8 is a flowchart showing an example of the first exclusive processing procedure of the input device 1 according to the first embodiment. FIG. 9 is a flowchart showing an example of the second exclusive processing procedure of the input device 1 according to the first embodiment.

Here, the exclusive processing procedure when the contact operation is performed on the input device 1 will be described as the first exclusive processing procedure, and the exclusive processing procedure when the voice input is performed will be described as the second exclusive processing procedure. conduct.

As shown in FIG. 8, in the first exclusive process, when the detection unit 11 detects the contact with the operation surface 5A, the exclusive control unit 14 of the input device 1 determines whether or not the operation reception unit 12 is the operation reception ON. (Step S101). Here, when the operation reception unit 12 is the operation reception ON (step S101, Yes), the exclusive control unit 14 prohibits the voice reception unit 13 from receiving the voice (step S102).

Subsequently, the exclusive control unit 14 controls the in-vehicle device 2 and the speaker 4 via the information processing unit 16 to notify the user that voice reception is prohibited (step S103), and ends the process. On the other hand, in the determination of step S101, when the operation reception unit 12 is the operation reception OFF (step S101, No), the exclusive control unit 14 permits the voice reception by the voice reception unit 13 (step S104), and processes. To finish.

Next, the second exclusive processing procedure of the input device 1 will be described with reference to FIG. As shown in FIG. 9, first, the exclusive control unit 14 of the input device 1 determines whether or not the voice reception unit 13 is voice reception ON when the voice input is performed to the microphone 3 (step S201). Here, when the voice reception unit 13 is the voice reception ON (step S201, Yes), the exclusive control unit 14 prohibits the operation reception unit 12 from accepting the operation (step S202).

Subsequently, the exclusive control unit 14 controls the in-vehicle device 2 and the speaker 4 via the information processing unit 16 to notify the user that the operation acceptance is prohibited (step S203), and ends the process. On the other hand, in the determination of step S201, when the voice reception unit 13 is the voice reception OFF (step S201, No), the exclusive control unit 14 permits the operation reception by the operation reception unit 12 (step S204), and processes. To finish.

<5. Hardware configuration>
The input device 1 according to the present embodiment can be realized by a computer 600 having a configuration shown as an example in FIG. FIG. 10 is a hardware configuration diagram showing an example of a computer that realizes the function of the input device 1.

The computer 600 includes a CPU (Central Processing Unit) 610, a ROM (Read Only Memory) 620, a RAM (Random Access Memory) 630, and an HDD (Hard Disk Drive) 640. Further, the computer 600 includes a media interface (I / F) 650, a communication interface (I / F) 660, and an input / output interface (I / F) 670.

The computer 600 may include an SSD (Solid State Drive), and the SSD may perform some or all of the functions of the HDD 640. Further, SSD may be provided instead of HDD 640.

The CPU 610 operates based on a program stored in at least one of the ROM 620 and the HDD 640, and controls each part. The ROM 620 stores a boot program executed by the CPU 610 when the computer 600 is started, a program that depends on the hardware of the computer 600, and the like. The HDD 640 stores a program executed by the CPU 610, data used by the program, and the like.

The media I / F 650 reads the programs and data stored in the storage medium 680 and provides them to the CPU 610 via the RAM 630. The CPU 610 loads the program from the storage medium 680 onto the RAM 630 via the media I / F 650, and executes the loaded program. Alternatively, the CPU 610 executes the program using such data. The storage medium 680 is, for example, an optical magnetic recording medium such as a DVD (Digital Versatile Disc), an SD card, a USB memory, or the like.

The communication I / F 660 receives data from another device via the network 690 and sends it to the CPU 610, and transmits the data generated by the CPU 610 to the other device via the network 690. Alternatively, the communication I / F 660 receives a program from another device via the network 690 and sends it to the CPU 610, and the CPU 610 executes the program.

The CPU 610 controls a display unit 2A such as a display, an output unit such as a speaker 4, and an input unit such as a keyboard, a mouse, a button, and an operation unit 5 via an input / output I / F 670. The CPU 610 acquires data from the input unit via the input / output I / F 670. Further, the CPU 610 outputs the generated data to the display unit and the output unit via the input / output I / F 670.

For example, when the computer 600 functions as the input device 1, the CPU 610 of the computer 600 excludes the detection unit 11, the operation reception unit 12, and the voice reception unit 13 by executing the program loaded on the RAM 630. Each function of the control unit 14, the vibration control unit 15, and the information processing unit 16 is realized.

The CPU 610 of the computer 600 reads, for example, these programs from the storage medium 680 and executes them, but as another example, these programs may be acquired from another device via the network 690. Further, the HDD 640 can store the information stored in the storage unit 20.

As described above, the input device 1 according to the present embodiment includes a detection unit 11, at least one vibration element 31, an operation reception unit 12, a vibration control unit 15, a voice reception unit 13, and an exclusive control unit. It is provided with 14. The detection unit 11 detects the contact position of the user with respect to the operation surface 5A. At least one vibrating element 31 vibrates the operating surface 5A. The operation reception unit 12 receives a predetermined input operation based on the detection result of the detection unit 11. The vibration control unit 15 controls the vibration element 31 so that the vibration state corresponds to the input operation received by the operation reception unit 12. The voice reception unit 13 receives voice input. The exclusive control unit 14 exclusively controls the reception of input operations by the operation reception unit 12 and the reception of voice input by the voice reception unit 13. As a result, it is possible to suppress the vibration of the input device 1 by the vibrating element 31 from interfering with the voice input.

[Second Embodiment]
Subsequently, a modified example of the present embodiment will be described with reference to FIG. FIG. 11 is a block diagram showing the configuration of the input device 1 according to the second embodiment.

As shown in FIG. 11, the input device 1 according to the second embodiment has a rear stage of the microphone 3 instead of the exclusive control unit 14 (see FIG. 3) of the configuration of the input device 1 according to the first embodiment. That is, a damping unit 17 is provided between the microphone 3 and the voice receiving unit 13. The same components as those of the display device 1 shown in FIG. 3 are designated by the same reference numerals, and the description thereof will be omitted.

When the voice data acquired from the microphone 3 contains a noise component generated by the vibration of the vibrating elements 31a and 31b, the damping unit 17 attenuates the noise component. For example, the attenuation unit 17 generates a pulse having the opposite phase of the noise component when the noise component is detected from the voice data acquired from the microphone 3. Subsequently, the attenuation unit 17 superimposes such a pulse on the voice data to obtain voice data in which the noise component is attenuated. Such voice data is input to the voice reception unit 13.

Further, the input device 1 may be configured to include a filter that cuts a specific frequency band as the attenuation unit 17. Such a filter is, for example, a filter that cuts the frequency band of a noise component, and is provided, for example, after the microphone 3.

As a result, the voice receiving unit 13 can acquire voice data in which the noise component generated by the vibration of the vibrating element 31 is attenuated or cut. Therefore, in the input device 1 according to the present embodiment, even if the vibrating element 31 vibrates and the vibration propagates and is input to the microphone 3, it is possible to suppress the hindrance to the voice input.

For example, the user can simultaneously execute an input operation and a voice input by the input device 1. For example, the user can perform an input operation with the input device 1 even during a hands-free call.

As described above, the input device 1 according to the present embodiment includes a detection unit 11, at least one vibration element 31, an operation reception unit 12, a vibration control unit 15, a voice reception unit 13, and a damping unit 17. And. The detection unit 11 detects the contact position of the user with respect to the operation surface 5A. At least one vibrating element 31 vibrates the operating surface 5A. The operation reception unit 12 receives a predetermined input operation based on the detection result of the detection unit 11. The vibration control unit 15 controls the vibration element 31 so that the vibration state corresponds to the input operation received by the operation reception unit 12. The voice reception unit 13 receives voice input. The damping unit 17 attenuates the noise component generated by the vibration of the vibrating element 31. As a result, it is possible to suppress the hindrance to the voice input due to the vibration of the input device 1.

By the way, in the above-described embodiment, it has been described that the input device 1 incorporates a microphone 3 for inputting voice and a damping unit 17 provided between the microphone 3 and the voice receiving unit 13. However, as the input device 1, a microphone 3 and a damping unit 17 are provided outside the input device 1, and the input device 1 can be connected to the input device 1 by, for example, a wired or wireless line input, that is, a function as an input system. It may be configured to be used.

Further, in the above-described embodiment, the case where the exclusive control unit 14 stops the reception of the input operation by the operation reception unit 12 when the voice reception unit 13 is accepting the voice input has been described. When 13 is accepting voice input, although the operation receiving unit 12 accepts the input operation, the tactile sensation using vibration may not be given to the input operation.

Further, in the above-described embodiment, the case where the user inputs only with the input device 1 has been described. However, when the display unit 2A of the in-vehicle device 2 serves as any input device such as a touch panel and the display device, the user inputs. The input operation may be performed by using the device 1 and the display unit 2A in combination.

According to the above-described embodiment, the following input device 1, display device, control method of the input device 1, and a program can be realized.

(1) A detection unit 11 that detects the contact position of the user with respect to the operation surface 5A, at least one vibrating element 31 that vibrates the operation surface 5A, and an operation reception unit that accepts a predetermined input operation based on the detection result of the detection unit 11. 12, the vibration control unit 15 that controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation reception unit 12, the voice reception unit 13 that receives the voice input, and the input by the operation reception unit 12. An input device 1 including an exclusive control unit 14 that exclusively controls the reception of operations and the reception of voice input by the voice reception unit 13.

(2) In the input device 1 of the above (1), the exclusive control unit 14 stops the operation reception unit 12 from accepting the input operation when the voice reception unit 13 is accepting the voice input, and the vibration control unit 14. An input device 1 for stopping the vibrating element 31 at 15.

(3) In the input device 1 of the above (2), the exclusive control unit 14 restarts the reception of the input operation by the operation reception unit 12 when the reception of the voice input by the voice reception unit 13 is completed.

(4) In the input devices 1 of (1) to (3) above, the exclusive control unit 14 causes the voice reception unit 13 to stop accepting voice input when the operation reception unit 12 is accepting an input operation. Input device 1.

(5) In the input device 1 of the above (4), the exclusive control unit 14 causes the voice reception unit 13 to restart the reception of the voice input when the reception of the input operation by the operation reception unit 12 is completed.

(6) In the input device 1 of the above (1), the exclusive control unit 14 is characterized in that the vibration control unit 15 reduces the amplitude of the vibration element 31 when the voice reception unit 13 is accepting voice input. Input device 1.

According to the input devices 1 of the above (1) to (6), it is possible to suppress the hindrance to the voice input system due to the vibration of the input device 1.

(7) A detection unit 11 that detects the contact position of the user with respect to the operation surface 5A, at least one vibrating element 31 that vibrates the operation surface 5A, and an operation reception unit that accepts a predetermined input operation based on the detection result of the detection unit 11. 12, a vibration control unit 15 that controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation reception unit 12, and a damping unit 17 that attenuates a noise component generated by the vibration of the vibration element 31. An input device 1.

According to the input device 1 of the above (7), even if the input device 1 vibrates and the vibration propagates and is input to the input device 1, it is possible to suppress that the voice input is hindered.

(8) A display device including the input device 1 according to any one of (1) to (7) above, and a display unit for displaying an image corresponding to an input operation and voice input received by the input device 1. ..

According to the display device (8) above, the user can confirm the input operation by the image displayed on the display unit. This improves user operability.

(9) A control method for the input device 1, which includes a detection step of detecting a user's contact position with respect to the operation surface 5A, a vibration process of vibrating the operation surface 5A by at least one vibrating element 31, and detection of the detection unit 11. An operation reception process that accepts a predetermined input operation based on the result, a vibration control process that controls the vibrating element 31 so as to be in a vibration state corresponding to the input operation received by the operation reception process, and a voice reception process that accepts voice input. A control method of an input device including the reception of an input operation in the operation reception process and an exclusive control step of exclusively controlling the reception of voice input in the voice reception process.

According to the control method of the input device 1 according to the above (9), it is possible to provide a control method of the input device 1 capable of suppressing a hindrance to the voice input system due to the vibration of the input device 1.

(10) A detection step of the control method of the input device 1, which detects the contact position of the user with respect to the operation surface 5A, a vibration step of vibrating the operation surface 5A by at least one vibrating element 31, and a detection result of the detection process. An operation reception process that accepts a predetermined input operation based on the above, a vibration control process that controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation reception process, and noise generated by the vibration of the vibration element 31. A method of controlling an input device that includes a damping step that attenuates components.

According to the control method of the input device 1 of the above (10), even if the input device 1 vibrates and the vibration propagates and is input to the input device 1, it is possible to suppress the hindrance to the voice input. It is possible to provide a control method of the input device 1 capable of performing the above.

(11) A detection step for detecting the contact position of the user with respect to the operation surface 5A, a vibration step for vibrating the operation surface 5A by at least one vibrating element 31, and a detection result of the detection step, which is a control program of the input device 1. An operation reception step that accepts a predetermined input operation based on the above, a vibration control step that controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation reception step, and a voice reception step that accepts voice input. , A program that causes a computer to execute an exclusive control step that exclusively controls the reception of input operations by the operation reception step and the reception of voice input by the voice reception step.

According to the program (11) above, it is possible to provide a program capable of suppressing a hindrance to the voice input system due to vibration of the input device 1.

(12) In the program of the input device 1, the detection step of detecting the contact position of the user with respect to the operation surface 5A, the vibration step of vibrating the operation surface 5A by at least one vibrating element 31, and the detection result of the detection step. An operation reception step that accepts a predetermined input operation based on the vibration control step, a vibration control step that controls the vibration element 31 so as to be in a vibration state corresponding to the input operation received by the operation reception step, and a voice reception step that accepts voice input. A program that causes a computer to perform a damping step that attenuates a noise component generated by the vibration of the vibrating element 31.

According to the program of the input device 1 of the above (12), even if the input device 1 vibrates and the vibration propagates and is input to the input device 1, it is possible to suppress the hindrance to the voice input. It is possible to provide a program of the input device 1 that can be used.

Further effects and variations can be easily derived by those skilled in the art. For this reason, the broader aspects of the invention are not limited to the particular details and representative embodiments expressed and described above. Therefore, various modifications can be made without departing from the spirit or scope of the general concept of the invention as defined by the appended claims and their equivalents.

1 Input device 2 In-vehicle device 3 Microphone 4 Speaker 5 Operation unit 10 Control unit 11 Detection unit 12 Operation reception unit 13 Voice reception unit 14 Exclusive control unit 15 Vibration control unit 16 Information processing unit 17 Damping unit 20 Storage unit 21 Operation information 30 Vibration Part 31 Vibration element

Claims (5)

A detector that detects the user's contact position with respect to the operation surface,
At least one vibrating element that vibrates the operation surface,
An operation receiving unit that receives based rather input operation on a detection result of the detecting section,
A vibration control unit that controls the vibration element so as to be in a vibration state corresponding to the input operation received by the operation reception unit.
A voice reception unit that accepts voice input of voice data acquired by the voice input unit,
An attenuation unit provided between the voice input unit and the voice reception unit to attenuate a noise component generated by vibration of the vibration element from the voice data.
With
The vibration control unit
An input device characterized in that when the voice input is being accepted by the voice receiving unit and the input operation is received by the operation receiving unit, the vibration by the vibrating element is stopped. The vibration control unit
The input device according to claim 1, wherein when the reception of the voice input by the voice receiving unit is completed, the control of the vibrating element in response to the input operation is restarted. The input device according to claim 1 or 2,
A display device including the input operation received by the input device and a display unit for displaying an image corresponding to the voice input. It is a control method of the input device.
A detection process that detects the user's contact position with respect to the operation surface,
A vibration process in which the operation surface is vibrated by at least one vibrating element,
An operation accepting step of accepting based rather input operation on a detection result of said detecting step,
A vibration control step of controlling the vibrating element so as to be in a vibrating state corresponding to the input operation received by the operation receiving step, and a vibration control step.
A voice reception process that accepts voice input of voice data acquired by the voice input process, and
A damping step provided between the voice input step and the voice receiving step to attenuate a noise component generated by vibration of the vibrating element from the voice data,
Including
The vibration control step is
A control method for an input device, characterized in that vibration by the vibrating element is stopped when the input operation is received by the operation reception process when the voice input is being received by the voice reception process. A detection step that detects the user's contact position with respect to the operation surface,
A vibration step in which the operation surface is vibrated by at least one vibrating element, and
An operation accepting step of accepting based rather input operation on a detection result of the detecting step,
A vibration control step that controls the vibration element so as to be in a vibration state corresponding to the input operation received by the operation reception step, and a vibration control step.
A voice reception step that accepts voice input of voice data acquired by the voice input step, and
An attenuation step provided between the voice input step and the voice reception step to attenuate a noise component generated by the vibration of the vibrating element from the voice data,
Let the computer run
The vibration control step
A program characterized in that when the voice input is being accepted by the voice reception step and the input operation is received by the operation reception step, the vibration by the vibration element is stopped.

Images