JP2010231609A - Tactile presentation device and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a tactile presentation device, capable of simultaneously attaining reduction in noise and diversification of the feeling of operation. <P>SOLUTION: The tactile presentation device includes a display means 51, a contact detection means 41 which detects a contact state of a user's operation site 56 to the display means 51; a tactile vibration generation means 50 which generates tactile vibration for giving a predetermined tactile to the operation site 56; a vibration waveform data generation means which generates, based on the detection result by the contact detection means 41, waveform data for generating the tactile vibration; and an ultrasonic modulation means which performs modulation processing to the waveform data with ultrasonic wave as carrier wave, and outputs an ultrasonic modulation signal generated by the modulation processing to the tactile vibration generation means 50 as a signal for generating the tactile vibration. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an apparatus and method for presenting a tactile sensation to a user in a display device such as a touch panel.

  In recent years, a man-machine interface in which a planar display device such as a liquid crystal panel or an organic EL display is combined with a touch panel mechanism has been developed. This type of technology allows the user to intuitively understand the relationship between the symbols displayed on the display and the operation, and is often used in ATM machines, game machines, and the like.

  In the interface as described above, since an operation method of touching a display which is smooth and hardly elastic is used, there is a problem that it is difficult for the user to obtain an operation feeling compared to mechanical means such as buttons. For this reason, there is a high risk of erroneous input or duplicate input, especially for visually impaired persons and even healthy persons. In view of this, an apparatus has been developed that includes a vibration generating means on the display as described above, generates vibration at a predetermined location on the display in response to a user's operation, and presents a click feeling or the like.

  However, in the apparatus as described above, since a vibration wave having a frequency in the audible band is often used as the vibration wave generated to present the click feeling or the like, there is a problem that noise is generated. For this reason, it is difficult to apply a device that gives an operational feeling as described above to devices other than devices that are used in a noisy environment, such as a navigation system for automobiles. Therefore, it is conceivable to use a vibration wave having a frequency outside the audible band as the vibration wave that gives the operational feeling as described above. However, when a vibration wave of, for example, 100 kHz or less is used as such a vibration wave, there arises a problem that the types of tactile sensations that can be realized are greatly limited.

  In order to solve the above problems, a configuration using high-frequency surface acoustic waves or Lamb waves of several MHz or more is disclosed (see Patent Document 1). Thereby, it is supposed that it is possible to present a sense of roughness of an object surface corresponding to the contact position as a tactile sense while measuring the contact position.

JP 2001-255993 A

  However, in the configuration according to Patent Document 1, since a standing wave or traveling wave is used as a vibration wave for giving a feeling of operation, the waveform of the vibration wave that can be transmitted is limited depending on the physical properties and shape of the portion that presents the tactile sensation. Is done. That is, there is a problem that the operational feeling that can be provided is limited.

  Therefore, an object of the present invention is to simultaneously realize noise reduction and diversification of operation feeling.

  The present invention for solving the above-described problems is directed to display means, contact detection means for detecting a contact state of a user's operation part to the display means, and the operation part in contact with the display means. A tactile sensation vibration generating means for generating a tactile sensation giving a tactile sensation, a vibration waveform data generating means for generating waveform data for generating the tactile sensation vibration based on a detection result by the contact detecting means, and the vibration waveform data The waveform data generated by the generation unit is modulated using ultrasonic waves as a carrier wave, and the ultrasonic modulation signal generated by the modulation processing is transmitted to the tactile vibration generation unit as a signal for generating the tactile vibration. It is a tactile sensation providing apparatus including an ultrasonic modulation means for outputting.

  In this way, by performing a modulation process using ultrasonic waves as a carrier wave on the waveform data for generating a predetermined tactile vibration, the frequency is out of the audible band while maintaining the waveform characteristics of the waveform data. Can be changed. Thereby, generation | occurrence | production of noise can be prevented and it becomes possible to show various tactile sensations.

  In addition, it is preferable that the ultrasonic modulation means performs either frequency modulation or phase modulation. Further, it is more preferable to perform amplitude modulation in addition to this processing. Furthermore, it is preferable that the amplitude modulation system is suppressed carrier wave single sideband amplitude modulation.

  There are various possible modulation methods in the ultrasonic modulation process as described above. However, if suppressed carrier double-sideband amplitude modulation is used, noise waves that are different from the original base wave (vibration wave based on waveform data) are likely to be generated during demodulation. In many cases, the tactile sensation is uncomfortable. Therefore, the inventor has found that such a problem can be solved by using suppressed carrier wave single sideband amplitude modulation. In addition, it has been confirmed that frequency modulation and phase modulation have higher demodulation efficiency than such amplitude modulation. These frequency modulation and phase modulation can be said to have a problem in energy saving because they always output a carrier wave. However, such a problem is caused by performing frequency modulation or phase modulation and amplitude modulation to maintain high demodulation efficiency. As a result, the power consumption can be reduced.

  In addition, the vibration waveform data generation means is configured to optimize the vibration waveform database based on the vibration waveform database storing a plurality of the waveform data set for each type of tactile sensation and the detection result by the contact detection means. Vibration waveform data extracting means for extracting the waveform data may be provided.

  Thus, by storing the waveform data corresponding to the type of tactile sensation in advance, the processing speed can be improved. Examples of the tactile sensation include a smooth feeling, a rough feeling, a catching feeling, a pressure feeling, a pressing feeling, a hit feeling, a numbness feeling, an itching feeling, a pain feeling, a heat feeling, and a cooling feeling.

  Further, the vibration waveform data extraction means is further for extracting the waveform data from the vibration waveform database based on image data displayed on a portion of the display screen where the contact part is in contact. May be.

  Thereby, the tactile sensation suitable for an image can be presented. For example, when touching an image of a needle, it is preferable to present a feeling of pain, and when touching an image of ice, a cool feeling may be presented.

  The present invention also includes a step of detecting a state in which the user's operation part is in contact with the display means, and a predetermined tactile vibration is applied to the part in contact with the operation part based on the detected state. Generating waveform data to be generated; performing a modulation process on the waveform data using an ultrasonic wave as a carrier; and contacting the display unit based on an ultrasonic modulation signal generated by the modulation process Generating a tactile vibration that gives a predetermined tactile sensation to the operation site.

  The effect by this method is the same as that by the said apparatus.

  According to the present invention, it is possible to simultaneously realize noise reduction and diversification of operational feeling.

It is a block diagram which shows the functional structure of the tactile sense presentation apparatus which concerns on this invention. It is a block diagram which shows the example at the time of comprising the tactile sensation presentation apparatus based on this Embodiment with the computer system. It is a figure which shows the hardware constitutions of the tactile sense presentation apparatus which concerns on this Embodiment. It is a figure which shows the process by MPU which concerns on this Embodiment. It is a flowchart which shows the flow of the process by MPU which concerns on this Embodiment.

Embodiment 1
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram showing a functional configuration of a tactile sensation providing apparatus 1 according to the present invention. The tactile sensation providing apparatus 1 includes display means 11, contact detection means 12, vibration generation means 13, vibration waveform data generation means 14, and ultrasonic modulation means 15.

  The display unit 11 displays a predetermined image and includes, for example, a liquid crystal panel, an organic EL display, and the like.

  The contact detection unit 12 detects a state when an operation site such as a user's finger is brought into contact with the display unit 11 and includes a touch panel mechanism including various sensors. As this sensor, a sensor capable of detecting position, speed, acceleration, pressing, pressing change rate, and the like is preferable.

  The vibration generating means 13 generates a tactile vibration that gives a predetermined tactile sensation to the operation part that is in contact with the display means 11, and is a vibration transmission panel that is arranged to overlap the display means 11. The vibration transmission panel includes an actuator that outputs a predetermined vibration wave.

  The vibration waveform data generation means 14 generates waveform data for generating a vibration wave by the vibration generation means 13 based on the detection result by the contact detection means 12, and includes an MPU including a predetermined control program. (Micro Processing Unit).

  The ultrasonic modulation means 15 performs modulation processing on the waveform data generated by the vibration waveform data generation means 14 using ultrasonic waves, that is, vibration waves having a frequency higher than the audible band (approximately 20 kHz or more) as a carrier wave, An ultrasonic modulation signal is generated. This ultrasonic modulation signal is output to the vibration generating means 13 and used as a signal for generating a vibration wave that presents a predetermined tactile sensation. The ultrasonic modulation means 15 is constituted by an MPU or the like including a predetermined control program.

  FIG. 2 is a block diagram showing an example in which the tactile sensation providing apparatus 1 is configured using a predetermined computer system. The computer system includes a central processing unit 21, a storage device 22, an input device 23, an output device 24, and a bus 25. FIG. 3 is a diagram schematically showing a hardware configuration of the tactile sensation providing apparatus 1. The tactile sensation providing apparatus 1 includes an MPU 20, a display 51, a touch panel mechanism 41, and a vibration generating mechanism 50 that constitute a part of the computer system.

  In FIG. 2, the central processing unit 21 is constituted by a CPU (Central Processing Unit), and performs various controls and calculations according to a program stored in the storage device 22.

  The storage device 22 includes a RAM (Random Access Memory), a ROM (Read Only Memory), and the like, and includes a program memory 31 and a data memory 32 as storage areas. The program memory 31 stores an ultrasonic modulation program 35 for executing processing related to the ultrasonic modulation means 15, a waveform data extraction program 36 for extracting optimum waveform data from waveform data 36 to be described later, and the like. . The data memory 32 includes a vibration waveform database (DB) 37 for storing various types of waveform data, an image database (DB) 38 for storing data of images displayed on the display 51, and the like.

  The input device 23 includes the touch panel mechanism 41. The touch panel mechanism 41 is physically configured integrally with the display 51.

  The output device 24 includes the display 51, an actuator 52, a vibration transmission panel 53, and the like. The actuator 52 and the vibration transmission panel 53 constitute a part of the vibration generating mechanism 50. The actuator 52 generates a vibration wave in the vibration transmission panel 53 according to an input signal, and the vibration generated in the vibration transmission panel 53 is felt by the operation part.

  FIG. 4 is a block diagram showing processing by the MPU 20 according to the present embodiment. As shown in the figure, optimal waveform data is obtained from the vibration waveform DB 37 based on the contact state information 101 detected by the touch panel mechanism 41 and image data 102 for displaying a predetermined image 55 on the display 51. Optimal waveform extraction processing 103 to be extracted is performed. The contact state information 101 is preferably information indicating coordinate data of the contact part 56 on the display 51, a moving direction, a moving speed, a contact pressure, a contact time, and the like of the contact part 56. By referring to the contact state information 101 and the image data 102, it is possible to determine how and what image 55 on the display 51 is touched by the contact portion 56. Based on the determination result, the waveform data presenting the optimum tactile sensation can be extracted from the drive waveform database 37. Of course, new waveform data may be generated based on the contact state information 101, the image data 102, and the like.

  Then, the optimum waveform data generated (extracted) as described above is subjected to the ultrasonic modulation processing 104 to become an ultrasonic modulation signal 105, which is output as a drive signal to the actuator 52 of the vibration generating mechanism 50. The

  The ultrasonic modulation processing 104 performs modulation processing using the ultrasonic wave as a carrier wave on the optimal waveform data extracted by the optimal waveform extraction processing 103 or generated by other processing. In the ultrasonic modulation processing 104, frequency modulation, phase modulation, and amplitude modulation are performed. Frequency modulation and phase modulation exhibit higher demodulation efficiency than amplitude modulation. In addition to performing frequency modulation or phase modulation, and performing amplitude modulation, the highest demodulation efficiency can be obtained. The amplitude modulation method used here is preferably suppressed carrier single sideband amplitude modulation (SSB: Single Sideband). If suppressed carrier sideband amplitude modulation (DSB) is used, noise tends to occur during demodulation.

  FIG. 5 is a flowchart showing a flow of processing by the MPU 20 according to the present embodiment. When the coordinate information of the place where the contact part 56 is in contact on the display 51 is acquired by the signal from the touch panel mechanism 41 (S201), whether or not the contact point is within the designated image range. Is determined (S202). The designated image range is a range in which a tactile sensation should be presented to the contact portion 56, and is set as appropriate based on the position of the image displayed on the display 51, the effective range of the vibration effect of the vibration generating mechanism 50, and the like. Is.

  If it is determined in step S202 that the contact portion 56 is within the specified image range (YES), it is determined whether or not the contact portion 56 is stationary at the contact point for a certain time or more. (S203). In this step S203, when it is determined that the camera is stationary for a predetermined time or longer (YES), the vibration generating mechanism 50 performs a process of presenting a click feeling or a tactile sensation equivalent to the contact site 56 ( S204).

  If it is determined in step S203 that the contact portion 56 has not been stationary for a predetermined time (NO), it is determined whether or not the contact portion 56 has moved (S205). If it is determined in step S205 that the contact portion 56 has not moved (NO), stationary processing such as temporary stop of waveform output and output of another waveform according to the conditions is performed (S206). On the other hand, if it is determined in step S205 that the contact portion 56 has moved (YES), a tactile sensation process that presents a tactile sensation according to the image is performed (S207). In this tactile sensation process, selection of a presentation waveform according to a specific image range, adjustment of amplitude / frequency according to speed / acceleration, and the like are performed. Thereafter, it is determined again whether or not the contact portion 56 is within the designated image range (S208). If it is determined that the contact portion 56 is within the range (YES), the step S205 is executed, and is not within the range. Is determined (NO), step S202 is executed.

  According to the tactile sensation providing apparatus 1 having the above-described configuration, it is possible to simultaneously realize noise reduction and diversification of operation feeling. In the ultrasonic modulation processing 104, by performing amplitude modulation together with frequency modulation or phase modulation, power consumption can be suppressed while maintaining high demodulation efficiency.

  The present invention can be applied to various display devices including a touch panel.

DESCRIPTION OF SYMBOLS 1 Tactile sensation presentation apparatus 11 Display means 12 Contact detection means 13 Lead generation means 14 Vibration waveform data generation means 15 Ultrasonic modulation means 41 Touch panel mechanism 51 Display 50 Vibration generation mechanism

Claims (12)

Display means;
Contact detection means for detecting a contact state of the user's operation part to the display means;
Tactile sensation vibration generating means for generating tactile sensation vibration that gives a predetermined tactile sensation to the operation part in contact with the display means;
Vibration waveform data generating means for generating waveform data for generating the tactile vibration based on the detection result by the contact detecting means;
The waveform data generated by the vibration waveform data generation means is subjected to modulation processing using ultrasonic waves as a carrier wave, and the ultrasonic modulation signal generated by the modulation processing is used as the tactile sensation as a signal for generating the tactile vibration. Ultrasonic modulation means for outputting to the vibration generating means;
A tactile sensation presentation device. The ultrasonic modulation means performs either frequency modulation or phase modulation.
The tactile sensation providing apparatus according to claim 1. The ultrasonic modulation means further performs amplitude modulation.
The tactile sensation providing apparatus according to claim 2. The ultrasonic modulation means performs suppressed carrier wave single sideband amplitude modulation;
The tactile sensation presentation apparatus according to claim 1 or 3. The vibration waveform data generating means includes
A vibration waveform database storing a plurality of the waveform data set for each type of tactile sensation;
Vibration waveform data extraction means for extracting the optimum waveform data from the vibration waveform database based on the detection result by the contact detection means;
A tactile sensation providing apparatus according to any one of claims 1 to 4. The vibration waveform data extracting means further extracts the waveform data from the vibration waveform database based on image data displayed on a portion of the display screen where the contact part is in contact.
The tactile sensation providing apparatus according to claim 5. Detecting a state where the user's operation part is in contact with the display means;
Generating waveform data for generating a predetermined tactile vibration in a portion in contact with the operation site based on the detected state;
Performing a modulation process using ultrasonic waves as a carrier wave on the waveform data;
Generating a tactile sensation that gives a predetermined tactile sensation to the operation part in contact with the display unit based on the ultrasonic modulation signal generated by the modulation process;
A tactile sensation presentation method comprising: In the modulation process, either frequency modulation or phase modulation is performed.
The tactile sensation presentation method according to claim 7. In the modulation process, further amplitude modulation is performed.
The tactile sensation presentation method according to claim 8. In the modulation process, suppressed carrier single sideband amplitude modulation,
The tactile sensation presentation method according to claim 7 or 9. Extracting the optimum waveform data from the plurality of waveform data stored in advance for each type of tactile sensation based on the state where the operation part is in contact with the display means;
The tactile sensation presentation method according to any one of claims 7 to 10, further comprising: Extracting the waveform data based on image data displayed on a portion of the display screen where the contact part is in contact;
The tactile sensation presentation method according to claim 11, further comprising:

Images