WO2013114793A1 - 触感呈示装置および触感呈示方法 - Google Patents
触感呈示装置および触感呈示方法 Download PDFInfo
- Publication number
- WO2013114793A1 WO2013114793A1 PCT/JP2013/000144 JP2013000144W WO2013114793A1 WO 2013114793 A1 WO2013114793 A1 WO 2013114793A1 JP 2013000144 W JP2013000144 W JP 2013000144W WO 2013114793 A1 WO2013114793 A1 WO 2013114793A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- frequency
- panel
- tactile sensation
- signal
- user
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B06—GENERATING OR TRANSMITTING MECHANICAL VIBRATIONS IN GENERAL
- B06B—METHODS OR APPARATUS FOR GENERATING OR TRANSMITTING MECHANICAL VIBRATIONS OF INFRASONIC, SONIC, OR ULTRASONIC FREQUENCY, e.g. FOR PERFORMING MECHANICAL WORK IN GENERAL
- B06B1/00—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency
- B06B1/02—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency making use of electrical energy
- B06B1/0207—Driving circuits
- B06B1/0223—Driving circuits for generating signals continuous in time
- B06B1/0269—Driving circuits for generating signals continuous in time for generating multiple frequencies
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K15/00—Acoustics not otherwise provided for
- G10K15/02—Synthesis of acoustic waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
Definitions
- the present invention relates to a tactile sensation presentation apparatus that presents haptics when a user touches a panel.
- acoustic noise may occur because the panel is vibrated to provide a tactile sensation. This acoustic noise causes the user to feel uncomfortable or uncomfortable.
- the present invention provides a tactile sensation providing apparatus capable of reducing the uncomfortable feeling caused to the user due to acoustic noise when the tactile sensation is presented to the user by vibrating the panel.
- a tactile sensation presentation apparatus is a tactile sensation presentation apparatus that presents a tactile sensation to a user who touched a panel, and a position acquisition unit that acquires a position touched by the user on the panel and the panel
- a carrier signal generation unit that generates a sound signal
- an acoustic signal generation unit that generates an acoustic signal having a plurality of harmonics corresponding to a predetermined fundamental frequency
- a drive signal by adding the carrier signal and the acoustic signal.
- an actuator that presents a tactile sensation to the user by vibrating the panel according to the drive signal.
- the tactile sensation providing apparatus it is possible to reduce a sense of incongruity caused to the user by acoustic noise when the tactile sensation is presented to the user by vibrating the panel.
- FIG. 1A is a diagram illustrating frequency characteristics of human hearing.
- FIG. 1B is a diagram illustrating frequency characteristics of human tactile sensation.
- FIG. 2 is a diagram illustrating the relationship between the touch position and the vibration frequency.
- FIG. 3 is a diagram illustrating a change in frequency of acoustic noise when the touch position is changed.
- FIG. 4 is a configuration diagram of the tactile sensation providing apparatus according to the first embodiment.
- FIG. 5 is a diagram illustrating an example of an xy coordinate system for representing a touch position.
- FIG. 6 is a diagram illustrating an example of information stored in the storage unit according to the first embodiment.
- FIG. 7 is a diagram illustrating another example of information stored in the storage unit according to the first embodiment.
- FIG. 1A is a diagram illustrating frequency characteristics of human hearing.
- FIG. 1B is a diagram illustrating frequency characteristics of human tactile sensation.
- FIG. 2 is a diagram illustrating the relationship between the touch position and the vibration frequency.
- FIG. 3 is
- FIG. 8 is a diagram illustrating an example of the arrangement of panels and actuators in the first embodiment.
- FIG. 9A is a diagram illustrating an example of a vibration distribution of the panel when the frequency is 210 Hz.
- FIG. 9B is a diagram illustrating an example of a vibration distribution of the panel when the frequency is 350 Hz.
- FIG. 10 is a diagram illustrating the vibration distribution of the panel when the frequency is switched according to the touch position.
- FIG. 11 is a diagram showing the characteristics of frequency and amplitude intensity.
- FIG. 12 is a flowchart showing processing of the acoustic signal generation unit in the first embodiment.
- FIG. 13 is a flowchart showing the operation of the tactile sensation providing apparatus according to the first embodiment.
- FIG. 9A is a diagram illustrating an example of a vibration distribution of the panel when the frequency is 210 Hz.
- FIG. 9B is a diagram illustrating an example of a vibration distribution of the panel when the frequency is 350 Hz.
- FIG. 10 is
- FIG. 14 is a diagram illustrating an example of the acoustic signal generated by the acoustic signal generation unit in the first modification of the first embodiment.
- FIG. 15 is a configuration diagram of the tactile sensation providing apparatus according to the second embodiment.
- FIG. 16 is a graph showing an example of the touch speed, the modulation signal, and the modulated drive signal in the second embodiment.
- FIG. 17 is a diagram illustrating an example of an image displayed on the panel.
- FIG. 18 is a diagram illustrating an example of an image displayed on the panel.
- FIG. 19A is a diagram illustrating an example of a modulated signal, a drive signal, and a modulated drive signal in Embodiment 2.
- FIG. 19B is a diagram illustrating an example of a modulated signal, a drive signal, and a modulated drive signal in Embodiment 2.
- acoustic noise When a panel is vibrated to present a tactile sensation, a sound that can be heard by the user (hereinafter referred to as “acoustic noise”) is generated according to the vibration frequency of the panel.
- the acoustic noise may cause the user to feel uncomfortable or uncomfortable. Therefore, a technique for making acoustic noise inaudibly inconspicuous by adding a frequency different from the vibration frequency of the touch panel to the vibration frequency of the touch panel has been proposed (for example, see Patent Document 1).
- FIG. 1A shows the frequency characteristics of human hearing. That is, FIG. 1A shows a frequency band (hearing band) of vibration that can be perceived by human hearing. Specifically, FIG. 1A shows the minimum audible range in human hearing. As shown in FIG. 1A, a human can perceive vibrations from about 20 Hz to 20 kHz.
- FIG. 1B shows the frequency characteristics of human haptics. That is, FIG. 1B shows a frequency band (haptic band) of vibration that can be perceived by human tactile sense. Specifically, FIG. 1B shows frequency characteristics of vibration detection threshold values of three tactile sensation receptors (SAI, FAI, FAII) possessed by humans. It shows that sensitivity is so high that a threshold value is low. As shown in FIG. 1B, it can be seen that the tactile sensation receptor can detect vibrations ranging from several Hz to about 500 Hz.
- SAI, FAI, FAII tactile sensation receptor
- the vibration frequency band (20 Hz to 20 kHz) perceptible by humans and the vibration frequency band (several Hz to 500 Hz) perceptible by tactile sensation are overlapped in a band of about 20 Hz to about 500 Hz. That is, when the panel is vibrated in a frequency band that can be perceived by touch, acoustic noise that can be perceived by hearing is generated.
- FIG. 2 shows the relationship between the touch position and the vibration frequency.
- 210 Hz vibration is applied to the panel 1101 by the actuator 1107. That is, when the touch position is included in the region 1401, 210 Hz acoustic noise is generated.
- vibration of 350 Hz is applied to the panel 1101 by the actuator 1107. That is, when the touch position is included in the area 1402, acoustic noise of 350 Hz is generated.
- the acoustic noise also changes every time the area including the touch position is switched.
- FIG. 3 shows changes in the frequency of acoustic noise when the touch position changes.
- the acoustic noise changes discontinuously according to the change in the touch position.
- Such a change in acoustic noise is sensitively perceived by the auditory sense and causes the user to feel uncomfortable.
- Patent Document 1 it is difficult to reduce such a change in acoustic noise.
- the vibration frequency of the panel for presenting a tactile sensation according to the touch position on the panel when changing the vibration frequency of the panel for presenting a tactile sensation according to the touch position on the panel, the change in acoustic noise due to the change in the touch position is reduced.
- a tactile sensation providing apparatus capable of reducing a sense of incongruity caused to a user by noise.
- a tactile sensation presentation apparatus is a tactile sensation presentation apparatus that presents a tactile sensation to a user who touched a panel, and a position acquisition unit that acquires a position touched by the user on the panel and the panel
- a carrier signal generation unit that generates a sound signal
- an acoustic signal generation unit that generates an acoustic signal having a plurality of harmonics corresponding to a predetermined fundamental frequency
- a drive signal by adding the carrier signal and the acoustic signal.
- an actuator that presents a tactile sensation to the user by vibrating the panel according to the drive signal.
- a drive signal in which acoustic signals having a plurality of harmonics corresponding to a predetermined fundamental frequency are added is generated.
- the fundamental frequency may be the same as the first frequency or the second frequency.
- one of the first frequency and the second frequency can be used as the fundamental frequency. Therefore, the type of sound perceived by the user can be reduced to two types: the sound of the fundamental frequency, the other sound of the first frequency and the second frequency, and the sound of the fundamental frequency, and the user feels more uncomfortable. Can be reduced.
- the first frequency may be one of a plurality of resonance frequencies of the panel
- the second frequency may be another one of the plurality of resonance frequencies of the panel.
- the resonance frequency of the panel can be used as the first frequency and the second frequency. Therefore, the panel can be vibrated efficiently with less energy.
- the fundamental frequency may be a frequency at which the panel resonates most among the plurality of resonance frequencies.
- the frequency at which the panel resonates most can be used as the fundamental frequency.
- the greater the panel amplitude the louder the sound perceived by the user. Therefore, when vibration with the most resonant frequency is given to the panel and vibration with another resonance frequency is given to the panel, the most perceived sound can be continuously perceived by the user. As a result, the change in acoustic noise can be further reduced, and the uncomfortable feeling that occurs to the user can be further reduced.
- each of the plurality of harmonics may be a harmonic having a frequency higher than an upper limit frequency predetermined as an upper limit of a vibration frequency perceived by the user by touch.
- harmonics having a frequency higher than the upper limit frequency can be used as the plurality of harmonics included in the acoustic signal. Therefore, the change in tactile sensation that occurs to reduce the change in acoustic noise can be suppressed.
- the actuator includes a first actuator and a second actuator that are arranged at different positions, and the carrier signal generation unit is arranged at the first position when the touched position is the first position.
- a carrier signal for the first actuator and a carrier signal for the second actuator having a corresponding phase relationship are generated, and the drive signal generation unit is configured to generate a carrier signal and the acoustic signal for the first actuator.
- To generate a drive signal for the first actuator and By adding the carrier signal and the acoustic signal for the second actuator may generate a driving signal for the second actuator.
- the phase relationship corresponding to the touch position can be used when generating carrier signals for a plurality of actuators. Therefore, the variation of the carrier signal can be increased, and the panel can be vibrated more efficiently.
- the acoustic signal generation unit may generate the acoustic signal having the plurality of harmonics whose signal intensity is smaller as the frequency is higher.
- FIG. 4 is a configuration diagram of the tactile sensation providing apparatus 100 according to the first embodiment. This tactile sensation providing apparatus 100 presents a tactile sensation to the user who touched the panel.
- the tactile sensation providing apparatus 100 includes a panel 101, a position acquisition unit 102, a storage unit 103, a carrier signal generation unit 104, an acoustic signal generation unit 105, a drive signal generation unit 106, and an actuator. 107.
- Panel 101 transmits vibrations for presenting a tactile sensation to the user.
- the panel 101 is a member made of glass or acrylic, for example.
- the panel 101 is also a screen for displaying content and the like.
- the content is, for example, an image such as an animal, clothes or a game, or a video such as a singer promotion video or a movie.
- the content may be a button arrangement such as a software keyboard.
- the material, shape, size, thickness, hardness, fixing method, and the like of the panel 101 are not particularly limited.
- the position acquisition unit 102 acquires a touched position (touch position) on the panel 101 when the user touches the panel 101.
- the touch position corresponds to one pixel or a plurality of pixels on the panel 101.
- FIG. 5 shows an example of an xy coordinate system for representing a touch position.
- the x-axis is set in the horizontal direction (direction parallel to the long side) of the rectangular panel 101 of about 12 inches (vertical: 150 mm, horizontal: 250 mm), and in the vertical direction (direction parallel to the short side).
- the y axis is set.
- the origin 0 (0, 0) is set at the upper left corner of the panel 101.
- the scales of the x coordinate and the y coordinate are set to 0.25 mm, 0.15 mm, and 0.25 mm, respectively. That is, the coordinates of the point A at the lower right corner of the panel 101 are (1000, 1000).
- the position acquisition unit 102 acquires the touch position by, for example, a capacitance method or a resistance film method. Note that the touch position acquisition method need not be limited to the capacitance method and the resistance film method.
- the position acquisition unit 102 acquires a touch position by a capacitance method.
- the position acquisition unit 102 acquires the touch position by detecting a change in the capacitance of the panel 101.
- the position acquisition unit 102 continuously acquires the center position of the touched range on the panel 101 as the touch position at predetermined time intervals.
- the position acquisition unit 102 may acquire the center of gravity of the load as the touch position instead of the center position.
- the position acquisition unit 102 may acquire a time when the user touches the panel 101 (touch time).
- the touch time may not include the date as 11: 11: 11: 11, but may include the date (11: 11: 11: 11, November 11, 2011). Note that the touch time may be acquired simultaneously with the touch position.
- the storage unit 103 stores a plurality of frequencies corresponding to a plurality of positions on the panel 101.
- Each of the plurality of frequencies stored in the storage unit 103 may be the resonance frequency of the panel 101.
- the resonance frequency of panel 101 is a frequency (natural frequency) at which panel 101 vibrates naturally. When panel 101 vibrates at the natural frequency of panel 101, the amplitude increases.
- the resonance frequency of the panel 101 is determined depending on the member, size, thickness, hardness, and the like of the panel 101.
- Each of the plurality of frequencies stored in the storage unit 103 may be a frequency at which the user perceives tactile sensation.
- the frequency at which the user perceives tactile sensation is a frequency in a band where the user can perceive tactile sensation.
- the frequency band in which a human can perceive a tactile sensation is in a range higher than 0 Hz and lower than 500 Hz, as shown in FIG. 1B. Therefore, the frequency band in which the user can perceive a tactile sensation is within a range higher than 0 Hz and lower than 500 Hz, for example.
- a plurality of frequencies may be set for each user.
- the format for storing a plurality of frequencies corresponding to a plurality of positions may be any format as long as the frequency corresponding to the position on the panel 101 can be specified.
- FIG. 6 shows an example of information stored in the storage unit 103 according to the first embodiment.
- the storage unit 103 stores a pair of a rectangular area and a frequency specified by the coordinates of the lower left position and the coordinates of the lower right position.
- the touch position (10, 10) is included in a rectangular area specified by the upper left position (0, 0) and the lower right position (100, 1000). Therefore, the frequency corresponding to the touch position (10, 10) is “210 Hz”.
- the information stored in the storage unit 103 may include phase information in addition to the frequency.
- the phase information is information indicating a phase relationship between a plurality of carrier signals or a phase relationship between a plurality of drive signals.
- the phase information is information indicating any one of in-phase, anti-phase, and phase delay, for example.
- FIG. 7 shows another example of information stored in the storage unit 103 according to the first embodiment.
- the storage unit 103 stores the frequency and phase (phase information) corresponding to the rectangular area.
- the frequency and phase corresponding to the touch position are “210 Hz” and “In-phase”.
- the frequency and phase corresponding to the touch position are “350 Hz” and “reverse phase”. It is.
- the storage unit 103 may be configured by, for example, a semiconductor memory, a magnetic disk, or an optical disk.
- the storage unit 103 may be a storage device (for example, NAS (Network Attached Storage) or a memory card) connected to the tactile sensation providing apparatus 100 via a communication interface. In such a case, the tactile sensation providing apparatus 100 may not include the storage unit 103.
- NAS Network Attached Storage
- storage part 103 may memorize
- the predetermined threshold is an amplitude at which a tactile sensation can be perceived, and is about several ⁇ m, for example.
- FIG. 8 shows an example of the arrangement of the panel 101 and the actuator 107 (first actuator 107A and second actuator 107B) in the first embodiment.
- Each of FIG. 9A and FIG. 9B shows an example of the vibration distribution of the panel 101.
- Panel 101 and actuator 107 are in contact with each other.
- the drive frequency of the actuator 107 is the resonance frequency of the panel 101.
- FIG. 9A shows an actual measurement result of the vibration distribution of the panel 101 when the drive signal of the first actuator 107A and the drive signal of the second actuator 107B are in phase and the frequency of each drive signal is 210 Hz.
- a dark color region indicates that the vibration amplitude of the panel 101 is large, and a light color region indicates that the vibration amplitude of the panel 101 is small. That is, in FIG. 9A, a region 301 corresponds to a vibration node. Therefore, when the two drive signals are in phase and the frequency of each drive signal is 210 Hz, the region 301 may not be able to present a tactile sensation.
- FIG. 9B shows an actual measurement result of the vibration distribution of the panel 101 when the drive signal of the first actuator 107A and the drive signal of the second actuator 107B are in opposite phases and the frequency of each drive signal is 350 Hz.
- a region 302 corresponds to a vibration node. Therefore, when the two drive signals are out of phase and the frequency of each drive signal is 350 Hz, the region 302 may not be able to present a tactile sensation.
- the frequency of the drive signal needs to be changed according to the touch position on the panel 101.
- FIG. 10 shows the vibration distribution of the panel when the frequency is switched according to the touch position. As shown in FIG. 10, by changing the frequency for vibrating the panel 101 depending on the position on the panel 101, a tactile sensation is presented to the user at any position on the panel 101.
- phase information is used, but phase information may not be used. Even in such a case, the tactile sensation can be presented to the user at most positions on the panel 101 by changing the frequency for vibrating the panel 101 according to the touch position.
- the carrier signal generation unit 104 refers to the information stored in the storage unit 103 and acquires a frequency corresponding to the touch position acquired by the position acquisition unit 102. Then, the carrier signal generation unit 104 generates a carrier signal having the acquired frequency component.
- the carrier signal generation unit 104 generates a carrier signal having a first frequency component when the touch position is the first position, and has a second frequency component when the touch position is the second position. Generate a signal.
- the first position and the second position are different positions on the panel 101.
- the carrier signal generation unit 104 determines which area of the plurality of areas includes the touch position. Then, the carrier signal generation unit 104 generates a carrier signal having a frequency component corresponding to the region including the touch position.
- the carrier signal generation unit 104 refers to the information illustrated in FIG. 6 and changes the region including the touch position to the upper left position (100, 0) and the lower right position ( 200, 1000). Then, the carrier signal generation unit 104 generates a carrier signal having a component with a frequency of 350 Hz corresponding to the determined region.
- the carrier signal generation unit 104 may acquire phase information corresponding to the touch position with reference to the information illustrated in FIG. 7 and generate a carrier signal using the acquired phase information. For example, when the touch position is (150, 500), the carrier signal generation unit 104 generates two carrier signals of opposite phases with a frequency of 350 Hz (a carrier signal for the first actuator 107A and a carrier signal for the second actuator 107B). ) Is generated.
- the carrier signal generation unit 104 generates, as a carrier signal, a sine wave having an intensity (amplitude) of 1 and a frequency of F c according to the following formula (1), for example.
- s c is a carrier signal
- F c is a frequency corresponding to the touch position among a plurality of frequencies stored in the storage unit 103
- t is time.
- the carrier signal generation unit 104 does not need to generate a carrier signal, and may only determine the frequency corresponding to the touch position.
- the carrier signal generation unit 104 may be configured by a CPU, for example.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics corresponding to a predetermined fundamental frequency.
- the acoustic signal generation unit 105 has an acoustic signal having a plurality of harmonics corresponding to at least one predetermined frequency (fundamental frequency) among the plurality of frequencies stored in the storage unit 103. Is generated. That is, here, the fundamental frequency is at least one of a plurality of frequencies stored in the storage unit 103.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics corresponding to the same fundamental frequency regardless of the touch position. That is, the acoustic signal generation unit 105 generates the same acoustic signal both when the touch position is the first position and when the touch position is the second position.
- harmonics are high-order frequency components that are integer multiples of the fundamental frequency.
- the harmonics are components of 700 Hz, 1050 Hz, 1400 Hz,.
- the acoustic signal has a plurality of harmonics. Therefore, the acoustic signal has at least two or more frequencies excluding the fundamental frequency, and has a higher-order frequency component that is an integral multiple of the fundamental frequency. For example, the acoustic signal has a frequency component twice the fundamental frequency (second harmonic), a frequency component three times (third harmonic),. Harmonics). However, n is an integer of 4 or more. Note that the more the types (frequency) of harmonics included in the sound perceived by the user, the more the user tends to feel the sound of the fundamental frequency corresponding to those harmonics.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics corresponding to the same fundamental frequency regardless of the touch position.
- the Sound When a person hears a sound having a plurality of harmonics corresponding to one fundamental frequency, the sound contains a fundamental frequency component even if the sound does not contain a fundamental frequency component (fundamental wave). Perceives sounds with the same pitch (fundamental frequency) as when listening. This phenomenon is known as the Missing F0 phenomenon. By utilizing this phenomenon, the user's uncomfortable feeling due to the discontinuity of the acoustic noise can be reduced.
- the frequency of the carrier signal is changed according to the touch position in order to present a tactile sensation to the user. Then, a drive signal for the actuator 107 is generated using this carrier signal. Therefore, when the user performs an operation of changing the touch position (for example, when an operation of tracing the panel 101 is performed), the vibration frequency of the panel 101 may change during the operation. Then, when the vibration frequency of the panel 101 changes, the acoustic noise also changes discontinuously.
- the acoustic noise generated when the touch position is the first position, and the touch position This is different from the acoustic noise generated when is at the second position. Therefore, when the user performs an operation of moving the touch position from the first position to the second position, the acoustic noise changes discontinuously.
- the acoustic signal generation unit 105 uses either the first frequency corresponding to the first position or the second frequency corresponding to the second position as the fundamental frequency. That is, the tactile sensation providing apparatus 100 generates sound having a plurality of harmonics corresponding to the same fundamental frequency in both cases where the touch position is the first position and the touch position is the second position. Let Then, due to the Missing F0 phenomenon, the user feels that a sound including the fundamental frequency component can be heard even if the sound does not include the fundamental frequency component. Therefore, the user feels as if the same acoustic noise is heard regardless of whether the touch position is the first position or the second position. As a result, the discontinuous change of the acoustic noise is reduced, and the user's uncomfortable feeling caused by the change is reduced.
- the acoustic signal generation unit 105 When the touch position is the third position, the acoustic signal generation unit 105 outputs an acoustic signal having a plurality of harmonics corresponding to the same fundamental frequency as when the touch position is the first position and the second position. Generate. Thereby, even when the user performs an operation of changing the touch position in the order of the first position, the second position, and the third position, the discontinuous change in the acoustic noise is reduced.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics corresponding to the same fundamental frequency regardless of the touch position will be described in more detail using a specific example.
- the plurality of frequencies stored in the storage unit 103 are 210 Hz and 350 Hz.
- the first frequency corresponding to the first position is 210 Hz
- the second frequency corresponding to the second position is 350 Hz.
- the user can hear acoustic noise of 210 Hz when the touch position is the first position, and can hear acoustic noise of 350 Hz when the touch position is the second position. Therefore, when the user performs an operation of moving the touch position from the first position to the second position, the acoustic noise changes discontinuously from 210 Hz to 350 Hz during the operation.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics corresponding to at least one frequency (for example, 350 Hz) among the plurality of frequencies 210 Hz and 350 Hz stored in the storage unit 103. . That is, the acoustic signal generation unit 105 includes a 700 Hz component (second harmonic), a 1050 Hz component (third harmonic),..., And a 350 ⁇ n Hz component (first harmonic) that are frequency components that are multiples of 350 Hz. An acoustic signal having n harmonics) is generated.
- the acoustic signal generation unit 105 outputs an acoustic signal having a plurality of harmonics corresponding to the fundamental frequency of 350 Hz. Generate. Therefore, in any case where the touch position is the first position and the touch position is the second position, sounds having the same plurality of harmonics are generated. Then, due to the Missing F0 phenomenon, when the touch position is the first position, the user hears acoustic noise having a fundamental frequency of 350 Hz, even though the panel vibration does not include a component having a fundamental frequency of 350 Hz. Feel like. When the touch position is the second position, the vibration of the panel includes a component having a fundamental frequency of 350 Hz. Therefore, even if an acoustic signal is not generated, the user may hear 350 Hz acoustic noise. hear.
- the acoustic noise associated with the change of the vibration frequency of the panel 101 can be heard. Discontinuous changes are reduced. As a result, user discomfort due to discontinuous changes in acoustic noise is reduced.
- each of the plurality of harmonics included in the acoustic signal may be a harmonic having a frequency higher than an upper limit frequency predetermined as an upper limit of the vibration frequency perceived by the user through touch.
- the predetermined upper limit frequency is, for example, 500 Hz as shown in FIG. 1B.
- the upper limit frequency may not be 500 Hz, and may be changed according to a part (for example, a finger or a palm) used by the user for touch.
- the fundamental frequency corresponding to the plurality of harmonics included in the acoustic signal may be a frequency at which the panel 101 resonates most among the plurality of resonance frequencies of the panel 101.
- the frequency at which the panel 101 resonates most is the frequency at which the vibration amplitude of the panel 101 becomes the largest.
- the sound pressure tends to increase as the amplitude increases. Therefore, the larger the amplitude, the louder the sound can be heard. Therefore, when the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics corresponding to the frequency (basic frequency) at which the panel 101 resonates most, the user feels that the sound of the fundamental frequency can be heard more. .
- the acoustic signal generation unit 105 may be configured using a CPU, for example.
- the strength of resonance can be obtained by using the Q value represented by the equation (2).
- ⁇ 0 is the resonance frequency.
- ⁇ 1 is a frequency at which the vibration energy is half the resonance frequency on the left side of the resonance frequency.
- ⁇ 2 indicates a frequency at which the vibration energy is half the resonance frequency on the right side of the resonance frequency (see FIG. 11).
- the acoustic signal generation unit 105 generates the acoustic signal s A according to the following equation (3), for example.
- the acoustic signal is a signal having n sine waves having an intensity of 1 and a frequency of kF b (k is an integer of 2 to n).
- s A represents an acoustic signal
- k represents an integer of 2 to n
- n represents an integer of 2 or more
- F b is one of a plurality of frequencies stored in the storage unit 103. (Fundamental frequency)
- t represents time.
- the acoustic signal generation unit 105 may not generate an acoustic signal, and may only determine a plurality of harmonic frequencies.
- the acoustic signal generation unit 105 generates an acoustic signal having all of a plurality of harmonics corresponding to each of the plurality of frequencies stored in the storage unit 103. Then, the user can hear acoustic noise corresponding to all of the frequencies stored in the storage unit 103 regardless of the touch position on the panel 101. Therefore, the discontinuous change of the acoustic noise accompanying the change of the vibration frequency of the panel 101 is reduced.
- the acoustic signal generation unit 105 determines one fundamental frequency from a plurality of frequencies
- the acoustic signal generation unit 105 has a higher frequency than the upper limit frequency of vibration perceived by tactile sensation among a plurality of harmonics corresponding to the plurality of frequencies.
- a frequency corresponding to a harmonic that is a harmonic and has the lowest frequency may be determined as the fundamental frequency.
- FIG. 12 is a flowchart showing processing of the acoustic signal generation unit 105 in the first embodiment.
- Step S101 The acoustic signal generation unit 105 acquires a plurality of frequencies stored in the storage unit 103.
- the acoustic signal generation unit 105 acquires 210 Hz and 350 Hz.
- Step S102 For each acquired frequency, the acoustic signal generation unit 105 calculates a second harmonic frequency corresponding to the frequency.
- the acoustic signal generation unit 105 calculates 420 Hz and 700 Hz as the second harmonic frequencies corresponding to 210 Hz and 350 Hz.
- Step S103 The acoustic signal generation unit 105 determines whether the frequency of the second harmonic calculated in step S102 is higher than the upper limit frequency for perceiving tactile sensation. If there is no frequency higher than the upper limit frequency, the process proceeds to step S104. If there is a frequency higher than the upper limit frequency, the process proceeds to step S105.
- the acoustic signal generation unit 105 determines that there is a frequency higher than the upper limit frequency (500 Hz), and proceeds to step S105.
- Step S104 The acoustic signal generation unit 105 calculates the frequency of the harmonic of the next order of the harmonic determined in step S103. And the acoustic signal generation part 105 performs step S103 again. Steps S103 and S104 are repeatedly executed until there is a frequency exceeding the upper limit frequency among the calculated harmonic frequencies.
- the acoustic signal generation unit 105 determines, as a fundamental frequency, a frequency corresponding to a harmonic having a frequency closest to the upper limit frequency among harmonic frequencies determined to be higher than the upper limit frequency. For example, when the harmonic frequency determined to be higher than the upper limit frequency is 700 Hz, the frequency 350 Hz corresponding to the 700 Hz harmonic is determined as the fundamental frequency.
- Step S106 The acoustic signal generation unit 105 creates a plurality of harmonics corresponding to the fundamental frequency determined in step S105 and having a frequency exceeding the upper limit frequency.
- the acoustic signal generation unit 105 creates harmonics of 700 Hz, 1050 Hz,.
- n is an integer of 2 or more.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics created in step S106. For example, when the frequencies of the plurality of generated harmonics are 700 Hz, 1050 Hz,..., 350 ⁇ n Hz, the acoustic signal generation unit 105 has harmonics of 350 Hz, 1050 Hz,. Generate an acoustic signal.
- step S101 to step S105 shown in FIG. 12 may be executed in advance before the touch position is acquired. That is, the fundamental frequency used for generating the acoustic signal may be determined in advance.
- the drive signal generation unit 106 generates a drive signal having the carrier signal generated by the carrier signal generation unit 104 and the acoustic signal generated by the acoustic signal generation unit 105. Specifically, the drive signal generation unit 106 generates a drive signal by adding the carrier signal and the acoustic signal. In other words, the drive signal generation unit 106 generates a drive signal by synthesizing the carrier signal and the acoustic signal. Accordingly, the drive signal includes a frequency component corresponding to the touch position and a plurality of harmonic frequency components.
- the drive signal generation unit 106 as shown in equation (4), a carrier signal s c generated by the equation (1), the sum of the acoustic signal s A generated by the equation (3), the drive Generated as signal s D.
- the drive signal generation unit 106 may generate a drive signal by weighted addition of the carrier signal and the acoustic signal.
- the drive signal is generated by adding the carrier signal and the acoustic signal with equal weight, the energy of the sound of the drive signal is increased, and the vibration of the panel 101 may be weakened. Therefore, the drive signal generation unit 106 can appropriately adjust the energy of the sound by weighting and adding the carrier signal and the acoustic signal. In this case, the drive signal generation unit 106 generates a drive signal using, for example, Expression (5).
- r is a value greater than 0 and less than 1.
- the actuator 107 is driven by the drive signal generated by the drive signal generation unit 106 and presents a tactile sensation to the user by vibrating the panel 101. That is, the actuator 107 presents a tactile sensation to the user by vibrating the panel 101 in accordance with the drive signal. That is, the actuator 107 gives the panel 101 the vibration indicated by the drive signal.
- the actuator 107 is stuck on the surface of the panel 101.
- the actuator 107 is not particularly limited, but can be configured using, for example, a piezoelectric element or a motor.
- the vibration applied by the actuator 107 is transmitted from the position where the actuator 107 is disposed to the touch position.
- a tactile sensation is presented to the user at the touch position.
- the actuator 107 includes the first actuator 107A and the second actuator 107B that are arranged at different positions, but may include three or more actuators. Thereby, like the above-mentioned measurement experiment, a some actuator can be driven according to the drive signal of an in-phase or a reverse phase, and the kind of vibration mode of the panel 101 can be increased.
- the actuator 107 may not include a plurality of actuators. That is, the actuator 107 may include only one actuator.
- the actuator 107 may be driven using the amplified drive signal after the drive signal generated by the drive signal generation unit 106 is amplified using an amplifier.
- the drive signal generation unit 106 can amplify the drive signal using an amplifier, thereby increasing the vibration of the panel and presenting a stronger tactile sensation to the user.
- FIG. 13 is a flowchart showing the operation of the tactile sensation providing apparatus 100 according to the first embodiment. The operation of the tactile sensation providing apparatus 100 will be described with reference to FIG. Here, it is assumed that the storage unit 103 stores a first frequency corresponding to the first position and a second frequency corresponding to the second position.
- Step S201 The position acquisition unit 102 acquires a position (touch position) touched by the user on the panel 101. Specifically, the position acquisition unit 102 acquires the coordinates of the touch position as shown in FIG.
- Step S202 The carrier signal generation unit 104 determines whether the touch position is the first position or the second position. Specifically, the carrier signal generation unit 104 determines which of the plurality of areas defined by the information illustrated in FIG. 6 includes the touch position, so that the touch position is the first position. Or the second position.
- Step S203 When the touch position is the first position, the carrier signal generation unit 104 generates a carrier signal having a first frequency component corresponding to the first position. For example, when the touch position is (50,500), a carrier signal of 210 Hz is generated with reference to FIG.
- Step S204 When the touch position is the second position, the carrier signal generation unit 104 generates a carrier signal having a second frequency component corresponding to the second position. For example, when the touch position is (150, 500), a carrier signal of 350 Hz is generated with reference to FIG.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics corresponding to at least one of the first frequency and the second frequency.
- the fundamental frequency may be determined in advance according to the method shown in FIG. That is, the acoustic signal generation unit 105 performs acoustic signals having a plurality of harmonics corresponding to the same fundamental frequency in both the case where the touch position is the first position and the case where the touch position is the second position. Is generated.
- Step S206 The drive signal generation unit 106 generates a drive signal by adding the carrier signal generated in step S203 or step S204 and the acoustic signal generated in step S205.
- Step S207 The actuator 107 presents a tactile sensation to the user by vibrating the panel 101 in accordance with the drive signal generated in step S206.
- the tactile sensation providing apparatus 100 can present tactile sensation to the user by executing the above steps S201 to S207, for example, when the user's touch is detected.
- step S201 the position acquisition unit 102 may acquire the time when the user touches the panel 101 in addition to the touch position.
- step S202 it has been determined which of the two positions (first position and second position) the touch position is, but it may be determined which of the three or more positions.
- the carrier signal generation unit 104 may determine which frequency the touch position corresponds to.
- the carrier signal generation unit 104 is a plurality of carrier signals having a frequency corresponding to the touch position, and A plurality of carrier signals having a phase relationship corresponding to the position may be generated.
- the plurality of carrier signals are carrier signals for a plurality of actuators (first actuator 107A and second actuator 107B).
- the carrier signal generation unit 104 and the acoustic signal generation unit 105 determine the frequency corresponding to the touch position and the frequencies of the plurality of harmonics without generating the carrier signal and the acoustic signal, respectively. May be.
- the drive signal generation unit 106 may generate a signal having a frequency component determined by the carrier signal generation unit 104 and a plurality of frequency components determined by the acoustic signal generation unit 105 as a drive signal. Good.
- tactile sensation providing apparatus 100 has an acoustic having a plurality of harmonics corresponding to a predetermined fundamental frequency regardless of whether the touch position is the first position or the second position.
- a drive signal added with the signal can be generated. Even if the sound does not contain the fundamental frequency component, the person perceives the fundamental frequency sound if the harmonics corresponding to the fundamental frequency are included (Missing F0 phenomenon). Therefore, even when the touch position is changed from the first position to the second position, the tactile sensation providing apparatus 100 can cause the user to perceive the sound of the fundamental frequency, and therefore the change in the acoustic noise due to the change in the touch position. Can be reduced. As a result, the tactile sensation providing apparatus 100 can reduce the user's uncomfortable feeling caused by discontinuous changes in acoustic noise.
- the tactile sensation providing apparatus 100 can use one of the first frequency and the second frequency as a fundamental frequency. Therefore, the tactile sensation providing apparatus 100 can reduce the types of sounds perceived by the user into two types of sounds of the fundamental frequency, the other sound of the first frequency and the second frequency, and the sound of the fundamental frequency, It is possible to further reduce the uncomfortable feeling that occurs to the user.
- the tactile sensation providing apparatus 100 can generate a signal having a resonance frequency component corresponding to the touch position as a carrier signal. Therefore, the tactile sensation providing apparatus 100 can vibrate the panel efficiently with less energy.
- the tactile sensation providing apparatus 100 can use the frequency at which the panel resonates most as the fundamental frequency. Generally, the greater the panel amplitude, the louder the sound perceived by the user. Therefore, when vibrations having other resonance frequencies are applied to the panel after vibrations having the most resonant frequency are applied to the panel, the tactile sensation providing apparatus 100 continuously causes the user to perceive the most perceived sound. be able to. As a result, the tactile sensation providing apparatus 100 can further reduce the change in the acoustic noise, and can further reduce the uncomfortable feeling that occurs to the user.
- the tactile sensation providing apparatus 100 can use harmonics having a frequency higher than the upper limit frequency as a plurality of harmonics included in the acoustic signal. Therefore, the tactile sensation providing apparatus 100 can suppress changes in tactile sensation that occur in order to reduce changes in acoustic noise.
- the tactile sensation providing apparatus 100 can use a phase relationship corresponding to the touch position when generating carrier signals for a plurality of actuators. Therefore, the tactile sensation providing apparatus 100 can increase the variation of the carrier signal, and can vibrate the panel more efficiently.
- the carrier signal is a signal for presenting a tactile sensation to the user.
- the acoustic signal is a signal for reducing a sense of incongruity that occurs to the user due to discontinuous changes in acoustic noise.
- the total energy of the drive signal which is a signal for driving the actuator 107 is constant.
- the energy corresponding to the carrier signal decreases.
- the signal strength for presenting a tactile sensation to the user is weakened. That is, if the energy corresponding to the acoustic signal increases, the sense of incongruity that occurs to the user due to the discontinuous change in acoustic noise decreases, but the tactile sensation presented to the user also decreases.
- the energy corresponding to the acoustic signal is adjusted so as to be as small as possible while ensuring the energy necessary for reducing the uncomfortable feeling generated by the user.
- the acoustic signal has many high-order harmonics, the ratio of the energy corresponding to the acoustic signal in the total energy of the drive signal is large, so the necessity for adjusting the energy corresponding to the acoustic signal is high.
- the tactile sensation providing apparatus 100 generates energy signals having a plurality of harmonics whose signal intensity is smaller as the frequency is higher, thereby reducing the discomfort that occurs to the user, and energy corresponding to the sound signals. Decrease.
- the components of the tactile sensation providing apparatus 100 according to the first modification of the first embodiment will be specifically described with a focus on differences from the first embodiment.
- the tactile sensation providing apparatus 100 in the present modification has the same configuration as the tactile sensation providing apparatus in the first embodiment, illustration is omitted.
- the acoustic signal generation unit 105 generates an acoustic signal having a plurality of harmonics whose signal intensity is smaller as the frequency is higher. That is, in this modification, the acoustic signal generation unit 105 adjusts the energy corresponding to the acoustic signal by adjusting the signal strength of each harmonic included in the acoustic signal.
- the acoustic signal generation unit 105 performs energy corresponding to the acoustic signal by, for example, a method of linearly reducing or exponentially reducing energy of a plurality of harmonics included in the acoustic signal. Adjust.
- the acoustic signal generation unit 105 In order to reduce the energy of a plurality of harmonics included in the acoustic signal exponentially, the acoustic signal generation unit 105 generates a plurality of harmonics having a signal intensity that is lower as the frequency is higher, as shown in Equation (6). An acoustic signal is generated.
- s A represents an acoustic signal
- t represents time
- k represents an integer of 2 to n
- F b represents a frequency stored in the storage unit 103
- ⁇ represents a constant.
- FIG. 14 shows an example of an acoustic signal generated by the acoustic signal generation unit 105 in the first modification of the first embodiment.
- the horizontal axis indicates the frequency
- the vertical axis indicates the energy corresponding to the frequency.
- each harmonic is adjusted such that the higher the higher harmonics, the smaller the spectral intensity (signal intensity or amplitude). As a result, the intensity of the acoustic signal is reduced as a whole.
- the acoustic signal generation unit 105 may delete higher-order harmonics of a certain order or more from a plurality of harmonics included in the acoustic signal when the intensity of the acoustic signal needs to be adjusted. .
- the sensitivity of human hearing is assumed to be high in a band of approximately 1 to 2 kHz. Therefore, the acoustic signal generation unit 105 may delete harmonics of 2 kHz or higher from the acoustic signal. Thereby, the acoustic signal generation unit 105 can reduce the influence on the auditory sense by reducing the intensity of the acoustic signal.
- the acoustic signal generation unit 105 may adjust the intensity of the acoustic signal so that the energy varies for each band. Thereby, the acoustic signal generation unit 105 can give the acoustic signal a timbre such as a wind instrument.
- the acoustic signal generation unit 105 may adjust the intensity of the acoustic signal so that the energy varies according to time. Thereby, the acoustic signal generation unit 105 can give the acoustic signal a natural tone different from an artificial sound (such as a buzzer sound).
- the drive signal generation unit 106 when the acoustic signal generation unit 105 determines the frequencies of a plurality of harmonics included in the acoustic signal, the drive signal generation unit 106 generates an acoustic signal having a plurality of harmonics whose signal intensity is smaller as the frequency is higher. May be.
- the tactile sensation providing apparatus 100 can generate an acoustic signal having a plurality of harmonics whose signal intensity is smaller as the frequency is higher. Therefore, the tactile sensation providing apparatus 100 can relatively reduce the intensity of the high frequency component that requires a large amount of energy to vibrate the panel, and can reduce the energy required to reduce the change in acoustic noise. it can.
- the second embodiment is mainly different from the first embodiment in that the drive signal is modulated.
- the second embodiment will be described with a focus on differences from the first embodiment.
- FIG. 15 is a configuration diagram of the tactile sensation providing apparatus 200 according to the second embodiment. 15, the same components as those in FIG. 4 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.
- the tactile sensation providing apparatus 200 includes a panel 101, a storage unit 103, a carrier signal generation unit 104, an acoustic signal generation unit 105, a drive signal generation unit 106, an actuator 107, a position acquisition unit 202, and a tactile velocity measurement unit. 208, a modulation signal generation unit 209, and a modulation unit 210.
- ⁇ Location acquisition unit 202> In addition to the touch position, the position acquisition unit 202 acquires a time when the user touches the panel 101 (touch time).
- the touch speed measurement unit 208 measures the touch speed (touch speed) by the user using the touch position and the touch time acquired by the position acquisition unit 202.
- the speed measurement unit 208 tactile the second touch position acquired by the touch time t (x t, y t) and the first touch position obtained by the touch time (t- ⁇ t) (x t -1, y t -1 ) and the haptic velocity (v x , v y ) is obtained from equation (7).
- v x indicates the touch speed in the horizontal direction
- v y indicates the touch speed in the vertical direction
- the modulation signal generation unit 209 generates a modulation signal having a higher frequency component as the touch speed measured by the touch speed measurement unit 208 increases.
- This modulation signal is a signal for modulating the drive signal of the actuator 107.
- FIG. 16 shows an example of the touch speed, the modulation signal, and the modulated drive signal.
- the tactile velocity changes from 0 mm / s to 10 mm / s at a constant acceleration from time 0 to 5 seconds.
- the modulation signal generation unit 209 generates a modulation signal as shown in FIG. Specifically, the modulation signal generation unit 209 generates a modulation signal using Expression (8).
- s m indicates the modulation signal
- a i represents the intensity of the i-th spatial frequency
- ⁇ (1 / mm) represents a spatial frequency of the displayed texture image onto the panel 101.
- the modulation signal generation unit 209 generates a modulation signal having a sine wave having a frequency proportional to the touch speed.
- the tactile speed used in Equation (8) is the speed v x in the direction (x direction) in which the user's touch crosses the striped pattern.
- the modulation signal generation unit 209 As the touch speed of the user increases, the number of texture stripes in FIG. 17 that pass through the unit time increases, so the modulation signal generation unit 209 generates a modulation signal having a higher frequency component. On the contrary, the modulation signal generation unit 209 generates a modulation signal having a lower frequency component as the tactile velocity is lower.
- the modulation unit 210 modulates the drive signal generated by the drive signal generation unit 106 using the modulation signal generated by the modulation signal generation unit 209. That is, the modulation unit 210 performs amplitude modulation or frequency modulation on the drive signal using the modulation signal. Specifically, the modulation unit 210 may perform amplitude modulation of the drive signal, for example, as in Expression (9).
- the modulation unit 210 may perform amplitude modulation of the drive signal as shown in Expression (10), for example.
- FIG. 16 (c) shows an example of a modulated drive signal.
- the modulation unit 210 multiplies the modulation signal having a frequency component corresponding to the touch speed by the drive signal for driving the actuator 107, thereby amplitude of the drive signal. Can be modulated.
- the modulation signal generation unit 209 generates a modulation signal for a half wavelength of a sine wave having a frequency corresponding to the button at the touch position, for example.
- the carrier signal generation unit 104 generates a carrier signal having a frequency component corresponding to the button. For example, when the position of the button corresponding to 210 Hz is the touch position, the modulation unit 210 modulates the drive signal as shown in FIG. 19A. For example, when the position of the button corresponding to 370 Hz is the touch position, the drive signal is modulated as shown in FIG. 19B.
- the tactile sensation providing apparatus has been described based on the embodiment, but the present invention is not limited to this embodiment. Unless it deviates from the gist of the present invention, various modifications conceived by those skilled in the art have been made in this embodiment, and forms constructed by combining components in different embodiments are also within the scope of one or more aspects. May be included.
- the tactile sensation providing apparatus includes the storage unit, but may not include the storage unit.
- the tactile sensation providing apparatus may acquire a frequency corresponding to the touch position from, for example, an external storage device.
- the tactile sensation providing apparatus modulates the drive signal, but may modulate the carrier signal and the acoustic signal.
- the tactile sensation providing apparatus may generate the drive signal by adding the modulated carrier signal and the modulated acoustic signal.
- each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component.
- Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
- the software that realizes the tactile sensation providing apparatus of each of the above embodiments is the following program.
- this program is a tactile sensation presentation method for presenting a tactile sensation to a user who touches a panel on a computer, the position obtaining step for obtaining a position touched by the user on the panel, and the touched Carrier signal generation for generating a carrier signal having a first frequency component when the position is the first position, and generating a carrier signal having a second frequency component when the touched position is the second position Generating an acoustic signal having a plurality of harmonics corresponding to a predetermined fundamental frequency, and generating a driving signal by adding the carrier signal and the acoustic signal Tactile sensation that presents tactile sensation to the user by vibrating the panel according to the step and the drive signal A step to execute the tactile sensation method comprising.
- a tactile sensation providing apparatus can present a tactile sensation to a user touching a panel, and thus includes a touch panel, a TV, a digital still camera, a digital movie camera, a personal computer, a portable information terminal, It is also useful for mobile phones.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Mechanical Engineering (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
本発明者らは、パネルを振動させることによりユーザに触感を呈示する場合に、音響ノイズによってユーザに生じる違和感に関して新たな知見を見出した。以下に、新たな知見について説明する。
図4は、実施の形態1における触感呈示装置100の構成図である。この触感呈示装置100は、パネルをタッチしたユーザに触感を呈示する。
パネル101は、ユーザに触感を呈示するための振動を伝達する。具体的には、パネル101は、例えば、ガラス製あるいはアクリル製の部材である。
位置取得部102は、ユーザがパネル101上をタッチした際、そのパネル101上のタッチされた位置(タッチ位置)を取得する。タッチ位置は、パネル101上の一画素または複数の画素に相当する。
記憶部103は、パネル101上の複数の位置に対応する複数の周波数を記憶している。
キャリア信号生成部104は、記憶部103に記憶されている情報を参照して、位置取得部102が取得したタッチ位置に対応する周波数を取得する。そして、キャリア信号生成部104は、取得した周波数の成分を有するキャリア信号を生成する。
音響信号生成部105は、予め定められた基本周波数に対応する複数の高調波を有する音響信号を生成する。
音響信号生成部105は、記憶部103に記憶されている複数の周波数を取得する。
音響信号生成部105は、取得した各周波数について、当該周波数に対応する第2高調波の周波数を算出する。
音響信号生成部105は、ステップS102で算出された第2高調波の周波数の中に、触感を知覚する上限周波数より高い周波数があるか否かを判断する。上限周波数より高い周波数がない場合は、ステップS104に進む。上限周波数より高い周波数がある場合は、ステップS105に進む。
音響信号生成部105は、ステップS103で判断された高調波の次の次数の高調波の周波数を算出する。そして、音響信号生成部105は、再びステップS103を実行する。算出された高調波の周波数の中に上限周波数を超える周波数が存在するまでステップS103およびステップS104が繰り返し実行される。
音響信号生成部105は、上限周波数よりも高いと判定された高調波の周波数の中から最も上限周波数に近い周波数の高調波に対応する周波数を基本周波数として決定する。例えば、上限周波数よりも高いと判定された高調波の周波数が700Hzである場合、700Hzの高調波に対応する周波数350Hzを基本周波数として決定する。
音響信号生成部105は、ステップS105で決定された基本周波数に対応する複数の高調波であって上限周波数を超える周波数の複数の高調波を作成する。
音響信号生成部105は、ステップS106で作成された複数の高調波を有する音響信号を生成する。例えば、作成された複数の高調波の周波数が700Hz、1050Hz、・・・、350×nHzである場合、音響信号生成部105は、350Hz、1050Hz、・・・および350×nHzの高調波を有する音響信号を生成する。
駆動信号生成部106は、キャリア信号生成部104により生成されたキャリア信号と、音響信号生成部105により生成された音響信号とを有する駆動信号を生成する。具体的には、駆動信号生成部106は、キャリア信号と音響信号とを加算することにより駆動信号を生成する。言い換えれば、駆動信号生成部106は、キャリア信号と音響信号とを合成することにより駆動信号を生成する。これにより、駆動信号は、タッチ位置に対応する周波数成分と、複数の高調波の周波数成分とを含む。
アクチュエータ107は、駆動信号生成部106により生成された駆動信号により駆動され、パネル101を振動させることによりユーザに触感を呈示する。つまり、アクチュエータ107は、駆動信号に従ってパネル101を振動させることにより、ユーザに触感を呈示する。すなわち、アクチュエータ107は、駆動信号が示す振動をパネル101に与える。
位置取得部102は、パネル101上の、ユーザによりタッチされた位置(タッチ位置)を取得する。具体的には、位置取得部102は、図5に示すように、タッチ位置の座標を取得する。
キャリア信号生成部104は、タッチ位置が第1位置であるか第2位置であるかを判定する。具体的には、キャリア信号生成部104は、タッチ位置が、図6に示す情報によって定義された複数の領域のいずれの領域に含まれるかを判定することにより、タッチ位置が第1位置であるか第2位置であるかを判定する。
キャリア信号生成部104は、タッチ位置が第1位置である場合に、第1位置に対応する第1周波数の成分を有するキャリア信号を生成する。例えば、タッチ位置が(50,500)である場合に、図6を参照して210Hzのキャリア信号を生成する。
キャリア信号生成部104は、タッチ位置が第2位置である場合に、第2位置に対応する第2周波数の成分を有するキャリア信号を生成する。例えば、タッチ位置が(150,500)である場合に、図6を参照して350Hzのキャリア信号を生成する。
音響信号生成部105は、第1周波数および第2周波数のうちの少なくとも一方の周波数に対応する複数の高調波を有する音響信号を生成する。基本周波数は、例えば図12に示す方法に従って予め定められればよい。すなわち、音響信号生成部105は、タッチ位置が第1位置である場合とタッチ位置が第2位置である場合との両方の場合において、同一の基本周波数に対応する複数の高調波を有する音響信号を生成する。
駆動信号生成部106は、ステップS203またはステップS204で生成されたキャリア信号と、ステップS205で生成された音響信号とを加算することにより駆動信号を生成する。
アクチュエータ107は、ステップS206で生成された駆動信号に従ってパネル101を振動させることにより、ユーザに触感を呈示する。
次に、実施の形態1の変形例1について説明する。
音響信号生成部105は、周波数が高いほど信号強度が小さい複数の高調波を有する音響信号を生成する。つまり、本変形例では、音響信号生成部105は、音響信号に含まれる各高調波の信号強度を調整することにより、音響信号に相当するエネルギーを調整する。
実施の形態2では、駆動信号を変調する点が実施の形態1と主として異なる。以下、実施の形態1と異なる部分を中心に実施の形態2について説明する。
位置取得部202は、タッチ位置に加えて、ユーザによりパネル101がタッチされた時刻(タッチ時刻)を取得する。
触速度計測部208は、位置取得部202により取得されたタッチ位置およびタッチ時刻を用いて、ユーザによるタッチの速度(触速度)を計測する。
変調信号生成部209は、触速度計測部208が計測した触速度が大きいほど高い周波数の成分を有する変調信号を生成する。この変調信号は、アクチュエータ107の駆動信号を変調するための信号である。
変調部210は、駆動信号生成部106により生成された駆動信号を、変調信号生成部209により生成された変調信号を用いて変調する。つまり、変調部210は、変調信号を用いて駆動信号を振幅変調または周波数変調する。具体的には、変調部210は、例えば式(9)のように駆動信号の振幅変調を行ってもよい。
101 パネル
102、202 位置取得部
103 記憶部
104 キャリア信号生成部
105 音響信号生成部
106 駆動信号生成部
107 アクチュエータ
107A 第1アクチュエータ
107B 第2アクチュエータ
208 触速度計測部
209 変調信号生成部
210 変調部
301 領域
302 領域
Claims (9)
- パネルをタッチしたユーザに触感を呈示する触感呈示装置であって、
パネルと、
前記パネル上の、前記ユーザによりタッチされた位置を取得する位置取得部と、
前記タッチされた位置が第1位置である場合に第1周波数の成分を有するキャリア信号を生成し、前記タッチされた位置が第2位置である場合に第2周波数の成分を有するキャリア信号を生成するキャリア信号生成部と、
予め定められた基本周波数に対応する複数の高調波を有する音響信号を生成する音響信号生成部と、
前記キャリア信号と前記音響信号とを加算することにより駆動信号を生成する駆動信号生成部と、
前記駆動信号に従って前記パネルを振動させることにより、前記ユーザに触感を呈示するアクチュエータと、を備える
触感呈示装置。 - 前記基本周波数は、前記第1周波数または前記第2周波数と同一である
請求項1に記載の触感呈示装置。 - 前記第1周波数は、前記パネルの複数の共振周波数のうちの1つであり、
前記第2周波数は、前記パネルの複数の共振周波数のうちの他の1つである
請求項2に記載の触感呈示装置。 - 前記基本周波数は、前記複数の共振周波数のうち前記パネルが最も共振する周波数である
請求項3に記載の触感呈示装置。 - 前記複数の高調波の各々は、前記ユーザが触覚により知覚する振動の周波数の上限として予め定められた上限周波数より高い周波数の高調波である
請求項1~4のいずれか1項に記載の触感呈示装置。 - 前記アクチュエータは、互いに異なる位置に配置された第1アクチュエータおよび第2アクチュエータを含み、
前記キャリア信号生成部は、
前記タッチされた位置が前記第1位置である場合に、前記第1位置に対応する位相関係を有する、前記第1アクチュエータのためのキャリア信号および前記第2アクチュエータのためのキャリア信号を生成し、
前記タッチされた位置が前記第2位置である場合に、前記第2位置に対応する位相関係を有する、前記第1アクチュエータのためのキャリア信号および前記第2アクチュエータのためのキャリア信号を生成し、
前記駆動信号生成部は、前記第1アクチュエータのためのキャリア信号と前記音響信号を加算することにより、前記第1アクチュエータのための駆動信号を生成し、かつ前記第2アクチュエータのためのキャリア信号と前記音響信号を加算することにより、前記第2アクチュエータのための駆動信号を生成する
請求項1~5のいずれか1項に記載の触感呈示装置。 - 前記音響信号生成部は、周波数が高いほど信号強度が小さい前記複数の高調波を有する前記音響信号を生成する
請求項1~6のいずれか1項に記載の触感呈示装置。 - パネルをタッチしたユーザに触感を呈示する触感呈示方法であって、
前記パネル上の、前記ユーザによりタッチされた位置を取得する位置取得ステップと、
前記タッチされた位置が第1位置である場合に第1周波数の成分を有するキャリア信号を生成し、前記タッチされた位置が第2位置である場合に第2周波数の成分を有するキャリア信号を生成するキャリア信号生成ステップと、
予め定められた基本周波数に対応する複数の高調波を有する音響信号を生成する音響信号生成ステップと、
前記キャリア信号と前記音響信号とを加算することにより駆動信号を生成する駆動信号生成ステップと、
前記駆動信号に従って前記パネルを振動させることにより、前記ユーザに触感を呈示する触感呈示ステップと、を含む
触感呈示方法。 - 請求項8に記載の触感呈示方法をコンピュータに実行させるためのプログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/007,758 US9152232B2 (en) | 2012-01-30 | 2013-01-16 | Haptic feedback device and haptic feedback method |
JP2013537356A JP6112458B2 (ja) | 2012-01-30 | 2013-01-16 | 触感呈示装置および触感呈示方法 |
EP13744364.4A EP2811375B1 (en) | 2012-01-30 | 2013-01-16 | Tactile-feel presentation device and method for presenting tactile feel |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012016632 | 2012-01-30 | ||
JP2012-016632 | 2012-01-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013114793A1 true WO2013114793A1 (ja) | 2013-08-08 |
Family
ID=48904846
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/000144 WO2013114793A1 (ja) | 2012-01-30 | 2013-01-16 | 触感呈示装置および触感呈示方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US9152232B2 (ja) |
EP (1) | EP2811375B1 (ja) |
JP (1) | JP6112458B2 (ja) |
WO (1) | WO2013114793A1 (ja) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015083691A1 (ja) * | 2013-12-02 | 2015-06-11 | 株式会社ニコン | 電子機器、および振動情報生成装置 |
JP2018101274A (ja) * | 2016-12-20 | 2018-06-28 | 株式会社東海理化電機製作所 | 触聴覚呈示装置 |
WO2019003870A1 (ja) * | 2017-06-30 | 2019-01-03 | 日本電産サンキョー株式会社 | 入力装置 |
JP2019075059A (ja) * | 2017-10-19 | 2019-05-16 | 株式会社デンソーテン | 操作入力装置 |
CN110241568A (zh) * | 2018-03-07 | 2019-09-17 | 青岛海尔滚筒洗衣机有限公司 | 一种带震动功能的洗衣机及控制方法 |
JP2019185554A (ja) * | 2018-04-13 | 2019-10-24 | 株式会社デンソーテン | 音響出力装置及び音響出力方法 |
CN113746368A (zh) * | 2020-05-27 | 2021-12-03 | 太阳诱电株式会社 | 驱动装置、触觉提示装置和驱动方法 |
CN114207555A (zh) * | 2019-07-23 | 2022-03-18 | 索尼集团公司 | 控制装置、控制方法和控制程序 |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB0905692D0 (en) * | 2009-04-02 | 2009-05-20 | Tno | Touch sensitive device |
WO2013114792A1 (ja) * | 2012-01-31 | 2013-08-08 | パナソニック株式会社 | 触感呈示装置および触感呈示方法 |
FR2998989B1 (fr) * | 2012-12-05 | 2015-01-02 | Thales Sa | Dispositif tactile multitouches a detection capacitive multifrequence et barycentrique |
EP2976694B1 (en) * | 2013-03-20 | 2019-10-09 | Nokia Technologies Oy | A touch display device with tactile feedback |
JP2015121983A (ja) * | 2013-12-24 | 2015-07-02 | 京セラ株式会社 | 触感呈示装置 |
JPWO2015121964A1 (ja) * | 2014-02-14 | 2017-03-30 | 富士通株式会社 | 入力装置 |
EP3611597B1 (en) * | 2014-03-31 | 2023-06-07 | Sony Group Corporation | Tactile sense presentation device, signal generating device, tactile sense presentation system, and tactile sense presentation method |
CN104216576B (zh) * | 2014-08-27 | 2018-05-11 | 合肥鑫晟光电科技有限公司 | 一种表面声波触摸屏及触摸显示装置 |
CN107037964B (zh) * | 2016-02-04 | 2020-09-08 | 南京中兴新软件有限责任公司 | 一种操作触控方法和终端 |
US10304298B2 (en) * | 2016-07-27 | 2019-05-28 | Immersion Corporation | Braking characteristic detection system for haptic actuator |
JP6827387B2 (ja) * | 2017-08-16 | 2021-02-10 | 株式会社デンソーテン | 制御装置、入力システムおよび制御方法 |
JPWO2019244716A1 (ja) * | 2018-06-19 | 2021-06-24 | ソニーグループ株式会社 | 情報処理装置、情報処理方法、およびプログラム |
CN111596754B (zh) | 2019-02-20 | 2024-06-21 | 天马日本株式会社 | 触觉呈现装置 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0990867A (ja) * | 1995-09-27 | 1997-04-04 | Olympus Optical Co Ltd | 触覚呈示装置 |
JP2006079238A (ja) * | 2004-09-08 | 2006-03-23 | Alpine Electronics Inc | タッチパネル装置 |
JP2008130055A (ja) | 2006-11-27 | 2008-06-05 | Sony Corp | タッチパネルディスプレイ装置および駆動方法並びに電子機器 |
JP2011501296A (ja) | 2007-10-17 | 2011-01-06 | イマージョン コーポレイション | 触覚フィードバック装置用のデジタルエンベロープ変調器 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100141408A1 (en) * | 2008-12-05 | 2010-06-10 | Anthony Stephen Doy | Audio amplifier apparatus to drive a panel to produce both an audio signal and haptic feedback |
JP2011146006A (ja) | 2010-01-18 | 2011-07-28 | Murata Mfg Co Ltd | 入力装置及び電子機器 |
-
2013
- 2013-01-16 JP JP2013537356A patent/JP6112458B2/ja active Active
- 2013-01-16 WO PCT/JP2013/000144 patent/WO2013114793A1/ja active Application Filing
- 2013-01-16 EP EP13744364.4A patent/EP2811375B1/en active Active
- 2013-01-16 US US14/007,758 patent/US9152232B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0990867A (ja) * | 1995-09-27 | 1997-04-04 | Olympus Optical Co Ltd | 触覚呈示装置 |
JP2006079238A (ja) * | 2004-09-08 | 2006-03-23 | Alpine Electronics Inc | タッチパネル装置 |
JP2008130055A (ja) | 2006-11-27 | 2008-06-05 | Sony Corp | タッチパネルディスプレイ装置および駆動方法並びに電子機器 |
JP2011501296A (ja) | 2007-10-17 | 2011-01-06 | イマージョン コーポレイション | 触覚フィードバック装置用のデジタルエンベロープ変調器 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2811375A4 * |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2015083691A1 (ja) * | 2013-12-02 | 2015-06-11 | 株式会社ニコン | 電子機器、および振動情報生成装置 |
JPWO2015083691A1 (ja) * | 2013-12-02 | 2017-03-16 | 株式会社ニコン | 電子機器、および振動情報生成装置 |
JP2018101274A (ja) * | 2016-12-20 | 2018-06-28 | 株式会社東海理化電機製作所 | 触聴覚呈示装置 |
WO2019003870A1 (ja) * | 2017-06-30 | 2019-01-03 | 日本電産サンキョー株式会社 | 入力装置 |
JP2019012409A (ja) * | 2017-06-30 | 2019-01-24 | 日本電産サンキョー株式会社 | 入力装置 |
JP2019075059A (ja) * | 2017-10-19 | 2019-05-16 | 株式会社デンソーテン | 操作入力装置 |
JP7094088B2 (ja) | 2017-10-19 | 2022-07-01 | 株式会社デンソーテン | 操作入力装置 |
CN110241568A (zh) * | 2018-03-07 | 2019-09-17 | 青岛海尔滚筒洗衣机有限公司 | 一种带震动功能的洗衣机及控制方法 |
CN110241568B (zh) * | 2018-03-07 | 2023-08-22 | 青岛海尔洗涤电器有限公司 | 一种带震动功能的洗衣机及控制方法 |
JP2019185554A (ja) * | 2018-04-13 | 2019-10-24 | 株式会社デンソーテン | 音響出力装置及び音響出力方法 |
CN114207555A (zh) * | 2019-07-23 | 2022-03-18 | 索尼集团公司 | 控制装置、控制方法和控制程序 |
CN113746368A (zh) * | 2020-05-27 | 2021-12-03 | 太阳诱电株式会社 | 驱动装置、触觉提示装置和驱动方法 |
Also Published As
Publication number | Publication date |
---|---|
EP2811375A4 (en) | 2015-03-18 |
JPWO2013114793A1 (ja) | 2015-05-11 |
US20140071071A1 (en) | 2014-03-13 |
JP6112458B2 (ja) | 2017-04-12 |
US9152232B2 (en) | 2015-10-06 |
EP2811375A1 (en) | 2014-12-10 |
EP2811375B1 (en) | 2017-03-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6112458B2 (ja) | 触感呈示装置および触感呈示方法 | |
JP6044791B2 (ja) | 触感呈示装置および触感呈示方法 | |
JP5507760B2 (ja) | 電子機器 | |
US10318006B2 (en) | High definition haptic effects generation using primitives | |
JP6037252B2 (ja) | 電子機器 | |
JP6054320B2 (ja) | タッチ感知式デバイス | |
US20190066459A1 (en) | Haptic system with increased lra bandwidth | |
JP6172284B2 (ja) | 駆動制御装置、電子機器、及び駆動制御方法 | |
JP2008123429A (ja) | タッチパネルディスプレイ装置および電子機器並びに遊技機器 | |
JP2019519856A (ja) | マルチモーダルハプティック効果 | |
JPWO2015136923A1 (ja) | 電子機器 | |
JP2019102018A (ja) | 情報処理装置及びプログラム | |
WO2015136835A1 (ja) | 電子機器 | |
JP5924802B2 (ja) | 入力装置 | |
WO2016092644A1 (ja) | 電子機器及び駆動制御方法 | |
JP2006133932A (ja) | 入力装置 | |
WO2023119483A1 (ja) | 触覚提示装置、ディスプレイ装置、データ端末装置、および触覚提示方法 | |
JP2008310546A (ja) | タッチパネル入力装置 | |
JP2019186657A (ja) | 出力装置および出力方法 | |
JP2012205151A (ja) | 携帯電子機器 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2013537356 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13744364 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14007758 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2013744364 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013744364 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |