US20070091063A1 - Tactile force sense information display system and method - Google Patents
Tactile force sense information display system and method Download PDFInfo
- Publication number
- US20070091063A1 US20070091063A1 US10/579,672 US57967204A US2007091063A1 US 20070091063 A1 US20070091063 A1 US 20070091063A1 US 57967204 A US57967204 A US 57967204A US 2007091063 A1 US2007091063 A1 US 2007091063A1
- Authority
- US
- United States
- Prior art keywords
- haptic
- presentation
- torque
- eccentric
- force
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 90
- 230000035807 sensation Effects 0.000 claims abstract description 113
- 239000013598 vector Substances 0.000 claims description 43
- 230000008859 change Effects 0.000 claims description 25
- 230000006870 function Effects 0.000 claims description 14
- 230000002123 temporal effect Effects 0.000 claims description 10
- 239000012530 fluid Substances 0.000 claims description 6
- 239000000463 material Substances 0.000 claims description 4
- 239000002245 particle Substances 0.000 claims description 2
- 230000001953 sensory effect Effects 0.000 abstract description 91
- 238000006243 chemical reaction Methods 0.000 abstract description 8
- 230000000873 masking effect Effects 0.000 description 29
- 230000033001 locomotion Effects 0.000 description 24
- 230000001133 acceleration Effects 0.000 description 16
- 230000001413 cellular effect Effects 0.000 description 14
- 230000001360 synchronised effect Effects 0.000 description 12
- 210000003205 muscle Anatomy 0.000 description 11
- 230000010355 oscillation Effects 0.000 description 11
- 230000005484 gravity Effects 0.000 description 8
- 230000035945 sensitivity Effects 0.000 description 7
- 230000002441 reversible effect Effects 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000012905 input function Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000003491 array Methods 0.000 description 4
- 230000003247 decreasing effect Effects 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 235000016496 Panda oleosa Nutrition 0.000 description 3
- 240000000220 Panda oleosa Species 0.000 description 3
- 230000000994 depressogenic effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 239000007788 liquid Substances 0.000 description 2
- 230000003183 myoelectrical effect Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000011514 reflex Effects 0.000 description 2
- 230000035939 shock Effects 0.000 description 2
- 230000000153 supplemental effect Effects 0.000 description 2
- 230000001629 suppression Effects 0.000 description 2
- 206010016322 Feeling abnormal Diseases 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 241000219793 Trifolium Species 0.000 description 1
- 208000003443 Unconsciousness Diseases 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 210000003484 anatomy Anatomy 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- ZYXYTGQFPZEUFX-UHFFFAOYSA-N benzpyrimoxan Chemical compound O1C(OCCC1)C=1C(=NC=NC=1)OCC1=CC=C(C=C1)C(F)(F)F ZYXYTGQFPZEUFX-UHFFFAOYSA-N 0.000 description 1
- 230000001143 conditioned effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000000881 depressing effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 229910003460 diamond Inorganic materials 0.000 description 1
- 239000010432 diamond Substances 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000010304 firing Methods 0.000 description 1
- 210000004699 muscle spindle Anatomy 0.000 description 1
- 108091008709 muscle spindles Proteins 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 238000003756 stirring Methods 0.000 description 1
- 230000003746 surface roughness Effects 0.000 description 1
- 210000002435 tendon Anatomy 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B06—GENERATING OR TRANSMITTING MECHANICAL VIBRATIONS IN GENERAL
- B06B—METHODS OR APPARATUS FOR GENERATING OR TRANSMITTING MECHANICAL VIBRATIONS OF INFRASONIC, SONIC, OR ULTRASONIC FREQUENCY, e.g. FOR PERFORMING MECHANICAL WORK IN GENERAL
- B06B1/00—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency
- B06B1/02—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency making use of electrical energy
- B06B1/04—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency making use of electrical energy operating with electromagnetism
- B06B1/045—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency making use of electrical energy operating with electromagnetism using vibrating magnet, armature or coil system
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
- A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B06—GENERATING OR TRANSMITTING MECHANICAL VIBRATIONS IN GENERAL
- B06B—METHODS OR APPARATUS FOR GENERATING OR TRANSMITTING MECHANICAL VIBRATIONS OF INFRASONIC, SONIC, OR ULTRASONIC FREQUENCY, e.g. FOR PERFORMING MECHANICAL WORK IN GENERAL
- B06B1/00—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency
- B06B1/02—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency making use of electrical energy
- B06B1/04—Methods or apparatus for generating mechanical vibrations of infrasonic, sonic, or ultrasonic frequency making use of electrical energy operating with electromagnetism
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B6/00—Tactile signalling systems, e.g. personal calling systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
- G10K15/00—Acoustics not otherwise provided for
- G10K15/04—Sound-producing devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B3/00—Line transmission systems
- H04B3/02—Details
- H04B3/36—Repeater circuits
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D19/00—Control of mechanical oscillations, e.g. of amplitude, of frequency, of phase
- G05D19/02—Control of mechanical oscillations, e.g. of amplitude, of frequency, of phase characterised by the use of electric means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/013—Force feedback applied to a game
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
Definitions
- the present invention relates to a haptic information presentation system and method, which uses sensory characteristics.
- the invention relates to a haptic information presentation system, a haptic information presentation method, a haptic presentation device of a haptic information presentation system, and a control device of a haptic information presentation system, which is for providing a man-machine interface mounted on an equipment used in the field of VR (Virtual Reality), an equipment used in the field of game, a cellular phone, a portable navigation equipment, a PDA (Personal Digital Assistant) or the like.
- VR Virtual Reality
- PDA Personal Digital Assistant
- a haptic presentation part in contact with a human sense organ and a haptic presentation system main body are connected to each other by a wire or an arm, and there has been a disadvantage that the existence of the wire, arm or the like restricts the human motion.
- use is limited to an effective space in which the haptic presentation system main body and the haptic presentation part are connected to each other by the wire or the arm, there has been a limitation in the expanse of the space which can be used.
- Non-patent document 1 a torque presentation apparatus using a gyro moment and a gimbal structure has been developed.
- the gimbal structure there are problems that the direction of a torque which can be presented is limited, the structure becomes complicated, and the control becomes troublesome.
- non-patent document 2 a non-grounding mobile haptic information presentation device
- a torque in an arbitrary direction or with an arbitrary magnitude can be presented by independently controlling the rotations of three gyro motors arranged in three-axis orthogonal coordinates.
- the torque is generated by controlling a resultant angular momentum vector generated by the three gyro motors
- the structure is relatively simple and the control is also easy.
- haptic information is made to be capable of being continuously presented, and a force sensation other than the torque is made to be capable of being presented.
- Non-patent document 1 Masayuki Yoshie, Hiroaki Yano, Hiroo Iwata “Development of Non-grounded Force Display Using Gyro Moment”, Research Report Collection (Kenkyu Hokokusho) of Human Interface Society, vol. 3, No. 5, pp. 25-30 (2000)
- a first object of the invention is to provide a haptic information presentation system and method, in which in a conventional non-grounding man-machine interface having no reaction base on the human body and for giving the existence of a virtual object and the impact force of a collision to a person, a haptic information presentation mechanism using human sensory characteristic is realized, so that haptic information of vibration, torque, force and the like can be continuously presented in the same direction, which can not be presented only by the physical characteristics of a haptic presentation device.
- the performance of the presentation device is not infinite, and in the case where the performance of the presentation device is not sufficient, for example, when the torque continues to be continuously presented, it becomes necessary to return the rotation velocity of the rotator to the initial state in one cycle of the presentation. That is, it is required that the integral value of the angular momentum vector of the rotator is made zero. In this case, the quite opposite torque or force is presented, and there arises a problem that the senses in the positive direction and the negative direction cancel each other out.
- a second object of the invention is to provide a haptic information presentation system and method, in which human sensory characteristics are used, and in an operation of a haptic presentation device, even if a return is made physically to the initial state in one cycle, and a integral value of physical quantity becomes zero, a integral value of a sensory quantity does not become zero, and a sense can continue to be presented freely in an arbitrary direction.
- a haptic information presentation system includes a haptic presentation unit having two eccentric rotators, and a control unit that independently changes a frequency and an intensity of a vibration and/or a vibration sensation by controlling rotation directions, a phase relation and rotation speeds of the two eccentric rotators.
- a haptic information presentation system includes a haptic presentation unit having two eccentric rotators, and a control unit that independently changes a frequency and an intensity of a force and/or a force sensation by inverting rotation directions of the two eccentric rotators.
- a haptic information presentation system includes a haptic presentation unit having an eccentric rotator array in which plural single eccentric rotators, and/or plural twin eccentric rotators each having two eccentric rotators, and/or plural twin eccentric rotators arranged in a three-dimensional space are arranged two-dimensionally or three-dimensionally, and a control unit to control a rotation state of each of the eccentric rotators included in the haptic presentation unit.
- a haptic information presentation system includes a haptic presentation unit having plural rotators arranged three-dimensionally, and a control unit to control a temporal change of a resultant angular momentum vector of the haptic presentation unit, in which the control unit generates a torque with a fixed value by abruptly changing the resultant angular momentum vector in the vicinity of zero, and controls a precession torque to be a specified value or less.
- a frequency and an intensity of a vibration and/or a vibration sensation are independently changed by controlling rotation directions, a phase relation and rotation speeds of the two eccentric rotators.
- a frequency and an intensity of a force and/or a force sensation are independently changed by inverting rotation directions of the two eccentric rotators.
- a seventh aspect of the invention in a haptic information presentation method, when a control is made on a haptic presentation unit having an eccentric rotator array in which plural single eccentric rotators, and/or plural twin eccentric rotators each having two eccentric rotators arranged on a same rotation axis, and/or plural twin eccentric rotators arranged in a three-dimensional space are arranged two-dimensionally or three-dimensionally, a rotation state of each of the eccentric rotators included in the haptic presentation unit is individually controlled.
- a haptic presentation unit having plural rotators arranged three-dimensionally when a haptic presentation unit having plural rotators arranged three-dimensionally is controlled, a temporal change of a resultant angular momentum vector of the haptic presentation unit is controlled, a torque with a fixed value is generated by abruptly changing the resultant angular momentum vector in the vicinity of zero, and a precession torque is controlled to have a specified value or less.
- the sheet-shaped eccentric rotator array to which the invention is applied by suitably controlling the rotations of the respective eccentric rotators, the vibration sensation, torque sensation, and force sensation of various patterns in space and time can be presented onto the palm.
- the sheet-shaped eccentric rotator array can be applied to a glove, clothes, or something having a wearable shape.
- various haptic information relating to an object such as the existence, shape, elasticity, texture and the like of a virtual object, can be presented by suitably changing a space portion of a force sensation in accordance with the movement of a palm or the like.
- FIG. 1 is a view showing a rough structure of a haptic information presentation system of an embodiment of the invention.
- a haptic presentation device 112 is such that the rotation velocity of at least one rotator in the haptic presentation device 112 is controlled by using a control device 111 , and a vibration, force or torque as its physical characteristics is controlled, so that a user 110 is made to perceive various haptic information such as the vibration, force or torque.
- a haptic information presentation system 4101 includes a haptic presentation device 4110 , a control device 4120 , and an input device 4130 .
- the haptic presentation device 4110 includes therein at least one rotator 4180 rotated by a motor, and it is rotated by the control from the control device 4120 .
- a stepping motor, a servo motor, or the like can be applied to the driving of the rotator 4180 .
- the control device 4120 includes a CPU (central processing unit) 4160 , a RAM (random access memory) 4170 , a ROM (read only memory) 4140 and the like.
- the CPU 4160 controls the whole operation of the control device 4120 .
- the RAM 4170 is used as a work area to temporarily store data of a processing object and the like when the CPU 4160 performs the processing.
- a control program 4150 is previously stored in the ROM 4140 .
- the control program 4150 is a program to prescribe the control processing of the haptic presentation device 4110 corresponding to the input signal from the input device 4130 .
- the CPU 4160 reads the control program 4150 from the ROM 4140 and executes it, and controls the rotator 4180 of the haptic presentation device 4110 correspondingly to the respective input signals.
- the input device 4130 is, for example, a select button of an input menu.
- the CPU 4160 performs a processing (for example, the haptic presentation device 4110 is controlled so as to generate a torque in a specified rotation direction) corresponding to the input of the select button selected by depression, touch or the like.
- the input device 4130 as stated above may be united with the control device 4120 and made a part of the control device 4120 .
- the input device 4130 is a device such as a well-known myoelectric detector to detect myoelectricity described later, or a well-known angular acceleration sensor.
- a trigger signal of myoelectricity occurrence from the myoelectric detector, or a signal of angular acceleration from the angular acceleration sensor is inputted to the control device 4120 , the CPU 4160 feeds back the input and controls the haptic presentation device 4110 .
- the input device 4130 such as the angular acceleration sensor, together with the haptic presentation machine 4110 , may be included in the inside of the haptic presentation device 4110 .
- FIG. 2 and FIG. 3 are views showing the haptic information presentation method in which a sensory characteristic relating to a haptic sense is used and the haptic presentation device is controlled by the control device of the haptic information presentation system.
- a sensory quantity 213 thereof is often a nonlinear characteristic, such as a logarithm, with respect to a physical quantity 212 which is mainly a stimulus.
- FIG. 2-1 schematically shows a case where the sensory characteristic 211 is a logarithmic function characteristic.
- a torque 223 is proportional to the time differential of a rotation velocity (angular velocity) 222 .
- the torque sensation 224 is perceived.
- the torque 223 is physically returned to an initial state 228 in one cycle, and an integral value thereof is zero.
- a sensory integral value of the torque sensation 224 as the sensory quantity does not necessarily become zero.
- FIG. 3-1 in FIG. 3 schematically shows a case where a sensory characteristic 231 has a threshold value.
- a torque sensation 244 is represented as in FIG. 3-2 .
- a torque 243 is physically returned to an initial state 248 in one cycle, and an integral value thereof is zero.
- the torque sensation 244 as the sensory quantity is the sensory threshold value or less in a section of an operation point B duration time 246 , it becomes zero. As a result, a torque sensation can continue to be intermittently presented only in one direction.
- FIG. 4-1 to FIG. 4-3 are views showing a haptic information presentation method using a hysteresis sensory characteristic relating to a haptic sense.
- the sensory characteristic is not isotropic between a time when a displacement 312 is increased and a time when it is decreased, for example, between a time when a muscle is extended and a time when it is contracted, and often indicates a hysteresis sensory characteristic 311 .
- the hysteresis sensory characteristic 311 of FIG. 4-1 schematically represents the hysteresis characteristic of the sensory characteristic.
- a torque 333 is proportional to the time differential of a rotation velocity 332 of a rotator.
- the torque sensation 334 is perceived.
- the torque 333 is physically returned to an initial state 338 in one cycle, and an integral value thereof is zero.
- a sensory integral value of the torque sensation 334 as the sensory quantity does not necessarily become zero.
- FIG. 5 and FIG. 6 are views showing, as an example of a method of changing a sensory characteristic, a haptic information presentation method using a method of changing a sensory characteristic by a masking effect relating to a haptic sensation.
- FIG. 5-1 schematically shows a torque 413 as a maskee, and the torque sensation 434 perceived at this time is represented as in FIG. 5-3 .
- the torque 413 is proportional to the time differential of a rotation velocity 412 of a rotator.
- an initialization time 415 in which the rotation velocity 412 of the rotator is initialized, and a masking duration time 425 corresponding thereto are shortened like an initialization time 445 and a masking duration time 455 shown in FIG. 6-1 , and when it becomes shorter than a certain specific time, a critical fusion occurs in which although a negative torque due to the initialization physically exists, it is felt as if torque is continuously presented like a torque sensation 464 .
- a masker to generate a masking vibration may be a rotator different from a rotator as a maskee whose torque is masked by that or the rotator itself as the maskee.
- the case where the rotator of the maskee is also the masker means that at the time of masking, the rotator is controlled to generate the masking vibration by the control device.
- the vibration direction of the masker may be the same as the rotation direction of the rotator as the maskee or may not be the same.
- FIG. 7 is a view schematically showing this case. As shown in FIG. 7 , before and after high torque sensations 485 and 486 , a torque sensation 484 is decreased by forward masking 485 and backward masking 486 .
- FIG. 8 is a view showing a haptic information presentation method using a method of controlling haptic information presentation in conformity with change of sensory characteristics relating to a haptic sense.
- the sensitivity of a torque sensation 517 is changed according to a muscle tensile state or at least one state of physical, physiological and psychological states.
- a muscle is instantaneously expanded by a presented torque 514 (high torque 524 in a short time) as an external force
- a sensor called a muscle spindle in the muscle senses this, and the muscle is quickly contracted in a conditioned reflex way by a muscle cause torque 515 (muscle reflex cause torque 525 ) having power not lower than this external force.
- myoelectricity 511 is generated.
- a control circuit 512 having detected it controls a haptic presentation device 513 , and changes the sensitivity of the torque sensation 517 by activating a presentation torque 516 (gentle middle torque 526 ) in synchronization with the contraction of the muscle.
- the above is established not only in the muscle tensile state but also in the case of the change of sensory sensitivity due to at least one state of breath, posture and neural firing states.
- FIG. 9 shows a haptic information presentation method using a method of correcting a presentation physical quantity according to a relation between the presentation physical quantity and a sensory quantity with respect to a palm direction and relating to a haptic sense.
- the sensitivity is different according to the palm direction because of the anatomical structure of a skeleton, joint, tendon, muscle and the like.
- the direction presentation with high precision becomes possible by correcting the intensity (rotation velocity ⁇ 612 ) of the presentation physical quantity in conformity with the sensitivity (anisotropic sensitivity curve 611 ) dependent on the palm direction.
- FIG. 10 is an explanatory view of an eccentric rotator which can be applied to the rotator of the haptic presentation device of the embodiment, and is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and the rotation of an eccentric rotator 711 is phase synchronized as in FIG. 10-2 .
- FIG. 10-3 schematically shows a case where a sensory characteristic 731 is a logarithmic function characteristic, and the sensory characteristic 731 indicates that similarly to the sensory characteristic 211 , a sensory quantity 733 has a nonlinear characteristic of a logarithm or the like with respect to a physical quantity 732 as a stimulus.
- a torque sensation 744 is represented as in FIG. 10-4 .
- a torque 743 is proportional to the time differential of a rotation velocity 742 of the rotator.
- the torque sensation 744 When an operation is performed at the operation point A 734 and the operation point B 735 , the torque sensation 744 is perceived.
- the torque 743 is physically returned to an initial state 748 in one cycle, and an integral value thereof is zero.
- the sensory integral value of the torque sensation 744 as the sensory quantity does not necessarily become zero.
- FIG. 11 is an explanatory view of an eccentric rotator applicable to the rotator of the haptic presentation device of the embodiment, and is a view showing a haptic information presentation method of a vibration sensation, torque sensation, and force sensation by suitable synchronization of rotation directions and phases of both an eccentric rotator A 812 ad an eccentric rotator B 813 .
- FIG. 11-2 schematically shows a case where both the eccentric rotator A 812 and the eccentric rotator B 813 of FIG. 11-1 are synchronously rotated in the same direction.
- FIG. 11-3 schematically shows a case where both the eccentric rotator A 812 and the eccentric rotator B 813 of FIG. 11-1 are synchronously rotated with a phase delay of 180 degrees and in the same direction.
- the torque rotation without eccentricity can be formed.
- FIG. 11-4 schematically shows a case where both the eccentric rotator A 812 and the eccentric rotator B 813 of FIG. 11-1 are synchronously rotated in the opposite directions.
- a force to linearly generate simple harmonic oscillations in an arbitrary direction can be synthesized.
- FIG. 12-1 is a view showing a method of changing a vibration intensity of an eccentric vibration by suitably synchronizing the rotation directions and phases of both the eccentric rotator A 822 and the eccentric rotator B 823 in FIG. 11-2 .
- a phase difference for example, a phase difference 0° 851 , a phase difference 90° 852 , a phase difference 180° 853 ) of rotations of both the eccentric rotator A 822 and the eccentric rotator B 823 is adjusted, and resultant barycenters ( 854 , 855 , 856 ) of the two eccentric rotators, and barycenter moment lengths ( 857 , 858 , 859 ) between the rotation centers of the rotators and the resultant barycenters are suitably changed, so that the vibration intensity of the eccentric vibration can be changed without changing the rotation velocities of the eccentric rotators ( 822 , 823 ).
- the vibration frequency and the vibration intensity can be independently controlled.
- the vibration intensity is increased by increasing the rotation velocity, and the vibration frequency and the vibration intensity can not be independently controlled.
- FIG. 12-2 is a view showing a method in which the rotation directions of both the eccentric rotator A 842 and the eccentric rotator B 843 in FIG. 11-4 are suitably inverted, so that the intensity of a force and/or a force sensation and the intensity of a vibration and/or a vibration sensation are changed.
- amplitudes ( 866 , 867 ) of vibrations are suitably changed, and the intensity of a force and/or a force sensation can be made variable without changing the rotation velocities of the eccentric rotators ( 842 , 843 ).
- the frequency and the intensity of the force and/or the force sensation can be independently controlled.
- FIG. 13 is a view showing a haptic presentation device 1301 in which both the eccentric rotator A 812 and the eccentric rotator B 813 are made one pair and three such pairs are arranged in an orthogonal coordinate system.
- Reference numeral 1310 in the drawing denotes an eccentric rotator; and 1311 , a motor to drive it.
- the vibration sensation, the torque sensation, and the force sensation shown in FIG. 11-2 to FIG. 11-4 can be presented in an arbitrary three-dimensional direction.
- the arrangement of the orthogonal coordinate system is an example for presentation in the three-dimensional direction.
- FIG. 14 is a view showing a sheet-shaped eccentric rotator array 880 in which one of the eccentric rotator 711 of FIG. 10-1 , the twin eccentric rotator 811 of FIG. 11-1 , and the twin eccentric rotator arranged in the three-dimensional space of FIG. 13 is arranged like a sheet in a three-dimensional plane.
- a practicing method of a drive portion of the twin eccentric rotator may be a molecular motor or a piezoelectric element, and anything may be used as long as an objective physical quantity can be presented.
- FIG. 15 is a view showing a glove-shaped eccentric rotator array 890 in which the sheet-shaped eccentric rotator array 880 is formed into a glove shape.
- the sheet-shaped eccentric rotator array 880 and the glove-shaped eccentric rotator array 890 are merely examples of the embodiment, and the embodiment can be applied to clothes and wearable haptic information presentation, inclusive of a case where the eccentric rotator array is three-dimensionally arranged.
- FIG. 16 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotations of both an eccentric rotator A 912 and an eccentric rotator B 913 are phase synchronized.
- FIG. 16-2 schematically shows a case where both the eccentric rotator A 912 and the eccentric rotator B 913 of FIG. 16-1 are synchronously rotated with a phase delay of 180 degrees in the same direction. As a result of the synchronous rotation, the torque rotation without eccentricity can be formed.
- FIG. 16-3 schematically shows a case where a sensory characteristic 931 is a logarithmic function characteristic, and similarly to the sensory characteristic 211 , the sensory characteristic 931 indicates that a sensory quantity 933 has a nonlinear characteristic of a logarithm or the like with respect to a physical quantity 932 as a stimulus.
- a torque sensation 944 is represented as in FIG. 16-4 .
- a torque 943 is proportional to the time differential of a rotation velocity 942 of a rotator.
- the torque 943 is physically returned to an initial state 948 in one cycle, and an integral value thereof is zero.
- a sensory integral value of the torque sensation 944 as a sensory quantity does not necessarily become zero.
- FIG. 17 is a view showing a haptic information presentation method in which a sensory characteristic relating a haptic sense is used, and the rotations of both an eccentric rotator A 1012 and an eccentric rotator B 1013 are phase synchronized in the opposite directions.
- FIG. 17-2 schematically shows a case where both the eccentric rotator A 1012 and the eccentric rotator B 1013 of FIG. 17-1 are synchronously rotated in the opposite directions.
- a force to linearly generate simple harmonic oscillations in an arbitrary direction can be synthesized.
- FIG. 17-3 schematically shows a case where a sensory characteristic 1031 is a logarithmic function characteristic, and similarly to the sensory characteristic 211 , the sensory characteristic 1031 indicates that a sensory quantity 1033 has a nonlinear characteristic of a logarithm or the like with respect to a physical quantity 1032 as a stimulus.
- a force sensation 1044 is represented as in FIG. 17-4 .
- a magnitude 1042 of a resultant rotation velocity of both the eccentric rotators is the combination of rotation velocities of the eccentric rotator A 1012 and the eccentric rotator B 1013 , and a force 1043 is proportional to the time differential of the magnitude 1042 of the resultant rotation velocity of both the eccentric rotators.
- the force 1043 is physically returned to an initial state 1048 in one cycle, and an integral value is zero.
- a sensory integral value of the force sensation 1044 as a sensory quantity does not necessarily become zero.
- the force sensation can continue to be freely presented in an arbitrary direction by suitably selecting the operation point A 1034 and the operation point B 1035 , by suitably selecting an operation point A duration time 1045 and an operation point B duration time 1046 , and by adjusting the synchronous phases of both the eccentric rotator A 1012 and the eccentric rotator B 1013 .
- the sensory characteristic 1031 exhibits a nonlinear characteristic of an exponential function case or the like. Also in the case where the sensory characteristic 1031 of FIG. 17-3 has a threshold value like the sensory characteristic 231 of FIG. 3-1 , a force sensation similar to that of FIG. 3-2 occurs, and the force sensation can continue to be intermittently presented only in one direction.
- FIG. 18 is a schematic view of a method in which the presentation method of the force sensation using both the eccentric rotators shown in FIG. 17 is used to present a pushing feeling by oneself ( FIG. 18-1 ), an expansion feeling ( FIG. 18-2 ), a pressure feeling ( FIG. 18-3 ), a pulling feeling by oneself ( FIG. 18-4 ), a pulled feeling from outside ( FIG. 18-5 ), and a pushed feeling from outside ( FIG. 18-6 ).
- a twin eccentric rotator 1111 and a twin eccentric rotator 1112 are used on the front and back of a palm, and a force 1113 and a force 1114 are presented, so that a feeling such as to push an object by oneself with the front of the palm can be presented.
- the expansion feeling ( FIG. 18-2 ), the pressure feeling ( FIG. 18-3 ), the pulling feeling by oneself ( FIG. 18-4 ), the pulled feeling from outside ( FIG. 18-5 ), and the pushed feeling from outside ( FIG. 18-6 ) can also be similarly presented.
- FIG. 19 is a view showing a method of presenting a force 1173 , a shear force 1174 , and a torque 1175 to a palm and a finger tip by suitably controlling the rotation of each twin eccentric rotator 1172 on 1171 of the groove-shaped eccentric rotator arrays 1170 .
- a resisting force 1193 presented to a palm by suitably adjusting the spatial intensity distribution of a resisting force 1193 presented to a palm, and by presenting a spherical resisting force 1191 , a cubic resisting force 1192 or the like, a three-dimensional shape feeling of a sphere, a cubic or the like, or a tactile sensation such as an elastic feeling or a soft feeling can be presented to the palm.
- FIG. 23 is a view showing a vibration haptic information presentation method in an arbitrary direction using a method of changing a sensory characteristic by a masking effect relating to a haptic sense, which is an example of a control method of continuously or intermittently presenting haptic information of at least one of a vibration sensation, a force sensation and a torque sensation in an arbitrary direction.
- the sensory characteristic is masked by a masking vibration 1216 , and a force sensation 1224 is decreased.
- This masking vibration can be generated by synchronizing the rotation velocity 1022 of the eccentric rotator A with the rotation velocity 1023 of the eccentric rotator A in FIG. 17-2 and by fractuating the velocities.
- FIG. 23-1 schematically shows this, and the force sensation 1224 perceived at this time is represented as in FIG. 23-2 .
- a force 1213 is proportional to the time differential of a magnitude 1212 of a resultant rotation velocity of the two eccentric rotators.
- an initialization time 1215 in which the rotation velocity 1212 of the rotator is initialized is shortened and when it becomes shorter than a certain specific time as shown in FIG. 23-3 , a critical fusion occurs in which although a negative force due to the initialization physically exists, it is felt as if a force is continuously presented like a force sensation 1244 .
- a method of accelerating and decelerating the rotation velocity of a rotation body having an inertia moment there are a method of accelerating and decelerating the rotation velocity of a rotation body having an inertia moment, and a method of turning a rotation body around an axis orthogonal to its rotation axis. From the viewpoint of dynamics of mechanism, the method is roughly classified into following two types, namely, a rotator posture control type (hereinafter referred to as a gyroscope type 1311 ) and a resultant angular momentum vector differential type 1312 ( FIG. 24 ).
- a rotator posture control type hereinafter referred to as a gyroscope type 1311
- a resultant angular momentum vector differential type 1312 FIG. 24
- the gyroscope type 1311 using a gyroscope to control the posture of a rotator will be described.
- a gimbal structure is used, and with respect to the posture of the rotator turning at a constant angular velocity ⁇ 0 , turning angles ⁇ 1 and ⁇ 2 around two gimbal shafts are changed so that torque can be generated.
- Rotation speeds ⁇ x , ⁇ y and ⁇ z of three rotators fixed to an x-axis, a y-axis and a z-axis are independently controlled, and the angular momentums of the rotators are combined, so that an angular momentum vector can be formed in an arbitrary direction.
- a torque can be formed in an arbitrary direction.
- a torque vector at the time when the angular momentum vector L is changed is expressed as follows.
- the direction of the angular momentum vector generated can be controlled in an arbitrary direction.
- This method has merits that the control is easy, and various three-dimensional force sensations can be presented.
- the torque felt by a person has the same magnitude as this torque vector ⁇ and the opposite direction by the action-reaction law (Newton's third law).
- a torque felt by a person through the temporal change of a resultant angular momentum vector 1332 on the palm of the turning person is the sum of a torque [dL/dt] O ⁇ by the temporal change of the resultant angular momentum vector 1332 in the turning coordinate system O ⁇ 1331 and the precession torque ⁇ L.
- precession means that when a torque is applied to a gyro from outside, the spin axis of the gyro is turned in a direction orthogonal to the applied torque.
- the cause of the generation of the precession torque here is the turning of the coordinate axis. That is, even in the case where there is no temporal change of the angular momentum L on the palm of the user when viewed from the user, when the user turns at the angular velocity ⁇ as shown in FIG. 25 , the precession torque ⁇ L is felt.
- the control feature of this embodiment is to control the temporal change of the resultant angular momentum vector L 1332 , and the easiness of the control is a great merit.
- L By abruptly changing L in the vicinity of zero, a large torque [dL/dt] O ⁇ is generated, and the precession torque ( ⁇ L) can be suppressed to be low. By this, the navigation is enabled without hindering the movement of the user.
- a large angular momentum vector L is required, and as a result, a large precession torque is generated without fail.
- miniaturization is required to such a degree as to enable internal or external mounting to a cellular phone or a PDA.
- consideration will be given to a torque presentation method and operation principle in the case where internal mounting to a cellular phone is performed.
- a classification into four can be made as shown in FIG. 26 .
- a vibration has been used to inform an incoming call.
- attention is first aroused by vibration, and then, the direction in which a turn is to be made is indicated by voice. That is, since attention is aroused by the vibration, and direction information is not presented, this is defined as a Zero dimension (vibration 1341 ).
- FIG. 26-3 shows a model which adopts an opposed type twin motor system newly invented in view of the balance of the center of gravity and the like.
- the arm is lowered, the turning vector ⁇ is generated around an elbow as a fulcrum, a torque ⁇ x is generated in the torque presentation device and in the x direction on the palm so as to turn the L z vector, and a torque is generated in the direction of canceling the turning vector ⁇ .
- the torque around the elbow as the fulcrum which suppresses the vertical movement of the torque presentation device, stabilizes the position of the torque presentation device.
- a description will be given to a haptic presentation device in which the haptic presentation device 1301 shown in FIG. 13 is further improved.
- FIG. 28 is a view showing a two-dimensional sectional view of a haptic presentation device 2801 in which similarly to the haptic presentation device 1301 of FIG. 13 , two facing eccentric rotators are made one pair and three such pairs are arranged in an orthogonal coordinate system.
- an eccentric rotator (inertia; inertial body) 2804 , a motor 2803 and the like are arranged in a spherical housing 2807
- FIG. 28 is a sectional view taken along the center of the spherical housing 2807 .
- the eccentric rotator 2804 and the motor 2803 are united, and a rotating shaft 2802 of the motor is fixed to a joint 2810 of the housing 2807 .
- the rotating shaft 2802 is fixed, and similarly to the rotation of a normal motor, a magnet of a rotator of the motor integral with the rotating shaft 2802 and an electromagnet of the main body of the motor 2803 repel each other and the motor 2803 is rotated.
- a rotation body in which the eccentric rotator and the motor are united is rotated.
- the mass of the rotation portion can be made large (that is, the inertia moment can be made large), and the efficiency of the mechanical operation (presentation of vibration, torque and force) by the rotation of the rotation body is improved. Further, as the weight of the housing 2807 is reduced, the efficiency is improved.
- the haptic presentation device 2801 shown in FIG. 28 is not limited to the case where the eccentric rotator is applied, but is naturally applicable to a rotator which is not eccentric. Further, although the spherical housing is exemplified for the haptic presentation device 2801 , the principle of the haptic presentation device 2801 can be naturally applied to a housing other than the spherical shape.
- FIG. 29 is a view showing a two-dimensional sectional view of a haptic presentation device 2901 in which the haptic presentation device 2801 of FIG. 28 is further improved.
- the haptic presentation device 2901 includes a turbine fin 2908 arranged in a spherical housing 2807 and a fluid (gas flow or liquid flow) 2909
- FIG. 28 is a sectional view taken along the center of the spherical housing 2807 .
- the turbine fin 2908 is provided in a rotation body in which an eccentric rotator 2804 and a motor 2803 are united.
- the load resistance is applied to the rotation of the turbine fin by the circulation of the fluid, and as a result, since the effective inertia moment of the rotation body is increased, the efficiency of the mechanical operation (presentation of vibration, torque and force) by the rotation of the rotation body is improved. Further, as the relative weight of the housing 2807 is reduced, the efficiency is improved. Besides, the load resistance can be applied to the rotation of the turbine fin by providing a narrowing hole 2910 to narrow the section of a liquid flow passage in a route for circulation of the fluid.
- FIG. 30 is a view showing a two-dimensional sectional view of a haptic presentation device 3001 in which the haptic presentation device 2901 of FIG. 29 is further improved.
- the haptic presentation device 3001 includes an air 3009 in a spherical housing 3007 , holes 3010 are provided in the housing 3007 to be opposite to turbine fins, and FIG. 30 is a sectional view taken along the center of the spherical housing 3007 .
- the holes 3010 are provided in the housing 3007 , in the haptic presentation device 3001 , according to the control of a motor, for example, air flows 3002 a and 3002 b flowing through the haptic presentation device 3001 from the left to the right of FIG. 30 are generated.
- the force of jet of the air flow 3002 b is also added, and the efficiency of continuing to present the force sensation in the left direction in the drawing is improved.
- the closing and opening of these holes is controlled (not inevitable) by a valve 3010 and a control circuit, so that the flow rate and flow speed can be controlled.
- the turbine fin is a variable fin which can control a relation between a rotation direction and a blast direction, and even if the torque direction resulting from the rotation is the same direction, the flowing direction of an air current can be controlled by changing the angle of the fin. Besides, it may be fixed according to a use.
- rotators of two motors, motor bodies, eccentric rotation bodies, two turbine fins in which the generating directions of air currents are opposite to each other are mounted to one rotating shaft 2802 , and the flow direction of the air current may be controlled by selecting the turbine fin to be rotated (not shown).
- FIG. 31 is a view showing another applied example of the groove-shaped eccentric rotator array 890 of FIG. 15 and is a view showing a groove-shaped eccentric rotator array 3110 in which a sheet-shaped eccentric rotator array 3111 is formed into a groove shape.
- rotators are arranged like a grid, and only eccentric rotators 3170 a to 3173 a , and 3170 b to 3177 b rotate.
- haptic information of a virtual twist as a spatial expansion can be presented onto the palm.
- a large torque is presented in the same direction by the eccentric rotators 3170 a to 3173 a , so that a large resultant torque 315 a to twist the center part of the palm counterclockwise is presented.
- a small torque is presented in the same direction by the eccentric rotators 3170 b to 3177 b , so that a resultant torque 315 b to twist the palm peripheral part clockwise is presented.
- FIG. 32 is a view showing a two-dimensional sectional view of a haptic presentation device 3201 in which the haptic presentation device 2801 of FIG. 28 is further improved.
- a control circuit 3205 and an angular acceleration sensor (and gravity/acceleration sensor) 3206 are arranged at the center part of a spherical housing 2807
- FIG. 32 is a sectional view taken along the center of the spherical housing 2807 .
- the control circuit 3205 corresponds to the control device 4120 of FIG. 41
- the angular acceleration sensor (and the gravity/acceleration sensor) 3206 corresponds to the input device 4130 of FIG. 41 .
- the haptic presentation device 3201 of FIG. 32 is a ball in a mode of a baseball ball, it may be a ball with any shape.
- the angular acceleration sensor 3206 monitors a back spin 3215 generated at the release when the ball (haptic presentation device 3201 ) is pitched in a direction denoted by reference numeral 3210 in the drawing.
- the gravity direction is detected by the gravity/acceleration sensor, and since the gravity direction is periodically changed in the xyz axis components of the sensor, the rotation of the ball can be monitored.
- another method can be applied.
- the control circuit 3205 analyzes the input information from the angular acceleration sensor (and the gravity/acceleration sensor) 3206 , and controls a motor in the haptic presentation device 3201 so as to cancel the back spin 3215 of the ball (haptic presentation device 3201 ).
- the ball (haptic presentation device 3201 ) is not rotated, and becomes a breaking ball (so-called knuckle ball) irregularly swaying and changing by the influence of the flow and swirl generated behind it.
- a breaking ball so-called knuckle ball
- the embodiment of FIG. 32 can be applied to the haptic presentation device 2901 of FIG. 29 .
- the haptic presentation device 3001 of FIG. 30 In a conventional haptic presentation device in the VR, its own weight reduces the original VR effect to be felt by the user. Then, in the haptic presentation device 3001 of FIG. 30 , the air current flowing through the haptic presentation device 3001 from the top to the bottom of FIG. 30 is generated by the control of the motor, so that the force of the jet of the air current toward the bottom reduces the weight of the haptic presentation device 3001 itself to be felt by the user, and the original effect to cause the user to feel the VR can be improved. Similarly, by generating the air current flowing through the haptic presentation device 3001 from the bottom to the top of FIG. 30 , the user can be made to feel that the weight of the haptic presentation device 3001 itself is heavier than actual by the force of the jet of the air current toward the top.
- FIG. 33 is an explanatory view of a pen-shaped device 3301 having the built-in haptic presentation device described in the embodiment.
- the pen-shaped device 3301 is provided with a touch panel 3350 on a surface, the touch panel 3350 indicates respective button columns denoted by reference numerals 3310 , 3320 , 3330 , and 3340 in the drawing, and each of the button columns includes four buttons.
- the pen-shaped device 3301 of this embodiment is applied to, for example, a pen-shaped cellular phone.
- the function of the touch panel 3350 may be realized by a physical button instead of the touch panel.
- each of the button columns may include a desired number of buttons instead of the four buttons.
- FIG. 42 is provided as a supplemental explanation view of FIG. 33 .
- FIG. 42 is provided as a supplemental explanation view of FIG. 33 .
- the rotation of 180° is performed from FIG. 33 ( a ) to FIG. 33 ( b ) and the use is made, virtual operation panels which is the number of columns exist at intervals of a rotation angle of (360°/the number of columns).
- buttons of numeral input functions of “1, 4, 7, *”, “3, 6, 9, #” and “2, 5, 8, 0”.
- buttons “1, 4, 7, *” of the button column 3310 respectively become kana input functions of “A, TA, MA, “.”
- the buttons “3, 6, 9, #” of the button column 3320 respectively become kana input functions of “SA, HA, RA, (enter)”
- the buttons “diamond mark”, “heart mark”, “spade mark”, “clover mark” of the button column 3340 become kana input functions of “KA, NA, HA, WA”.
- the realization is performed with four rows and four columns, and as the front side of the device, the first column, the second column and the third column are used, and as the back side of the device, the third column, the fourth column, and the first column are made usable.
- FIG. 34 is a view showing a rough structure of the pen-shaped device 3301 .
- the pen-shaped device 3301 includes a haptic presentation device 3410 , a control circuit 3420 , a posture sensor 3430 based on a well-known acceleration sensor, a pen-shaped device control circuit 3440 , and a touch panel 3350 .
- the control circuit 3420 corresponds to the control device 4120 of FIG. 41
- the posture sensor 3430 corresponds to the input device 4130 of FIG. 41 .
- the pen-shaped device control circuit 3440 judges, based on the input from the posture sensor 3430 , in which state of FIG. 33 ( a ) and FIG. 33 ( b ) the user sees the pen-shaped device 3301 .
- FIG. 33 ( a ) and FIG. 33 ( b ) the user sees the pen-shaped device 3301 .
- the input functions of the respective button columns denoted by reference numerals 3310 , 3320 , 3330 and 3340 are determined, and the corresponding buttons are displayed on the touch panel.
- the pen-shaped device control circuit 3440 processes the input from the touch panel 3350 , and in the case where for example, the button “0” is depressed by the user, the input of numeral 0 is processed. Since a circuit and its control to process the input from the posture sensor 3430 and the input from the touch panel 3550 , such as the pen-shaped device control circuit 3440 , are well-known for one skilled in the art, the detailed description would be unnecessary.
- the posture sensor 3430 detects the posture change toward a direction 3302 in FIG. 34 , or the pressure sensor of the touch panel detects the motion of the depressing finger, and the control circuit 3420 analyzes the input information from the posture sensor 3430 , controls the motor in the haptic presentation device 3410 , and gives haptic feedback so as to present the movement in the directions 3460 and 3302 , so that a feeling such as to press an actual button is presented in spite of the virtual button on the touch panel.
- the haptic presentation device 3410 presents the force in the directions 3460 and 3302 , and causes the user to feel the depression of the button “0”.
- the posture sensor 3430 detects a posture change toward a direction 3470 in FIG. 34 , or the sensor of the touch panel detects the movement of the finger, and the control circuit 3420 analyzes input information from the posture sensor 3430 and the touch panel sensor, controls the motor in the haptic presentation device 3410 , and gives haptic feedback the movement in the directions 3470 and 3480 , so that a feeling such as to operate an actual scroll wheel or joystick is presented in spite of the virtual wheel on the touch panel.
- the haptic presentation device 3410 presents the force in the directions 3470 and 3480 , and causes the user to feel the operation feeling of the virtual scroll wheel.
- FIG. 35 is an explanatory view of a pointer 3501 having a built-in haptic presentation device described in the embodiment, and is a view showing a rough structure of the pointer 3501 .
- the pointer 3501 includes a haptic presentation device 3510 , a control circuit 3520 , a posture sensor (or a position sensor or an acceleration sensor) 3530 , a pointer control circuit 3540 , a switch 3550 , and a laser light source 3590 .
- the control circuit 3520 corresponds to the control device 4120 in FIG. 41
- the posture sensor 3530 and the switch 3550 correspond to the input device 4130 in FIG. 41 .
- the pointer control circuit 3540 makes a control so that when the switch 3550 is turned ON, a laser beam 3580 is emitted from the laser light source 3590 . Since a circuit to control the laser light source 3590 to emit the laser beam 3580 , such as the pointer control circuit 3540 , and its control are well known for one skilled in the art, the detailed description would be unnecessary.
- the posture sensor 3530 detects the posture change toward the direction 3570
- the control circuit 3520 analyzes input information from the posture sensor 3530 , and controls a motor in the haptic presentation device 3510 so as to suppress the movement of the haptic presentation device 3510 toward the direction 3570 .
- the haptic presentation device 3510 presents a force in a direction 3590 , and causes the user to feel a resisting force against the sway direction 3570 .
- the user is made to feel the resisting force (force in the direction 3590 ) against the direction 3570 in which the object 3560 is moved, and as a result, such a feeling that the user grasps the object 3560 and moves it is given.
- the selection of the object 3560 and the grasping intention are informed to the pointer control circuit 3540 by using the laser light source 3590 and the laser beam tracking function, no limitation is made to this as long as the selection and the grasping intension can be inputted.
- FIG. 36 is an explanatory view of a baton-type controller 3601 having a built-in haptic presentation device described in the embodiment, and is a view showing a rough structure of the baton-type controller 3601 .
- the baton-type controller 3601 is a controller used in a well-known (conducting) music game of a home video game machine.
- the baton-type controller 3601 includes a haptic presentation device 3616 , a control circuit 3620 , a posture sensor 3630 , and a controller control circuit 3640 .
- the control circuit 3620 corresponds to the control device 4120 in FIG. 41
- the posture sensor 3630 and the controller control circuit 3640 correspond to the input device 4130 in FIG. 41 .
- the controller control circuit 3640 transmits/receives a signal 3609 to/from a game machine 3606 , processes input information from the posture sensor 3630 to transmit it to the game machine 3606 , and receives an instruction from the game machine 3606 . Since a circuit to perform a control to communicate with the game machine 3606 , such as the controller control circuit 3640 , and its control are well-known for one skilled in the art, the detailed description would be unnecessary. Incidentally, in FIG. 36 , although a signal of a wired system is exemplified as the signal 3609 , no limitation is made to this, and the signal 3609 may be a signal in a wireless system.
- the posture sensor (or pressure sensor) 3630 detects the grasping way and the posture change toward the direction 3607 , and the controller control circuit 3640 processes the input information from the posture sensor 3630 , and transmits it to the game machine 3606 .
- the game machine 3606 processes the music game based on the information of the posture change from the posture sensor 3630 , and the performance of an orchestra in the music game, such as a tempo, rhythm, and breath, is changed by the swinging way of the baton of the conductor.
- a suppression signal is transmitted to the controller control circuit 3640 .
- the controller control circuit 3640 transmits the information to the control circuit 3620 .
- the control circuit 3620 analyzes the input information from the controller control circuit 3640 , and controls a motor in the haptic presentation device 3610 so as to suppress the motion of the haptic presentation device 3610 toward the direction 3607 .
- the haptic presentation device 3610 presents a force toward a direction 3660 , and causes the user to feel a resisting force against the swing direction 3607 .
- FIG. 37 is a view showing a rough structure of a modified example of the haptic information presentation method of FIG. 11-4 described in the embodiment.
- the two eccentric rotators are synchronously rotated in the opposite directions, and the force to linearly generate the simple harmonic oscillations in an arbitrary direction is synthesized.
- FIG. 37 is a view showing a piezoelectric matrix 3730 as an oscillator in which instead of the eccentric rotators, piezoelectric elements 3701 are used.
- a piezoelectric array 3710 is constructed in which the plural piezoelectric elements 3701 are laminated in an x-direction in the drawing
- a piezoelectric array 3720 is constructed in which the plural piezoelectric elements 3701 are laminated in a y-direction in the drawing
- the piezoelectric arrays 3710 and 3720 are alternatively arranged in the x and the y directions in the oscillator.
- a haptic information presentation method using the piezoelectric matrix 3730 of FIG. 37 is a method in which the piezoelectric matrix 3730 is used instead of the rotator 4180 in FIG. 41 .
- the control device 4120 of FIG. 41 controls the voltage in the x direction in FIG. 37 to control simple harmonic oscillation 3750 in the x direction, and controls the voltage in the y direction in FIG. 37 to control simple harmonic oscillation 3740 in the y direction.
- a sufficient amplitude is not obtained by the single piezoelectric element 3701
- the piezoelectric arrays 3710 and 3720 are constructed, so that a large amplitude can be produced. According to the method of FIG.
- a stepping motor and a servo motor required for driving the rotator 4180 become unnecessary, and also in the control device 4120 , a control circuit for the motors becomes unnecessary, and the structure of the combination of the haptic presentation device and the control device becomes simple.
- the piezoelectric matrix 3730 of FIG. 37 is expanded, and a piezoelectric cube is formed in which the piezoelectric arrays 3710 and 3720 are alternately arranged in the x, y and z directions, an oscillator can be formed in which simple harmonic oscillations in the x, y and z directions can be controlled.
- the method of FIG. 37 can be applied to, for example, a mechanism for generating a force in a desired direction by a controller of a game machine.
- the arrangement pattern of the piezoelectric elements 3701 is arbitrary as long as the simple harmonic oscillations in the x, y and z directions can be generated.
- FIG. 38 is also a view showing a rough structure of another modified example of the haptic information presentation method of FIG. 11-4 described in the embodiment.
- FIG. 38 ( a ) shows a cubic oscillator 3801 using a speaker structure instead of an eccentric rotator, and the oscillator 3801 includes magnets 3810 b , 3810 c , 3810 m and the like of the speaker at the centers of the respective planes.
- the magnets 3810 b , 3810 c , 3810 m and the like are not restricted to the centers of the respective planes, but may be located at arbitrary positions on the planes.
- FIG. 38 ( b ) is a view showing a sectional view in a case where in FIG. 38 ( a ), the oscillator 3801 is cut along a horizontal section 3820 passing through the barycenter and is seen.
- the oscillator 3801 includes, at the respective planes, cones 3840 a , 3850 a , 3840 b , 3850 b , 3840 c , 3850 c , 3840 d and 3850 d of the speaker combined with the magnets 3810 a , 3810 b , 3810 c and 3810 d , respectively.
- the haptic information presentation method using the oscillator 3801 of FIG. 38 is a method using the oscillator 3801 instead of the rotator 4180 in FIG. 41 .
- the control device 4120 of FIG. 41 controls, for example, the voltage of the magnet in the x direction in FIG. 38 ( b ) to control simple harmonic oscillation 3870 in the x direction, and controls the voltage of the magnet in the y direction in FIG. 38 ( b ) to control simple harmonic oscillation 3860 in the y direction.
- a large amplitude caused by the magnets of the speaker and by the vibrations of the cones can be produced.
- a stepping motor and a servo motor required for driving the rotator 4180 become unnecessary, and also in the control device 4120 , a control circuit for the motors becomes unnecessary, and the structure of the combination of the haptic presentation device and the control device becomes simple.
- the structure of the cones 3840 a , 3850 a , 3840 b , 3850 b , 3840 c , 3850 c , 3840 d and 3850 d of the speaker combined with the respective magnets 3810 a , 3810 b , 3810 c and 3810 d may not be adopted, and as long as the simple harmonic oscillations in the x, y and z directions can be generated, no limitation is made particularly to the combination of the magnets and the cones, and a structure of only magnets may be adopted.
- FIG. 39 is a view showing a rough structure of a modified example of the haptic presentation device 1301 of FIG. 13 described in the embodiment.
- the rotation axes of the two eccentric rotators opposite to each other have only to be parallel to each other, inclusive of the case where they are on the same axis.
- the haptic presentation device 1301 of FIG. 13 as in the description in FIG. 11-1 to FIG. 12-2 which is the premise thereof, the rotation axes of the two eccentric rotators opposite to each other have only to be parallel to each other, inclusive of the case where they are on the same axis.
- FIG. 39 is a view showing a structure in which a surplus moment caused by the rotation of two eccentric rotators on different planes is suppressed.
- the arrangement of two facing eccentric rotators 3901 a and 3901 b shown in FIG. 39 is such that the rotation axes thereof are on the same axis, and a part of the eccentric rotator 3901 b covers the eccentric rotator 3901 a .
- the structure as stated above since many material particles of the two eccentric rotators 3901 a and 3901 b are rotated on the same plane around the same rotation axis, the generation of the surplus moment caused by the rotation of the two facing eccentric rotators on the different planes is suppressed, and the rattle or the like of the rotation axis is also relieved.
- FIG. 40 is an explanatory view of a desk device 4001 having a built-in haptic presentation device described in the embodiment, and is a view showing a rough structure of the desk device 4001 .
- the desk device 4001 includes a haptic presentation device 4010 , a control circuit 4020 , and a posture sensor 4030 (may be an acceleration, angular acceleration, or position sensor).
- the control circuit 4020 corresponds to the control device 4120 in FIG. 41
- ad the posture sensor 4030 corresponds to the input device 4130 in FIG. 41 .
- the posture sensor 4030 detects the position change toward the direction 4040 in FIG. 40
- the control circuit 4020 analyzes input information from the posture sensor 4030 , and controls motors in the haptic presentation device 4010 so as to suppress the motion of the haptic presentation device 4010 toward the direction 4040 or so as to sway it in the horizontal direction.
- the haptic presentation device 4010 presents a force in a direction 4050 , and causes the user to feel the friction force on the desk against the movement toward the direction 4040 .
- the posture sensor 4030 detects the position change toward the direction 4040 in FIG. 40
- the control circuit 4020 analyzes input information from the posture sensor 4030 , and controls motors in the haptic presentation device 4010 so as to generate a force in a normal direction to the direction 4040 of the haptic presentation device 4010 .
- the haptic presentation device 4010 presents a force to generate simple harmonic oscillations or the like in the direction 4060 , and causes the user to feel the roughness on the desk against the movement toward the direction 4040 .
- the existence of an object in a virtual space, or the shock due to a collision can be presented by presenting a force to the person through the man-machine interface to which the invention is applied, or by giving a resisting force or a reaction force to limit the motion of the person.
- various instruction, guides and the like which have not been conventionally seen, can be realized through the skin of the operator.
- FIG. 1 is a view showing a rough structure of a haptic information presentation system of an embodiment of the invention.
- FIG. 2 is a view showing a haptic information presentation method using a sensory characteristic relating to a haptic sense.
- FIG. 3 is a view showing a haptic information presentation method using a sensory characteristic relating to a haptic sense.
- FIG. 4 is a view showing a haptic information presentation method using a hysteresis sensory characteristic relating to a haptic sense.
- FIG. 5 is a view showing a haptic information presentation method using a method of changing a sensory characteristic by a masking effect relating to a haptic sense.
- FIG. 6 is a view showing a haptic information presentation method using a method of changing a sensory characteristic by a masking effect relating to a haptic sense.
- FIG. 7 is a schematic view showing a method of changing a sensory characteristic by a masking effect relating to a haptic sense.
- FIG. 8 is a view showing a haptic information presentation method using a method of controlling haptic information presentation in conformity with a change of a sensory characteristic relating to a haptic sense.
- FIG. 9 is a view showing a haptic information presentation method using a method of controlling haptic information presentation in conformity with an anisotropic sensitivity curve change as a sensory characteristic relating to a haptic sense.
- FIG. 10 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotation of an eccentric rotator 711 is phase synchronized.
- FIG. 11 is a view showing a haptic information presentation method of a vibration sensation, a torque sensation, and a force sensation by suitably synchronizing rotation directions and phases of both an eccentric rotator A 812 and an eccentric rotator B 813 .
- FIG. 12 is a view showing a haptic information presentation method of a vibration sensation and a force sensation by suitably synchronizing rotation directions and phases of both the eccentric rotator A 812 and the eccentric rotator B 813 .
- FIG. 13 is an explanatory view in which both the eccentric rotator A 812 and the eccentric rotator B 813 are made one pair, and three such pairs are arranged in an orthogonal coordinate system.
- FIG. 14 is an explanatory view of a sheet-shaped eccentric rotator array to which the invention is applied.
- FIG. 15 is an explanatory view of a glove-shaped eccentric rotator array to which the invention is applied.
- FIG. 16 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotations of both an eccentric rotator A 912 and an eccentric rotator B 913 are phase synchronized.
- FIG. 17 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotations of both an eccentric rotator A 1012 and an eccentric rotator B 1013 are phase synchronized in opposite directions.
- FIG. 18 is a schematic view of a method in which the presentation method of a force sensation using both the eccentric rotators shown in FIG. 17 is used to present a pushing feeling by oneself, an expansion feeling, a pressure feeling, a pulling feeling by oneself, a pulled feeling from outside, and a pushed feeling from outside.
- FIG. 19 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied.
- FIG. 20 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied.
- FIG. 21 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied.
- FIG. 22 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied.
- FIG. 23 is a view showing a haptic information presentation method in an arbitrary direction by using a method of changing a sensory characteristic by a masking effect relating to a haptic sense.
- FIG. 24 is an explanatory view of a gyroscope type and a resultant angular momentum vector differential type.
- FIG. 25 is an explanatory view of a resultant angular momentum in an inertia coordinate system.
- FIG. 26 is an explanatory view showing a torque presentation method and an operation principle in the case where a cellular phone has a built-in haptic information presentation system to which the invention is applied.
- FIG. 27 is an explanatory view showing that in the explanation of merits of three-dimensional torque presentation, when an arm is moved vertically, the posture of a torque presentation device is stabilized by the conservation of a turning axis like a vertical gyro in an airplane.
- FIG. 28 is a view showing a two-dimensional sectional view of a haptic presentation device 2801 in which two facing eccentric rotators are made one pair and three such pairs are arranged in an orthogonal coordinate system.
- FIG. 29 is a view showing a two-dimensional sectional view of a haptic presentation device 2901 in which the haptic presentation device 2801 is further improved.
- FIG. 30 is a view showing a two-dimensional sectional view of a haptic presentation device 3001 in which the haptic presentation device 2901 is further improved.
- FIG. 31 is a view showing another applied example of the glove-shaped eccentric rotator array 890 of FIG. 15 .
- FIG. 32 is a view showing a two-dimensional sectional view of a haptic presentation device 3201 in which the haptic presentation device 2801 is further improved.
- FIG. 33 is an explanatory view of a pen-shaped device 3301 having a built-in haptic presentation device of the embodiment.
- FIG. 34 is a view showing a rough structure of a pen-shaped device 3301 .
- FIG. 35 is an explanatory view of a laser pointer 3501 having a built-in haptic presentation device of the embodiment and is a view showing a rough structure of the laser pointer 3501 .
- FIG. 36 is an explanatory view of a baton-type controller 3601 having a built-in haptic presentation device of the embodiment and is a view showing a rough structure of the baton-type controller 3601 .
- FIG. 37 is a view showing a rough structure of a modified example of the haptic information presentation method of FIG. 11-4 .
- FIG. 38 is a view showing a rough structure of another modified example of the haptic information presentation method of FIG. 11-4 .
- FIG. 39 is a view showing a rough structure of a modified example of a haptic presentation device 1301 of FIG. 13 .
- FIG. 40 is an explanatory view of a desk device 4001 having a built-in haptic presentation device of the embodiment and is a view showing a rough structure of the desk device 4001 .
- FIG. 41 is a block diagram of a haptic information presentation system of the embodiment.
- FIG. 42 is a supplemental explanatory view of the pen-shaped device 3301 having the built-in haptic presentation device of the embodiment.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mechanical Engineering (AREA)
- Electromagnetism (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A system and a method are realized in which in a conventional non-grounding man-machine interface having no reaction base on the human body and for giving the existence of a virtual object and the impact force of a collision to a person, a haptic sensation of a torque, a force and the like can be continuously presented in the same direction, which can not be presented by only the physical characteristic of a haptic sensation presentation device. In a haptic presentation device 112, the rotation velocity of at least one rotator in the haptic presentation device 112 is controlled by a control device 111, and a vibration, a force or a torque as the physical characteristic is controlled, so that the user 110 is made to conceive various haptic information of the vibration, force, torque or the like. The haptic information presentation system uses a human sensory characteristic or illusion to suitably control the physical quantity, and causes the person to feel a force which can not exist physically, or a haptic sensory physical characteristic.
Description
- The present invention relates to a haptic information presentation system and method, which uses sensory characteristics.
- More particularly, the invention relates to a haptic information presentation system, a haptic information presentation method, a haptic presentation device of a haptic information presentation system, and a control device of a haptic information presentation system, which is for providing a man-machine interface mounted on an equipment used in the field of VR (Virtual Reality), an equipment used in the field of game, a cellular phone, a portable navigation equipment, a PDA (Personal Digital Assistant) or the like.
- With respect to a conventional haptic device in the VR, in the haptic presentation of a tensile force or reaction force, a haptic presentation part in contact with a human sense organ and a haptic presentation system main body are connected to each other by a wire or an arm, and there has been a disadvantage that the existence of the wire, arm or the like restricts the human motion. Besides, since use is limited to an effective space in which the haptic presentation system main body and the haptic presentation part are connected to each other by the wire or the arm, there has been a limitation in the expanse of the space which can be used.
- On the other hand, a man-machine interface which is of a non-grounding type and has no reaction base on the human body has been proposed. However, in this type of presentation device, the rotation velocity (angular velocity) of a motor is controlled so that a torque is presented by a temporal change of an angular momentum vector, and it has been difficult to continuously present haptic information of torque, force or the like in the same direction.
- As a non-grounding type haptic information presentation device, a torque presentation apparatus using a gyro moment and a gimbal structure has been developed (non-patent document 1). However, in the gimbal structure, there are problems that the direction of a torque which can be presented is limited, the structure becomes complicated, and the control becomes troublesome.
- On the other hand, a non-grounding mobile haptic information presentation device (non-patent document 2) has been proposed in which a torque in an arbitrary direction or with an arbitrary magnitude can be presented by independently controlling the rotations of three gyro motors arranged in three-axis orthogonal coordinates. In this haptic information presentation device, since the torque is generated by controlling a resultant angular momentum vector generated by the three gyro motors, the structure is relatively simple and the control is also easy. However, there are such problems to be solved that haptic information is made to be capable of being continuously presented, and a force sensation other than the torque is made to be capable of being presented.
- [Non-patent document 1] Masayuki Yoshie, Hiroaki Yano, Hiroo Iwata “Development of Non-grounded Force Display Using Gyro Moment”, Research Report Collection (Kenkyu Hokokusho) of Human Interface Society, vol. 3, No. 5, pp. 25-30 (2000)
- [Non-patent document 2] Yokichi Tanaka, Masataka Sakai, Yuka Kohno, Yukio Fukui, Juli Yamashita, Norio Nakamura, “Mobil Torque Display and Haptic Characteristics of Human Palm”, INTERNATIONAL CONFERENCE ON ARTIFICIAL REALITY AND TELEXISTENCE, pp. 115-120 (2001/12)
- In view of the above, a first object of the invention is to provide a haptic information presentation system and method, in which in a conventional non-grounding man-machine interface having no reaction base on the human body and for giving the existence of a virtual object and the impact force of a collision to a person, a haptic information presentation mechanism using human sensory characteristic is realized, so that haptic information of vibration, torque, force and the like can be continuously presented in the same direction, which can not be presented only by the physical characteristics of a haptic presentation device.
- Besides, when a physical quantity continues to be continuously presented in the man-machine interface, in case the performance of the presentation device is sufficiently high, the physical quantity such as the torque or force can continue to be continuously presented in the same direction. However, actually, the performance of the presentation device is not infinite, and in the case where the performance of the presentation device is not sufficient, for example, when the torque continues to be continuously presented, it becomes necessary to return the rotation velocity of the rotator to the initial state in one cycle of the presentation. That is, it is required that the integral value of the angular momentum vector of the rotator is made zero. In this case, the quite opposite torque or force is presented, and there arises a problem that the senses in the positive direction and the negative direction cancel each other out.
- Thus, a second object of the invention is to provide a haptic information presentation system and method, in which human sensory characteristics are used, and in an operation of a haptic presentation device, even if a return is made physically to the initial state in one cycle, and a integral value of physical quantity becomes zero, a integral value of a sensory quantity does not become zero, and a sense can continue to be presented freely in an arbitrary direction.
- In order to achieve the above object, according to a first aspect of the invention, a haptic information presentation system includes a haptic presentation unit having two eccentric rotators, and a control unit that independently changes a frequency and an intensity of a vibration and/or a vibration sensation by controlling rotation directions, a phase relation and rotation speeds of the two eccentric rotators.
- According to a second aspect of the invention, a haptic information presentation system includes a haptic presentation unit having two eccentric rotators, and a control unit that independently changes a frequency and an intensity of a force and/or a force sensation by inverting rotation directions of the two eccentric rotators.
- According to a third aspect of the invention, a haptic information presentation system includes a haptic presentation unit having an eccentric rotator array in which plural single eccentric rotators, and/or plural twin eccentric rotators each having two eccentric rotators, and/or plural twin eccentric rotators arranged in a three-dimensional space are arranged two-dimensionally or three-dimensionally, and a control unit to control a rotation state of each of the eccentric rotators included in the haptic presentation unit.
- According to a fourth aspect of the invention, a haptic information presentation system includes a haptic presentation unit having plural rotators arranged three-dimensionally, and a control unit to control a temporal change of a resultant angular momentum vector of the haptic presentation unit, in which the control unit generates a torque with a fixed value by abruptly changing the resultant angular momentum vector in the vicinity of zero, and controls a precession torque to be a specified value or less.
- According to a fifth aspect of the invention, in a haptic information presentation method, when a haptic presentation unit having two eccentric rotators is controlled, a frequency and an intensity of a vibration and/or a vibration sensation are independently changed by controlling rotation directions, a phase relation and rotation speeds of the two eccentric rotators.
- According to a sixth aspect of the invention, in a haptic information presentation method, when a haptic presentation unit having two eccentric rotators is controlled, a frequency and an intensity of a force and/or a force sensation are independently changed by inverting rotation directions of the two eccentric rotators.
- According to a seventh aspect of the invention, in a haptic information presentation method, when a control is made on a haptic presentation unit having an eccentric rotator array in which plural single eccentric rotators, and/or plural twin eccentric rotators each having two eccentric rotators arranged on a same rotation axis, and/or plural twin eccentric rotators arranged in a three-dimensional space are arranged two-dimensionally or three-dimensionally, a rotation state of each of the eccentric rotators included in the haptic presentation unit is individually controlled.
- According to an eighth aspect of the invention, in a haptic information presentation method, when a haptic presentation unit having plural rotators arranged three-dimensionally is controlled, a temporal change of a resultant angular momentum vector of the haptic presentation unit is controlled, a torque with a fixed value is generated by abruptly changing the resultant angular momentum vector in the vicinity of zero, and a precession torque is controlled to have a specified value or less.
- When the haptic information presentation system of the invention and the haptic information presentation method are carried out, special effects listed below can be obtained.
- (1) It becomes possible to continuously or intermittently present the haptic information of the torque, force and the like in the same direction, which has been difficult in a conventional man-machine interface which is of a non-grounding type and has no reaction base on the body.
- (2) By using human sensory characteristics and illusion, it becomes possible to present the haptic sensory-physical characteristics of the torque, force or the like, which can not exist physically, to a person.
- (3) By using the human sensory characteristics, it becomes possible to present the haptic information efficiently while energy is saved, and a miniaturized haptic presentation system can be realized.
- (4) In order to present a vibration sensation, a torque sensation, and a force sensation, a device corresponding to each of them is conventionally required. However, according to the invention, it becomes possible to simultaneously present one or more of the vibration sensation, the torque sensation, and the force sensation by one mechanism of the eccentric rotators, various haptic information can be presented, and the presentation system can be miniaturized.
- (5) By carrying out the invention, it is possible to realize a useful man-machine interface, an interface between a robot and a machine, an interface between an animal and a machine, and the like, which can be mounted on an equipment used in the field of VR (Virtual Reality), an equipment used in the field of game, a cellular phone, a portable navigation equipment, a PDA (Personal Digital Assistant) and the like. For example, in the field of the VR, the existence of an object in a virtual space or the shock due to a collision can be presented by presenting a force to a person through the man-machine interface or by giving a resisting force or reaction force. Besides, by mounting the interface on the cellular phone, portable navigation equipment, PDA, or the like, various instructions, guides and the like, which have not existed conventionally, can be realized through the skin of an operator.
- (6) An eccentric rotator which is conventionally known and is used in a manner mode of a cellular phone or the like, the vibration intensity is increased by increasing the rotation velocity, and the vibration frequency and the vibration intensity have not been capable of being independently controlled. However, in the eccentric rotator to which the invention is applied, the vibration intensity of the eccentric vibration can be changed without changing the rotation velocity. By this, it becomes possible to independently control the vibration frequency and the vibration intensity.
- (7) According to the sheet-shaped eccentric rotator array to which the invention is applied, by suitably controlling the rotations of the respective eccentric rotators, the vibration sensation, torque sensation, and force sensation of various patterns in space and time can be presented onto the palm. Besides, the sheet-shaped eccentric rotator array can be applied to a glove, clothes, or something having a wearable shape.
- (8) According to the sheet-shaped eccentric rotator array to which the invention is applied, various haptic information relating to an object, such as the existence, shape, elasticity, texture and the like of a virtual object, can be presented by suitably changing a space portion of a force sensation in accordance with the movement of a palm or the like.
- (9) In an inertia coordinate system, in the case where the temporal change of the resultant angular momentum vector is controlled, the easiness of the control is a great merit. That is, the resultant angular momentum vector is abruptly changed in the vicinity of zero, so that a large torque is generated, and a precession torque can be suppressed to be low. Besides, in the case where the torque presentation device sways according to the movement of the user and difficulty occurs, the resultant angular momentum vector is temporarily changed in the vicinity of the resultant angular momentum vector with a suitable magnitude, so that a specified torque can be presented while the sway of the torque presentation device is suppressed.
- Hereinafter, embodiments of the invention will be described with reference to the drawings.
- (Operation Principle 1)
-
FIG. 1 is a view showing a rough structure of a haptic information presentation system of an embodiment of the invention. - A
haptic presentation device 112 is such that the rotation velocity of at least one rotator in thehaptic presentation device 112 is controlled by using acontrol device 111, and a vibration, force or torque as its physical characteristics is controlled, so that a user 110 is made to perceive various haptic information such as the vibration, force or torque. - Hereinafter, although the haptic information presentation system of the embodiment will be described with reference to FIGS. 2 to 40 in addition to
FIG. 1 , before that, the outline of the block structure of the system will be described with reference to a block diagram of the haptic information presentation system of the embodiment ofFIG. 41 attached to the end of the drawings. - In
FIG. 41 , a hapticinformation presentation system 4101 includes ahaptic presentation device 4110, acontrol device 4120, and aninput device 4130. Thehaptic presentation device 4110 includes therein at least onerotator 4180 rotated by a motor, and it is rotated by the control from thecontrol device 4120. A stepping motor, a servo motor, or the like can be applied to the driving of therotator 4180. Thecontrol device 4120 includes a CPU (central processing unit) 4160, a RAM (random access memory) 4170, a ROM (read only memory) 4140 and the like. - The
CPU 4160 controls the whole operation of thecontrol device 4120. TheRAM 4170 is used as a work area to temporarily store data of a processing object and the like when theCPU 4160 performs the processing. Acontrol program 4150 is previously stored in theROM 4140. Thecontrol program 4150 is a program to prescribe the control processing of thehaptic presentation device 4110 corresponding to the input signal from theinput device 4130. TheCPU 4160 reads thecontrol program 4150 from theROM 4140 and executes it, and controls therotator 4180 of thehaptic presentation device 4110 correspondingly to the respective input signals. - The
input device 4130 is, for example, a select button of an input menu. TheCPU 4160 performs a processing (for example, thehaptic presentation device 4110 is controlled so as to generate a torque in a specified rotation direction) corresponding to the input of the select button selected by depression, touch or the like. Theinput device 4130 as stated above may be united with thecontrol device 4120 and made a part of thecontrol device 4120. - Alternatively, the
input device 4130 is a device such as a well-known myoelectric detector to detect myoelectricity described later, or a well-known angular acceleration sensor. When a trigger signal of myoelectricity occurrence from the myoelectric detector, or a signal of angular acceleration from the angular acceleration sensor is inputted to thecontrol device 4120, theCPU 4160 feeds back the input and controls thehaptic presentation device 4110. Theinput device 4130 such as the angular acceleration sensor, together with thehaptic presentation machine 4110, may be included in the inside of thehaptic presentation device 4110. - Since a general processing method in which the
CPU 4160 reads thecontrol program 4150 from theROM 4140 and executes it so that the control of therotator 4180 of thehaptic presentation device 4110 is performed correspondingly to each input signal, is well known for one skilled in the art throughnon-patent documents -
FIG. 2 andFIG. 3 are views showing the haptic information presentation method in which a sensory characteristic relating to a haptic sense is used and the haptic presentation device is controlled by the control device of the haptic information presentation system. - In a sensory characteristic 211, a sensory quantity 213 thereof is often a nonlinear characteristic, such as a logarithm, with respect to a
physical quantity 212 which is mainly a stimulus.FIG. 2-1 schematically shows a case where the sensory characteristic 211 is a logarithmic function characteristic. When consideration is given to a case where a positive torque is generated at an operation point A 214 on the sensory characteristic 211, and a negative torque in the reverse direction is generated at anoperation point B 215, a torque sensation 224 is represented as shown inFIG. 2-2 . A torque 223 is proportional to the time differential of a rotation velocity (angular velocity) 222. When an operation is performed at the operation point A 214 and theoperation point B 215, the torque sensation 224 is perceived. The torque 223 is physically returned to aninitial state 228 in one cycle, and an integral value thereof is zero. However, a sensory integral value of the torque sensation 224 as the sensory quantity does not necessarily become zero. By suitably selecting the operation point A 214 and theoperation point B 215 and by suitably setting an operation point Aduration time 225 and an operation pointB duration time 226, the torque sensation can freely continue to be presented in an arbitrary direction. - The above is established also when the sensory characteristic 211 exhibits a nonlinear characteristic of an exponential function case or the like.
-
FIG. 3-1 inFIG. 3 schematically shows a case where a sensory characteristic 231 has a threshold value. When consideration is given to a case where a positive torque is generated at anoperation point A 234 on the sensory characteristic 231, and a negative torque in the reverse direction is generated at anoperation point B 235, a torque sensation 244 is represented as inFIG. 3-2 . - Similarly to the case which is shown in
FIG. 2-1 andFIG. 2-2 and in which the sensory characteristic is nonlinear, a torque 243 is physically returned to aninitial state 248 in one cycle, and an integral value thereof is zero. However, since the torque sensation 244 as the sensory quantity is the sensory threshold value or less in a section of an operation pointB duration time 246, it becomes zero. As a result, a torque sensation can continue to be intermittently presented only in one direction. -
FIG. 4-1 toFIG. 4-3 are views showing a haptic information presentation method using a hysteresis sensory characteristic relating to a haptic sense. - The sensory characteristic is not isotropic between a time when a displacement 312 is increased and a time when it is decreased, for example, between a time when a muscle is extended and a time when it is contracted, and often indicates a hysteresis
sensory characteristic 311. The hysteresissensory characteristic 311 ofFIG. 4-1 schematically represents the hysteresis characteristic of the sensory characteristic. When consideration is given to a case where a positive torque is generated in anoperation passage A 314 on the hysteresis sensory characteristic 311, and a negative torque in the reverse direction is generated in an operation passage B 315, these behaviors are represented as inFIG. 4-2 , and a torque sensation 334 is represented as inFIG. 4-3 . A torque 333 is proportional to the time differential of a rotation velocity 332 of a rotator. When an operation is performed in theoperation passage A 314 and the operation passage B 315, the torque sensation 334 is perceived. The torque 333 is physically returned to aninitial state 338 in one cycle, and an integral value thereof is zero. However, a sensory integral value of the torque sensation 334 as the sensory quantity does not necessarily become zero. By suitably selecting theoperation passage A 314 and the operation passage B 315, and by suitably setting an operation passage A duration time 335 and an operation passageB duration time 336, a high torque sensation in an arbitrary direction can continue to be intermittently and continuously presented. -
FIG. 5 andFIG. 6 are views showing, as an example of a method of changing a sensory characteristic, a haptic information presentation method using a method of changing a sensory characteristic by a masking effect relating to a haptic sensation. - In the sensory characteristic, masking is performed by a masking vibration and a torque sensation 434 is decreased. As this masking method, simultaneous masking 424 (having satisfactory results in masking of the visual sense and hearing sense), forward masking 425, and backward masking 426 are enumerated.
FIG. 5-1 schematically shows a torque 413 as a maskee, and the torque sensation 434 perceived at this time is represented as inFIG. 5-3 . The torque 413 is proportional to the time differential of a rotation velocity 412 of a rotator. - At this time, an initialization time 415 in which the rotation velocity 412 of the rotator is initialized, and a masking duration time 425 corresponding thereto are shortened like an initialization time 445 and a masking duration time 455 shown in
FIG. 6-1 , and when it becomes shorter than a certain specific time, a critical fusion occurs in which although a negative torque due to the initialization physically exists, it is felt as if torque is continuously presented like a torque sensation 464. - Incidentally, a masker to generate a masking vibration may be a rotator different from a rotator as a maskee whose torque is masked by that or the rotator itself as the maskee.
- The case where the rotator of the maskee is also the masker means that at the time of masking, the rotator is controlled to generate the masking vibration by the control device. The vibration direction of the masker may be the same as the rotation direction of the rotator as the maskee or may not be the same.
- The above can occur also in the case where the maskee and the masker are the same stimulus (in the case where the rotator of the maskee is also the masker).
FIG. 7 is a view schematically showing this case. As shown inFIG. 7 , before and after high torque sensations 485 and 486, a torque sensation 484 is decreased by forward masking 485 and backward masking 486. -
FIG. 8 is a view showing a haptic information presentation method using a method of controlling haptic information presentation in conformity with change of sensory characteristics relating to a haptic sense. - With respect to the sensory characteristic, the sensitivity of a torque sensation 517 is changed according to a muscle tensile state or at least one state of physical, physiological and psychological states. For example, when a muscle is instantaneously expanded by a presented torque 514 (high torque 524 in a short time) as an external force, a sensor called a muscle spindle in the muscle senses this, and the muscle is quickly contracted in a conditioned reflex way by a muscle cause torque 515 (muscle reflex cause torque 525) having power not lower than this external force. At this time, myoelectricity 511 is generated. A
control circuit 512 having detected it controls a haptic presentation device 513, and changes the sensitivity of the torque sensation 517 by activating a presentation torque 516 (gentle middle torque 526) in synchronization with the contraction of the muscle. - The above is established not only in the muscle tensile state but also in the case of the change of sensory sensitivity due to at least one state of breath, posture and neural firing states.
-
FIG. 9 shows a haptic information presentation method using a method of correcting a presentation physical quantity according to a relation between the presentation physical quantity and a sensory quantity with respect to a palm direction and relating to a haptic sense. In the palm, the sensitivity is different according to the palm direction because of the anatomical structure of a skeleton, joint, tendon, muscle and the like. The direction presentation with high precision becomes possible by correcting the intensity (rotation velocity ω 612) of the presentation physical quantity in conformity with the sensitivity (anisotropic sensitivity curve 611) dependent on the palm direction. -
FIG. 10 is an explanatory view of an eccentric rotator which can be applied to the rotator of the haptic presentation device of the embodiment, and is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and the rotation of an eccentric rotator 711 is phase synchronized as inFIG. 10-2 . -
FIG. 10-3 schematically shows a case where a sensory characteristic 731 is a logarithmic function characteristic, and the sensory characteristic 731 indicates that similarly to the sensory characteristic 211, a sensory quantity 733 has a nonlinear characteristic of a logarithm or the like with respect to a physical quantity 732 as a stimulus. When consideration is given to a case where a positive torque is generated at an operation point A 734 on the sensory characteristic 731 (vibration is also generated by the eccentricity of the eccentric rotator 711), and a negative torque in the reverse direction is generated at an operation point B 735, a torque sensation 744 is represented as inFIG. 10-4 . A torque 743 is proportional to the time differential of a rotation velocity 742 of the rotator. When an operation is performed at the operation point A 734 and the operation point B 735, the torque sensation 744 is perceived. The torque 743 is physically returned to an initial state 748 in one cycle, and an integral value thereof is zero. However, the sensory integral value of the torque sensation 744 as the sensory quantity does not necessarily become zero. By suitably selecting the operation point A 734 and the operation point B 735, and by suitably setting an operation point A duration time 745 and an operation point B duration time 746, the torque sensation can continue to be freely presented in an arbitrary direction. - The above is established also when the sensory characteristic 731 exhibits nonlinear characteristic of an exponential function case or the like. Also in the case where the sensory characteristic 731 of
FIG. 10-3 has a threshold value as in thesensory characteristic 231 ofFIG. 3-1 , a torque sensation similar to that ofFIG. 3-2 occurs, and a torque sensation can continue to be intermittently presented only in one direction. -
FIG. 11 is an explanatory view of an eccentric rotator applicable to the rotator of the haptic presentation device of the embodiment, and is a view showing a haptic information presentation method of a vibration sensation, torque sensation, and force sensation by suitable synchronization of rotation directions and phases of both an eccentric rotator A 812 ad an eccentric rotator B 813. -
FIG. 11-2 schematically shows a case where both the eccentric rotator A 812 and the eccentric rotator B 813 ofFIG. 11-1 are synchronously rotated in the same direction. As a result of the synchronous rotation, the eccentric rotations are combined.FIG. 11-3 schematically shows a case where both the eccentric rotator A 812 and the eccentric rotator B 813 ofFIG. 11-1 are synchronously rotated with a phase delay of 180 degrees and in the same direction. As a result of the synchronous rotation, the torque rotation without eccentricity can be formed. -
FIG. 11-4 schematically shows a case where both the eccentric rotator A 812 and the eccentric rotator B 813 ofFIG. 11-1 are synchronously rotated in the opposite directions. As a result of the synchronous rotation in the opposite directions, a force to linearly generate simple harmonic oscillations in an arbitrary direction can be synthesized. -
FIG. 12-1 is a view showing a method of changing a vibration intensity of an eccentric vibration by suitably synchronizing the rotation directions and phases of both theeccentric rotator A 822 and the eccentric rotator B 823 inFIG. 11-2 . A phase difference (for example, aphase difference 0° 851, a phase difference 90° 852, a phase difference 180° 853) of rotations of both theeccentric rotator A 822 and the eccentric rotator B 823 is adjusted, and resultant barycenters (854, 855, 856) of the two eccentric rotators, and barycenter moment lengths (857, 858, 859) between the rotation centers of the rotators and the resultant barycenters are suitably changed, so that the vibration intensity of the eccentric vibration can be changed without changing the rotation velocities of the eccentric rotators (822, 823). By this, the vibration frequency and the vibration intensity can be independently controlled. - On the other hand, in an eccentric rotator used in a manner mode of a cellular phone or the like, the vibration intensity is increased by increasing the rotation velocity, and the vibration frequency and the vibration intensity can not be independently controlled.
-
FIG. 12-2 is a view showing a method in which the rotation directions of both the eccentric rotator A 842 and the eccentric rotator B 843 inFIG. 11-4 are suitably inverted, so that the intensity of a force and/or a force sensation and the intensity of a vibration and/or a vibration sensation are changed. By inverting the rotation direction in suitable phases (for example,phase 0° 861, phase 45° 862, phase 90° 863, phase 135° 864, phase 180° 865) of both the eccentric rotator A 842 and the eccentric rotator B 843, amplitudes (866, 867) of vibrations are suitably changed, and the intensity of a force and/or a force sensation can be made variable without changing the rotation velocities of the eccentric rotators (842, 843). By this, the frequency and the intensity of the force and/or the force sensation can be independently controlled. - In the description of
FIG. 11-1 toFIG. 12-2 , although the rotation axes of both the eccentric rotators are represented on the same axis, it is not inevitable that they are on the same axis, and the rotation axes have only to be parallel to each other, inclusive of the case where they are on the same axis. -
FIG. 13 is a view showing ahaptic presentation device 1301 in which both the eccentric rotator A 812 and the eccentric rotator B 813 are made one pair and three such pairs are arranged in an orthogonal coordinate system.Reference numeral 1310 in the drawing denotes an eccentric rotator; and 1311, a motor to drive it. By arranging the plural eccentric rotators in the three-dimensional space, the vibration sensation, the torque sensation, and the force sensation shown inFIG. 11-2 toFIG. 11-4 can be presented in an arbitrary three-dimensional direction. The arrangement of the orthogonal coordinate system is an example for presentation in the three-dimensional direction. -
FIG. 14 is a view showing a sheet-shapedeccentric rotator array 880 in which one of the eccentric rotator 711 ofFIG. 10-1 , the twin eccentric rotator 811 ofFIG. 11-1 , and the twin eccentric rotator arranged in the three-dimensional space ofFIG. 13 is arranged like a sheet in a three-dimensional plane. A practicing method of a drive portion of the twin eccentric rotator may be a molecular motor or a piezoelectric element, and anything may be used as long as an objective physical quantity can be presented. -
FIG. 15 is a view showing a glove-shaped eccentric rotator array 890 in which the sheet-shapedeccentric rotator array 880 is formed into a glove shape. By suitably controlling the rotation of each eccentric rotator, the vibration sensation, torque sensation, and force sensation of various patterns in space and time can be presented onto a palm. - Incidentally, the sheet-shaped
eccentric rotator array 880 and the glove-shaped eccentric rotator array 890 are merely examples of the embodiment, and the embodiment can be applied to clothes and wearable haptic information presentation, inclusive of a case where the eccentric rotator array is three-dimensionally arranged. -
FIG. 16 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotations of both an eccentric rotator A 912 and an eccentric rotator B 913 are phase synchronized. - Here,
FIG. 16-2 schematically shows a case where both the eccentric rotator A 912 and the eccentric rotator B 913 ofFIG. 16-1 are synchronously rotated with a phase delay of 180 degrees in the same direction. As a result of the synchronous rotation, the torque rotation without eccentricity can be formed. -
FIG. 16-3 schematically shows a case where a sensory characteristic 931 is a logarithmic function characteristic, and similarly to the sensory characteristic 211, the sensory characteristic 931 indicates that a sensory quantity 933 has a nonlinear characteristic of a logarithm or the like with respect to a physical quantity 932 as a stimulus. When consideration is given to a case where a positive torque is generated at an operation point A 934 on the sensory characteristic 931, and a negative torque in the reverse direction is generated at an operation point B 935, a torque sensation 944 is represented as inFIG. 16-4 . A torque 943 is proportional to the time differential of a rotation velocity 942 of a rotator. When an operation is performed at an operation point A 934 and an operation point B 935, the torque sensation 944 is perceived. - The torque 943 is physically returned to an initial state 948 in one cycle, and an integral value thereof is zero. However, a sensory integral value of the torque sensation 944 as a sensory quantity does not necessarily become zero. By suitably selecting the operation point A 934 and the operation point B 935 and by suitably setting an operation point A duration time 945 and an operation point B duration time 946, the torque sensation can continue to be freely presented in an arbitrary direction.
- The above is established also when the sensory characteristic 931 exhibits a nonlinear characteristic of an exponential function case or the like. Also in the case where the sensory characteristic 931 of
FIG. 16-3 has a threshold value like thesensory characteristic 231 ofFIG. 3-1 , a torque sensation similarly to that ofFIG. 3-2 occurs, and the torque sensation can continue to be intermittently presented only in one direction. -
FIG. 17 is a view showing a haptic information presentation method in which a sensory characteristic relating a haptic sense is used, and the rotations of both an eccentric rotator A 1012 and an eccentric rotator B 1013 are phase synchronized in the opposite directions. -
FIG. 17-2 schematically shows a case where both the eccentric rotator A 1012 and the eccentric rotator B 1013 ofFIG. 17-1 are synchronously rotated in the opposite directions. As a result of the synchronous rotation in the opposite directions, a force to linearly generate simple harmonic oscillations in an arbitrary direction can be synthesized.FIG. 17-3 schematically shows a case where a sensory characteristic 1031 is a logarithmic function characteristic, and similarly to the sensory characteristic 211, the sensory characteristic 1031 indicates that asensory quantity 1033 has a nonlinear characteristic of a logarithm or the like with respect to a physical quantity 1032 as a stimulus. When consideration is given to a case where a positive force is generated at an operation point A 1034 on the sensory characteristic 1031 and a negative force in the reverse direction is generated at an operation point B 1035, a force sensation 1044 is represented as inFIG. 17-4 . A magnitude 1042 of a resultant rotation velocity of both the eccentric rotators is the combination of rotation velocities of the eccentric rotator A 1012 and the eccentric rotator B 1013, and a force 1043 is proportional to the time differential of the magnitude 1042 of the resultant rotation velocity of both the eccentric rotators. When an operation is performed at an operation point A 1034 and an operation point B 1035, a force sensation 1044 is perceived. The force 1043 is physically returned to an initial state 1048 in one cycle, and an integral value is zero. However, a sensory integral value of the force sensation 1044 as a sensory quantity does not necessarily become zero. The force sensation can continue to be freely presented in an arbitrary direction by suitably selecting the operation point A 1034 and the operation point B 1035, by suitably selecting an operation point A duration time 1045 and an operation point B duration time 1046, and by adjusting the synchronous phases of both the eccentric rotator A 1012 and the eccentric rotator B 1013. - The above is established also when the sensory characteristic 1031 exhibits a nonlinear characteristic of an exponential function case or the like. Also in the case where the sensory characteristic 1031 of
FIG. 17-3 has a threshold value like thesensory characteristic 231 ofFIG. 3-1 , a force sensation similar to that ofFIG. 3-2 occurs, and the force sensation can continue to be intermittently presented only in one direction. -
FIG. 18 is a schematic view of a method in which the presentation method of the force sensation using both the eccentric rotators shown inFIG. 17 is used to present a pushing feeling by oneself (FIG. 18-1 ), an expansion feeling (FIG. 18-2 ), a pressure feeling (FIG. 18-3 ), a pulling feeling by oneself (FIG. 18-4 ), a pulled feeling from outside (FIG. 18-5 ), and a pushed feeling from outside (FIG. 18-6 ). - In the pushing feeling by oneself (
FIG. 18-1 ), a twineccentric rotator 1111 and a twineccentric rotator 1112 are used on the front and back of a palm, and a force 1113 and a force 1114 are presented, so that a feeling such as to push an object by oneself with the front of the palm can be presented. - The expansion feeling (
FIG. 18-2 ), the pressure feeling (FIG. 18-3 ), the pulling feeling by oneself (FIG. 18-4 ), the pulled feeling from outside (FIG. 18-5 ), and the pushed feeling from outside (FIG. 18-6 ) can also be similarly presented. -
FIG. 19 is a view showing a method of presenting aforce 1173, ashear force 1174, and atorque 1175 to a palm and a finger tip by suitably controlling the rotation of each twin eccentric rotator 1172 on 1171 of the groove-shaped eccentric rotator arrays 1170. - Besides, as shown in
FIG. 20 , by presenting a torque in the same direction on a skin-shapedeccentric rotator array 1181 round around a finger, aresultant torque 1185 to twist the whole finger can be presented. - Further, as shown in
FIG. 21 , by suitably adjusting the spatial intensity distribution of a resisting force 1193 presented to a palm, and by presenting a spherical resistingforce 1191, a cubic resisting force 1192 or the like, a three-dimensional shape feeling of a sphere, a cubic or the like, or a tactile sensation such as an elastic feeling or a soft feeling can be presented to the palm. - Further, as shown in
FIG. 22 , by temporally changing the spatial intensity distribution of the resisting force 1193 presented onto the palm, it is possible to present a feeling 1195 in which a force is transmitted on the palm, a feeling in which a object rotates on the palm, and a force sensation 1196 in which a force passes through the palm. Similarly, by changing the shear force, the torque and the like, the texture of a surface of a virtual object, such as surface roughness, can be presented. - According to the presentation methods shown in FIGS. 19 to 22, by suitably changing the space distribution of the force sensation in conformity with the movement of the palm, it is possible to present various haptic information relating to the object, such as the existence, shape, elasticity, texture and the like of the virtual object.
- (Operation Principle 2)
-
FIG. 23 is a view showing a vibration haptic information presentation method in an arbitrary direction using a method of changing a sensory characteristic by a masking effect relating to a haptic sense, which is an example of a control method of continuously or intermittently presenting haptic information of at least one of a vibration sensation, a force sensation and a torque sensation in an arbitrary direction. - The sensory characteristic is masked by a masking vibration 1216, and a force sensation 1224 is decreased. This masking vibration can be generated by synchronizing the rotation velocity 1022 of the eccentric rotator A with the rotation velocity 1023 of the eccentric rotator A in
FIG. 17-2 and by fractuating the velocities.FIG. 23-1 schematically shows this, and the force sensation 1224 perceived at this time is represented as inFIG. 23-2 . A force 1213 is proportional to the time differential of a magnitude 1212 of a resultant rotation velocity of the two eccentric rotators. - At this time, an initialization time 1215 in which the rotation velocity 1212 of the rotator is initialized is shortened and when it becomes shorter than a certain specific time as shown in
FIG. 23-3 , a critical fusion occurs in which although a negative force due to the initialization physically exists, it is felt as if a force is continuously presented like a force sensation 1244. - The above occurs also in the case where a maskee and a masker are different rotators, and a similar continuous presented sensation occurs not only in the case of the force but also in the case of a torque.
- In the actual use of the haptic information presentation system, since a posture change of a torque presentation device by a human unconscious motion is felt as an inertial force due to the Coriolis force or gyro effect, it is necessary that the inertial force of the rotator itself is suppressed to the utmost, and a large torque can also be presented. In the following, this inertial force will be considered.
- As methods of generating a torque sensation, there are a method of accelerating and decelerating the rotation velocity of a rotation body having an inertia moment, and a method of turning a rotation body around an axis orthogonal to its rotation axis. From the viewpoint of dynamics of mechanism, the method is roughly classified into following two types, namely, a rotator posture control type (hereinafter referred to as a gyroscope type 1311) and a resultant angular momentum vector differential type 1312 (
FIG. 24 ). - First, the
gyroscope type 1311 using a gyroscope to control the posture of a rotator will be described. A gimbal structure is used, and with respect to the posture of the rotator turning at a constant angular velocity ω0, turning angles θ1 and θ2 around two gimbal shafts are changed so that torque can be generated. An angular momentum L0 at the time when the rotation body with an inertia moment I is rotated at an angular velocity ω0 is expressed by
L 0 =Iω 0. - At this time, in view of the direction in which the torque is generated, a torque vectors at the time when an angular momentum vector L (|L|=L0) having a constant magnitude is turned at an angular velocity ω is expressed by
τ=ω×L, where ω=dθ/dt. - Next, the resultant angular momentum vector differential type 1312 to control the time change of the resultant angular momentum vector will be described. Rotation speeds ωx, ωy and ωz of three rotators fixed to an x-axis, a y-axis and a z-axis are independently controlled, and the angular momentums of the rotators are combined, so that an angular momentum vector can be formed in an arbitrary direction. When this is suitably controlled, a torque can be formed in an arbitrary direction. A torque vector at the time when the angular momentum vector L is changed is expressed as follows.
- When an inertia moment around each axis is made Ii, the angular momentum Li of rotation at an angular velocity ωi around each of the x-axis, y-axis and z-axis is expressed by
L i =I iωi, i=x, y, z. - When unit vectors in the x-axis, y-axis and z-axis directions are made i, j and k, the resultant angular momentum vector composed of the angular momentums around the respective axes is expressed by
L=L x i+L y j+L z k.
The time differential of the resultant angular momentum vector is the torque vector τ.
τ=dL/dt - Accordingly, by changing the ratio ωx: ωy: ωz of the angular speeds in the x-axis, y-axis and z-axis directions, the direction of the angular momentum vector generated can be controlled in an arbitrary direction. This method has merits that the control is easy, and various three-dimensional force sensations can be presented. Incidentally, the torque felt by a person has the same magnitude as this torque vector τ and the opposite direction by the action-reaction law (Newton's third law).
- When reference is made to
FIG. 25 , - Where, in the case where |L|=L0 is constant, and the direction of the resultant angular momentum vector L is turned at ω=dΩ/dt, the torque vector is expressed by
and is coincident with that of the gyroscope type. This indicates that although the torque which can be presented in the gyroscope type can be presented by the proposed method, the converse is not. - Now, in the case where consideration is given to the use in the so-called human navigation, the motion of the posture of a user generates a change of angular momentum vector, and there is a possibility that an unintentional torque is presented. Then, consideration is given to a torque generated by the resultant angular momentum vector L turning on a turning coordinate system OΩ turning at an angular velocity vector Ω with respect to the inertia coordinate system O.
- The equation of motion in the inertia coordinate system O 1330 and the turning coordinate
system O Ω 1331 is expressed by
As shown inFIG. 25 , a torque felt by a person through the temporal change of a resultant angular momentum vector 1332 on the palm of the turning person is the sum of a torque [dL/dt]OΩ by the temporal change of the resultant angular momentum vector 1332 in the turning coordinate system OΩ 1331 and the precession torque Ω×L. The term “precession” means that when a torque is applied to a gyro from outside, the spin axis of the gyro is turned in a direction orthogonal to the applied torque. The cause of the generation of the precession torque here is the turning of the coordinate axis. That is, even in the case where there is no temporal change of the angular momentum L on the palm of the user when viewed from the user, when the user turns at the angular velocity Ω as shown inFIG. 25 , the precession torque Ω×L is felt. - Here, in the case where the navigation is performed, there occurs a case where the change of the posture of the user is suppressed. This is because when the body of the user is turned in the horizontal direction, the precession torque well known in a gyrocompass is exerted on the angular momentum Lxi, orthogonal to the angular velocity Ω and Lyj, and functions to suppress the turn Ω of the body of the user. Although this precession torque prevents the free movement of the user, it has an effect to suppress the fluctuation of the torque presentation device due to the walking of the user. Besides, when the arm of the user is moved in the vertical direction, a similar precession torque is exerted on the angular momentum Lxi and Lzk. That is, when the user moves the body, the torque is exerted, and the same direction is always indicated like the gyrocompass.
- The control feature of this embodiment is to control the temporal change of the resultant angular momentum vector L 1332, and the easiness of the control is a great merit. By abruptly changing L in the vicinity of zero, a large torque [dL/dt]OΩ is generated, and the precession torque (Ω×L) can be suppressed to be low. By this, the navigation is enabled without hindering the movement of the user.
- On the other hand, in the case where the torque presentation device is swayed by the movement of the user and a difficulty occurs, by temporally changing L in the vicinity of the resultant angular momentum vector L 1332 having a suitable magnitude, the torque can be presented while the sway of the torque presentation device is suppressed.
- On the other hand, in the case where the
gyroscope type 1311 is used,
is established. In order to present a large torque, a large angular momentum vector L is required, and as a result, a large precession torque is generated without fail. - Especially, for the use in the so-called human navigation, miniaturization is required to such a degree as to enable internal or external mounting to a cellular phone or a PDA. Here, consideration will be given to a torque presentation method and operation principle in the case where internal mounting to a cellular phone is performed.
- According to the number of dimensions in which a torque is actually generated, a classification into four can be made as shown in
FIG. 26 . - In a conventional cellular phone, a vibration has been used to inform an incoming call. In the navigation by a recent cellular phone, when a street corner approaches, attention is first aroused by vibration, and then, the direction in which a turn is to be made is indicated by voice. That is, since attention is aroused by the vibration, and direction information is not presented, this is defined as a Zero dimension (vibration 1341).
- Besides, in the direction presentation on a plane space as in the navigation or the like, two dimensions are sufficient as shown in
FIG. 26-3 , and a haptic navigation system can be constructed by internal mounting to a cellular phone or the like.FIG. 26-4 shows a model which adopts an opposed type twin motor system newly invented in view of the balance of the center of gravity and the like. - Next, merits of three-dimensional torque presentation will be described.
- As described above, since the Ω×L component hinders the motion of the user, it has been proposed that the operation is performed at the control point where L is in the vicinity of zero. However, with respect to the Lz component, although the precession torque is not exerted in the turn on the horizontal surface, such as the turning of the user, the posture of the torque presentation device becomes stable in the vertical motion of the arm by the conservation of the rotation axis like a vertical gyro in an airplane (see
FIG. 27 ). - That is, the arm is lowered, the turning vector Ω is generated around an elbow as a fulcrum, a torque τx is generated in the torque presentation device and in the x direction on the palm so as to turn the Lz vector, and a torque is generated in the direction of canceling the turning vector Ω. It is conceivable that the torque around the elbow as the fulcrum, which suppresses the vertical movement of the torque presentation device, stabilizes the position of the torque presentation device.
- When this is Lx, like a gyroscope (an ‘CHUKYU GOMA’) which does not fall but turns while keeping the horizontal, it is conceivable that while the arm is turning on the horizontal plane, the torque to cancel the gravity is generated to float the torque presentation device, and reduces the user's fatigue caused by continuing to hold it.
- (Operation Principle 3)
- Hereinafter, a description will be given to a haptic presentation device in which the
haptic presentation device 1301 shown inFIG. 13 is further improved. -
FIG. 28 is a view showing a two-dimensional sectional view of ahaptic presentation device 2801 in which similarly to thehaptic presentation device 1301 ofFIG. 13 , two facing eccentric rotators are made one pair and three such pairs are arranged in an orthogonal coordinate system. In thehaptic presentation device 2801, an eccentric rotator (inertia; inertial body) 2804, amotor 2803 and the like are arranged in aspherical housing 2807, andFIG. 28 is a sectional view taken along the center of thespherical housing 2807. Theeccentric rotator 2804 and themotor 2803 are united, and arotating shaft 2802 of the motor is fixed to a joint 2810 of thehousing 2807. That is, therotating shaft 2802 is fixed, and similarly to the rotation of a normal motor, a magnet of a rotator of the motor integral with therotating shaft 2802 and an electromagnet of the main body of themotor 2803 repel each other and themotor 2803 is rotated. By this, in thehaptic presentation device 2801, a rotation body in which the eccentric rotator and the motor are united is rotated. Incidentally, it would be apprehensible for one of ordinary skill in the art that a terminal for power supply to the main body of themotor 2803 is fabricated so that the polarity of the contact is kept even if the main body of themotor 2803 is rotated (not shown). Thus, as compared with thehaptic presentation device 1301 ofFIG. 13 in which the motor is fixed to the housing and only the eccentric rotator is rotated, in thehaptic presentation device 2801, the mass of the rotation portion can be made large (that is, the inertia moment can be made large), and the efficiency of the mechanical operation (presentation of vibration, torque and force) by the rotation of the rotation body is improved. Further, as the weight of thehousing 2807 is reduced, the efficiency is improved. - Incidentally, the
haptic presentation device 2801 shown inFIG. 28 is not limited to the case where the eccentric rotator is applied, but is naturally applicable to a rotator which is not eccentric. Further, although the spherical housing is exemplified for thehaptic presentation device 2801, the principle of thehaptic presentation device 2801 can be naturally applied to a housing other than the spherical shape. -
FIG. 29 is a view showing a two-dimensional sectional view of ahaptic presentation device 2901 in which thehaptic presentation device 2801 ofFIG. 28 is further improved. Thehaptic presentation device 2901 includes aturbine fin 2908 arranged in aspherical housing 2807 and a fluid (gas flow or liquid flow) 2909, andFIG. 28 is a sectional view taken along the center of thespherical housing 2807. Theturbine fin 2908 is provided in a rotation body in which aneccentric rotator 2804 and amotor 2803 are united. By this, in thehaptic presentation device 2901, when the rotation body in which the eccentric rotator and the motor are united is rotated, the turbine fin stirs thefluid 2909. Thus, as compared with the rotation of the rotation body of thehaptic presentation device 2801 ofFIG. 28 , in thehaptic presentation device 2901, the load resistance is applied to the rotation of the turbine fin by the circulation of the fluid, and as a result, since the effective inertia moment of the rotation body is increased, the efficiency of the mechanical operation (presentation of vibration, torque and force) by the rotation of the rotation body is improved. Further, as the relative weight of thehousing 2807 is reduced, the efficiency is improved. Besides, the load resistance can be applied to the rotation of the turbine fin by providing anarrowing hole 2910 to narrow the section of a liquid flow passage in a route for circulation of the fluid. -
FIG. 30 is a view showing a two-dimensional sectional view of ahaptic presentation device 3001 in which thehaptic presentation device 2901 ofFIG. 29 is further improved. Thehaptic presentation device 3001 includes anair 3009 in aspherical housing 3007, holes 3010 are provided in thehousing 3007 to be opposite to turbine fins, andFIG. 30 is a sectional view taken along the center of thespherical housing 3007. As a result that theholes 3010 are provided in thehousing 3007, in thehaptic presentation device 3001, according to the control of a motor, for example, air flows 3002 a and 3002 b flowing through thehaptic presentation device 3001 from the left to the right ofFIG. 30 are generated. In this case, as compared with thehaptic presentation device 2901 ofFIG. 29 in which a force sensation continues to be presented in the left direction in the drawing, in thehaptic presentation device 3001, the force of jet of theair flow 3002 b is also added, and the efficiency of continuing to present the force sensation in the left direction in the drawing is improved. Incidentally, it would be obvious for one skilled in the art that the closing and opening of these holes is controlled (not inevitable) by avalve 3010 and a control circuit, so that the flow rate and flow speed can be controlled. - The turbine fin is a variable fin which can control a relation between a rotation direction and a blast direction, and even if the torque direction resulting from the rotation is the same direction, the flowing direction of an air current can be controlled by changing the angle of the fin. Besides, it may be fixed according to a use.
- Incidentally, rotators of two motors, motor bodies, eccentric rotation bodies, two turbine fins in which the generating directions of air currents are opposite to each other are mounted to one rotating
shaft 2802, and the flow direction of the air current may be controlled by selecting the turbine fin to be rotated (not shown). -
FIG. 31 is a view showing another applied example of the groove-shaped eccentric rotator array 890 ofFIG. 15 and is a view showing a groove-shaped eccentric rotator array 3110 in which a sheet-shapedeccentric rotator array 3111 is formed into a groove shape. InFIG. 31 , rotators are arranged like a grid, and onlyeccentric rotators 3170 a to 3173 a, and 3170 b to 3177 b rotate. By this, by suitably controlling the rotations of theeccentric rotators 3170 a to 3173 a, and 3170 b to 3177 b of the groove-shaped eccentric rotator array 3110, haptic information of a virtual twist as a spatial expansion can be presented onto the palm. In more detail, a large torque is presented in the same direction by theeccentric rotators 3170 a to 3173 a, so that a large resultant torque 315 a to twist the center part of the palm counterclockwise is presented. Besides, a small torque is presented in the same direction by theeccentric rotators 3170 b to 3177 b, so that aresultant torque 315 b to twist the palm peripheral part clockwise is presented. By this, a virtual twist haptic sensation is felt in which the palm center part is intensely twisted counterclockwise, and the palm peripheral part is weakly twisted clockwise. -
FIG. 32 is a view showing a two-dimensional sectional view of ahaptic presentation device 3201 in which thehaptic presentation device 2801 ofFIG. 28 is further improved. In thehaptic presentation device 3201, a control circuit 3205 and an angular acceleration sensor (and gravity/acceleration sensor) 3206 are arranged at the center part of aspherical housing 2807, andFIG. 32 is a sectional view taken along the center of thespherical housing 2807. The control circuit 3205 corresponds to thecontrol device 4120 ofFIG. 41 , and the angular acceleration sensor (and the gravity/acceleration sensor) 3206 corresponds to theinput device 4130 ofFIG. 41 . Although it is assumed that thehaptic presentation device 3201 ofFIG. 32 is a ball in a mode of a baseball ball, it may be a ball with any shape. Theangular acceleration sensor 3206 monitors aback spin 3215 generated at the release when the ball (haptic presentation device 3201) is pitched in a direction denoted by reference numeral 3210 in the drawing. Besides, in the case of a uniform rotation motion, the gravity direction is detected by the gravity/acceleration sensor, and since the gravity direction is periodically changed in the xyz axis components of the sensor, the rotation of the ball can be monitored. Incidentally, even if the method as stated above is not used, when the rotation of the ball can be detected, another method can be applied. The control circuit 3205 analyzes the input information from the angular acceleration sensor (and the gravity/acceleration sensor) 3206, and controls a motor in thehaptic presentation device 3201 so as to cancel theback spin 3215 of the ball (haptic presentation device 3201). Thus, the ball (haptic presentation device 3201) is not rotated, and becomes a breaking ball (so-called knuckle ball) irregularly swaying and changing by the influence of the flow and swirl generated behind it. Similarly, by freely controlling the rotation and the like, it is possible to realize various breaking balls including a curve, a shoot, and a breaking ball which is impossible in a real baseball, such as a breaking ball which is curved and then shoots and drops. Incidentally, the embodiment ofFIG. 32 can be applied to thehaptic presentation device 2901 ofFIG. 29 . - Reference is again made to the
haptic presentation device 3001 ofFIG. 30 . In a conventional haptic presentation device in the VR, its own weight reduces the original VR effect to be felt by the user. Then, in thehaptic presentation device 3001 ofFIG. 30 , the air current flowing through thehaptic presentation device 3001 from the top to the bottom ofFIG. 30 is generated by the control of the motor, so that the force of the jet of the air current toward the bottom reduces the weight of thehaptic presentation device 3001 itself to be felt by the user, and the original effect to cause the user to feel the VR can be improved. Similarly, by generating the air current flowing through thehaptic presentation device 3001 from the bottom to the top ofFIG. 30 , the user can be made to feel that the weight of thehaptic presentation device 3001 itself is heavier than actual by the force of the jet of the air current toward the top. -
FIG. 33 is an explanatory view of a pen-shapeddevice 3301 having the built-in haptic presentation device described in the embodiment. The pen-shapeddevice 3301 is provided with atouch panel 3350 on a surface, thetouch panel 3350 indicates respective button columns denoted byreference numerals device 3301 of this embodiment is applied to, for example, a pen-shaped cellular phone. Incidentally, the function of thetouch panel 3350 may be realized by a physical button instead of the touch panel. Besides, each of the button columns may include a desired number of buttons instead of the four buttons. Besides, a desired number of button columns may be provided (as an example of these,FIG. 42 is provided as a supplemental explanation view ofFIG. 33 ). Here, although the rotation of 180° is performed fromFIG. 33 (a) toFIG. 33 (b) and the use is made, virtual operation panels which is the number of columns exist at intervals of a rotation angle of (360°/the number of columns). - As shown in
FIG. 33 (a), in the case where the user grasps the pen-shapeddevice 3301 and the pen-shapeddevice 3301 is seen from a direction denoted byreference numeral 3302, thebutton columns - On the other hand, as shown in
FIG. 33 (b), in the case where the user rotates the pen-shapeddevice 3301 from the state ofFIG. 33 (a) by 180° and grasps it, and the pen-shapeddevice 3301 is seen from a direction denoted byreference numeral 3302, the buttons “1, 4, 7, *” of thebutton column 3310 respectively become kana input functions of “A, TA, MA, “.”, the buttons “3, 6, 9, #” of thebutton column 3320 respectively become kana input functions of “SA, HA, RA, (enter)”, and the buttons “diamond mark”, “heart mark”, “spade mark”, “clover mark” of thebutton column 3340 become kana input functions of “KA, NA, HA, WA”. That is, in the case of this example, the realization is performed with four rows and four columns, and as the front side of the device, the first column, the second column and the third column are used, and as the back side of the device, the third column, the fourth column, and the first column are made usable. -
FIG. 34 is a view showing a rough structure of the pen-shapeddevice 3301. The pen-shapeddevice 3301 includes ahaptic presentation device 3410, acontrol circuit 3420, aposture sensor 3430 based on a well-known acceleration sensor, a pen-shapeddevice control circuit 3440, and atouch panel 3350. Thecontrol circuit 3420 corresponds to thecontrol device 4120 ofFIG. 41 , and theposture sensor 3430 corresponds to theinput device 4130 ofFIG. 41 . The pen-shapeddevice control circuit 3440 judges, based on the input from theposture sensor 3430, in which state ofFIG. 33 (a) andFIG. 33 (b) the user sees the pen-shapeddevice 3301. As inFIG. 33 (a) orFIG. 33 (b), the input functions of the respective button columns denoted byreference numerals device control circuit 3440 processes the input from thetouch panel 3350, and in the case where for example, the button “0” is depressed by the user, the input ofnumeral 0 is processed. Since a circuit and its control to process the input from theposture sensor 3430 and the input from thetouch panel 3550, such as the pen-shapeddevice control circuit 3440, are well-known for one skilled in the art, the detailed description would be unnecessary. - Here, for example, in the case where the button “0” is depressed by the user, the
posture sensor 3430 detects the posture change toward adirection 3302 inFIG. 34 , or the pressure sensor of the touch panel detects the motion of the depressing finger, and thecontrol circuit 3420 analyzes the input information from theposture sensor 3430, controls the motor in thehaptic presentation device 3410, and gives haptic feedback so as to present the movement in thedirections haptic presentation device 3410 presents the force in thedirections - Besides, for example, in the case where the button “0” is rubbed by the user from the top to the bottom, the
posture sensor 3430 detects a posture change toward adirection 3470 inFIG. 34 , or the sensor of the touch panel detects the movement of the finger, and thecontrol circuit 3420 analyzes input information from theposture sensor 3430 and the touch panel sensor, controls the motor in thehaptic presentation device 3410, and gives haptic feedback the movement in thedirections haptic presentation device 3410 presents the force in thedirections -
FIG. 35 is an explanatory view of apointer 3501 having a built-in haptic presentation device described in the embodiment, and is a view showing a rough structure of thepointer 3501. Thepointer 3501 includes ahaptic presentation device 3510, acontrol circuit 3520, a posture sensor (or a position sensor or an acceleration sensor) 3530, apointer control circuit 3540, aswitch 3550, and alaser light source 3590. Thecontrol circuit 3520 corresponds to thecontrol device 4120 inFIG. 41 , and theposture sensor 3530 and theswitch 3550 correspond to theinput device 4130 inFIG. 41 . Thepointer control circuit 3540 makes a control so that when theswitch 3550 is turned ON, alaser beam 3580 is emitted from thelaser light source 3590. Since a circuit to control thelaser light source 3590 to emit thelaser beam 3580, such as thepointer control circuit 3540, and its control are well known for one skilled in the art, the detailed description would be unnecessary. - Here, in the case where the user depresses the
switch 3550, and thepointer 3501 is swayed in adirection 3570, theposture sensor 3530 detects the posture change toward thedirection 3570, and thecontrol circuit 3520 analyzes input information from theposture sensor 3530, and controls a motor in thehaptic presentation device 3510 so as to suppress the movement of thehaptic presentation device 3510 toward thedirection 3570. Thus, thehaptic presentation device 3510 presents a force in adirection 3590, and causes the user to feel a resisting force against thesway direction 3570. By this, for example, in the case where thelaser beam 3580 is irradiated to anobject 3560 having a laser beam tracking function, and theobject 3560 is moved from the left to the right inFIG. 35 while being pointed, the user is made to feel the resisting force (force in the direction 3590) against thedirection 3570 in which theobject 3560 is moved, and as a result, such a feeling that the user grasps theobject 3560 and moves it is given. Here, although the selection of theobject 3560 and the grasping intention are informed to thepointer control circuit 3540 by using thelaser light source 3590 and the laser beam tracking function, no limitation is made to this as long as the selection and the grasping intension can be inputted. -
FIG. 36 is an explanatory view of a baton-type controller 3601 having a built-in haptic presentation device described in the embodiment, and is a view showing a rough structure of the baton-type controller 3601. The baton-type controller 3601 is a controller used in a well-known (conducting) music game of a home video game machine. The baton-type controller 3601 includes a haptic presentation device 3616, acontrol circuit 3620, aposture sensor 3630, and acontroller control circuit 3640. Thecontrol circuit 3620 corresponds to thecontrol device 4120 inFIG. 41 , and theposture sensor 3630 and thecontroller control circuit 3640 correspond to theinput device 4130 inFIG. 41 . Thecontroller control circuit 3640 transmits/receives asignal 3609 to/from a game machine 3606, processes input information from theposture sensor 3630 to transmit it to the game machine 3606, and receives an instruction from the game machine 3606. Since a circuit to perform a control to communicate with the game machine 3606, such as thecontroller control circuit 3640, and its control are well-known for one skilled in the art, the detailed description would be unnecessary. Incidentally, inFIG. 36 , although a signal of a wired system is exemplified as thesignal 3609, no limitation is made to this, and thesignal 3609 may be a signal in a wireless system. - Here, when the user plays the music game of a
monitor 3605, in the case where the baton-type controller 3601 is swayed in adirection 3607, the posture sensor (or pressure sensor) 3630 detects the grasping way and the posture change toward thedirection 3607, and thecontroller control circuit 3640 processes the input information from theposture sensor 3630, and transmits it to the game machine 3606. The game machine 3606 processes the music game based on the information of the posture change from theposture sensor 3630, and the performance of an orchestra in the music game, such as a tempo, rhythm, and breath, is changed by the swinging way of the baton of the conductor. In the case where it is judged that the music at that time exceeds the performance speed at which a person can play and the dynamic range of, a playing method, a suppression signal is transmitted to thecontroller control circuit 3640. When receiving the suppression signal, thecontroller control circuit 3640 transmits the information to thecontrol circuit 3620. Thecontrol circuit 3620 analyzes the input information from thecontroller control circuit 3640, and controls a motor in the haptic presentation device 3610 so as to suppress the motion of the haptic presentation device 3610 toward thedirection 3607. Thus, the haptic presentation device 3610 presents a force toward adirection 3660, and causes the user to feel a resisting force against theswing direction 3607. By this, in the music game, the music does not exceed the performance speed at which a person can play and the dynamic range of the playing method, and the music game becomes more real. - Hereinafter, modified examples of the
operation principles 1 to 3 will be described. -
FIG. 37 is a view showing a rough structure of a modified example of the haptic information presentation method ofFIG. 11-4 described in the embodiment. InFIG. 11-4 , the two eccentric rotators are synchronously rotated in the opposite directions, and the force to linearly generate the simple harmonic oscillations in an arbitrary direction is synthesized.FIG. 37 is a view showing apiezoelectric matrix 3730 as an oscillator in which instead of the eccentric rotators,piezoelectric elements 3701 are used. Apiezoelectric array 3710 is constructed in which the pluralpiezoelectric elements 3701 are laminated in an x-direction in the drawing, apiezoelectric array 3720 is constructed in which the pluralpiezoelectric elements 3701 are laminated in a y-direction in the drawing, and thepiezoelectric arrays - A haptic information presentation method using the
piezoelectric matrix 3730 ofFIG. 37 is a method in which thepiezoelectric matrix 3730 is used instead of therotator 4180 inFIG. 41 . In the structure as stated above, thecontrol device 4120 ofFIG. 41 controls the voltage in the x direction inFIG. 37 to control simpleharmonic oscillation 3750 in the x direction, and controls the voltage in the y direction inFIG. 37 to control simpleharmonic oscillation 3740 in the y direction. Although a sufficient amplitude is not obtained by the singlepiezoelectric element 3701, in the structure ofFIG. 37 , thepiezoelectric arrays FIG. 37 , in thehaptic presentation device 4110 ofFIG. 41 , a stepping motor and a servo motor required for driving therotator 4180 become unnecessary, and also in thecontrol device 4120, a control circuit for the motors becomes unnecessary, and the structure of the combination of the haptic presentation device and the control device becomes simple. - Further, it would be understood for one skilled in the art that when the
piezoelectric matrix 3730 ofFIG. 37 is expanded, and a piezoelectric cube is formed in which thepiezoelectric arrays FIG. 37 can be applied to, for example, a mechanism for generating a force in a desired direction by a controller of a game machine. Here, the arrangement pattern of thepiezoelectric elements 3701 is arbitrary as long as the simple harmonic oscillations in the x, y and z directions can be generated. -
FIG. 38 is also a view showing a rough structure of another modified example of the haptic information presentation method ofFIG. 11-4 described in the embodiment.FIG. 38 (a) shows acubic oscillator 3801 using a speaker structure instead of an eccentric rotator, and theoscillator 3801 includesmagnets magnets -
FIG. 38 (b) is a view showing a sectional view in a case where inFIG. 38 (a), theoscillator 3801 is cut along ahorizontal section 3820 passing through the barycenter and is seen. Theoscillator 3801 includes, at the respective planes,cones magnets - The haptic information presentation method using the
oscillator 3801 ofFIG. 38 is a method using theoscillator 3801 instead of therotator 4180 inFIG. 41 . In the structure as stated above, thecontrol device 4120 ofFIG. 41 controls, for example, the voltage of the magnet in the x direction inFIG. 38 (b) to control simpleharmonic oscillation 3870 in the x direction, and controls the voltage of the magnet in the y direction inFIG. 38 (b) to control simpleharmonic oscillation 3860 in the y direction. In the structure ofFIG. 38 , a large amplitude caused by the magnets of the speaker and by the vibrations of the cones can be produced. According to the method ofFIG. 38 , in thehaptic presentation device 4110 ofFIG. 41 , a stepping motor and a servo motor required for driving therotator 4180 become unnecessary, and also in thecontrol device 4120, a control circuit for the motors becomes unnecessary, and the structure of the combination of the haptic presentation device and the control device becomes simple. Here, the structure of thecones respective magnets -
FIG. 39 is a view showing a rough structure of a modified example of thehaptic presentation device 1301 ofFIG. 13 described in the embodiment. In thehaptic presentation device 1301 ofFIG. 13 , as in the description inFIG. 11-1 toFIG. 12-2 which is the premise thereof, the rotation axes of the two eccentric rotators opposite to each other have only to be parallel to each other, inclusive of the case where they are on the same axis. Thus, in thehaptic presentation device 1301 ofFIG. 13 , since the two facing eccentric rotators are separated in the rotation axis direction and respectively rotate on different planes, a surplus moment caused by mutual forces generated in the rotation plane directions of the two eccentric rotators is generated in thehaptic presentation device 1301, and there is a fear that a rattle or the like of the rotation axis is caused.FIG. 39 is a view showing a structure in which a surplus moment caused by the rotation of two eccentric rotators on different planes is suppressed. - The arrangement of two facing
eccentric rotators FIG. 39 is such that the rotation axes thereof are on the same axis, and a part of theeccentric rotator 3901 b covers theeccentric rotator 3901 a. By the structure as stated above, since many material particles of the twoeccentric rotators eccentric rotators FIG. 13 , and the respective eccentric rotator pairs 3901 a and 3901 b and the like have only to be in an orthogonal relation. Besides, when the rotations can be three-dimensionally combined in an arbitrary direction, they may not be orthogonal to each other. Incidentally, this embodiment is not limited to the three dimensions, and according to a use, it can be applied to one dimension or two dimensions. -
FIG. 40 is an explanatory view of adesk device 4001 having a built-in haptic presentation device described in the embodiment, and is a view showing a rough structure of thedesk device 4001. Thedesk device 4001 includes ahaptic presentation device 4010, acontrol circuit 4020, and a posture sensor 4030 (may be an acceleration, angular acceleration, or position sensor). Thecontrol circuit 4020 corresponds to thecontrol device 4120 inFIG. 41 , ad the posture sensor 4030 corresponds to theinput device 4130 inFIG. 41 . - Here, for example, in the case where the
desk device 4001 is moved on the desk by the user toward adirection 4040, the posture sensor 4030 detects the position change toward thedirection 4040 inFIG. 40 , and thecontrol circuit 4020 analyzes input information from the posture sensor 4030, and controls motors in thehaptic presentation device 4010 so as to suppress the motion of thehaptic presentation device 4010 toward thedirection 4040 or so as to sway it in the horizontal direction. Thus, thehaptic presentation device 4010 presents a force in adirection 4050, and causes the user to feel the friction force on the desk against the movement toward thedirection 4040. - Besides, for example, in the case where the
desk device 4001 is moved on the desk by the user toward thedirection 4040, the posture sensor 4030 detects the position change toward thedirection 4040 inFIG. 40 , and thecontrol circuit 4020 analyzes input information from the posture sensor 4030, and controls motors in thehaptic presentation device 4010 so as to generate a force in a normal direction to thedirection 4040 of thehaptic presentation device 4010. Thus, thehaptic presentation device 4010 presents a force to generate simple harmonic oscillations or the like in thedirection 4060, and causes the user to feel the roughness on the desk against the movement toward thedirection 4040. - By carrying out the invention, it is possible to realize the useful man-machine interface which can be mounted on an equipment used in the field of VR (Virtual Reality), an equipment used in the field of game, a cellular phone, a portable navigation equipment, a PDA (Personal digital Assistant) and the like.
- More specifically, for example, in the field of the VR, the existence of an object in a virtual space, or the shock due to a collision can be presented by presenting a force to the person through the man-machine interface to which the invention is applied, or by giving a resisting force or a reaction force to limit the motion of the person. Besides, by mounting the interface on the cellular phone, the portable navigation equipment or the like, various instruction, guides and the like, which have not been conventionally seen, can be realized through the skin of the operator.
-
FIG. 1 is a view showing a rough structure of a haptic information presentation system of an embodiment of the invention. -
FIG. 2 is a view showing a haptic information presentation method using a sensory characteristic relating to a haptic sense. -
FIG. 3 is a view showing a haptic information presentation method using a sensory characteristic relating to a haptic sense. -
FIG. 4 is a view showing a haptic information presentation method using a hysteresis sensory characteristic relating to a haptic sense. -
FIG. 5 is a view showing a haptic information presentation method using a method of changing a sensory characteristic by a masking effect relating to a haptic sense. -
FIG. 6 is a view showing a haptic information presentation method using a method of changing a sensory characteristic by a masking effect relating to a haptic sense. -
FIG. 7 is a schematic view showing a method of changing a sensory characteristic by a masking effect relating to a haptic sense. -
FIG. 8 is a view showing a haptic information presentation method using a method of controlling haptic information presentation in conformity with a change of a sensory characteristic relating to a haptic sense. -
FIG. 9 is a view showing a haptic information presentation method using a method of controlling haptic information presentation in conformity with an anisotropic sensitivity curve change as a sensory characteristic relating to a haptic sense. -
FIG. 10 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotation of an eccentric rotator 711 is phase synchronized. -
FIG. 11 is a view showing a haptic information presentation method of a vibration sensation, a torque sensation, and a force sensation by suitably synchronizing rotation directions and phases of both an eccentric rotator A 812 and an eccentric rotator B 813. -
FIG. 12 is a view showing a haptic information presentation method of a vibration sensation and a force sensation by suitably synchronizing rotation directions and phases of both the eccentric rotator A 812 and the eccentric rotator B 813. -
FIG. 13 is an explanatory view in which both the eccentric rotator A 812 and the eccentric rotator B 813 are made one pair, and three such pairs are arranged in an orthogonal coordinate system. -
FIG. 14 is an explanatory view of a sheet-shaped eccentric rotator array to which the invention is applied. -
FIG. 15 is an explanatory view of a glove-shaped eccentric rotator array to which the invention is applied. -
FIG. 16 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotations of both an eccentric rotator A 912 and an eccentric rotator B 913 are phase synchronized. -
FIG. 17 is a view showing a haptic information presentation method in which a sensory characteristic relating to a haptic sense is used, and rotations of both an eccentric rotator A 1012 and an eccentric rotator B 1013 are phase synchronized in opposite directions. -
FIG. 18 is a schematic view of a method in which the presentation method of a force sensation using both the eccentric rotators shown inFIG. 17 is used to present a pushing feeling by oneself, an expansion feeling, a pressure feeling, a pulling feeling by oneself, a pulled feeling from outside, and a pushed feeling from outside. -
FIG. 19 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied. -
FIG. 20 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied. -
FIG. 21 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied. -
FIG. 22 is an explanatory view of a skin-shaped eccentric rotator array to which the invention is applied. -
FIG. 23 is a view showing a haptic information presentation method in an arbitrary direction by using a method of changing a sensory characteristic by a masking effect relating to a haptic sense. -
FIG. 24 is an explanatory view of a gyroscope type and a resultant angular momentum vector differential type. -
FIG. 25 is an explanatory view of a resultant angular momentum in an inertia coordinate system. -
FIG. 26 is an explanatory view showing a torque presentation method and an operation principle in the case where a cellular phone has a built-in haptic information presentation system to which the invention is applied. -
FIG. 27 is an explanatory view showing that in the explanation of merits of three-dimensional torque presentation, when an arm is moved vertically, the posture of a torque presentation device is stabilized by the conservation of a turning axis like a vertical gyro in an airplane. -
FIG. 28 is a view showing a two-dimensional sectional view of ahaptic presentation device 2801 in which two facing eccentric rotators are made one pair and three such pairs are arranged in an orthogonal coordinate system. -
FIG. 29 is a view showing a two-dimensional sectional view of ahaptic presentation device 2901 in which thehaptic presentation device 2801 is further improved. -
FIG. 30 is a view showing a two-dimensional sectional view of ahaptic presentation device 3001 in which thehaptic presentation device 2901 is further improved. -
FIG. 31 is a view showing another applied example of the glove-shaped eccentric rotator array 890 ofFIG. 15 . -
FIG. 32 is a view showing a two-dimensional sectional view of ahaptic presentation device 3201 in which thehaptic presentation device 2801 is further improved. -
FIG. 33 is an explanatory view of a pen-shapeddevice 3301 having a built-in haptic presentation device of the embodiment. -
FIG. 34 is a view showing a rough structure of a pen-shapeddevice 3301. -
FIG. 35 is an explanatory view of alaser pointer 3501 having a built-in haptic presentation device of the embodiment and is a view showing a rough structure of thelaser pointer 3501. -
FIG. 36 is an explanatory view of a baton-type controller 3601 having a built-in haptic presentation device of the embodiment and is a view showing a rough structure of the baton-type controller 3601. -
FIG. 37 is a view showing a rough structure of a modified example of the haptic information presentation method ofFIG. 11-4 . -
FIG. 38 is a view showing a rough structure of another modified example of the haptic information presentation method ofFIG. 11-4 . -
FIG. 39 is a view showing a rough structure of a modified example of ahaptic presentation device 1301 ofFIG. 13 . -
FIG. 40 is an explanatory view of adesk device 4001 having a built-in haptic presentation device of the embodiment and is a view showing a rough structure of thedesk device 4001. -
FIG. 41 is a block diagram of a haptic information presentation system of the embodiment. -
FIG. 42 is a supplemental explanatory view of the pen-shapeddevice 3301 having the built-in haptic presentation device of the embodiment. -
- 112 haptic presentation device
- 111 control device
- 110 user
- 211 sensory characteristic
- 212 physical quantity
- 213 sensory quantity
- 214 operation point A
- 215 operation point B
- 222 rotation velocity
- 223 torque
- 224 torque sensation
- 228 initial state
- 225 operation point A duration time
- 226 operation point B duration time
- 231 sensory characteristic
- 234 operation point A
- 235 operation point B
- 244 torque sensation
- 243 torque
- 248 initial state
- 246 operation point B duration time
- 312 variation
- 311 hysteresis sensory characteristic
- 314 operation passage A
- 315 operation passage B
- 334 torque sensation
- 333 torque
- 332 rotation velocity
- 338 initial state
- 464 torque sensation
- 424 masking
- 425 forward masking
- 426 backward masking
- 413 torque
- 434 torque sensation
- 412 rotation velocity
- 415 initialization time
- 445 masking duration time
- 485 forward masking
- 486 backward masking
- 484 torque sensation
- 513 haptic presentation device
- 514 presentation torque
- 515 muscle cause torque
- 516 presentation torque
- 517 torque sensation
- 812 eccentric rotator A
- 813 eccentric rotator B
- 912 eccentric rotator A
- 913 eccentric rotator B
- 931 sensory characteristic
- 932 physical quantity
- 933 sensory quantity
- 934 operation point A
- 935 operation point B
- 944 torque sensation
- 942 rotation velocity
- 943 torque
- 948 initial state
- 945 operation point A duration time
- 946 operation point B duration time
- 1012 eccentric rotator A
- 1013 eccentric rotator B
- 1031 sensory characteristic
- 1032 physical quantity
- 1033 sensory quantity
- 1034 operation point A
- 1035 operation point B
- 1044 force sensation
- 1043 force
- 1042 magnitude of resultant rotation velocity
- 1048 initial state
- 1045 operation point A duration time
- 1046 operation point B duration time
- 1111 twin eccentric rotator
- 1112 twin eccentric rotator
- 1113, 1114 force
- 1216 masking vibration
- 1124 torque sensation
- 1224 force sensation
- 1212 magnitude of resultant rotation velocity
- 1244 initialization time
- 1301 force sensation
- 1301 haptic presentation device
Claims (24)
1. A haptic information presentation system, comprising:
a haptic presentation unit having two eccentric rotators; and
a control unit that independently changes one or more of a frequency of a vibration, an intensity of a vibration and a vibration sensation by controlling one or more of rotation directions, a phase relation or rotation speeds of the two eccentric rotators.
2. A haptic information presentation system, comprising:
a haptic presentation unit having two eccentric rotators; and
a control unit that independently changes one or more of a frequency of a force, an intensity of a force or a force sensation by inverting rotation directions in the two eccentric rotators.
3. A haptic information presentation system, comprising:
a haptic presentation unit having an eccentric rotator array in which one or more of multiple single eccentric rotators, or twin eccentric rotators each having two eccentric rotators, or plural twin eccentric rotators arranged in a three-dimensional space are arranged two-dimensionally or three-dimensionally; and
a control unit to control a rotation state of each of the eccentric rotators included in the haptic presentation unit.
4. The haptic information presentation system according to claim 3 , wherein
the eccentric rotator array is adapted to form a skin-shaped eccentric rotator array, and
the control unit causes the presentation of one or more of a vibration changing spatially and temporally, a vibration sensation, a torque, a torque sensation, a force or a force sensation.
5. The haptic information presentation system according to claim 4 , wherein setting the control mode of the skin-shaped eccentric rotator array causes the presentation of one or more of a vibration, a force, a shear force, a torque, a resultant torque to twist a palm or a finger or another whole presentation object, a shape feeling of a three-dimensional object caused by presentation of a three-dimensional resisting force, an elastic feeling, a tactile sensation, a feeling in which a force is transmitted on a palm or a finger or another presentation object; a feeling in which a material rolls on a palm or a finger or another presentation object, a feeling in which a force, a vibration or a torque passes through a palm or a finger or another presentation object, and a texture of a surface of a virtual object.
6. A haptic information presentation system, comprising:
a haptic presentation unit having plural rotators arranged three-dimensionally; and
a control unit to control a temporal change of a resultant angular momentum vector of the haptic presentation unit,
wherein the control unit causes the generation of a torque with a fixed value by abruptly changing the resultant angular momentum vector in a vicinity of zero, and controls a precession torque to be a specified value or less.
7. The haptic information presentation system according to any one of claim 6 , wherein the haptic presentation unit has a shape mountable on a portable communication equipment or a mobile electronic equipment.
8. A haptic information presentation method, wherein when a haptic presentation unit having two eccentric rotators is controlled,
a frequency and an intensity of a vibration and/or a vibration sensation are independently changed by controlling rotation directions, a phase relation and rotation speeds in the two eccentric rotators.
9. A haptic information presentation method, wherein when a haptic presentation unit having two eccentric rotators is controlled,
a frequency and an intensity of a force and/or a force sensation are independently changed by inverting rotation directions in the two eccentric rotators.
10. A haptic information presentation method, wherein when a control is made on a haptic presentation unit having an eccentric rotator array in which plural single eccentric rotators, and/or plural twin eccentric rotators each having two eccentric rotators arranged on a same rotation axis, and/or plural twin eccentric rotators arranged in a three-dimensional space are arranged two-dimensionally or three-dimensionally,
a rotation state of each of the eccentric rotators included in the haptic presentation unit is individually controlled.
11. The haptic information presentation method according to claim 10 , wherein
the eccentric rotator array is worked to form a skin-shaped eccentric rotator array, and
a vibration changing spatially and temporally and/or a vibration sensation, a torque and/or a torque sensation, or a force and/or a force sensation is presented.
12. The haptic information presentation method according to claim 11 , wherein by setting a control mode of the skin-shaped eccentric rotator array, one of a vibration, a force, a shear force, a torque, a resultant torque to twist a palm or a finger or another whole presentation object, a shape feeling of a three-dimensional object caused by presentation of a three-dimensional resisting force, an elastic feeling, a tactile sensation, a feeling in which a force is transmitted on a palm or a finger or another presentation object, a feeling in which a material rolls on a palm or a finger or another presentation object, a feeling in which a force, a vibration or a torque passes through a palm or a finger or another presentation object, and a texture of a surface of a virtual object is presented.
13. A haptic information presentation method, wherein when a haptic presentation unit having plural rotators arranged three-dimensionally is controlled, a temporal change of a resultant angular momentum vector of the haptic presentation unit is controlled, and
a torque with a fixed value is generated by abruptly changing the resultant angular momentum vector in a vicinity of zero, and a precession torque is controlled to have a specified value or less.
14. The haptic information presentation system according to claim 2 , wherein
the haptic presentation unit includes a rotation unit to rotate the eccentric rotator,
the control unit controls a rotation state of the rotation unit included in the haptic presentation unit, and the rotation unit rotates together with the eccentric rotator to be rotated.
15. The haptic information presentation system according to claim 14 , wherein the haptic presentation unit includes a fin rotated together with the eccentric rotator, and a fluid surrounding the fin.
16. The haptic information presentation system according to claim 15 , wherein
the fluid is air, and
the haptic presentation_unit includes a hole opposite to the fin and communicating with outside.
17. The haptic information presentation system according to claim 14 , further comprising an input unit to input external information to the control unit,
wherein the control unit controls a rotation state of each of the eccentric rotators included in the haptic presentation unit in accordance with the external information inputted from the input unit.
18. The haptic information presentation system according to claim 17 , wherein
the haptic presentation unit includes the input unit and the control unit, and
the haptic presentation unit itself is the haptic information presentation system.
19. The haptic information presentation system according to claim 14 , wherein
piezoelectric elements are used instead of the eccentric rotators, and
the control unit controls a voltage of each of the piezoelectric elements included in the haptic presentation unit.
20. The haptic information presentation system according to claim 14 , wherein magnets are used instead of the eccentric rotators, and the control unit controls a voltage of each of the magnets included in the haptic presentation unit.
21. The haptic information presentation system according to claim 14 , wherein material particles of the two eccentric rotators rotate around a same rotation axis on a same plane.
22. A haptic presentation_device of a haptic information presentation system, comprising a function of a haptic presentation unit of a haptic information presentation system according to claim 14 .
23. A control device of a haptic information presentation system, comprising a function of a control unit of a haptic information presentation system according to claim 14 .
24. The haptic information presentation system according to claim 1 , wherein
the haptic presentation unit includes a rotation unit to rotate the eccentric rotator,
the control unit controls a rotation state of the rotation unit included in the haptic presentation unit, and the rotation unit rotates together with the eccentric rotator to be rotated.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/710,813 US9041520B2 (en) | 2003-11-20 | 2010-02-23 | Haptic information presentation system and method |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2003390802 | 2003-11-20 | ||
JP2003402892 | 2003-12-02 | ||
JP2003-402892 | 2003-12-02 | ||
JP2004-331263 | 2004-11-15 | ||
JP2004331263A JP4111278B2 (en) | 2003-11-20 | 2004-11-15 | Haptic information presentation system |
PCT/JP2004/017277 WO2005050427A1 (en) | 2003-11-20 | 2004-11-19 | Tactile force sense information display system and method |
JP2003-390802 | 2013-11-20 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2004/017277 A-371-Of-International WO2005050427A1 (en) | 2003-11-20 | 2004-11-19 | Tactile force sense information display system and method |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/710,813 Continuation US9041520B2 (en) | 2003-11-20 | 2010-02-23 | Haptic information presentation system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070091063A1 true US20070091063A1 (en) | 2007-04-26 |
Family
ID=34623575
Family Applications (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/579,672 Abandoned US20070091063A1 (en) | 2003-11-20 | 2004-11-19 | Tactile force sense information display system and method |
US12/710,813 Active 2030-03-13 US9041520B2 (en) | 2003-11-20 | 2010-02-23 | Haptic information presentation system and method |
US13/855,935 Active US9171437B2 (en) | 2003-11-20 | 2013-04-03 | Haptic information presentation system and method |
US13/855,881 Active US9142104B2 (en) | 2003-11-20 | 2013-04-03 | Haptic information presentation system and method |
US13/855,844 Active US9135791B2 (en) | 2003-11-20 | 2013-04-03 | Haptic information presentation system and method |
US14/718,539 Active US9495803B2 (en) | 2003-11-20 | 2015-05-21 | Haptic information presentation system and method |
US14/840,423 Active US9495804B2 (en) | 2003-11-20 | 2015-08-31 | Haptic information presentation system and method |
US15/293,609 Active 2024-12-16 US10216278B2 (en) | 2003-11-20 | 2016-10-14 | Haptic information presentation system and method |
US16/232,811 Active US11287888B2 (en) | 2003-11-20 | 2018-12-26 | Haptic information presentation system and method |
Family Applications After (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/710,813 Active 2030-03-13 US9041520B2 (en) | 2003-11-20 | 2010-02-23 | Haptic information presentation system and method |
US13/855,935 Active US9171437B2 (en) | 2003-11-20 | 2013-04-03 | Haptic information presentation system and method |
US13/855,881 Active US9142104B2 (en) | 2003-11-20 | 2013-04-03 | Haptic information presentation system and method |
US13/855,844 Active US9135791B2 (en) | 2003-11-20 | 2013-04-03 | Haptic information presentation system and method |
US14/718,539 Active US9495803B2 (en) | 2003-11-20 | 2015-05-21 | Haptic information presentation system and method |
US14/840,423 Active US9495804B2 (en) | 2003-11-20 | 2015-08-31 | Haptic information presentation system and method |
US15/293,609 Active 2024-12-16 US10216278B2 (en) | 2003-11-20 | 2016-10-14 | Haptic information presentation system and method |
US16/232,811 Active US11287888B2 (en) | 2003-11-20 | 2018-12-26 | Haptic information presentation system and method |
Country Status (6)
Country | Link |
---|---|
US (9) | US20070091063A1 (en) |
JP (1) | JP4111278B2 (en) |
KR (4) | KR101520203B1 (en) |
CA (1) | CA2547961C (en) |
GB (1) | GB2423846B (en) |
WO (1) | WO2005050427A1 (en) |
Cited By (66)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090036212A1 (en) * | 2007-07-30 | 2009-02-05 | Provancher William R | Shear Tactile Display System for Communicating Direction and Other Tactile Cues |
US20090153350A1 (en) * | 2007-12-12 | 2009-06-18 | Immersion Corp. | Method and Apparatus for Distributing Haptic Synchronous Signals |
US20090227296A1 (en) * | 2008-03-10 | 2009-09-10 | Lg Electronics Inc. | Terminal and method of controlling the same |
US20090285407A1 (en) * | 2008-05-15 | 2009-11-19 | Brian John Cragun | Method and Apparatus for Providing Audio Motion Feedback in a Simulated Three-Dimensional Environment |
US20100103135A1 (en) * | 2008-10-27 | 2010-04-29 | Hiroto Sugahara | Mobile Apparatus |
US20100105432A1 (en) * | 2008-10-27 | 2010-04-29 | Brother Kogyo Kabushiki Kaisha | Mobile Apparatus |
US20100101480A1 (en) * | 2008-10-27 | 2010-04-29 | Hiroto Sugahara | Mobile Apparatus |
US20100164697A1 (en) * | 2008-12-30 | 2010-07-01 | Samsung Electronics Co., Ltd. | Apparatus and method for providing haptic function in a portable terminal |
US20100177065A1 (en) * | 2009-01-14 | 2010-07-15 | International Business Machines Corporation | Haptic Motion Feedback Mechanism |
US20100177064A1 (en) * | 2009-01-14 | 2010-07-15 | International Business Machines Corporation | Haptic Motion Feedback Device |
US20100245237A1 (en) * | 2007-09-14 | 2010-09-30 | Norio Nakamura | Virtual Reality Environment Generating Apparatus and Controller Apparatus |
US20110018696A1 (en) * | 2009-01-21 | 2011-01-27 | Korea Institute Of Science And Technology | Vibrotactile Device and Method Using the Same |
US20110032090A1 (en) * | 2008-04-15 | 2011-02-10 | Provancher William R | Active Handrest For Haptic Guidance and Ergonomic Support |
US20110190058A1 (en) * | 2005-06-27 | 2011-08-04 | Coactive Drive Corporation | Synchronized vibration device for haptic feedback |
US20120154132A1 (en) * | 2010-12-21 | 2012-06-21 | Samsung Electronics Co., Ltd. | Method, device, and system for providing sensory information and sense |
US20120242465A1 (en) * | 2009-12-08 | 2012-09-27 | Nec Corporation | Information presentation device using tactile stimulus with vibrator |
US8326462B1 (en) | 2008-03-12 | 2012-12-04 | University Of Utah Research Foundation | Tactile contact and impact displays and associated methods |
US20130082829A1 (en) * | 2011-10-03 | 2013-04-04 | Sony Corporation | Force sense presentation apparatus |
US20130179827A1 (en) * | 2011-10-17 | 2013-07-11 | Marcus Eriksson | Electronic device interface |
US8610548B1 (en) | 2009-02-03 | 2013-12-17 | University Of Utah Research Foundation | Compact shear tactile feedback device and related methods |
CN103578302A (en) * | 2012-07-29 | 2014-02-12 | 黄颖峰 | Passive type tension sensing memorizer |
US8701074B2 (en) | 2010-04-13 | 2014-04-15 | Synopsys, Inc. | Automatic reduction of modes of electronic circuits for timing analysis |
US20140253448A1 (en) * | 2013-03-07 | 2014-09-11 | Lenovo (Singapore) Pte. Ltd. | Devices, systems, and methods for providing physical feedback in a handheld electronic controller |
US8981682B2 (en) | 2005-06-27 | 2015-03-17 | Coactive Drive Corporation | Asymmetric and general vibration waveforms from multiple synchronized vibration actuators |
US8994665B1 (en) | 2009-11-19 | 2015-03-31 | University Of Utah Research Foundation | Shear tactile display systems for use in vehicular directional applications |
US20150097774A1 (en) * | 2012-04-18 | 2015-04-09 | Sony Corporation | Operation method, control apparatus, and program |
US20150346833A1 (en) * | 2014-06-03 | 2015-12-03 | Beijing TransBorder Information Technology Co., Ltd. | Gesture recognition system and gesture recognition method |
US9268401B2 (en) | 2007-07-30 | 2016-02-23 | University Of Utah Research Foundation | Multidirectional controller with shear feedback |
US20160144404A1 (en) * | 2005-06-27 | 2016-05-26 | Coactive Drive Corporation | Synchronized array of vibration actuators in an integrated module |
US9459632B2 (en) | 2005-06-27 | 2016-10-04 | Coactive Drive Corporation | Synchronized array of vibration actuators in a network topology |
US9600094B2 (en) * | 2015-03-04 | 2017-03-21 | Lenovo (Singapore) Pte. Ltd. | Apparatus, method, and program product for directing motion of a writing device |
US20170178469A1 (en) * | 2015-12-17 | 2017-06-22 | Harman International Industries, Inc. | Fan-driven force device |
US20170220117A1 (en) * | 2014-10-02 | 2017-08-03 | Dav | Control device and method for a motor vehicle |
US20170220118A1 (en) * | 2014-10-02 | 2017-08-03 | Dav | Control device for a motor vehicle |
US20170280397A1 (en) * | 2016-03-24 | 2017-09-28 | Immersion Corporation | Energy savings mode for silent haptics |
US9793869B1 (en) * | 2016-04-27 | 2017-10-17 | Cisco Technology, Inc. | Satellite microphone assembly |
US20170300039A1 (en) * | 2015-03-18 | 2017-10-19 | Nikon Corporation | Electronic device and program |
US9804677B2 (en) * | 2016-02-04 | 2017-10-31 | Korea Institute Of Science And Technology | Method and apparatus for creating virtual joint sensation |
US9921652B2 (en) * | 2015-06-29 | 2018-03-20 | Apple Inc. | Input with haptic feedback |
US9971407B2 (en) | 2015-09-30 | 2018-05-15 | Apple Inc. | Haptic feedback for rotary inputs |
US9981182B2 (en) | 2016-02-12 | 2018-05-29 | Disney Enterprises, Inc. | Systems and methods for providing immersive game feedback using haptic effects |
US20180233226A1 (en) * | 2008-12-12 | 2018-08-16 | Immersion Corporation | Method and apparatus for providing a haptic monitoring system using multiple sensors |
US10082875B1 (en) | 2017-06-05 | 2018-09-25 | Korea Institute Of Science And Technology | Vibrating apparatus, system and method for generating tactile stimulation |
WO2018184032A1 (en) * | 2017-03-31 | 2018-10-04 | VRgluv LLC | Haptic interface devices |
US20190087063A1 (en) * | 2016-04-19 | 2019-03-21 | Nippon Telegraph And Telephone Corporation | Pseudo force sense generation apparatus |
US20190094967A1 (en) * | 2017-09-27 | 2019-03-28 | Qualcomm Incorporated | Method and apparatus for haptic feedback |
US10274988B2 (en) * | 2014-11-19 | 2019-04-30 | Panasonic Intellectual Property Management Co., Ltd. | Input/output operation device |
US10296018B2 (en) * | 2016-06-23 | 2019-05-21 | Harman International Industries, Incorporated | Pseudo force device |
US10345949B2 (en) * | 2015-08-27 | 2019-07-09 | Fujitsu Ten Limited | Audio device and menu display method of audio device |
US10503258B2 (en) | 2016-03-04 | 2019-12-10 | Apple Inc. | Input mechanism with force and rotation inputs and haptic feedback |
CN111033446A (en) * | 2017-08-31 | 2020-04-17 | 索尼公司 | Tactile presentation device |
CN111712784A (en) * | 2018-02-20 | 2020-09-25 | 索尼公司 | Haptic rendering device and haptic rendering system |
US10948514B2 (en) | 2015-11-30 | 2021-03-16 | Harman International Industries, Incorporated | Center of gravity shifting force device |
US10963055B2 (en) | 2016-12-15 | 2021-03-30 | Sony Interactive Entertainment Inc. | Vibration device and control system for presenting corrected vibration data |
US10963054B2 (en) | 2016-12-15 | 2021-03-30 | Sony Interactive Entertainment Inc. | Information processing system, vibration control method and program |
US10969867B2 (en) | 2016-12-15 | 2021-04-06 | Sony Interactive Entertainment Inc. | Information processing system, controller device, controller device control method and program |
US10981053B2 (en) | 2017-04-18 | 2021-04-20 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11013990B2 (en) | 2017-04-19 | 2021-05-25 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11103787B1 (en) | 2010-06-24 | 2021-08-31 | Gregory S. Rabin | System and method for generating a synthetic video stream |
US11145172B2 (en) | 2017-04-18 | 2021-10-12 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11198059B2 (en) | 2017-08-29 | 2021-12-14 | Sony Interactive Entertainment Inc. | Vibration control apparatus, vibration control method, and program |
US11203041B2 (en) | 2005-06-27 | 2021-12-21 | General Vibration Corporation | Haptic game controller with dual linear vibration actuators |
US11262845B2 (en) | 2017-11-21 | 2022-03-01 | Samsung Electronics Co., Ltd. | Device and method for providing vibration |
US11458389B2 (en) | 2017-04-26 | 2022-10-04 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11738261B2 (en) | 2017-08-24 | 2023-08-29 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11779836B2 (en) | 2017-08-24 | 2023-10-10 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
Families Citing this family (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4111278B2 (en) * | 2003-11-20 | 2008-07-02 | 独立行政法人産業技術総合研究所 | Haptic information presentation system |
JP2017073101A (en) * | 2015-10-05 | 2017-04-13 | 株式会社ミライセンス | Tactile and force information providing system |
JP2017073100A (en) * | 2015-10-05 | 2017-04-13 | 株式会社ミライセンス | Tactile and force information providing system |
US9802225B2 (en) * | 2005-06-27 | 2017-10-31 | General Vibration Corporation | Differential haptic guidance for personal navigation |
KR100867408B1 (en) * | 2005-12-23 | 2008-11-06 | 한국과학기술원 | Tactile display device with vibrotactile and thermal feedback |
JP4877937B2 (en) * | 2006-05-25 | 2012-02-15 | 国立大学法人岐阜大学 | Tactile interface |
JP2007331066A (en) * | 2006-06-15 | 2007-12-27 | Canon Inc | Contact presenting device and method |
US7920124B2 (en) | 2006-08-29 | 2011-04-05 | Canon Kabushiki Kaisha | Force sense presentation device, mixed reality system, information processing method, and information processing apparatus |
JP4818072B2 (en) * | 2006-11-08 | 2011-11-16 | キヤノン株式会社 | Haptic presentation device and mixed reality system |
ES2452323T3 (en) | 2006-11-20 | 2014-03-31 | Trimurti Holding Corporation | Tetra-block styrene copolymers and polymer blend compositions based on such copolymers |
JP4129036B1 (en) * | 2007-03-02 | 2008-07-30 | 株式会社コナミデジタルエンタテインメント | INPUT DEVICE, INPUT CONTROL METHOD, AND PROGRAM |
WO2009035100A1 (en) * | 2007-09-14 | 2009-03-19 | National Institute Of Advanced Industrial Science And Technology | Virtual reality environment creating device, and controller device |
JP5235424B2 (en) * | 2008-01-21 | 2013-07-10 | キヤノン株式会社 | Information processing apparatus and method |
KR101488528B1 (en) * | 2008-07-01 | 2015-01-30 | 엘지전자 주식회사 | PORTABLE TERMINAL and DRIVING METHOD OF THE SAME |
JP5352813B2 (en) * | 2009-09-08 | 2013-11-27 | 独立行政法人情報通信研究機構 | Non-grounding type haptic device |
JP2013045311A (en) * | 2011-08-25 | 2013-03-04 | Alps Electric Co Ltd | Vibration generation device |
KR101442341B1 (en) * | 2012-10-05 | 2014-09-24 | 한국과학기술원 | Method and apparatus for sending touch strength on user terminal and method for controlling user terminal using the same |
KR101979680B1 (en) | 2012-12-05 | 2019-05-20 | 삼성전자주식회사 | Tactile sensor |
US9202352B2 (en) * | 2013-03-11 | 2015-12-01 | Immersion Corporation | Automatic haptic effect adjustment system |
US10168766B2 (en) * | 2013-04-17 | 2019-01-01 | Nokia Technologies Oy | Method and apparatus for a textural representation of a guidance |
FR3006477B1 (en) * | 2013-05-29 | 2016-09-30 | Blinksight | DEVICE AND METHOD FOR DETECTING THE HANDLING OF AT LEAST ONE OBJECT |
JP5650295B1 (en) | 2013-09-12 | 2015-01-07 | 株式会社東海理化電機製作所 | Operating device |
US9164587B2 (en) * | 2013-11-14 | 2015-10-20 | Immersion Corporation | Haptic spatialization system |
US9619029B2 (en) | 2013-11-14 | 2017-04-11 | Immersion Corporation | Haptic trigger control system |
WO2015097569A1 (en) * | 2013-12-23 | 2015-07-02 | Srinivasan Tilak | Orientation indication device |
CN104134226B (en) * | 2014-03-12 | 2015-08-19 | 腾讯科技(深圳)有限公司 | Speech simulation method, device and client device in a kind of virtual scene |
GB201409764D0 (en) | 2014-06-02 | 2014-07-16 | Accesso Technology Group Plc | Queuing system |
US11900734B2 (en) | 2014-06-02 | 2024-02-13 | Accesso Technology Group Plc | Queuing system |
JP2015230540A (en) * | 2014-06-04 | 2015-12-21 | 株式会社東海理化電機製作所 | Tactile sense presentation device |
WO2016038953A1 (en) | 2014-09-10 | 2016-03-17 | ソニー株式会社 | Detection device, detection method, control device, and control method |
US10185396B2 (en) | 2014-11-12 | 2019-01-22 | Immersion Corporation | Haptic trigger modification system |
JP6379075B2 (en) * | 2015-08-03 | 2018-08-22 | 日本電信電話株式会社 | Traction generator |
JP6955229B2 (en) * | 2015-10-05 | 2021-10-27 | 株式会社村田製作所 | Tactile information presentation system |
US10850192B2 (en) | 2016-03-04 | 2020-12-01 | Sony Interactive Entertainment Inc. | Control apparatus and control program |
JP6786878B2 (en) * | 2016-05-27 | 2020-11-18 | 日本電気株式会社 | Vibration generator and vibration generation method |
JP6810544B2 (en) * | 2016-07-06 | 2021-01-06 | 株式会社ソニー・インタラクティブエンタテインメント | Operating device |
JP6626576B2 (en) | 2016-07-21 | 2019-12-25 | 株式会社ソニー・インタラクティブエンタテインメント | Operation device and control system |
KR102171538B1 (en) | 2016-07-26 | 2020-10-29 | 주식회사 소니 인터랙티브 엔터테인먼트 | Information processing system, operating device, and operating device control method |
EP3493030B1 (en) | 2016-07-26 | 2021-06-23 | Sony Interactive Entertainment Inc. | Operation device and operation device control method |
JP2018045407A (en) * | 2016-09-14 | 2018-03-22 | 株式会社東海理化電機製作所 | Tactile sense presentation device |
JP6777497B2 (en) * | 2016-10-25 | 2020-10-28 | 株式会社東海理化電機製作所 | Force sensation device |
US10078370B2 (en) * | 2016-11-23 | 2018-09-18 | Immersion Corporation | Devices and methods for modifying haptic effects |
WO2018146934A1 (en) * | 2017-02-09 | 2018-08-16 | 国立大学法人北海道大学 | Haptic feedback generating device |
DE102017105529A1 (en) * | 2017-03-15 | 2018-09-20 | Epcos Ag | Garment and use of the garment |
RU2658554C1 (en) * | 2017-06-27 | 2018-06-21 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Казанский национальный исследовательский технический университет им. А.Н. Туполева-КАИ" (КНИТУ-КАИ) | Simulator for studying the gyroscopic artificial horizon |
US11173393B2 (en) | 2017-09-29 | 2021-11-16 | Sony Interactive Entertainment Inc. | Operation device and control apparatus therefor |
US20190116022A1 (en) * | 2017-10-16 | 2019-04-18 | Samsung Electronics Co., Ltd. | Encryption device and operation method thereof |
CA3092689A1 (en) | 2017-10-23 | 2019-05-02 | Patent Holding Company 001, Llc | Communication devices, methods, and systems |
JP6949982B2 (en) | 2017-10-27 | 2021-10-13 | 株式会社ソニー・インタラクティブエンタテインメント | Operation device |
KR102004371B1 (en) * | 2018-05-16 | 2019-07-29 | (주)코어센스 | Smart glove apparatus and method for controlling smart glove using the same |
US11740697B1 (en) | 2018-06-19 | 2023-08-29 | Meta Platforms Technologies, Llc | Vibrotactile devices, systems, and related methods |
US11046182B2 (en) | 2018-10-22 | 2021-06-29 | Nio Usa, Inc. | System and method for providing momentum scrolling via a rotary user interface device |
US10671271B2 (en) | 2018-10-22 | 2020-06-02 | Nio Usa, Inc. | Jog dial user interface device |
KR102634541B1 (en) * | 2018-12-24 | 2024-02-06 | 엘지디스플레이 주식회사 | Apparatus for Generating Acceleration Feeling and Wearable Device with the same |
US20220094253A1 (en) * | 2019-01-24 | 2022-03-24 | General Vibration Corporation | Aerodynamic eccentric rotating mass attachment for vibration motor |
CN209692443U (en) | 2019-06-17 | 2019-11-26 | 广东肇庆爱龙威机电有限公司 | Motor |
JP7339806B2 (en) | 2019-08-05 | 2023-09-06 | 川崎重工業株式会社 | Control system, robot system and control method |
JP7344742B2 (en) * | 2019-10-09 | 2023-09-14 | アルプスアルパイン株式会社 | Force sensation generation device |
US11353966B1 (en) * | 2019-12-23 | 2022-06-07 | Facebook Technologies, Llc | Handheld controllers and artificial-reality systems |
WO2021199408A1 (en) * | 2020-04-02 | 2021-10-07 | 日本電信電話株式会社 | Pseudo-haptic sensation control device, pseudo-haptic sensation control method, and program |
JP2021174253A (en) * | 2020-04-24 | 2021-11-01 | 日本放送協会 | Pseudo experience system |
KR102332318B1 (en) * | 2020-07-22 | 2021-12-01 | 이화여자대학교 산학협력단 | Method and system for providing a roughness haptic of a virtual object using spatiotemporal encoding |
KR20240083855A (en) | 2020-10-30 | 2024-06-12 | 데이터필 인코포레이티드 | Wearable data communication devices, kits, methods, and systems |
EP4268054A4 (en) | 2020-12-22 | 2024-01-24 | Telefonaktiebolaget LM Ericsson (publ) | Methods and devices related to extended reality |
RU2761381C1 (en) * | 2021-04-06 | 2021-12-07 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Казанский национальный исследовательский технический университет им. А.Н. Туполева - КАИ" | Simulator for studying gyrocompass |
JPWO2023008397A1 (en) * | 2021-07-27 | 2023-02-02 | ||
WO2023008396A1 (en) * | 2021-07-27 | 2023-02-02 | 株式会社村田製作所 | Handle, shaver, hair dryer, hair iron, hairbrush, and eyelash curler |
WO2023176767A1 (en) | 2022-03-18 | 2023-09-21 | 株式会社村田製作所 | Pseudo-haptic sensation setting program, pseudo-haptic sensation setting device, pseudo-haptic sensation setting system, and image generation method |
WO2024053087A1 (en) * | 2022-09-09 | 2024-03-14 | 株式会社ソニー・インタラクティブエンタテインメント | Operation device |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6275213B1 (en) * | 1995-11-30 | 2001-08-14 | Virtual Technologies, Inc. | Tactile feedback man-machine interface device |
US7079995B1 (en) * | 2003-01-10 | 2006-07-18 | Nina Buttafoco | Tactile simulator for use in conjunction with a video display |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1995020788A1 (en) | 1994-01-27 | 1995-08-03 | Exos, Inc. | Intelligent remote multimode sense and display system utilizing haptic information compression |
US6166723A (en) | 1995-11-17 | 2000-12-26 | Immersion Corporation | Mouse interface device providing force feedback |
JP2923240B2 (en) * | 1996-02-20 | 1999-07-26 | 調和工業株式会社 | Eccentric weight type vibration generation / control method and eccentric weight type vibration exciter |
US6448977B1 (en) * | 1997-11-14 | 2002-09-10 | Immersion Corporation | Textures and other spatial sensations for a relative haptic interface device |
JP3574554B2 (en) * | 1997-11-18 | 2004-10-06 | 独立行政法人 科学技術振興機構 | Tactile presentation method and device |
US6429846B2 (en) | 1998-06-23 | 2002-08-06 | Immersion Corporation | Haptic feedback for touchpads and other touch controls |
JP4194696B2 (en) | 1998-10-22 | 2008-12-10 | 東芝エレベータ株式会社 | Elevator damping device |
US7084884B1 (en) * | 1998-11-03 | 2006-08-01 | Immersion Corporation | Graphical object interactions |
JP2000148393A (en) * | 1998-11-06 | 2000-05-26 | Minolta Co Ltd | Visual and touch sense information transmitting device |
JP2000126459A (en) | 1999-02-08 | 2000-05-09 | Snk:Kk | Vibration generating device to be installed on game machine |
DE20080209U1 (en) * | 1999-09-28 | 2001-08-09 | Immersion Corp | Control of haptic sensations for interface devices with vibrotactile feedback |
US6924787B2 (en) | 2000-04-17 | 2005-08-02 | Immersion Corporation | Interface for controlling a graphical image |
JPWO2002073385A1 (en) | 2001-03-08 | 2004-09-09 | 独立行政法人産業技術総合研究所 | Method and apparatus for presenting force sense using gyro |
US7202851B2 (en) | 2001-05-04 | 2007-04-10 | Immersion Medical Inc. | Haptic interface for palpation simulation |
JP3835204B2 (en) * | 2001-06-01 | 2006-10-18 | ヤマハ株式会社 | Audible sound and vibration generator |
JP2003251277A (en) * | 2002-03-04 | 2003-09-09 | Namiki Precision Jewel Co Ltd | Shaft fixed reluctance type vibration motor |
US11275405B2 (en) * | 2005-03-04 | 2022-03-15 | Apple Inc. | Multi-functional hand-held device |
JP2017073100A (en) | 2015-10-05 | 2017-04-13 | 株式会社ミライセンス | Tactile and force information providing system |
JP4111278B2 (en) * | 2003-11-20 | 2008-07-02 | 独立行政法人産業技術総合研究所 | Haptic information presentation system |
US20060061545A1 (en) | 2004-04-02 | 2006-03-23 | Media Lab Europe Limited ( In Voluntary Liquidation). | Motion-activated control with haptic feedback |
JP4684794B2 (en) | 2005-08-04 | 2011-05-18 | 富士通コンポーネント株式会社 | Operation device, electronic book apparatus, and electronic apparatus |
JP5352619B2 (en) | 2011-04-13 | 2013-11-27 | 株式会社日本自動車部品総合研究所 | Operation input device |
JP2015170213A (en) | 2014-03-07 | 2015-09-28 | キヤノン株式会社 | Handheld equipment, and control method and program |
-
2004
- 2004-11-15 JP JP2004331263A patent/JP4111278B2/en active Active
- 2004-11-19 KR KR1020137019330A patent/KR101520203B1/en active IP Right Grant
- 2004-11-19 WO PCT/JP2004/017277 patent/WO2005050427A1/en active Application Filing
- 2004-11-19 KR KR1020127008624A patent/KR101296925B1/en active IP Right Grant
- 2004-11-19 KR KR1020127032933A patent/KR101361291B1/en active IP Right Grant
- 2004-11-19 GB GB0609812A patent/GB2423846B/en active Active
- 2004-11-19 CA CA2547961A patent/CA2547961C/en active Active
- 2004-11-19 KR KR1020067012085A patent/KR101169814B1/en active IP Right Grant
- 2004-11-19 US US10/579,672 patent/US20070091063A1/en not_active Abandoned
-
2010
- 2010-02-23 US US12/710,813 patent/US9041520B2/en active Active
-
2013
- 2013-04-03 US US13/855,935 patent/US9171437B2/en active Active
- 2013-04-03 US US13/855,881 patent/US9142104B2/en active Active
- 2013-04-03 US US13/855,844 patent/US9135791B2/en active Active
-
2015
- 2015-05-21 US US14/718,539 patent/US9495803B2/en active Active
- 2015-08-31 US US14/840,423 patent/US9495804B2/en active Active
-
2016
- 2016-10-14 US US15/293,609 patent/US10216278B2/en active Active
-
2018
- 2018-12-26 US US16/232,811 patent/US11287888B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6275213B1 (en) * | 1995-11-30 | 2001-08-14 | Virtual Technologies, Inc. | Tactile feedback man-machine interface device |
US7079995B1 (en) * | 2003-01-10 | 2006-07-18 | Nina Buttafoco | Tactile simulator for use in conjunction with a video display |
Cited By (112)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11707765B2 (en) | 2005-06-27 | 2023-07-25 | Sony Interactive Entertainment LLC | Game controller with vibration accuators |
US10226792B2 (en) * | 2005-06-27 | 2019-03-12 | General Vibration Corporation | Synchronized array of vibration actuators in an integrated module |
US20110190058A1 (en) * | 2005-06-27 | 2011-08-04 | Coactive Drive Corporation | Synchronized vibration device for haptic feedback |
US9459632B2 (en) | 2005-06-27 | 2016-10-04 | Coactive Drive Corporation | Synchronized array of vibration actuators in a network topology |
US10843229B2 (en) | 2005-06-27 | 2020-11-24 | General Vibration Corporation | Synchronized array of vibration actuators in an integrated module |
US11203041B2 (en) | 2005-06-27 | 2021-12-21 | General Vibration Corporation | Haptic game controller with dual linear vibration actuators |
US8390218B2 (en) * | 2005-06-27 | 2013-03-05 | Coactive Drive Corporation | Synchronized vibration device for haptic feedback |
US9764357B2 (en) * | 2005-06-27 | 2017-09-19 | General Vibration Corporation | Synchronized array of vibration actuators in an integrated module |
US8384316B2 (en) | 2005-06-27 | 2013-02-26 | Coactive Drive Corporation | Synchronized vibration device for haptic feedback |
US8981682B2 (en) | 2005-06-27 | 2015-03-17 | Coactive Drive Corporation | Asymmetric and general vibration waveforms from multiple synchronized vibration actuators |
US10507493B2 (en) | 2005-06-27 | 2019-12-17 | General Vibration Corporation | Synchronized array of vibration actuators in an integrated module |
US20160144404A1 (en) * | 2005-06-27 | 2016-05-26 | Coactive Drive Corporation | Synchronized array of vibration actuators in an integrated module |
US9285878B2 (en) | 2007-07-30 | 2016-03-15 | University Of Utah Research Foundation | Shear tactile display system for communicating direction and other tactile cues |
US9268401B2 (en) | 2007-07-30 | 2016-02-23 | University Of Utah Research Foundation | Multidirectional controller with shear feedback |
US10191549B2 (en) | 2007-07-30 | 2019-01-29 | University Of Utah Research Foundation | Multidirectional controller with shear feedback |
US20090036212A1 (en) * | 2007-07-30 | 2009-02-05 | Provancher William R | Shear Tactile Display System for Communicating Direction and Other Tactile Cues |
US20100245237A1 (en) * | 2007-09-14 | 2010-09-30 | Norio Nakamura | Virtual Reality Environment Generating Apparatus and Controller Apparatus |
US11325029B2 (en) * | 2007-09-14 | 2022-05-10 | National Institute Of Advanced Industrial Science And Technology | Virtual reality environment generating apparatus and controller apparatus |
US20110121954A1 (en) * | 2007-12-12 | 2011-05-26 | Immersion Corporation, A Delaware Corporation | Method and Apparatus for Distributing Haptic Synchronous Signals |
CN101896962A (en) * | 2007-12-12 | 2010-11-24 | 英默森公司 | Method and apparatus for distributing haptic synchronous signals |
CN103699218A (en) * | 2007-12-12 | 2014-04-02 | 英默森公司 | Method and apparatus for distributing haptic synchronous signals |
US8378795B2 (en) | 2007-12-12 | 2013-02-19 | Immersion Corporation | Method and apparatus for distributing haptic synchronous signals |
US7839269B2 (en) | 2007-12-12 | 2010-11-23 | Immersion Corporation | Method and apparatus for distributing haptic synchronous signals |
US8093995B2 (en) | 2007-12-12 | 2012-01-10 | Immersion Corporation | Method and apparatus for distributing haptic synchronous signals |
US20090153350A1 (en) * | 2007-12-12 | 2009-06-18 | Immersion Corp. | Method and Apparatus for Distributing Haptic Synchronous Signals |
WO2009075931A1 (en) * | 2007-12-12 | 2009-06-18 | Immersion Corporation | Method and apparatus for distributing haptic synchronous signals |
US8723810B2 (en) * | 2008-03-10 | 2014-05-13 | Lg Electronics Inc. | Terminal for outputting a vibration and method of controlling the same |
US8704776B2 (en) * | 2008-03-10 | 2014-04-22 | Lg Electronics Inc. | Terminal for displaying objects and method of controlling the same |
US20090227296A1 (en) * | 2008-03-10 | 2009-09-10 | Lg Electronics Inc. | Terminal and method of controlling the same |
US20090227295A1 (en) * | 2008-03-10 | 2009-09-10 | Lg Electronics Inc. | Terminal and method of controlling the same |
US8326462B1 (en) | 2008-03-12 | 2012-12-04 | University Of Utah Research Foundation | Tactile contact and impact displays and associated methods |
US20110032090A1 (en) * | 2008-04-15 | 2011-02-10 | Provancher William R | Active Handrest For Haptic Guidance and Ergonomic Support |
US20090285407A1 (en) * | 2008-05-15 | 2009-11-19 | Brian John Cragun | Method and Apparatus for Providing Audio Motion Feedback in a Simulated Three-Dimensional Environment |
US8249263B2 (en) | 2008-05-15 | 2012-08-21 | International Business Machines Corporation | Method and apparatus for providing audio motion feedback in a simulated three-dimensional environment |
US8384529B2 (en) | 2008-10-27 | 2013-02-26 | Brother Kogyo Kabushiki Kaisha | Mobile apparatus including two force-sense generating mechanisms |
US8838170B2 (en) | 2008-10-27 | 2014-09-16 | Brother Kogyo Kabushiki Kaisha | Mobile apparatus |
US20100105432A1 (en) * | 2008-10-27 | 2010-04-29 | Brother Kogyo Kabushiki Kaisha | Mobile Apparatus |
US20100103135A1 (en) * | 2008-10-27 | 2010-04-29 | Hiroto Sugahara | Mobile Apparatus |
US20100101480A1 (en) * | 2008-10-27 | 2010-04-29 | Hiroto Sugahara | Mobile Apparatus |
US20180233226A1 (en) * | 2008-12-12 | 2018-08-16 | Immersion Corporation | Method and apparatus for providing a haptic monitoring system using multiple sensors |
US20100164697A1 (en) * | 2008-12-30 | 2010-07-01 | Samsung Electronics Co., Ltd. | Apparatus and method for providing haptic function in a portable terminal |
US8456289B2 (en) * | 2008-12-30 | 2013-06-04 | Samsung Electronics Co., Ltd. | Apparatus and method for providing haptic function in a portable terminal |
US8493188B2 (en) * | 2009-01-14 | 2013-07-23 | International Business Machines Corporation | Haptic motion feedback device |
US8344861B2 (en) * | 2009-01-14 | 2013-01-01 | International Business Machines Corporation | Haptic motion feedback mechanism |
US20100177064A1 (en) * | 2009-01-14 | 2010-07-15 | International Business Machines Corporation | Haptic Motion Feedback Device |
US20100177065A1 (en) * | 2009-01-14 | 2010-07-15 | International Business Machines Corporation | Haptic Motion Feedback Mechanism |
US20110018696A1 (en) * | 2009-01-21 | 2011-01-27 | Korea Institute Of Science And Technology | Vibrotactile Device and Method Using the Same |
US8704649B2 (en) * | 2009-01-21 | 2014-04-22 | Korea Institute Of Science And Technology | Vibrotactile device and method using the same |
US8610548B1 (en) | 2009-02-03 | 2013-12-17 | University Of Utah Research Foundation | Compact shear tactile feedback device and related methods |
US8994665B1 (en) | 2009-11-19 | 2015-03-31 | University Of Utah Research Foundation | Shear tactile display systems for use in vehicular directional applications |
US9278705B2 (en) * | 2009-12-08 | 2016-03-08 | Nec Corporation | Information presentation device using tactile stimulus with vibrator |
US20120242465A1 (en) * | 2009-12-08 | 2012-09-27 | Nec Corporation | Information presentation device using tactile stimulus with vibrator |
US8701074B2 (en) | 2010-04-13 | 2014-04-15 | Synopsys, Inc. | Automatic reduction of modes of electronic circuits for timing analysis |
US11103787B1 (en) | 2010-06-24 | 2021-08-31 | Gregory S. Rabin | System and method for generating a synthetic video stream |
US8766785B2 (en) * | 2010-12-21 | 2014-07-01 | Samsung Electronics Co., Ltd. | Method, device, and system for providing sensory information and sense |
US9483116B2 (en) | 2010-12-21 | 2016-11-01 | Samsung Electronics Co., Ltd | Method, device, and system for providing sensory information and sense |
US20120154132A1 (en) * | 2010-12-21 | 2012-06-21 | Samsung Electronics Co., Ltd. | Method, device, and system for providing sensory information and sense |
US9261896B2 (en) * | 2011-10-03 | 2016-02-16 | Sony Corporation | Force sense presentation apparatus |
US20130082829A1 (en) * | 2011-10-03 | 2013-04-04 | Sony Corporation | Force sense presentation apparatus |
US20130179827A1 (en) * | 2011-10-17 | 2013-07-11 | Marcus Eriksson | Electronic device interface |
US20150097774A1 (en) * | 2012-04-18 | 2015-04-09 | Sony Corporation | Operation method, control apparatus, and program |
US9740305B2 (en) * | 2012-04-18 | 2017-08-22 | Sony Corporation | Operation method, control apparatus, and program |
US10514777B2 (en) | 2012-04-18 | 2019-12-24 | Sony Corporation | Operation method and control apparatus |
CN103578302A (en) * | 2012-07-29 | 2014-02-12 | 黄颖峰 | Passive type tension sensing memorizer |
US9367133B2 (en) * | 2013-03-07 | 2016-06-14 | Lenovo (Singapore) Pte. Ltd. | Devices, systems, and methods for providing physical feedback in a handheld electronic controller |
US20140253448A1 (en) * | 2013-03-07 | 2014-09-11 | Lenovo (Singapore) Pte. Ltd. | Devices, systems, and methods for providing physical feedback in a handheld electronic controller |
US20150346833A1 (en) * | 2014-06-03 | 2015-12-03 | Beijing TransBorder Information Technology Co., Ltd. | Gesture recognition system and gesture recognition method |
US10061389B2 (en) * | 2014-06-03 | 2018-08-28 | Beijing TransBorder Information Technology Co., Ltd. | Gesture recognition system and gesture recognition method |
US11455037B2 (en) * | 2014-10-02 | 2022-09-27 | Dav | Control device for a motor vehicle |
US20170220118A1 (en) * | 2014-10-02 | 2017-08-03 | Dav | Control device for a motor vehicle |
US20170220117A1 (en) * | 2014-10-02 | 2017-08-03 | Dav | Control device and method for a motor vehicle |
US10274988B2 (en) * | 2014-11-19 | 2019-04-30 | Panasonic Intellectual Property Management Co., Ltd. | Input/output operation device |
US9600094B2 (en) * | 2015-03-04 | 2017-03-21 | Lenovo (Singapore) Pte. Ltd. | Apparatus, method, and program product for directing motion of a writing device |
US20170300039A1 (en) * | 2015-03-18 | 2017-10-19 | Nikon Corporation | Electronic device and program |
US9921652B2 (en) * | 2015-06-29 | 2018-03-20 | Apple Inc. | Input with haptic feedback |
US10345949B2 (en) * | 2015-08-27 | 2019-07-09 | Fujitsu Ten Limited | Audio device and menu display method of audio device |
US9971407B2 (en) | 2015-09-30 | 2018-05-15 | Apple Inc. | Haptic feedback for rotary inputs |
US10948514B2 (en) | 2015-11-30 | 2021-03-16 | Harman International Industries, Incorporated | Center of gravity shifting force device |
US9984540B2 (en) * | 2015-12-17 | 2018-05-29 | Harman International Industries, Incorporated | Fan-driven force device |
US20170178469A1 (en) * | 2015-12-17 | 2017-06-22 | Harman International Industries, Inc. | Fan-driven force device |
US9804677B2 (en) * | 2016-02-04 | 2017-10-31 | Korea Institute Of Science And Technology | Method and apparatus for creating virtual joint sensation |
US9981182B2 (en) | 2016-02-12 | 2018-05-29 | Disney Enterprises, Inc. | Systems and methods for providing immersive game feedback using haptic effects |
US10503258B2 (en) | 2016-03-04 | 2019-12-10 | Apple Inc. | Input mechanism with force and rotation inputs and haptic feedback |
US20170280397A1 (en) * | 2016-03-24 | 2017-09-28 | Immersion Corporation | Energy savings mode for silent haptics |
US10462748B2 (en) * | 2016-03-24 | 2019-10-29 | Immersion Corporation | Energy savings mode for silent haptics |
CN107229324A (en) * | 2016-03-24 | 2017-10-03 | 意美森公司 | For the energy saver mode of silent tactile |
US11531462B2 (en) * | 2016-04-19 | 2022-12-20 | Nippon Telegraph And Telephone Corporation | Pseudo force sense generation apparatus |
US20190087063A1 (en) * | 2016-04-19 | 2019-03-21 | Nippon Telegraph And Telephone Corporation | Pseudo force sense generation apparatus |
US20170353168A1 (en) * | 2016-04-27 | 2017-12-07 | Cisco Technology, Inc. | Satellite microphone assembly |
US10243529B2 (en) * | 2016-04-27 | 2019-03-26 | Cisco Technology, Inc. | Satellite microphone assembly |
CN108781316A (en) * | 2016-04-27 | 2018-11-09 | 思科技术公司 | satellite microphone assembly |
US9793869B1 (en) * | 2016-04-27 | 2017-10-17 | Cisco Technology, Inc. | Satellite microphone assembly |
US10296018B2 (en) * | 2016-06-23 | 2019-05-21 | Harman International Industries, Incorporated | Pseudo force device |
US10963055B2 (en) | 2016-12-15 | 2021-03-30 | Sony Interactive Entertainment Inc. | Vibration device and control system for presenting corrected vibration data |
US10963054B2 (en) | 2016-12-15 | 2021-03-30 | Sony Interactive Entertainment Inc. | Information processing system, vibration control method and program |
US10969867B2 (en) | 2016-12-15 | 2021-04-06 | Sony Interactive Entertainment Inc. | Information processing system, controller device, controller device control method and program |
US11500464B2 (en) | 2017-03-31 | 2022-11-15 | VRgluv LLC | Haptic interface devices |
US10698488B2 (en) | 2017-03-31 | 2020-06-30 | VRgluv LLC | Haptic interface devices |
WO2018184032A1 (en) * | 2017-03-31 | 2018-10-04 | VRgluv LLC | Haptic interface devices |
US11145172B2 (en) | 2017-04-18 | 2021-10-12 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US10981053B2 (en) | 2017-04-18 | 2021-04-20 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11013990B2 (en) | 2017-04-19 | 2021-05-25 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11458389B2 (en) | 2017-04-26 | 2022-10-04 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US10082875B1 (en) | 2017-06-05 | 2018-09-25 | Korea Institute Of Science And Technology | Vibrating apparatus, system and method for generating tactile stimulation |
US11738261B2 (en) | 2017-08-24 | 2023-08-29 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11779836B2 (en) | 2017-08-24 | 2023-10-10 | Sony Interactive Entertainment Inc. | Vibration control apparatus |
US11198059B2 (en) | 2017-08-29 | 2021-12-14 | Sony Interactive Entertainment Inc. | Vibration control apparatus, vibration control method, and program |
CN111033446A (en) * | 2017-08-31 | 2020-04-17 | 索尼公司 | Tactile presentation device |
US10496172B2 (en) * | 2017-09-27 | 2019-12-03 | Qualcomm Incorporated | Method and apparatus for haptic feedback |
US20190094967A1 (en) * | 2017-09-27 | 2019-03-28 | Qualcomm Incorporated | Method and apparatus for haptic feedback |
US11262845B2 (en) | 2017-11-21 | 2022-03-01 | Samsung Electronics Co., Ltd. | Device and method for providing vibration |
CN111712784A (en) * | 2018-02-20 | 2020-09-25 | 索尼公司 | Haptic rendering device and haptic rendering system |
Also Published As
Publication number | Publication date |
---|---|
KR20060131787A (en) | 2006-12-20 |
WO2005050427A1 (en) | 2005-06-02 |
US11287888B2 (en) | 2022-03-29 |
US20150253854A1 (en) | 2015-09-10 |
US20130265254A1 (en) | 2013-10-10 |
US20170031443A1 (en) | 2017-02-02 |
KR101296925B1 (en) | 2013-08-20 |
CA2547961A1 (en) | 2005-06-02 |
GB2423846A (en) | 2006-09-06 |
GB2423846B (en) | 2008-06-11 |
US9495803B2 (en) | 2016-11-15 |
US9135791B2 (en) | 2015-09-15 |
JP2005190465A (en) | 2005-07-14 |
US20110050404A1 (en) | 2011-03-03 |
US10216278B2 (en) | 2019-02-26 |
CA2547961C (en) | 2013-04-30 |
JP4111278B2 (en) | 2008-07-02 |
US20190129506A1 (en) | 2019-05-02 |
US9142104B2 (en) | 2015-09-22 |
KR20120055722A (en) | 2012-05-31 |
KR101361291B1 (en) | 2014-02-11 |
KR101169814B1 (en) | 2012-07-30 |
US9041520B2 (en) | 2015-05-26 |
US20150371510A1 (en) | 2015-12-24 |
US20130265148A1 (en) | 2013-10-10 |
US9171437B2 (en) | 2015-10-27 |
US20130265149A1 (en) | 2013-10-10 |
GB0609812D0 (en) | 2006-06-28 |
KR20130016373A (en) | 2013-02-14 |
KR101520203B1 (en) | 2015-05-13 |
KR20130101140A (en) | 2013-09-12 |
US9495804B2 (en) | 2016-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11287888B2 (en) | Haptic information presentation system and method | |
US11385723B2 (en) | Haptic information presentation system and method | |
US10936072B2 (en) | Haptic information presentation system and method | |
US20100225586A1 (en) | Impact force feedback device and interactive system using the same | |
Tanaka et al. | Mobile torque display and haptic characteristics of human palm | |
US20100022300A1 (en) | Device with spatially unrestricted force feedback | |
Wang et al. | JetController: High-speed ungrounded 3-DoF force feedback controllers using air propulsion jets | |
US10554101B2 (en) | Haptic device | |
JP3999631B2 (en) | 2-DOF drive mechanism and virtual reality system | |
JP2022167765A (en) | Augmented reality-based visual tactile ar medium | |
JP2022105942A (en) | Input device for operation in simulated virtual space |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:NAKAMURA, NORIO;FUKUI, YUKIO;SAKAI, MASATAKA;REEL/FRAME:018277/0570;SIGNING DATES FROM 20060620 TO 20060624 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |