JP2003323247A - Tactile sense and kinesthetic sense presentation device and tactile sense and kinesthetic sense presentation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a tactile sense and kinesthetic sense presentation device and a tactile sense and kinesthetic sense presentation system which are easily and accurately attached, removed, and operated, and which present tactile sense and kinesthetic sense to fingers according to a virtual space image. <P>SOLUTION: A real glove 20 prepares a comparatively long glove 2a provided with a tubular part 20a which covers an arm. The glove 2a is provided with an allowance absorbing part 27 which suppresses or prevents allowance of a part for fingers, a wrist fixing part 28 which fixes to a wrist, an arm fixing part 2d which fixes to an arm, and a torsion absorbing part 29 which absorbs torsion of a part for the arm. Besides, the real glove 20 is provided with a tactile sense generating part 21, a kinesthetic sense generation part 22, a position and posture detecting part 23, a control part 24, a signal processing part, and a signal transmitting part. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a tactile / force sense presentation device and a tactile / force sense presentation system.

[0002]

2. Description of the Related Art In Japanese Unexamined Patent Publication No. 6-282371, a virtual space image of a book or the like is displayed, and when a user (user) performs an operation of turning over the pages of the displayed virtual book, the operation is performed according to the operation. , A virtual space desktop device configured to turn over the pages of the book is disclosed.

However, in the above-mentioned conventional apparatus, the user cannot feel the texture of the paper of the book or the touch when touching, for example, the edge of the paper with the hands and fingers, and the user cannot use the hands and fingers. I feel a sense of incongruity because I cannot feel the reaction force when I hold a book.

When turning pages of a book, the edge of the book sheet is recognized by the feel of a finger, and the sheet (page) is detected.
It is a natural movement to flip the pages by pinching and lifting them with your fingers, but since the conventional device does not give you the feel of the book with your hands or fingers, you can flip the pages of the book every time. It is necessary to pay attention to the edge of the paper of the book and to move the finger to the edge, and it takes time and time to turn the pages of the book.

[0005]

SUMMARY OF THE INVENTION It is an object of the present invention to enable easy and reliable mounting and dismounting and operation, and to present a tactile sensation or a force sensation to a finger according to a virtual space image. It is to provide a tactile / force sense presentation device and a tactile / force sense presentation system that can perform

[0006]

The above objects are achieved by the present invention described in (1) to (40) below.

(1) It has a glove-like wearing means to be worn from the finger to the arm, a position detecting means for detecting the position of the finger, and a tactile sense generating means for generating a tactile sensation given to the finger. A tactile / force sense presentation device characterized by being configured to present a tactile sense to a finger.

(2) The tactile sense / force sense presentation device according to the above (1), wherein the drive source of the tactile sense generating means is provided in a portion corresponding to the arm of the mounting means.

(3) The tactile / force sense presentation device according to (1) or (2), further including control means for controlling driving of the tactile sense generating means in accordance with the virtual space image.

(4) When the finger touches the object in the virtual space image, the control means controls the drive of the tactile sensation generating means so that a feeling corresponding to the touch is obtained on the finger pad. The tactile / force sense presentation device according to 3).

(5) The tactile sense / force sense presentation device according to any one of the above (1) to (4), wherein the tactile sense generating means has a plurality of unit tactile sense generating units having a pressing unit for pressing the finger pad.

(6) The tactile force sense presentation device according to (5), wherein the pressing portions are arranged in a matrix on the finger pad.

(7) The unit tactile sensation generating section has the drive mechanism for driving the pressing section. (5) or (6)
The haptic / force feedback device described in.

(8) In the drive mechanism, the pressing portion is fixed, and the linear member having flexibility is installed movably, and the moving means for moving the linear member in its longitudinal direction. When the linear body moves in a predetermined direction, the pressing unit is guided by the moving direction restricting unit and protrudes toward a finger pad, and the pressing unit has a moving direction restricting unit that restricts a moving direction of the pressing unit. The tactile sense / force sense presentation device according to (7), wherein the finger pad is pressed by the portion.

(9) The tactile sensation / force sense according to the above (8), which has an urging means for urging the linear body in a direction opposite to the moving direction of the linear body when the pressing portion is projected. Presentation device.

(10) The tactile / force sense according to any one of the above (5) to (9), wherein the pressing portion is configured to press the finger pad in a direction substantially perpendicular to the finger pad. Presentation device.

(11) The tactile / force sense presentation device according to any one of the above (1) to (10), which has a communication means for transmitting or receiving a signal.

(12) The tactile sense / force sense presentation device according to the above (11), wherein the tactile sense generating means is driven based on a signal transmitted from the communication means.

(13) The above-mentioned (1) to ((1) to () which have a force sense generating means for generating a force sense applied to the finger and are configured to present the force sense to the finger according to the virtual space image. The tactile / force sense presentation device according to any one of 12).

(14) Glove-like wearing means to be worn from the finger to the arm, position detecting means for detecting the position of the finger,
A tactile sense / force sense presentation device comprising: a force sense generating unit that generates a sense of force applied to a finger, and configured to present a sense of force to a finger according to a virtual space image.

(15) The above (1) having a control means for controlling the drive of the force sense generating means in accordance with the virtual space image.
3) or the tactile sense / force sense presentation device according to (14).

(16) The tactile sense / force sense presentation device according to any one of the above (13) to (15), wherein the force sense generating means has a link mechanism.

(17) The force-sense generating means has a link mechanism having a plurality of rotatably connected frames and a drive source for rotating each of the frames. The tactile / force sense presentation device according to any one of (13) to (15), which is configured to give a force sense to a finger joint.

(18) The force sense corresponds to the reaction force from the object in the virtual space image.
3) The tactile sense / force sense presentation device according to any one of 17).

(19) The tactile / force sense presentation device according to any one of (13) to (18), which has a communication means for transmitting or receiving a signal.

(20) The tactile sense / force sense presentation device according to (19), wherein the force sense generator is configured to be driven based on a signal transmitted from the communication unit.

(21) The mounting means has a play absorbing portion for suppressing play of a portion corresponding to a fingertip.
The tactile sense / force sense presentation device according to any one of (1) to (20).

(22) The tactile force sense presentation device according to (21), wherein the play absorbing portion is made of an elastic body.

(23) The play absorbing portion is provided in a portion corresponding to the vicinity of the wrist of the mounting means.
The tactile sense / force sense presentation device according to 1) or (22).

(24) The tactile / force feedback device according to any one of (1) to (23), wherein the mounting means has a wrist fixing portion for fixing the mounting means to a wrist.

(25) The tactile / force sense presentation device according to (24), wherein the wrist fixing is made of an elastic body.

(26) The mounting means has an arm fixing portion for fixing the mounting means to an arm.
The tactile sense / force sense presentation device according to any one of 5).

(27) The tactile / force sense presentation device according to (26), wherein the arm fixing portion is made of an elastic body.

(28) The arm fixing portion is fixed to the arm by air pressure generated by injecting air.
The haptic / force feedback device described in.

(29) The tactile / force feedback device according to any one of (1) to (28) above, wherein the mounting means has a twist absorbing portion that absorbs a twist of a portion corresponding to the arm.

(30) The twist absorbing portion is composed of at least one strip-shaped portion obtained by forming an opening in a part of a tubular portion that covers the arm of the mounting means.
The haptic / force feedback device described in.

(31) The tactile sense / force sense presentation device according to any one of the above (1) to (30), wherein the mounting means has an opening at a portion corresponding to a finger joint.

(32) The position detecting means is provided so as to maintain a constant positional relationship with respect to the part detected by the position detecting means.
The tactile / force sense presentation device according to any one of 1).

(33) A tactile / force sense presentation system comprising the tactile / force sense presentation device according to any one of (1) to (32) above.

(34) The tactile / force sense presentation system according to (33), which has an image creating means for creating a virtual space image.

(35) The tactile sense / force sense presentation system according to the above (34), wherein the image creating means is configured to update the virtual space image according to the movement of the finger.

(36) The above (34), which has a communication means for transmitting or receiving a signal to or from the image forming means.
Alternatively, the tactile sense / force sense presentation system according to (35).

(37) The tactile / force sense presentation system according to any one of (33) to (36), which has a display means for displaying a virtual space image.

(38) The tactile sense / force sense presentation system according to the above (37), wherein the display means is mounted on the face for use.

(39) The tactile / force sense presentation system according to the above (37) or (38), which has a communication means for transmitting or receiving a signal to or from the display means.

(40) Image creating means for creating a virtual space image, display means for displaying the virtual space image, control means for controlling driving of the tactile / force sense presenting device, the image creating means and the display means. The tactile sense / force sense presentation system according to (33) above.

[0047]

BEST MODE FOR CARRYING OUT THE INVENTION A tactile / force sense presenting apparatus and a tactile sense / force sense presenting system of the present invention will be described below in detail based on preferred embodiments shown in the accompanying drawings.

FIG. 1 is a conceptual diagram showing a first embodiment of a tactile / force sense presentation device of the present invention and a configuration example of a tactile / force sense presentation system having the tactile / force sense presentation device, and FIG. It is a block diagram which shows the circuit structural example of the real glove shown in FIG. FIG. 3 is an external view (partially omitted from illustration) showing an external configuration example of the real glove shown in FIG. 1.

As shown in FIG. 1, the haptic / force feedback system 1 is attached to the hand (fingers) of a user (user), and the tactile sensation (feeling of touching, for example, touching) of each of the attached hands and fingers. , A distribution of contact strengths such as texture, shape, and strength) and a pair of real gloves (data gloves) 20 and 20 for giving a sense of force (a sense of force applied when touched), and a virtual space image (virtual space image) Virtual space display device (display means) 5 for displaying
An information processing device 8 that performs various processes such as drive control of each real globe 20 and the virtual space display device 5; and a base station 9 that creates a virtual space image and provides various services using the virtual space image. It has and.

Each of the real globe 20, the virtual space display device 5, the information processing device 8 and the base station 9 has a wireless communication function (wireless communication means) capable of wirelessly transmitting and receiving signals (wireless communication). The information processing device 8 and the real globe 20, the virtual space display device 5, and the base station 9 can communicate with each other.

The tactile / force sense presentation system 1 generates a virtual space image created (generated) by the information processing device 8 based on the information supplied from the base station 9, the virtual space display device 5 and each real globe 20. Virtual space display device 5
When a hand or finger wearing the real glove 20 virtually touches an object displayed in the virtual space by operating the hand or finger wearing the real glove 20, the state is displayed on the virtual space display device 5. At the same time, each process for giving a tactile sensation or a force sensation upon contact to the hand or each finger wearing the real glove 20 is performed.

The information processing device 8 is, for example, a mobile phone terminal, a personal computer having a wireless communication function, or P
DA (Personal Digital Assist)
It is configured by various devices having a wireless communication function (communication means) and a control function (control means), such as portable information devices called "tants".

The base station 9 is composed of various devices such as an Internet server provided on the Internet for providing information on virtual space images.

In this embodiment, each real globe 20, the virtual space display device 5, the information processing device 8 and the base station 9 have a wireless communication function. However, for example, some or all of them are wired communication. It may be configured to perform.

The information processing device 8 may have some or all of the functions of the base station 9.

The real globe 20 may have some or all of the functions of the virtual space display device 5, the information processing device 8 and the base station 9.

Here, in the present embodiment, the tactile / force sense presentation device 2 is equipped with a pair of real gloves 20, 20, that is, the real glove 20 for the left hand worn on the left hand of the user, and the real glove 20 for the right hand of the user. It is configured with the right-handed real glove 20. In the following description, one of the real gloves 20 will be representatively described.

In the present invention, the tactile / force sense presentation device 2
May be configured with one of the real gloves 20.

Further, according to the present invention, the tactile / force sense presentation device 2
In addition to the real globe 20, the virtual space display device 5,
Any one of the information processing device 8 and the base station 9
It may have one, two, or all. In this case, the tactile sense / force sense presentation device 2 may have some or all of the functions thereof.

As shown in FIG. 2, the real gloves 20
Is the sense (eg, texture, shape, etc.) of a finger touching an object (object) appearing in the virtual space (on the virtual space image).
A tactile generation unit (tactile generation means) 21 for generating a distribution of contact strength such as strength) and a sense of the strength of force applied to a hand or finger when touching an object appearing in a virtual space. A force sense generating unit (force sense generating means) 22 for causing it and a position / orientation detecting unit for detecting the position of each part of the real glove 20 (the position of each part such as the hand, wrist, arm, finger, etc. wearing the real glove 20). 23, a control unit 24 that controls each unit of the real globe 20, a signal processing unit 25 that performs signal processing such as amplification of a signal to be transmitted to the information processing apparatus 8, and wireless communication between the information processing apparatus 8. Signal transmission / reception unit 2 for performing
6 and 6.

Further, as shown in FIG. 3, the overall shape of the real glove 20 is a substantially long glove shape (glove shape). That is, the real glove 20 is a glove-like wearing unit that is worn from the wearer's (finger) 's finger to the vicinity of the elbow of the arm (from finger to arm), and is a tubular portion 20a covering the arm.
Has a relatively long glove 2a.

The user can easily and surely wear and remove the real glove 20 with the gloves 2a.

Since the glove 2a is worn from the hand to the arm, the operation (operation) in the virtual space can be performed easily and reliably.

This glove 2a has a play absorbing portion 27 for suppressing or preventing play of a portion corresponding to a fingertip, a wrist fixing portion 28 for fixing to a wrist, and an arm fixing portion 2d for fixing to an arm.
And a twist absorbing portion 29 that absorbs the twist of the portion corresponding to the arm.

The play absorbing portion 27 is provided at a portion corresponding to the vicinity of the wrist of the glove 2a. This play absorbing part 27
Is formed of an elastic body such as various rubbers.

When the user wears the real glove 20, the restoring force (elastic force) of the play absorbing portion 27 causes the glove 2 to move.
“A” is pulled in the elbow direction (base end side) and held in that state. As a result, it is possible to prevent or suppress play at the fingertips.

Further, even when used by a plurality of users having different hand sizes such as finger lengths, the play absorbing portion 27 can prevent or suppress play at the fingertips. .

The wrist fixing part 28 is provided continuously to the play absorbing part 27 on the elbow side (base end side) of the play absorbing part 27 of the glove 2a. The wrist fixing portion 28 is formed of, for example, an elastic body such as various kinds of rubber.

When the user wears the real glove 20, the glove 2 is restored by the restoring force (elastic force) of the wrist fixing portion 28.
a is fixed to the wrist. Thereby, it is possible to prevent the real gloves 20 from being displaced during use.

By the wrist fixing portion 28 and the play absorbing portion 27, the bundle 212a of the actuator wires 212 of the tactile sense generating portion 21, which will be described later, has a predetermined length so that each actuator wire 212 can move in its longitudinal direction. Held in position.

The arm fixing portion 2d is the tubular portion 20a of the glove 2a.
It is provided at the end of the elbow side (base end side). The arm fixing portion 2d is formed of, for example, an elastic body such as various rubbers.

When the user wears the real glove 20, the restoring force (elastic force) of the arm fixing portion 2d causes the glove 2a to move.
Is fixed to the arm. Thereby, it is possible to prevent the real gloves 20 from being displaced during use.

The twist absorbing portion 29 is the tubular portion 2 of the glove 2a.
It is provided in the middle of 0a, that is, between the wrist fixing portion 28 and the arm fixing portion 2d.

The twist absorbing portion 29 is composed of three strip portions 291 obtained by forming three openings 292 in a part of the tubular portion 20a. Each strip-shaped portion 291 is formed of a stretchable member such as cloth made of a stretchable material.

When the user wears the real glove 20 and twists his wrist, for example, each strip 291 expands and contracts, thereby absorbing the twist of the tubular portion 20a.

As described above, the twist absorbing portion 29 can prevent the real glove 20 from being twisted, so that the user can easily and smoothly move his / her hand or arm.

The number of the strip-shaped portions 291 of the twist absorbing portion 29 may be two or less, or four or more.

Further, openings 21a are formed in the portions of the gloves 2a corresponding to the joints on the back side of the fingers.

Through these openings 21a, the user can easily and smoothly move each joint of each finger.

The real glove 20 has a portion corresponding to the arm of the glove 2a, which is the twist absorbing portion 2
The control unit 24 is provided at a portion located in the elbow direction with respect to 9;
A power supply unit 30, a power generation unit 211 and the like are provided.

By arranging the control section 24, the power supply section 30, and the power generation section 211 as described above, the weight of the fingertip side (tip side) of the real glove 20 can be reduced (inertia reduced). Therefore, the user can easily perform the operation (operation).

The main part of the tactile sense generator 21 is the first part of each finger of the user when the user wears the real glove 20.
It is provided at a position that covers the fingertip portion ahead of the joint (the joint between the distal phalanx and the middle phalanx). Since the configuration and operation of each tactile sense generating unit 21 are almost the same, one of them will be described representatively below.

FIG. 4 is a vertical sectional view showing an example of the structure of the tactile sense generating section 21. In order to avoid making the figure complicated,
In the drawing, the thickness of some members is omitted.

As shown in FIG. 4A, the tactile sense generating section 21 includes a power generating section (moving means) 211 having a motor (driving source) 211a, and an actuator wire (movable) which is movable in the longitudinal direction. Flexible linear body) 212
And a wire holding portion (biasing means) 213 that holds one end of the actuator wire 212, a tactile presentation pin (pressing portion) 214 that presses the finger pad to generate a tactile sense, and a tactile presentation pin 214 while supporting the tactile presentation pin 214. Tactile presentation pin 21
4 has a plurality of unit tactile sense generating units (actuators) 210 configured with tactile sense pin support units (moving direction regulating means) 215 that regulate the moving direction of the No. Each unit tactile sensation generator 210 is independent of each other.

The power generating section 211, the actuator wire 212, and the tactile sense presentation pin support section 215 constitute a drive mechanism for driving the tactile sense presentation pin 214.

The power generator 211 is, for example, the controller 24.
The motor 211a provided therein is rotationally driven in accordance with the control signal from, and the process of winding the actuator wire 212 by the rotational driving of the motor 211a (the process of moving the actuator wire 212 in the longitudinal direction of the actuator wire 212) is performed. The control unit 24 controls the power generation unit 211 according to an instruction from the information processing device 8 so that the motor 211a is rotationally driven with a predetermined torque for a predetermined time. The power generation unit 211 performs a process of winding the actuator wire 212 for a predetermined length by applying rotational power to the motor 211a according to an instruction from the information processing device 8.

As shown in FIG. 4A, the wire holding portion 213 holds one end (terminal end) of the actuator wire 212 in the vicinity of the first joint of the finger in this embodiment. The wire holding portion 213 is made of an elastic member (elastic body) such as rubber or spring.

Therefore, the motor 211 of the power generation unit 211
When the actuator wire 212 is wound by driving a, and the actuator wire 212 moves clockwise in FIG. 4 (A), the wire holding portion 21 is correspondingly moved.
3 expands, and the actuator wire 212 moves in the counterclockwise direction in FIG. 4A (movement of the actuator wire 212 when the tactile sense presenting pin 214 is projected) due to the restoring force (elastic force) of the wire holding portion 213. (Direction opposite to direction)
Be urged by. Then, the motor 21 of the power generation unit 211
When the driving of the actuator 1a is stopped and the winding state of the actuator wire 212 is released, the wire holding portion 213 contracts by the restoring force (elastic force), whereby the wound actuator wire 212 is pulled out, Figure 4
Move counterclockwise in (A).

The power generator 211 is located on the other end (starting end) side of the actuator wire 212.

The tactile sense presenting pin 214 is used for giving a touch sensation (presence or absence of contact, strength, etc.) to the finger pad of the user, and is a minute contact plate (contact portion) that is a portion that contacts the finger pad.
214a and a supporting portion 214b for supporting the contact plate 214a
Composed of and. The support portion 214b has one end fixed to the middle of the actuator wire 212 and the other end provided with a contact plate 214a.

In this embodiment, as shown in FIG. 4 (A), the glove 2a of the real glove 20 has a double mounting structure for mounting (covering) a fingertip (for example, two members such as cloth are superposed). A structure in which some member can be housed between the two stacked members), and one of the actuator wires 212 is placed inside the portion that covers the fingertip (inside the double structure). A wire holding portion 213, a support portion 214b, and a tactile sense pin support portion 215 for restricting movement of the tactile sense pin 214 in the movement direction of the actuator wire 212. Then, one end side of the support portion 214b projects and the contact plate 214a is positioned inside the glove 2a in which the fingers are stored.

In this embodiment, the contact plate 214a is
Is always in contact with the fingertips of the hand wearing the real glove 20. The contact plate 2 is not limited to this.
14a may be configured to be in a state of being separated from the fingertip (a state where the contact plate 214a and the fingertip are not in contact with each other).

In FIG. 4A, in order to simplify the explanation,
One unit tactile sense generation unit 210 (one tactile sense presentation pin 21
4) is shown as a representative, as described above, in reality, the tactile sense generating unit 21 includes a plurality of unit tactile sense generating units 210.
The plurality of tactile sense presenting pins 214 are provided at positions corresponding to the finger pad of the user's fingertip when the user wears the real glove 20, for example, along the finger pad and on the finger pad. They are arranged in a matrix.

Before and after each tactile presentation pin 214, a tactile presentation pin support portion 215 for restricting the movement of the support portion 214b of the tactile presentation pin 214 in the movement direction of the actuator wire 212 is provided.

The tactile sense presenting pins 214 may be regularly arranged or may be irregularly arranged.

Next, the tactile sense generating operation by the tactile sense generating section 21 will be described. When the user puts on the real glove 20 and moves his hand or finger, the fingertip (finger pad) virtually touches an object (virtual object) appearing in the virtual space, that is, an object, the information processing device 8 Calculates the pressing force when there is an actual contact, and converts it into PWM data (for example, data indicating an excitation pattern for rotating the motor 211a) based on the calculation result.

In this case, in the virtual space (three-dimensional space), X-axis, Y-axis and Z-axis which are orthogonal to each other are previously set.
That is, X-Y-Z coordinates (three-dimensional coordinates) are assumed, and a match between the coordinates of the object and the coordinates of the fingertip of the user is detected, and when the match is detected, the coordinates of the object are detected. It is determined that the corresponding part and the part corresponding to the coordinates of the fingertip of the user have come into contact with each other. The coordinates of the user's fingertip are derived based on a signal (information) transmitted from the position / orientation detection unit 23, which will be described later, to the information processing device 8 via the signal transmission / reception unit 26.

Next, the information processing device 8 determines the derived PW.
The M data and the data for specifying (designating) the power generation unit 211 that operates the contact plate 214a that applies the pressing force to the contact position when it is actually contacted are transmitted to the real glove 20. The real globe 20 has a power generation unit 21 designated according to the received PWM data.
1 to wind up the actuator wire 212.

When the actuator wire 212 is wound up, it is placed on the finger pad.
Moves along the finger pad toward the tip of the finger, as shown in FIG.
As shown in (B), the tactile sense presenting pin 214 fixedly attached to the actuator wire 212 also moves along the finger pad toward the tip direction of the finger.

At this time, as shown in FIG. 4C, the tactile sense presenting pin 214 is restricted by the tactile sense presenting pin support portion 215 from moving in the tip direction of the finger, and is guided by the tactile presenting pin support portion 215. Then, it moves to the upper side in FIG. 4C (projects toward the finger pad). That is, the contact plate 214a of the tactile sense providing pin 214 moves substantially vertically upward with respect to the surface of the finger pad. Support part 214 of tactile presentation pin 214
In the standby state (in the initial state), b is inclined from the vertical direction to the tip direction of the finger as shown in FIG. 4 (B), and the contact plate 214a acts so as to move almost vertically upward. As a result, the contact plate 214a presses the finger pad in a substantially vertical direction, thereby applying a pressing force to the finger pad of the user's hand.

This operation is performed by a plurality of unit tactile sense generators 210.
Of the designated unit tactile sensation generating unit 210, and the tactile sensation is presented (applied) to the finger pad of the user's hand. Therefore, the user can obtain, on the finger pad, a feeling corresponding to the contact of the finger pad with the object (object) in the virtual space image.

In the designated unit haptic generator 210, when the driving of the motor 211a of the power generator 211 is stopped and the winding state of the actuator wire 212 is released, the wire holding portion 213 restores the restoring force (elastic force). ), The actuator wire 212 that has been wound is pulled out.

When the actuator wire 212 is pulled out, it is placed on the finger pad.
Moves toward the base end direction of the finger (right side in FIG. 4C) along the finger pad, and the tactile sense providing pin 214 fixedly attached to the actuator wire 212 also moves to the base end of the finger along the finger pad. Moving in the direction, the tactile presentation pin 214 is shown in FIG.
It returns to the initial state shown in (B). As a result, the pressing force applied from the tactile sense providing pin 214 to the finger pad of the user's hand is substantially eliminated.

According to such a tactile sense generating section 21, the actuator wire 212 is arranged substantially parallel to the finger pad (along the finger pad).
Since the force is applied almost perpendicularly to the finger pad by winding, the mechanism for providing the tactile sensation can be made thin, which allows the real glove 20 to be used.
The thickness on the finger pad side of can be suppressed as much as possible.

Further, it is possible to prevent the slack of the actuator wire 212, and more accurately and surely apply a large target pressing force from the tactile sense providing pin 214 to the finger pad of the user.

FIG. 5 and FIG. 6 are external views showing an example of the structure of the force sense generator 22. Note that FIG. 5 shows a state in which the frame cover is removed.

As shown in FIG. 5, the force sense generator 22 is provided on the back side of each finger of the user when the real glove 20 is worn. Since the configuration and operation of the force sense generator 22 are almost the same, one of them will be representatively described below.

The force sense generator 22 includes a link mechanism having a plurality of (six in this embodiment) frames 221 that are rotatably connected, and a plurality (seven in this embodiment) that rotate each frame 221. Link motor (driving source) 222
And a plurality of gloves provided on the glove 2a (four in this embodiment)
Frame holder 2b.

When the user wears the real glove 20, the frame holder 2b has a mounting portion located on the tip side of the first joint of the user's finger, the first joint and the second joint (the middle phalanx and the proximal joint). (A joint between the bone) and a mounting portion located between the second joint and the third joint,
It is provided in each of the mounting portions located on the proximal end side of the third joint (the joint between the proximal phalanx and the metacarpal bone).

The link mechanism is attached to the back side of the user's finger of the glove 2a when the real glove 20 is worn by the frame holder 2b.

That is, when the user wears the real glove 20, the frame 221 on the tip side (right side in FIG. 5) of the link mechanism is located at the tip side of the first joint of the user's finger. The frame 221 is rotatably installed with respect to the frame holder 2b.

Further, the base end side of the link mechanism (left side in FIG. 5)
The frame 221 at the end of the
When the user wears 0, the user's finger is arranged such that its end portion is located at a portion closer to the base end side than the third joint, and the base end portion of this frame 221 is rotatable with respect to the frame holder 2b. It is installed in.

Further, each of the remaining frames 22 of the link mechanism is
1 is when the user wears the real glove 20,
A portion of the user's finger between the first joint and the second joint, and the second joint
A frame connecting portion is provided at a portion between the joint and the third joint.
It is arranged so as to be positioned every other turn, and is installed so as to be rotatable with respect to the frame holder 2b at every other frame connecting portion.

Driving force (rotational force) of each link motor 222
Are transmitted to the corresponding frames 221 via power transmission units (not shown). That is, when the link motor 222 is rotationally driven in the predetermined direction, the corresponding frame 221 is rotated in the predetermined direction, whereby the angle of the frame 221 is changed (adjusted).

Note that FIG. 5 shows the bundle 212a of the actuator wires 212 described above.

As shown in FIG. 6, each frame 221 and each link motor 222 of the force sense generator 22 are housed in a frame cover 2c made of cloth, for example.

Further, as shown in FIG. 6, inside the frame cover 2c, a plurality of (four in this embodiment) position / orientation detecting units (positions) for detecting the position and attitude of a predetermined part of a hand or a finger. The detection means) 23 is installed. Each of the position / orientation detection units 23 is provided so as to be able to maintain a fixed positional relationship with respect to a portion (detection position) for detecting the position and orientation.

That is, each position / orientation detector 23 is attached and fixed to each link motor 222 fixed to the position where the frame holder 2b is provided in this embodiment. Therefore, the positional relationship between the part where each position / orientation detection unit 23 is provided and the predetermined part on the palm side of the user is kept constant. Therefore, the position and orientation detection unit 23 can easily and accurately derive the position and orientation of a predetermined part on the palm side of the user by detecting the position and orientation of the user.

Further, since each position / orientation detecting section 23 is arranged on the back side of the hand, the real glove 2
The thickness on the finger pad side of 0 can be suppressed as much as possible.

Further, as shown in FIG. 3, the position / orientation detecting unit 23, when the user wears the real glove 20,
It is also installed at a position corresponding to the base end side portion of the arm of the real glove 20.

With the position / orientation detecting unit 23, the position and orientation of each part such as each finger, hand, wrist, arm, etc. wearing the real glove 20 can be surely grasped.

Next, the force sense generating operation of the force sense generating section 22 will be described. When the user wears the real glove 20 and moves his or her hand or finger, the hand or finger virtually touches an object (virtual object) appearing in the virtual space, that is, an object. , The reaction force from the object to the finger (each joint of the finger) when there is an actual contact is calculated, and each link motor 22 is calculated based on the calculation result.
2 PWM data (for example, data indicating an excitation pattern for rotating the link motor 222).

The determination of contact between the object and the user's hand or finger is the same as in the case of the tactile sense generating section 21.

The information processing device 8 transmits the derived PWM data and the data indicating each link motor 222 to be driven to the real globe 20. Real glove 20
Adjusts the angle of each frame 221 by rotating the designated link motor 222 in a predetermined direction and rotating the corresponding frame 221 in a predetermined direction in accordance with the received data. Frames 22 on both ends
The angle of 1 and the angle of each frame connection part are adjusted.

By adjusting the angle of the frame 221, a predetermined amount of force is applied to each predetermined frame holder 2b, whereby a force corresponding to the reaction force from the object appearing in the virtual space is applied by the user. Given to each joint of the finger. That is, a force sensation is presented (applied) to each joint of the finger.

Here, the force generating section 22 has a function of adjusting the intervals between the plurality of mounting sections to be mounted on a plurality of parts of the finger (also serves as adjusting means).

For example, as shown in FIG. 5, by rotating a predetermined frame 221 and adjusting the angle of the frame 221, the intervals between the frame holders 2b can be lengthened or shortened. You can

FIG. 7 is a block diagram showing a configuration example of the position / orientation detection unit 23. In this embodiment, a quadrature coil type (orthogonal coil type) position sensor is used for the position / orientation detection unit 23. That is, the position / orientation detection unit 23 operates as shown in FIG.
As shown in FIG. 5, it is composed of an X-direction detection coil 231, a Y-direction detection coil 232, and a Z-direction detection coil 233. The X direction, the Y direction, and the Z direction are orthogonal to each other.

On the other hand, the information processing device 8 is provided with a magnetic field generator (not shown) for generating a magnetic field. The magnetic field generating unit has, for example, a configuration substantially the same as that of the position / orientation detecting unit 23, that is, an orthogonal coil type (orthogonal coil type)
Magnetic field generators (X-direction coil, Y-direction coil, Z-direction coil) are used.

The magnetic field generated by the magnetic field generator is detected by the position / orientation detector 23. In this case, from the X-direction coil, the Y-direction coil and the Z-direction coil of the magnetic field generation unit,
A magnetic field is generated, and each of them generates an X-direction detection coil 231, a Y-direction detection coil 232, and a Z-direction detection coil of the position / orientation detection unit 23.
Three coils of the direction detection coil 233 are used for detection.

Each signal (detection data) detected by the position / orientation detection unit 23 in each of the XYZ directions is amplified by the amplification unit 251 of the signal processing unit 25, and A /
After being converted into a digital signal by the D conversion unit 252, FIG.
Is output to the signal transmitting / receiving unit 26, and is transmitted to the information processing device 8 by the signal transmitting / receiving unit 26.

The information processing device 8 receives the signal,
Based on the signal (information), the position and posture of each part such as each finger, hand, wrist, and arm wearing the real glove 20 is derived, and the information is used in each predetermined process.

In this embodiment, the virtual space display device 5 is of a form to be mounted on the face for use, that is, H
A spectacle-shaped device called MD (head mounted display) is used.

FIG. 8 is a perspective view showing an external configuration example of the virtual space display device 5, and FIG. 9 is a block diagram showing a circuit configuration example of the virtual space display device 5.

The virtual space display device 5 is a wearer (user).
The image display portions 51a, 5a for displaying the virtual space image with respect to
1b and line-of-sight detection units 52a, 5 for detecting the line of sight of the wearer
2b and the concave / convex input unit 53 that captures the surrounding image (video)
a and 53b, a control unit 54 that controls the entire apparatus, a signal transmission / reception unit 55, and a position / orientation detection unit (position detection means) 5
6, a mounting unit 57, and a signal processing unit 58.

FIG. 10 is a diagram (block diagram, schematic diagram) showing a configuration example of the unevenness input unit 53a of the virtual space display device 5. As shown in FIG.

The concave / convex input section 53a includes a lens 531 and a C
CD (imaging device) 532, CCD control unit 533, C
It has a CD output amplifier 534.

The light (light flux) incident on the lens 531 is guided by the lens 531 onto the light receiving surface (imaging surface) of the CCD 532 to form an image, and the subject image (surrounding image).
Are imaged by the CCD 532. This CCD532
The drive of is controlled by the CCD control unit 533.

The signal output from the CCD 532 is CC
It is amplified by the D output amplifying section 534, and then the unevenness input section 5
3a is output, is input to the signal processing unit 58 shown in FIG. 9, undergoes predetermined signal processing, and is transmitted to the information processing device 8 by the signal transmitting / receiving unit 55.

The structure and operation of the concave / convex input section 53b are the same as those of the concave / convex input section 53a, and therefore the description thereof will be omitted.

FIG. 11 is a diagram (block diagram, schematic diagram) showing a configuration example of the image display section 51a of the virtual space display device 5. As shown in FIG.

The image display section 51a includes a lens 511, a lens moving mechanism 512 for moving the lens 511, a stepping motor 513, a motor control section 514, and a liquid crystal display panel 515 having a color filter (not shown).
The liquid crystal drive unit 516, the backlight 517, the backlight control unit 518, and the transistor 519.

When the virtual space image is displayed on the image display section 51a, the transistor 519 is turned on by the control of the backlight control section 518 to turn on the backlight 517.
Is driven, and the backlight 517 drives the liquid crystal display panel 51.
5 is irradiated with light.

Then, the liquid crystal drive section 516 controls the drive of the liquid crystal display panel 515 based on the display signal (image data), whereby the virtual space image is displayed on the liquid crystal display panel 515.

The wearer can visually recognize the virtual space image displayed on the liquid crystal display panel 515 through the lens 511 and the half mirror 521 of the line-of-sight detecting unit 52a described later.

The driving of the stepping motor 513 is controlled by the motor control section 514. When the stepping motor 513 rotates in a predetermined direction, the lens moving mechanism 51 is moved.
2, the lens 511 moves in a direction approaching the liquid crystal display panel 515, that is, a direction away from the wearer's eyes.

When the stepping motor 513 rotates in the opposite direction to the above, the lens moving mechanism 512 moves the lens 511 away from the liquid crystal display panel 515, that is, toward the wearer's eyes.

By changing the position of the lens 511, the perspective of the virtual space image can be changed.

The adjustment of the position of the lens 511, that is, the adjustment of the perspective of the virtual space image is performed based on the information on the line of sight of the wearer detected by the line-of-sight detection units 52a and 52b described later.

Since the structure and operation of the image display section 51b are the same as those of the image display section 51a, the description thereof will be omitted.

The line-of-sight detection units 52a and 52b have a function of detecting in which direction the line of sight of the wearer is (where in the virtual space image the focus is intended), and the wearer's line of sight for use as security information. It has the function of reading the iris pattern of the eye.

FIG. 12 is a diagram (block diagram, schematic diagram) showing a configuration example of the line-of-sight detection unit 52a of the virtual space display device 5.

The line-of-sight detection unit 52a includes a half mirror 521.
And a filter 52 for removing visible light and transmitting infrared light.
2, a lens 523, a CCD (imaging device) 524,
CCD control unit 525, CCD output amplification unit 526, LED (light emitting diode) 527 that emits infrared light, LE
It has a D control unit 528 and a transistor 529.

The LED 527 is driven by the LED control unit 52.
When the transistor 529 is turned on under the control of the LED control unit 528, the LED 527 is driven and infrared light is emitted from the LED 527.

The infrared light emitted from the LED 527 is transmitted through the filter 522, a part of which is reflected by the half mirror 521, and is radiated to the eyes of the wearer.

Then, the reflected light (light flux) from the wearer's eyes
Is partially reflected by the half mirror 521 and transmitted through the filter 522, and the lens 523 causes the CCD 524 to pass through.
The image of the subject (the image of the wearer's eyes) is guided and formed on the light receiving surface (image pickup surface) of the CCD 524. The driving of the CCD 524 is controlled by the CCD controller 525.

The signal output from the CCD 524 is CC
It is amplified by the D output amplification unit 526, and then the line-of-sight detection unit 5
It is output from 2a, is input to the signal processing unit 58 shown in FIG. 9, is subjected to predetermined signal processing, and is transmitted to the information processing device 8 by the signal transmitting / receiving unit 55.

The information processing device 8 receives the signal,
Based on the signal (information), it detects which direction the wearer's line of sight is (where in the virtual space image the focus is) and reads and analyzes the iris pattern of the wearer's eye. Use as security information.

On the other hand, from the lens 523 side to the filter 522
The visible light incident on the filter 522 is removed by the filter 522, and the visible light can be prevented from being emitted to the eyes of the wearer. As a result, it is possible to prevent the visibility of the virtual space image displayed on the liquid crystal display panel 515 from being degraded.

Since the structure and operation of the line-of-sight detection unit 52b are the same as those of the line-of-sight detection unit 52a, description thereof will be omitted.

The virtual space display device 5 includes two image capturing devices (imaging means), that is, the unevenness input section 53.
The surrounding image is captured and captured by a and 53b, and the captured image data (video data) is transmitted to the information processing device 8.

The information processing device 8 includes the concave / convex input portions 53a, 5
The visual angle difference is derived from the image captured in 3b, that is, the captured image data, and the virtual space image, that is, the image data of the virtual space is created based on the peripheral irregularities obtained from the visual angle difference and the like. Then, the information processing device 8
A combined image (image) of the created virtual space and an image for arranging a predetermined virtual object such as a virtual wallpaper, a virtual personal computer, or a virtual book in the virtual space according to the surrounding irregularities ( Image data (video data) indicating a composite video) is transmitted to the virtual space display device 5.

The virtual space display device 5 displays the image based on the image data from the information processing device 8 in the image display section 5.
Display using 1a and 51b.

In addition, the virtual space display device 5 operates when the worn real glove 20, that is, the hand or arm of the user is within the area of the image displayed by the image display portions 51a and 51b. The images corresponding to the hands and arms are also displayed on the image display units 51a and 51b.

In this case, as described above, the detection data of the plurality of position / orientation detection units 23 provided in the real glove 20 are transmitted to the information processing device 8, whereby the position and the posture of the real glove 20, that is, the real glove 20. The user's fingers, hands, wrists, arms, etc. are recognized by the information processing device 8.
That is, the information processing device 8 is step by step in the real globe 2
Based on the detection data from 0, each finger of the user,
Positions and postures of hands, wrists, arms, etc. are specified, and when they are within the area of the image displayed by the image display units 51a and 51b, a virtual space image showing them is created, and The image is combined with the basic image to obtain a combined image (image data of the combined image), and the image data is transmitted to the virtual space display device 5.

Therefore, the user's hand or arm is displayed on the image display unit 51.
When it is within the area of the image displayed by a and 51b, the image corresponding to the hand or arm is displayed on the image display units 51a and 51b.

Then, in synchronization with the actual movement of the hand or finger wearing the real glove 20, the image display portions 51a and 51b are linked.
The hands and fingers move in the virtual space image displayed in.

The position / orientation detector 56 determines the position and orientation of the virtual space display device 5, that is, the face (head) of the wearer.
Is a sensor for detecting the position and orientation of the. In this embodiment, a quadrature coil type position sensor, that is, the same as the position / orientation detecting unit 23 is used as the position / orientation detecting unit 56.

The signal (detection data) from the position / orientation detection unit 56 is input to the signal processing unit 58, subjected to predetermined signal processing, and transmitted to the information processing device 8 one by one by the signal transmission / reception unit 55. The information processing device 8 updates each virtual space image based on this detection data.

Therefore, for example, when the user wearing the virtual space display device 5 moves his / her neck, the image display unit 51
The virtual space images displayed on a and 51b change so as to be an image that matches the direction in which the user is facing.

Next, the operation (action) of the tactile / force sense presentation system 1 will be described. Here, a case where the user operates the virtual personal computer appearing in the virtual space by using the tactile / force sense presentation system 1 will be described as an example.

The user turns on the power of each unit, puts on the real gloves 20 in both hands, and puts on the virtual space display device 5 in the form of glasses (worn on the face). Then, the virtual space image including the virtual personal computer is displayed on the image display units 51a and 51b of the virtual space display device 5.

Also, the user's arm is placed in the image display portions 51a, 5a, 5b.
If it is made to enter the virtual space image displayed in 1b, the image of the hand or arm created by the information processing device 8 is displayed in the virtual space image as a virtual object. Then, when the user moves the hand or finger, the displayed hand or finger moves in the virtual space image in conjunction with the actual movement of the hand or finger.

The information processing device 8 confirms that the object in the virtual space image, that is, in the present embodiment, for example, part of the virtual personal computer (for example, keyboard) and part of the user's finger have the same coordinates. When it is detected, the real glove 20 is instructed to generate a sense of touch and a force. Specifically, real gloves 20
For the power generator 211 to be driven, PWM data used for driving the power generator 211, and the link motor 22 to be driven.
2 and PWM data used for driving the same are transmitted.

According to the instruction from the information processing device 8, the real globe 20 causes each designated motion generating section 211 to
PW for each specified torque and specified time
It is driven by M control. As a result, the contact plate 214a of each tactile sense providing pin 214, which is arranged at the same coordinate as a part of the virtual personal computer, projects,
A tactile sensation is given to each fingertip of the user having the same coordinates as a part of the virtual personal computer. That is,
Each fingertip is given a feeling of touch, texture, shape, strength, and the like.

At the same time, the real globe 20 drives each designated link motor 222 by PWM control for a designated time with a designated torque in accordance with an instruction from the information processing device 8. As a result, the force applied to each joint of each finger when touching a keyboard of an existing personal computer, that is,
A force corresponding to the pressing force (reaction force) applied to each joint of each finger is applied to each joint of each finger of the user.

When the user further moves the finger in the direction of pressing the key of the virtual personal computer, a virtual space image showing how the key is pressed is displayed on the image display portions 51a and 51b in accordance with the coordinate change of the finger. To be done.

In this case, the information processing device 8 generates the image data of the virtual space image for reproducing the change of the display state based on the pressed key in the virtual space image, and transmits it to the virtual space display device 5. The virtual space display device 5
Displays an image displayed on the display of the virtual personal computer based on the image data of the virtual space image from the information processing device 8 in which the key press is reflected.

As described above, according to the tactile / force sense presenting device 2 and the tactile sense / force sense presenting system 1, the real glove 20 can be easily and surely attached and detached, and the virtual space can be removed. Operation (operation)
Can be performed easily and reliably.

Further, the force sense and the tactile sense can be presented to each finger accurately and reliably according to the virtual space image.

As a result, the user can comfortably, easily and surely perform the operation (operation) in the virtual space.

Particularly, in the tactile sense generating section 21, it is possible to prevent the actuator wire 212 from slackening, and to apply a target large pressing force from each tactile sense presenting pin 214 to each finger pad of the user more accurately and surely. Can be given.

Thus, the user can more accurately and surely feel the sensation corresponding to the contact of each finger pad with the object (object) in the virtual space image.

Further, in the tactile sense generating section 21, the actuator wires 2 are arranged substantially parallel to the finger pads (along the finger pads).
12 is arranged, and by winding up its actuator wire 212, a force almost perpendicular to each finger pad is applied, so that the mechanism for giving a tactile sensation can be made thin, which makes it possible to realize a realistic structure. The thickness of the glove 20 on the finger pad side can be suppressed as much as possible.

Further, since the force sense generating section 22 has the link mechanism, it can cope with both the state where the finger is extended and the state where the finger is bent, and thereby, more reliably. Force can be given to each finger.

In the above-described embodiment, the case where the personal computer displayed in the virtual space image is virtually operated has been described as an example of use. However, the present invention is not limited to this and, for example, a virtual book is used. It can also be used to handle other items such as. When handling a virtual book, for example, when touching the edges of a virtual book or turning a page, feel the touch or force applied to a finger when touching the edge of a real book or turning a page. You can

Further, in the present invention, the virtual space image may not be displayed. That is, there may be predetermined data corresponding to the virtual space image, and a tactile sensation or a force sensation may be presented to the finger based on the data.

Next, a second embodiment of the tactile / force sense presentation device and the tactile / force sense presentation system of the present invention will be described.

FIG. 13 is a vertical cross-sectional view showing an example of the structure of the tactile sense generating unit of the tactile sense / force sense presentation device of the second embodiment.

Hereinafter, the tactile force / force sense presentation device 2 and the tactile force sense system 1 according to the second embodiment will be described focusing on the differences from the first embodiment described above, and the same matters will be described. The description is omitted.

As shown in FIG. 13A, in the haptic / force sense presentation device 2 of the second embodiment, each unit haptic generator (actuator) 210 of the haptic generator 21 has a motor (driving source). ) 211 a including a power generating unit (moving means) 211 and an actuator wire (flexible linear body) 212 movably installed in the longitudinal direction.
And a tactile sense presentation unit 216 that presses the finger pad to generate a tactile sense.

The tactile sense presentation unit 216 is used to give a touch sensation (presence or absence of contact, strength, etc.) to the finger pad of the user.
For example, it is formed of an elastic member (elastic body) such as a leaf spring. In this case, the tactile sense presentation unit 216 preferably has appropriate rigidity, and can be formed of, for example, an elastic body made of various metals.

The tactile sense providing section 216 includes a first plate piece (pressing section) 216a and a second plate piece (slide section) 216b.
It consists of and. The first plate piece 216a and the second plate piece 216b are joined at one end side, and the other end side of the first plate piece 216a has a minute contact portion 216c that is a portion that comes into contact with the finger pad. Is provided. This contact part 2
16c can be formed, for example, by bending the end portion of the first plate piece 216a toward the second plate piece 216b side.

Further, the one end side of the tactile sense presentation unit 216, that is, the left end portion in FIG. 13A is curved so as to be convex downward in FIG. 13A.

The first plate piece 216a and the second plate piece 216
A columnar guide part (moving direction restricting means) 217 for restricting the moving direction of the first plate piece 216a is installed between it and b.

A holding plate 218 is installed on the lower side of the tactile sense providing unit 216 in FIG. 13 (A), and the tactile sense presenting unit 216 moves (slides) along the holding plate 218.
Is ready to go. In this case, the tactile sense presentation unit 216
13 has a curved left end in FIG. 13 (A), it can move smoothly and reliably.

The guide portion 217 is fixed to the holding plate 218, and the holding plate 218 is fixed to the glove 2a.
That is, both the guide portion 217 and the pressing plate 218 are fixedly installed on the glove 2a.

Further, the second plate piece 21 of the tactile sense providing section 216.
One end of the actuator wire 212 is fixed to the end portion of 6b on the right side in FIG. 13 (A).

When the actuator wire 212 is wound up by driving the motor 211a of the power generation unit 211,
The actuator wire 212 is shown in FIG.
13A, the tactile sense providing section 216 attached and fixed to the actuator wire 212 also moves to the right side in FIG. 13A along the finger pad.

At this time, as shown in FIG. 13B, the first plate piece 216a of the tactile sense presentation section 216 has the guide section 217.
13B, the movement to the right side in FIG. 13B is restricted, and the guide portion 217 guides the movement to the upper side in FIG. 13B (projects toward the finger pad). That is,
The tactile sense providing portion 216 is elastically deformed, and the first plate piece 216 thereof is
When the posture of a is changed to the posture shown in FIG. 13B, the contact portion 216c moves (is pushed up) almost vertically upward with respect to the surface of the finger pad.

On the other hand, the actuator wire 212 is moved by the restoring force (elastic force) of the tactile sense presenting section 216 as shown in FIG.
(B) It is urged toward the middle left side (the direction opposite to the moving direction of the actuator wire 212 when the first plate piece 216a is projected). That is, the tactile sense presentation section 216 (first plate piece 216a) also serves as the urging means.

The contact portion 216c presses the finger pad in a substantially vertical direction due to the force exerted to move the contact portion 216c substantially vertically upward, thereby applying a pressing force to the finger pad of the user's hand. give.

This operation is performed by the plurality of unit tactile sense generating units 210.
Of the designated unit tactile sensation generating unit 210, and the tactile sensation is presented (applied) to the finger pad of the user's hand. Therefore, the user can obtain, on the finger pad, a feeling corresponding to the contact of the finger pad with the object (object) in the virtual space image.

In the designated unit tactile sense generator 210, when the driving of the motor 211a of the power generator 211 is stopped and the winding state of the actuator wire 212 is released, the restoring force (elastic force) of the tactile sense presenter 216 is restored. ) And the pressure from the user's finger, the tactile sense presentation unit 216 returns to the initial state shown in FIG. As a result, the pressing force applied from the tactile sense presentation unit 216 to the finger pad of the user is substantially eliminated.

According to the tactile / force sense presenting device 2 and the tactile sense / force sense presenting system 1, the same effects as those of the first embodiment described above can be obtained.

Next, a third embodiment of the tactile / force sense presentation device and the tactile / force sense presentation system of the present invention will be described.

FIG. 14 is an external view (partially omitted from illustration) showing an external configuration example of a real glove of the tactile / force sense presentation device of the third embodiment. In addition, in FIG. 14, the tactile sense generating unit 21, the power generating unit 211, the force sense generating unit 22 shown in FIG.
Position / orientation detection unit 23, control unit 24, and power supply unit 30
Etc. are not shown.

Hereinafter, the tactile / force sense presentation device 2 and the tactile sense / force sense system 1 of the third embodiment will be described focusing on the differences from the first embodiment described above, and the same matters will be described. The description is omitted.

As shown in FIG. 14, in the tactile / force sense presentation device 2 of the third embodiment, the glove 2a of the real glove 20 is used.
An arm fixing portion 2d having a form (air injection method) of fixing to the arm by air pressure (pressure) by injecting air (air) is provided at an end portion of the tubular portion 20a on the elbow side (base end side). .

The arm fixing portion 2d is composed of a bag-shaped arm fixing portion main body 21d into which air is injected and an air injecting portion 22d provided in the arm fixing portion main body 21d. The outer shape of the arm fixing portion main body 21d is tubular.

The hollow portion of the air injecting portion 22d communicates with the inside of the arm fixing portion main body 21d.
A lid 23d is provided at the tip of the.

When the lid 23d is attached to the tip of the air injecting portion 22d, the airtightness inside the arm fixing portion main body 21d is maintained, and when the lid 23d is removed, the air injecting portion 22d is released from the arm fixing portion main body 21d. Air can be injected and exhausted via.

The arm fixing portion 2d as described above is molded to fit the shape of the user's arm by using a mold such as a rubber mold according to each user.

When wearing the real glove 20, the user first wears the glove 2a and then the arm fixing portion 2
Air is injected into the arm fixing portion main body 21d of d.

In this air injection, for example, the lid 23d is removed from the tip of the air injection part 22d, and air is blown into the arm fixing part main body 21d from the air injection part 22d. Then, after injecting a predetermined amount of air, the lid 23d is attached to the tip of the air injecting portion 22d.

In this way, the real glove 20 is
The air is fixed to the user's arm by the air pressure of the arm fixing portion 2d, and is also fixed to the user's wrist by the restoring force (elastic force) of the wrist fixing portion 28.

When the user removes the real glove 20, first, the arm fixing portion main body 21d of the arm fixing portion 2d.
Evacuate the air from inside and then remove the real glove 20 from your hand.

According to the tactile / force sense presenting device 2 and the tactile sense / force sense presenting system 1, the same effects as those of the above-described first embodiment can be obtained.

Then, in this tactile / force sense presentation device 2,
Since the arm fixing portion 2d is of the air injection type, the real gloves 20 can be easily and quickly attached and detached.

In the present invention, the unit tactile-sense generating section 210 of the tactile-sense generating section 21 may be configured as in the second embodiment described above.

Although the haptic / force sense presentation device and the haptic / force sense presentation system of the present invention have been described above based on the illustrated embodiment, the present invention is not limited to this.
The configuration of each unit can be replaced with an arbitrary configuration having the same function.

Further, in the present invention, any two or more configurations (features) of the above-mentioned respective embodiments may be appropriately combined.

[0223]

As described above, according to the present invention,
According to the virtual space image (virtual space image), it is possible to accurately and surely present a tactile sensation or a force sensation to the finger.

Thus, the user (user) can comfortably, easily and surely perform the operation (operation) in the virtual space.
It can be carried out.

In particular, since the present invention has the glove-like wearing means to be worn from the finger to the arm, the user can easily and surely carry out the wearing and removing and the operation.

[Brief description of drawings]

FIG. 1 is a conceptual diagram showing a configuration example of a first embodiment of a tactile / force sense presentation device of the present invention and a tactile / force sense presentation system having the tactile / force sense presentation device.

FIG. 2 is a block diagram showing a circuit configuration example of the real glove shown in FIG.

FIG. 3 is an external view (partially omitted from illustration) showing an external configuration example of the real glove shown in FIG. 1.

FIG. 4 is a vertical cross-sectional view showing a configuration example of a tactile sense generating unit of the real glove shown in FIG.

5 is an external view showing a configuration example of a force sense generation unit of the real glove shown in FIG.

6 is an external view showing a configuration example of a force sense generation unit of the real glove shown in FIG.

7 is a block diagram showing a configuration example of a position / orientation detection unit of the real glove shown in FIG.

8 is a perspective view showing an example of an external configuration of the virtual space display device shown in FIG.

9 is a block diagram showing a circuit configuration example of the virtual space display device shown in FIG. 1. FIG.

10 is a diagram (block diagram, schematic diagram) showing a configuration example of an unevenness input unit of the virtual space display device shown in FIG. 1. FIG.

11 is a diagram (block diagram, schematic diagram) showing a configuration example of an image display unit of the virtual space display device shown in FIG. 1. FIG.

12 is a diagram (block diagram, schematic diagram) showing a configuration example of a line-of-sight detection unit of the virtual space display device shown in FIG. 1. FIG.

FIG. 13 is a vertical cross-sectional view showing a configuration example of a tactile sense generating unit of the tactile sense / force sense presentation device of the second embodiment.

FIG. 14 is an external view (partially omitted from the drawing) showing an external configuration example of a real glove of the tactile / force sense presentation device according to the third embodiment.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Tactile / force sense presentation system, 2 ... Tactile / force sense presentation device, 20 ... Real gloves, 2a ... Gloves, 20a ... Cylindrical part, 21a ... Opening, 2b・ ・
・ Frame holder, 2c ・ ・ ・ Frame cover, 2d ・
..Arm fixing part, 21d ... Arm fixing part body, 22d ...
-Air injection section, 23d ... Lid, 21 ... Tactile generation section, 210 ... Unit tactile generation section, 211 ... Power generation section, 211a ... Motor, 212 ... Actuator wire, 212a ... Bundle, 213 ... Wire holding part, 214 ... Tactile presentation pin, 214a ... Contact plate, 214b ... Support part, 215 ... Tactile presentation pin support part, 216 ... Tactile sense presenting section 216a ... first plate piece, 216b ... second plate piece, 216c ...
Contact part, 217 ... Guide part, 218 ... Holding plate,
22 ... Force sense generating unit, 221 ... Frame, 222
... Link motor, 23 ... Position / orientation detection unit, 23
DESCRIPTION OF SYMBOLS 1 ... X-direction detection coil, 232 ... Y-direction detection coil, 233 ... Z-direction detection coil, 24 ... Control part, 25 ... Signal processing part, 251 ... Amplification part, 25
2 ... A / D converter, 26 ... Signal transmitter / receiver, 27
... Play absorbing part, 28 ... Wrist fixing part, 29 ...
Twist absorption part, 291 ... band-shaped part, 292 ... aperture, 30 ... power supply part, 5 ... virtual space display device, 51a, 51b ... image display part, 511 ... lens, 512 ... Lens moving mechanism, 513 ... Stepping motor, 514 ... Motor control unit, 515 ...
..Liquid crystal display panel, 516 ... Liquid crystal drive unit, 517
... Backlight, 518 ... Backlight control unit, 519 ... Transistor, 52a, 52b ...
Line-of-sight detection unit, 521 ... Half mirror, 522 ...
Filter, 523 ... Lens, 524 ... CCD,
525 ... CCD control unit, 526 ... CCD output amplification unit, 527 ... LED, 528 ... LED control unit, 529 ... Transistor, 53a, 53b ...
Concavo-convex input section, 531 ... Lens, 532 ... CC
D: 533 ... CCD control unit, 534 ... CCD output amplification unit, 54 ... control unit, 55 ... signal transmission / reception unit, 56 ... position / orientation detection unit, 57 ... mounting unit, 5
8 ... Signal processing unit, 8 ... Information processing device, 9 ...
base station

Claims (40)

[Claims] 1. A glove-like wearing means to be worn from a finger to an arm, a position detecting means for detecting a position of the finger, and a tactile sense generating means for generating a tactile sensation given to the finger, according to a virtual space image. , A tactile / force sense presentation device characterized by being configured to present a tactile sense to a finger. 2. The tactile / force sense presentation device according to claim 1, wherein the drive source of the tactile sense generating means is provided in a portion corresponding to the arm of the mounting means. 3. The tactile sense / force sense presentation device according to claim 1, further comprising a control unit that controls driving of the tactile sense generating unit according to the virtual space image. 4. The control means controls the drive of the tactile sensation generating means such that when a finger touches an object in the virtual space image, a sense corresponding to the touch is obtained on the finger pad. The haptic / force feedback device described in. 5. The tactile sense / force sense presentation device according to claim 1, wherein the tactile sense generating unit has a plurality of unit tactile sense generating units including a pressing unit that presses a finger pad. 6. The tactile sense / force sense presentation device according to claim 5, wherein the pressing portions are arranged in a matrix with respect to a finger pad. 7. The tactile sense / force sense presentation device according to claim 5, wherein the unit tactile sense generating unit has a drive mechanism that drives the pressing unit. 8. The driving mechanism comprises a flexible linear body to which the pressing portion is fixed and is movably installed, a moving unit for moving the linear body in a longitudinal direction thereof, and the pressing unit. When the linear body moves in a predetermined direction, the pressing section is guided by the moving direction restricting section and protrudes toward the finger pad, and the pressing section is provided. The tactile / force sense presentation device according to claim 7, wherein the finger pad is pressed by the touch panel. 9. The tactile / force feedback device according to claim 8, further comprising a biasing unit that biases the linear body in a direction opposite to a moving direction of the linear body when the pressing portion is projected. . 10. The tactile / force sense presentation device according to claim 5, wherein the pressing portion is configured to press the finger pad in a direction substantially perpendicular to the finger pad. 11. The tactile sensation according to claim 1, further comprising communication means for transmitting or receiving a signal.
Force display device. 12. The tactile sense / force sense presentation device according to claim 11, wherein the tactile sense generating unit is configured to be driven based on a signal transmitted from the communication unit. 13. A haptic generator for generating a haptic force applied to a finger, which is configured to present a haptic force to a finger according to the virtual space image. A tactile / force sense presentation device described in Crab. 14. A virtual space image having a glove-like wearing means to be worn from a finger to an arm, a position detecting means for detecting the position of the finger, and a force sense generating means for generating a force sense applied to the finger. Accordingly, a tactile / force sense presentation device characterized by being configured to present force sense to a finger. 15. The tactile / force sense presentation device according to claim 13 or 14, further comprising control means for controlling driving of the force sense generation means in accordance with a virtual space image. 16. The tactile sense / force sense presentation device according to claim 13, wherein the force sense generating means has a link mechanism. 17. The force-sense generating means includes a link mechanism including a plurality of frames rotatably connected to each other, and a drive source for rotating each of the frames. The tactile sense / force sense presentation device according to any one of claims 13 to 15, wherein the tactile sense / force sense presentation device is configured to give force sense to a finger joint. 18. The tactile / force sense presentation device according to claim 13, wherein the force sense corresponds to a reaction force from an object in the virtual space image. 19. The tactile / force sense presentation device according to claim 13, further comprising communication means for transmitting or receiving a signal. 20. The tactile sense / force sense presentation device according to claim 19, wherein the force sense generator is configured to be driven based on a signal transmitted from the communication unit. 21. The play absorbing part has a play absorbing part for suppressing play of a part corresponding to a fingertip.
0. The tactile / force sense presentation device according to any one of 0. 22. The tactile / force sense presentation device according to claim 21, wherein the play absorbing portion is made of an elastic body. 23. The tactile / force sense presentation device according to claim 21, wherein the play absorbing portion is provided in a portion corresponding to the vicinity of the wrist of the mounting means. 24. The tactile / force sense presentation device according to claim 1, wherein the mounting means has a wrist fixing portion for fixing the mounting means to a wrist. 25. The tactile / force sense presentation device according to claim 24, wherein the wrist fixation is made of an elastic body. 26. The tactile / force sense presentation device according to claim 1, wherein the mounting means has an arm fixing portion that fixes the mounting means to an arm. 27. The tactile / force sense presentation device according to claim 26, wherein the arm fixing portion is made of an elastic body. 28. The tactile / force sense presentation device according to claim 26, wherein the arm fixing portion is fixed to the arm by air pressure generated by injecting air. 29. The tactile / force feedback device according to claim 1, wherein the mounting means has a twist absorbing portion that absorbs a twist of a portion corresponding to the arm. 30. The tactile sensation according to claim 29, wherein the twist absorbing portion is composed of at least one strip-shaped portion obtained by forming an opening in a part of a tubular portion covering the arm of the mounting means. Force display device. 31. The tactile / force sense presentation device according to claim 1, wherein the mounting means has an opening at a portion corresponding to a finger joint. 32. The tactile sensation / force according to claim 1, wherein the position detecting means is provided so as to maintain a constant positional relationship with respect to a site detected by the position detecting means. Haptic presentation device. 33. A tactile sense comprising the tactile sense / force sense presentation device according to any one of claims 1 to 32.
Force display system. 34. The tactile / force sense presentation system according to claim 33, further comprising image creating means for creating a virtual space image. 35. The image creating means is configured to update the virtual space image according to the movement of the finger.
The tactile / force sense presentation system according to 4. 36. A communication means for transmitting or receiving a signal to or from the image forming means, wherein:
5. The tactile / force sense presentation system according to 5. 37. The tactile / force sense presentation system according to claim 33, further comprising display means for displaying a virtual space image. 38. The tactile / force sense presentation system according to claim 37, wherein the display means is mounted on a face for use. 39. The tactile / force sense presentation system according to claim 37 or 38, further comprising communication means for transmitting or receiving a signal to or from the display means. 40. Image creating means for creating a virtual space image, display means for displaying the virtual space image, control means for controlling driving of the tactile / force sense presentation device, the image creating means and the display means. The tactile sense / force sense presentation system according to claim 33, further comprising: