JP6474115B2 - Tactile reproduction device - Google Patents

Description

  The present invention relates to a tactile sensation reproducing device that can feel a reaction force imitating that a virtual object to be held is held by a finger when an operation body provided in the input device is held by the finger.

Patent Document 1 describes an invention related to a virtual space display device.
This virtual space display device can communicate with a terminal communication unit and a server, and the terminal communication unit is equipped with a touch panel including a liquid crystal display and an input unit.

  By the communication from the server, the shopping mall image is displayed on the liquid crystal display of the touch panel. When the user drags the touch panel, the displayed scene in the shopping mall can be moved, and when the user taps a product thumbnail in the shopping mall screen, detailed information on the product is displayed on the screen. The user can temporarily collect the products to be purchased in the stock area, and can purchase the products by performing a settlement process on the stock products.

JP 2012-234355 A

  In the virtual space display device described in Patent Literature 1, it is possible to check the price and color of a product displayed in a store of a shopping mall, and further search for a product to be purchased with reference to detailed product information.

  However, since the product cannot actually be touched, the size and texture of the product cannot be felt by hand. In addition, when the product is a tool that cuts or bends the workpiece by hand operation, it is impossible to feel by hand how the operation is performed.

  The present invention solves the above-described conventional problems, and is a tactile reproduction device capable of reproducing an operation feeling when a held object that moves mechanically like a tool is operated by hand in a state close to reality. The purpose is to provide.

The tactile reproduction device of the present invention has an input device and a control unit,
A plurality of operating bodies projecting in opposite directions from the case to the input device; a position detecting device for detecting a projecting position of each operating body from the case; and a motor for applying a force to each of the operating bodies; Is provided,
In the control unit, when it is detected that the operation body is pushed and moved in the case direction based on a detection signal from the position detection device, the operation body is moved by driving the motor. Give reaction force,
When it is detected that any one of the operating bodies has moved in the case direction based on a detection signal from the position detection device, the motor is moved so that the other operating bodies also move in the case direction. It is characterized by controlling.

  The tactile sensation reproduction device of the present invention precedes another operation body when it is determined that any one of the operation bodies moves toward the case by a predetermined distance or more before the other operation body. Control is performed to follow the operating body and move in the case direction.

  In the tactile sensation reproduction device according to the present invention, when any of the operating bodies moved toward the case is moved in a direction protruding from the case, the other operating bodies are also moved by the force of the motor. It is possible to return to a position protruding from.

In the tactile sensation reproducing device of the present invention, the input device includes a thumb operating body that is pressed with the thumb, a first opposing operating body and a second opposing operating body that are individually pressed with the index and middle fingers. And
With respect to the protruding direction of the thumb operating body, the first opposing operating body and the second opposing operating body may protrude in opposite directions.

The tactile reproduction device of the present invention is provided with a display device,
The control unit displays a virtual held object image and a hand image on the display screen of the display device,
It is preferable that when the operation body of the input device is held by a finger, display is performed in which the image of the held object is grasped by the image of the hand.

In the haptic reproduction apparatus of the present invention, the virtual object to be held has a pair of gripping parts that rotate with a common fulcrum, and one gripping part is held by a thumb and the other gripping part Is displayed with an index finger and middle finger,
When the thumb operating body is pressed with the thumb, or the first opposing operating body or the second opposing operating body is pressed with the index finger or the middle finger, the image changes so that the pair of gripping parts approach each other in the display image. Is.

  For example, the held object is a cutting tool that is operated by being sandwiched between a thumb, an index finger, and a middle finger.

  Alternatively, the object to be held is pliers that are operated by being sandwiched between a thumb, an index finger, and a middle finger.

  Alternatively, the held object is a stapler that is operated by being sandwiched between a thumb, an index finger, and a middle finger.

  In the tactile sensation reproduction device of the present invention, when any one of the plurality of operation bodies protruding from the input device is pressed in advance, the other operation bodies follow this and retreat toward the case. By adopting this structure, it is possible to reproduce the same holding feeling as when various products such as tools whose gripping parts operate in a symmetrical manner are operated by hand.

Explanatory drawing which shows the example which uses the haptic reproduction apparatus of the 1st Embodiment of this invention, Explanatory drawing which shows the example which uses the haptic reproduction apparatus of the 2nd Embodiment of this invention, FIG. 2 illustrates an input device provided in the tactile reproduction device shown in FIG. 1, (A) is a perspective view seen from above, (B) is a perspective view seen from below, FIG. 3 is an exploded perspective view of the input device shown in FIG. The perspective view which shows the tactile sense generation unit provided in the input device shown in FIG. The block diagram which shows the structure of the tactile reproduction apparatus of embodiment of this invention, Explanatory drawing which shows the example of use of the tactile reproduction device of an embodiment, and shows a display image when operating a cutting tool as a virtual held object, (A) is explanatory drawing which shows operation | movement of each operation body when holding a cutting tool as a virtual to-be-held object, (B) other than operation | movement of each operation body when operating a cutting tool as a virtual to-be-held object An explanatory diagram showing an example of Explanatory drawing of the reaction force that acts on the thumb operating body when operating the cutting tool as a virtual held object, Explanatory drawing of the reaction force which acts on the 1st counter operation body, when operating a cutting tool as a virtual held object, Explanatory drawing of the reaction force which acts on the 2nd counter operation body, when operating a cutting tool as a virtual to-be-held object,

<Overall structure>
1A and 1B show a state in which the haptic reproduction apparatuses 1A and 1B of the present invention are used.

  A haptic reproduction device 1A according to the first embodiment shown in FIG. 1A includes a device main body 10A and an input device 20. In FIG. 1A, one input device 20 is used, and this input device 20 is operated with the right hand.

  The input device 20 is connected to the apparatus main body 10 </ b> A by a cord 52. A display device 13 is provided in the apparatus main body 10A. The display device 13 is a color liquid crystal display panel, an electroluminescence display panel, or the like. The apparatus main body 10A is a personal computer, a demonstration display apparatus having a relatively large display screen, or the like.

  As shown in FIG. 5, the apparatus main body 10 </ b> A is provided with a display driver 14 for driving the display device 13 and a control unit 15 for controlling the display form of the display driver 14. The control unit 15 is composed mainly of a CPU and a memory. In addition, an interface 16 is provided for exchanging signals between the control unit 15 and each input device 20.

  A tactile reproduction device 1B according to the second embodiment shown in FIG. 1B includes a device body 10B and an input device 20. In FIG. 1B, two identical input devices 20 are used, and the input device 20 is operated with the right hand and the left hand.

  The apparatus main body 10B includes a mask type main body 11 to be mounted in front of the eyes and a strap 12 for mounting the mask type main body 11 to the head.

  A display device 13 is provided on the mask-type main body 11 of the apparatus main body 10B. This display device 13 is installed in front of the eyes of the operator and is visible. The display driver 14, the control unit 15, the interface 16, and the like illustrated in FIG. 5 are mounted on the mask type main body 11.

  2A is a perspective view of the external appearance of the input device 20 from above, and FIG. 2B is a perspective view of the external appearance of the input device 20 viewed from below. FIG. 3 is an exploded perspective view of the input device 20. FIG. 4 shows the structure of the first tactile sensation generating unit 30 </ b> A among the three sets of tactile sensation generating units built in the input device 20. 2A, FIG. 3 and FIG. 4 show XYZ coordinates based on the input device 20. FIG. In the input device 20, the Z direction is the pressing direction of each operating body.

  In the usage example shown in FIGS. 1A and 1B, the input device 20 is held by a human hand in a posture in which the Y direction is directed up and down.

  As shown in FIG. 2, the input device 20 has a case 21 made of synthetic resin. The case 21 is large enough to be held with one hand. The case 21 is configured by combining an upper case 22 and a lower case 23. As shown in FIG. 3, the upper case 22 and the lower case 23 can be divided in the Z direction. The upper case 22 and the lower case 23 are fixed to each other by screwing means or the like, and a mechanism housing space is formed inside the two cases 22 and 23.

  The surface of the upper case 22 facing the Z direction is the first surface 22a, and the surface of the lower case 23 facing the Z direction is the second surface 23a. As shown in FIG. 3, the upper case 22 has operation holes 24, 24 penetrating in the Z direction on the first surface 22a. The lower case 23 has an operation hole 25 penetrating the second surface 23a in the Z direction. The operation holes 24 and 24 are formed side by side in the Y direction, and the opening size in the Y direction is larger in the operation holes 25 than in the individual operation holes 24.

  A connector mounting hole 26 is opened on the end surface of the upper case 22 facing the Y direction, and a power plug mounting hole 27 is opened on the end surface of the lower case 23 facing the Y direction.

  As shown in FIG. 3, a mechanism chassis 28 is stored in a mechanism storage space inside the case 21. The mechanism chassis 28 is bent from a metal plate to form a mounting plate portion 28a parallel to the XY plane and a partition plate portion 28b parallel to the YZ plane.

  The first tactile sensation generating unit 30A and the second tactile sensation generating unit 30B are fixed to one side in the X direction across the sorting plate portion 28b. The first tactile sensation generating unit 30A and the second tactile sensation generating unit 30B are arranged side by side in the Y direction. One set of the third tactile sensation generating unit 40 is provided on the other side in the X direction across the sorting plate portion 28b.

<Structure of tactile generating unit>
FIG. 4 shows the structure of the first tactile sensation generating unit 30A.

  The first tactile sensation generating unit 30 </ b> A has a frame 31 in which a metal plate 30 is bent. The first tactile sensation generating unit 30A is mounted on the mechanism chassis 28 by fixing the frame 31 to the sorting plate portion 28b.

  A moving member 32 </ b> A is provided on the frame 31. The moving member 32A is made of a synthetic resin material, and the first opposing operation body 33A is fixed to the tip thereof. The first opposing operation body 33A is formed of a synthetic resin material. As shown in FIG. 2, the first opposing operation body 33 </ b> A protrudes outward from the operation hole 24 formed in the upper case 22.

  As shown in FIG. 1A and FIG. 1B, when the input device 20 is held with the right hand, the first opposing operation body 33A is pushed with the index finger, and as shown in FIG. When the device 20 is held with the left hand, the first opposing operation body 33A is operated with the middle finger.

  As shown in FIG. 4, a guide long hole 31 c extending in the Z direction is formed in one side plate portion 31 a of the frame 31. A sliding protrusion 32a is integrally formed on the side of the moving member 32A, and the moving member 32A slides on the frame 31 in the Z direction by sliding the sliding protrusion 32a inside the guide slot 31c. It is supported to move freely. The moving member 32A has a recess 32b. A compression coil spring 34 is interposed between the moving member 32A and the lower end portion of the frame 31 inside the recess 32b. Due to the elastic force of the compression coil spring 34, the moving member 32 </ b> A is biased upward in the figure in the Z direction, which is the direction in which the first opposing operation body 33 </ b> A protrudes from the upper case 22.

  A motor 35 </ b> A is fixed to one side wall portion 31 a of the frame 31. An output gear 36a is fixed to the output shaft of the motor 35A. A reduction gear 36b is rotatably supported on the outer surface of the side wall 31a, and the output gear 36a and the reduction gear 36b are engaged with each other. A gear box 37 is fixed to the side wall 31 a of the frame 31, and a speed reduction mechanism is housed inside the gear box 37. The rotational force of the reduction gear 36 b is reduced by a reduction mechanism in the gear box 37. The speed reduction mechanism in the gear box 37 includes a sun gear and a planetary gear.

  A pinion gear 37 a is fixed to the reduction output shaft of the gear box 37. A rack part 32c is formed on the surface of the thick part of the moving member 32A, and the pinion gear 37a and the rack part 32c are engaged with each other. The tooth part of the pinion gear 38a and the tooth part of the rack part 32c are helical teeth inclined with respect to the Y direction orthogonal to the moving direction of the moving member 32A.

  By providing the compression coil spring 34, backlash between the pinion gear 38a and the rack portion 32c can be eliminated. However, the compression coil spring 34 may not be provided in each tactile sensation generating unit.

  A position detection device 38A is fixed to the other side wall 31b of the frame 31. The position detection device 38A has a stator portion fixed to the side wall portion 31b and a rotor portion that rotates to face the stator portion. The rotor shaft provided in the rotor portion rotates together with the pinion gear 37a. The position detection device 38A is a resistance change type, and an arc-shaped resistor pattern is provided in the stator portion, and a slider for sliding the resistor pattern is provided in the rotor portion. The position detection device 38A is of a magnetic detection type, in which a rotating magnet is fixed to the rotor portion, a magnetic detection element such as a GMR element is provided in the stator portion, and the rotation angle of the rotor portion is detected by the magnetic detection element. It may be a thing. Alternatively, the position detection device 38A may be an optical position detection device.

  As shown in FIG. 3, the second tactile sensation generating unit 30B is fixed alongside the first tactile sensation generating unit 30A on one side in the X direction across the sorting plate portion 28b. Since the structure of the second tactile sensation generating unit 30B is the same as that of the first tactile sensation generating unit 30A, detailed description of the structure is omitted.

  In the second tactile sensation generating unit 30B, the second opposing operation body 33B is fixed to the upper part on the Z side of the moving member 32B. The second opposing operating body 33B has the same shape and dimensions as the first opposing operating body 33A.

  In the second tactile sensation generating unit 30B, the motor is indicated by 35B and the position detecting device is indicated by 38B. These are the motor 35A and the position detecting device 38A provided in the first tactile sensation generating unit 30A. The same.

  As shown in FIG. 1A and FIG. 1B, when the input device 20 is held with the right hand, the second opposing operation body 33B is pushed with the middle finger, and as shown in FIG. When the device 20 is held with the left hand, the second opposing operation body 33B is operated with the index finger.

  As shown in FIG. 3, a third tactile sensation generating unit 40 is provided on the other side of the partition plate portion 28 b of the mechanism chassis 28.

  The third tactile generating unit 40 has the same basic structure as the first tactile generating unit 30A and the second tactile generating unit 30B, but the third tactile generating unit 40 is configured to be slightly larger. Yes. In the third tactile sensation generating unit 40, a moving member 42 is supported by a frame 41 so as to be movable in the Z direction, and a thumb operating body 43 is fixed to the front portion of the moving member 42. The thumb operation body 43 projects downward from the operation hole 25 of the lower case 23 in the figure. The moving member 42 is biased by a compression coil spring 44 in a direction in which the thumb operating body 43 protrudes from the operation hole 25. As described above, the compression coil spring 44 can be omitted.

  The thumb operating body 43 has a width dimension in the Y direction that is larger than that of the first opposing operating body 33A and the second opposing operating body 33B, and the first opposing operating body 33A and the second opposing operating body. Both 33B oppose the thumb operating body 43 in the Z direction. As shown in FIGS. 1A and 1B, the thumb operating body 43 is operated with the thumb both when the input device 20 is held with the right hand and with the left hand.

  Also in the third tactile sensation generating unit 40, the motor 45 is fixed to the frame 41, and the output gear 46a fixed to the output shaft of the motor 45 meshes with the reduction gear 46b. The rotational force of the reduction gear 46b is reduced by a reduction mechanism in the gear box 47, and the reduction output is transmitted from the pinion gear to the rack portion formed on the moving member 42. Then, the rotation of the pinion gear is detected by the position detection device 48.

  As shown in FIG. 3, a signal connector 17 and a power plug 29 are built in the case 21. The signal connector 17 is exposed inside a connector mounting hole 26 formed in the upper case 22, and the power plug 29 is exposed inside a power plug mounting hole 27 formed in the lower case 23.

  As shown in the block diagram of FIG. 5, a motor driver 51 is provided in each of the first tactile sensation generating unit 30A, the second tactile sensation generating unit 30B, and the third tactile sensation generating unit 40. The motor 35A provided in the first tactile sensation generating unit 30A, the motor 35B provided in the second tactile sensation generating unit 30B, and the motor 45 provided in the third tactile sensation generating unit 40 are rotated by respective motor drivers 51. Driven.

  Each motor driver 51 is connected to the signal connector 17 via an interface 17a.

  As shown in FIG. 5, an attitude detection unit 53 is provided inside the case 21 of the input device 20. The posture detection unit 53 is, for example, a magnetic sensor that detects a geomagnetic sensor or a vibration type gyro device, and can detect the posture of the input device 20 in the operation space and the position in the operation space. The attitude detection unit 53 is connected to the signal connector 17 via the interface 17a.

  As shown in FIG. 5, an interface 16 is provided in the apparatus main bodies 10 </ b> A and 10 </ b> B, and a signal connector to which each interface 16 is connected and the signal connector 17 to which each interface 17 a is connected are represented by a cord 52. It is connected. The cord 52 includes a power line, and the power line is connected to the power plug 29. Power is supplied to the input device 20 from the apparatus main bodies 10A and 10B through the power supply line.

  The apparatus main bodies 10A and 10B and the respective input devices 20 can communicate with each other by an RF signal, and the input device 20 may include a battery. In this case, the cord 52 that connects the apparatus main bodies 10A and 10B and the input device 20 is not necessary.

  Further, the apparatus main bodies 10A and 10B may further have a communication function with the server.

  Further, the apparatus main body 10A shown in FIG. 1A and the apparatus main body 10B shown in FIG. 1B are each provided with a sounding device. The sound generation device is a speaker that emits sound in space, or a receiver that applies sound to an operator's ear.

Next, an operation method and operation of the haptic reproduction apparatus 1 will be described.
<Operation of input device 20 and setting of reaction force>
As shown in FIG. 2, in the input device 20, the first opposing operation body 33A and the second opposing operation body 33B protrude from the first surface 22a of the case 21, and one thumb operation is performed on the second surface 22b. The body 43 protrudes, and the two opposing operation bodies 33A and 33B and the thumb operation body 43 protrude in opposite directions in the Z direction. As shown in FIGS. 1A and 1B, the input device 20 is held with one hand, the thumb operating body 43 is pressed with the thumb, and the first and second opposing operating bodies 33A and 33B are pressed with the index and middle fingers. Is pressed.

  In the input device 20, a control command is given from the control unit 15 to each motor driver 51, and the motor 35A of the first tactile sensation generating unit 30A, the motor 35B of the second tactile sensation generating unit 30B, and the third tactile sensation generating unit 40 are provided. The motor 45 is operated based on the control command.

  By controlling the rotation of the motors 35A and 35B and the motor 45, the moving members 32A and 32B and the moving member 42 can be moved to arbitrary positions and stopped at those positions. For example, the first opposing operating body 33A, the second opposing operating body 33B, and the thumb operating body 43 can be stopped at a position where they protrude from the case 21 to the maximum extent, or the operating bodies 33A, 33B, 43 can be stopped. The case 21 can be stopped at the maximum retracted position. Further, the operating bodies 33A and 33B and the operating body 43 can be stopped at any position between the maximum projecting position and the maximum retracted position.

  Further, by controlling the electric power applied to the motors 35A, 35B and the motor 45, the motors 35A, 35B, 45 are controlled so that they do not move even if the operating bodies 33A, 33B, 40 protruding from the case 21 are pushed with a finger. The rotor can be held with a strong force.

  When each of the moving members 32A, 32B, and 42 is in a movable state, any one of the first opposing operating body 33A, the second opposing operating body 33B, and the thumb operating body 43 is pressed to move the moving members 32A, 32B, When 42 moves in the push-in direction, the movement position is detected by the position detection devices 38A, 38B or the position detection device 48, and the detection output is given to the control unit 15. The control unit 15 holds data relating to a reaction force action line (reaction force action coefficient) indicating the relationship between the moving distance and the reaction force, and the motor 35A according to the push-in positions of the operating bodies 33A, 33B, and 43. , 35B or the motor 45 is controlled to generate a torque corresponding to the reaction force action line. Accordingly, a reaction force is applied to the index finger and the middle finger pressing the opposing operation bodies 33A and 33B, and the thumb pressing the thumb operation body 43.

  8A to 8C show examples of data of reaction force action lines (reaction force action coefficients) stored in the memory in the control unit 15. In either case, the horizontal axis represents the push amount (push position) of the operating bodies 33A, 33B, 43, and the push amount increases toward the right in the figure.

  The vertical axis represents the moving force applied from the motors 35A, 35B, 45 to the moving members 32A, 32B, 42, and the moving force is applied to each finger from the opposing operating bodies 33A, 33B and the thumb operating body 43. It becomes. As the positive number on the vertical axis increases, the force for causing the opposing operation bodies 33A and 33B and the thumb operation body 43 to protrude from the case 21 increases, and the reaction force felt by the finger increases. The numbers on the vertical axis of the diagrams shown in FIGS. 8A to 8C are control numerical values for setting the driving torque of the motor, and do not mean physical force units.

  The solid lines in the graphs shown in FIGS. 8A to 8C indicate changes in the force applied to the moving members 32A, 32B, and 42 when the operating bodies 33A, 33B, and 43 are pushed and moved toward the case 21. ing. The broken lines in the graph indicate changes in the force applied to the moving members 32A, 32B, and 42 when the operating bodies 33A, 33B, and 43 return and move in the direction protruding from the case 21.

  For example, in FIGS. 11A to 11C, the solid line is a horizontal straight line. This means that when each operating body 33A, 33B, 43 is pushed toward the case 21, the reaction force felt by the finger is constant no matter where it is pushed.

  In FIGS. 8A to 8C, there is a region where the solid line in the graph rises in a substantially linear function toward the right. This means that when each operating body 33A, 33B, 43 is pushed toward the case 21, the reaction force felt by the finger increases in proportion to the pushing amount, and the slope of the solid line in this case is This corresponds to the elastic modulus when the virtual object to be held is pressed.

<Tactile reaction force when operating a virtual cutting tool>
In the tactile reproduction devices 1A and 1B, an operator's hand can feel a reaction force imitating holding a plurality of types of virtual objects to be held by hand. Data of reaction force action lines (reaction force action coefficients) of a plurality of types of virtual held objects are stored in a memory provided in the control unit 15. Further, image data held in the control unit 15 is given to the display driver 14, and the display device 13 shown in FIG. 1A or 1B can select and display images of a plurality of types of virtual held objects. A hand image is also displayed. These displays are based on computer graphics.

  FIG. 6 shows a state where the cutting tool 60 is displayed on the display screen 13a of the display device 13 as a virtual object to be held. The cutting tool 60 is a nipper, and is provided with a pair of handles 61 and 61 and a cutting unit 62 that performs cutting by operating the handles 61 and 61. On the display screen 13a, a work 63 to be cut by the cutting tool 60 is displayed. The work 63 is an image of a metal wire.

  The image of the hand H is displayed on the display screen 13a, and the image of the hand H appearing on the display screen 13a is moved by a predetermined operation, and the handles 61 and 61 of the image of the cutting tool 60 are moved by the image of the hand H. The display changes so that is held. For example, when the input device 20 is moved while being held by hand, the movement posture is detected by the posture detection unit 53 and information on the posture is given to the control unit 15. Based on this information, the display driver 14 is controlled, and the image of the hand H appearing on the display screen 13a moves to go to grip the handles 61, 61. Alternatively, when the cutting tool 60 is selected as an object to be held with another operation member such as a keyboard, the display changes so that the hand H appearing on the display screen 13a holds the image of the cutting tool 60.

  When the cutting tool 60 is selected as a virtual object to be held, the motors 35A, 35B, and 45 are controlled, and the initial positions of the opposing operation bodies 33A and 33B and the thumb operation body 43 are set. When the virtual object to be held is the cutting tool 60, the opposing operation bodies 33A and 33B and the thumb operation body 43 are set to the initial positions that protrude from the case 21 to the maximum as shown in FIG.

  The control unit 15 reads out the data of reaction force action lines (reaction force action coefficients) shown in FIGS. 8A to 8C from the memory, and the control unit 15 reads the motors 35A, 35B, 45 based on the data of the reaction force action lines. To control. FIG. 8A shows reaction force action lines given from the motor 45 to the moving member 42 and the thumb operation body 43 in the third tactile sensation generating unit 40, and FIG. 8B shows the motor in the first tactile sensation generating unit 30A. FIG. 8C shows reaction force action lines given from 35A to the moving member 32A and the first opposing operation body 33A, and FIG. 8C shows the moving member 32B and the second opposing operation from the motor 35B in the second tactile sensation generating unit 30B. The reaction force action line given to the body 33B is shown.

  As shown in FIG. 6, when an image in which the hand H holds the handles 61 and 61 of the cutting tool 60 is displayed on the display screen 13a, the input device 20 held by the right hand as shown in FIG. 1A. When the user presses the thumb operating body 43 with the thumb, presses the first opposing operating body 33A with the index finger, and presses the second opposing operating body 33B with the middle finger, the thumb F1 of the image of the hand H and the index finger are displayed on the display screen 13a. The display changes so that the handles 61, 61 held by F2 and the middle finger F3 are brought closer to each other. When the handles 61 and 61 approach each other to some extent, the image changes so that the linear workpiece 63 is cut by the cutting portion 62.

  In this series of operations, the change in the reaction force Fa (see FIG. 7A) applied to the thumb operating body 43 is as shown by a solid line in FIG. 8A, and the reaction force indicated by a numerical value of “190” at the beginning of pressing. Fa feels on the thumb. When the thumb operating body 43 is pushed, the reaction force Fa felt by the thumb increases with a substantially linear function, and approaches the distance where the handles 61 and 61 are within the display screen 13a shown in FIG. When the workpiece 63 is cut, the reaction force Fa acting on the thumb operating body 43 is rapidly reduced from the maximum value, and the reaction force value becomes “0”. Thereafter, the reaction force Fa acting on the thumb operating body 43 is recovered in order to reproduce the resistance force acting on the thumb F1 holding the handles 61, 61.

  A change in the reaction force Fb applied to the first opposing operation body 33A is as shown by a solid line in FIG. 8B, and a basic change in the reaction force is the same as that in FIG. 8A. However, the initial reaction force Fb at which the first opposing operation body 33A starts to be pushed with the index finger is “0”. Further, the reaction force Fb applied to the first opposing operation body 33A is smaller than the reaction force Fa applied to the thumb operation body 43 from the start of pressing by the index finger to the maximum value of the reaction force just before the cutting operation. It is set to be.

  The change in the reaction force Fc applied to the second opposing operation body 33B is as shown by the solid line in FIG. 8C, and the basic change in the reaction force is the same as in FIGS. 8A and 8B. The numerical value of the initial reaction force Fc at which the second opposing operation body 33B starts to be pushed with the middle finger is “approximately 110”, which is larger than the initial value of the reaction force Fb against the index finger and smaller than the initial value of the reaction force Fa against the thumb. Further, the maximum value of the reaction force Fc immediately before the cutting operation is almost the same value as the maximum value of the reaction force Fb acting on the index finger shown in FIG. 8B.

  In the reaction force control, when the thumb operating body 43 is pushed with the thumb, the first opposing operating body 33A is pushed with the index finger, and the second opposing operating body 33B is pushed with the middle finger, it is as if the display screen 13a in FIG. The reaction force when grasping the handles 61, 61 of the cutting tool 60 shown in FIG. 6 becomes large, and a tactile sensation in which the reaction force rapidly decreases after the workpiece 63 is cut can be obtained.

  Here, when the cutting operation of the workpiece is performed by grasping the handle of the actual cutting tool 60 with an actual hand, one handle 61 is pushed only by the thumb, and the other handle 61 is operated by a plurality of fingers of the index finger and the middle finger. When pressed, the thumb and other fingers apply reaction forces to each other. Therefore, in an actual operation, a larger reaction force acts on the thumb than on the index finger and the middle finger. Further, between the middle finger and the index finger pressing the same handle 61, the handle 61 is strongly pressed by the middle finger, so that a larger reaction force than the index finger tends to act on the middle finger.

  Also, in the structure of the human hand, the thumb is short and the index and middle fingers are long, so even if you recognize that each finger is moving with the same force, the force acting on the held object from the thumb is actually The force is larger than the force acting on the held object from the index finger or the middle finger.

  Therefore, as shown in FIGS. 8A to 8C, the reaction force Fa acting on the thumb operation body 43 is changed from the start of pressing to the maximum value, the reaction force Fb acting on the first counter operation body 33A and the second reaction force Fb. The reaction force Fc acting on the opposing operation body 33B is made larger. That is, the reaction force applied from the thumb operation body 43 to the thumb is larger than the reaction force applied from the two opposing operation bodies 33A and 33B to the index finger and the middle finger. When a difference is given to the reaction force in this way, it is possible to obtain a feel of reaction force equivalent to that actually holding the handles 61, 61 in the human hand.

  Further, as shown in FIGS. 8B and 8B, the initial value of the reaction force Fc acting on the second opposing operation body 33B is made larger than the initial value of the reaction force Fb acting on the first opposing operation body 33A. Yes. As a result, the initial value of the reaction force applied from the second opposing operation body 33B to the middle finger is slightly larger than the initial value of the reaction force applied from the first opposing operation body 33A to the index finger. This also makes it possible to feel the same operational feeling as when the cutting tool 60 is actually operated with the thumb, index finger, and middle finger operating the input device 20.

  In addition, when the operation of the finger with respect to the operating bodies 33A, 33B, 43 and the change of the image of the hand H in the display screen 13a shown in FIG. By generating cutting sounds such as “pick” and “click” from the sound generation unit, the operator can easily recognize the feeling that the cutting tool 60 is actually operated.

  When the cutting operation by the cutting unit 62 is completed and the pressing force applied to each operating body 33A, 33B, 43 is removed from the finger, as shown by the broken lines in FIGS. 8A, 8B, and 8C, A return moving force is applied to the moving members 32A, 32B, and 42 from the motors 35A, 35B, and 45, and the operating bodies 33A, 33B, and 43 return to the initial positions protruding from the case 21. As indicated by broken lines in FIGS. 8A, 8B, and 8C, the restoring forces applied to the moving members 32A, 32B, and 42 from the motors 35A, 35B, and 45 at this time are all controlled by the same numerical value “80”. .

<Tactile reaction force when operating a held object having a pair of gripping parts approaching each other>
The nipper shown in FIG. 6 grips the opposing handles 61 and 61 by hand, but as a virtual object to be held and operated in the same way, scissors for cutting paper classified as the same cutting tool, paper There are scissors for cutting and scissors for cutting plants. Moreover, there is a pliers that performs an operation of bending with a workpiece sandwiched between the workpieces. Furthermore, there is a stapler or the like that is operated by being sandwiched between the thumb, forefinger, and middle finger.

  These have gripping portions (handles or operation portions) that move symmetrically around a common fulcrum, like handles 61 and 61 shown in FIG. These operate so that the two gripping parts approach each other when one gripping part is pushed with the thumb or the other gripping part is pushed with the index finger and the middle finger. That is, if one gripping part is pushed toward the other gripping part, the interval between the gripping parts naturally approaches.

  Therefore, in order to make it easy to obtain an operation feeling that mimics such an object to be held, it is detected by one of the position detection devices 38A, 38B, 48 that one of the operation bodies 33A, 33B, 43 has been pressed. In this case, it is possible to perform control to move the other operating bodies toward the case 21 by the same amount.

  For example, as shown in FIG. 6, in a state where the cutting tool 60 is displayed on the display screen 13a, the thumb is applied to the thumb operation body 43, the index finger is applied to the first opposing operation body 33A, and the middle finger is applied to the second operation body 33A. The thumb operation body 43 is pressed against the opposing operation body 33B by pushing the thumb operation body 43 in advance with the other finger to the pressing position Sa shown in FIG. When this is detected by the position detection device 48, the control unit 15 controls the motors 35A and 35B to automatically move the first opposing operation body 33A to the position Sb approaching the case 21, and the second The opposing operation body 33B is automatically moved to the position Sc approaching the case 21. At this time, the positions Sa, Sb, Sc of the operating bodies project from the case 21 are the same.

  Similarly, when the first opposing operation body 33A is pushed to the position Sb in advance, the second opposing operation body 33B is retracted to the position Sc following this, and the thumb operation body 43 is moved to the position Sa. Regress until. Further, when the second opposing operation body 33B is pushed into the position Sc in advance, the first opposing operation body 33A is retracted to the position Sa following this, and the thumb operation body 43 is retracted to the position Sa. Let

  That is, the control unit 15 monitors the position detection outputs from the three position detection devices 38A, 38B, and 48, and any one of the operation bodies 33A, 33B, and 43 is more than a certain distance from the other operation bodies. It is determined whether it has been pressed in advance. When it is determined that any one of the operating bodies is pushed ahead by a predetermined distance, the other operating bodies are caused to follow and retreat toward the case 21.

  At this time, the reaction force against the one of the operating bodies 33A, 33B, 43 that is pushed ahead by the finger is the reaction force action line (reaction force action coefficient) shown in FIGS. 8A, 8B, 8C. Reaction force is given based on

  Next, when the pressing force by any of the fingers is released after all the operating bodies have retreated, the reaction force is based on the reaction force action lines (reaction force action coefficients) shown in FIGS. 8A, 8B, and 8C. Occurs, and the operating body from which the pressing force is released is returned in the direction protruding from the case 21 in advance. At this time, the other operating body is also returned to the direction protruding from the case 21 following this.

  For example, after all the operating bodies 33A, 33B, 43 are retracted by the motor in a direction approaching the case 21, when a certain period of time elapses, when any operating body is subsequently pressed, FIG. A reaction force is applied to the operating body based on the reaction force action line (reaction force action coefficient) shown in FIGS. 8B and 8C. Therefore, after that, when the power of one of the fingers is weakened, the operating body that is touched by that finger is returned. This return movement is detected by the position detection device, the motor that drives the other operating body is started, and the other operating body is automatically moved away from the case 21 by the power of the motor. The body is returned to the initial position shown in FIG.

  For example, a state where the cutting tool 60 shown in FIG. 6 is displayed will be described as an example. When the thumb operation body 43 is pushed in advance with the thumb, the two opposing operation bodies 33A and 33B follow this case 21. Retreat toward. Accordingly, in the image displayed on the display screen 13a shown in FIG. 6, the handles 61 and 16 that are a pair of gripping portions approach each other and a cutting operation is performed. Here, when the force of pushing the thumb operation body 43 with the thumb is released, the thumb operation body 43 returns to the direction away from the case 21, and in conjunction with this, the two opposing operation bodies 33 A and 33 B also move away from the case 21. Return. Then, on the display screen 13a shown in FIG. 6, the cutting operation is completed, and the images of the handles 61, 61 are moved away from each other.

  Next, when one of the opposing operation bodies 33A and 33B is pressed in advance with the index finger or the middle finger, the opposing operation body and the thumb operation body 43 on the delayed side retreat toward the case 21 following this. In the display screen 13a shown in FIG. 6, the images of the handles 61 and 61 are approached and a cutting operation is performed.

  However, in this case, even if one of the index finger and the middle finger is separated from the opposing operation bodies 33A and 33B, when the opposing operation body is pressed on the other side, all the operation bodies protrude in a direction away from the case 21. Never do. When the position detection units 38A and 38B detect that both the index finger and the middle finger are about to move away from the opposing operating bodies 33A and 33B and the opposing operating bodies 33A and 33B have moved in the protruding direction, the first opposing operating body 33A. The second operation body 33B is moved in the direction away from the case 21 by the motors 35A and 35B, and in conjunction with this, the thumb operation body 43 is returned in the direction away from the case 21 by the motor 45.

  By performing the above-described control, the operation feeling is equivalent to the operation of holding and operating a tool in which the two gripping portions have a common fulcrum and rotate, such as the nipper shown in FIG. You will be able to get In addition, this simulated operation can be used for simulation of any machine, apparatus, or tool as long as the virtual object to be held has a movable part that operates symmetrically.

1A, 1B Tactile reproduction device 10A, 10B Device main body 11 Mask type main body 13 Display device 15 Control unit 20 Input device 21 Case 28 Mechanism chassis 30A First tactile generation unit 30B Second tactile generation unit 32A, 32B Moving member 33A First 1 counter operation body 33B second counter operation bodies 35A, 35B motors 38A, 38B position detection device 40 third tactile generating unit 42 moving member 43 thumb operation body 45 motor 48 position detection device

Claims (9)

An input device and a control unit;
A plurality of operating bodies projecting in opposite directions from the case to the input device; a position detecting device for detecting a projecting position of each operating body from the case; and a motor for applying a force to each of the operating bodies; Is provided,
In the control unit, when it is detected that the operation body is pushed and moved in the case direction based on a detection signal from the position detection device, the operation body is moved by driving the motor. Give reaction force,
When it is detected that any one of the operating bodies has moved in the case direction based on a detection signal from the position detection device, the motor is moved so that the other operating bodies also move in the case direction. A tactile reproduction device characterized by controlling.   When it is determined that any of the operating bodies is moving toward the case by a predetermined distance or more before the other operating bodies, the other operating bodies are caused to follow the preceding operating body and The haptic reproduction device according to claim 1, wherein the haptic reproduction device performs control to move in a case direction.   When any of the operating bodies moved toward the case is moved in a direction protruding from the case, the other operating bodies are also returned to the position protruding from the case by the force of the motor. The haptic reproduction apparatus according to claim 1 or 2. The input device includes a thumb operating body that is pressed with a thumb, a first opposing operating body and a second opposing operating body that are individually pressed with an index finger and a middle finger,
The haptic reproduction apparatus according to any one of claims 1 to 3, wherein the first opposing operating body and the second opposing operating body protrude in opposite directions with respect to the protruding direction of the thumb operating body. A display device is provided,
The control unit displays a virtual held object image and a hand image on the display screen of the display device,
5. The tactile reproduction according to claim 1, wherein when the operation body of the input device is held by a finger, a display in which an image of the held object is grasped by an image of the hand is performed. apparatus. The virtual object to be held has a pair of gripping parts having a common fulcrum and rotating, and one gripping part is held by a thumb and the other gripping part is held by an index finger and a middle finger. An image is displayed,
When the thumb operating body is pressed with the thumb, or the first opposing operating body or the second opposing operating body is pressed with the index finger or the middle finger, the image changes so that the pair of gripping parts approach each other in the display image. The haptic reproduction apparatus according to claim 5.   The tactile reproduction device according to claim 6, wherein the held object is a cutting tool that is operated by being sandwiched between a thumb, an index finger, and a middle finger.   The haptic reproduction apparatus according to claim 6, wherein the held object is a pliers that is operated by being sandwiched between a thumb, an index finger, and a middle finger.   The tactile reproduction device according to claim 6, wherein the held object is a stapler that is operated by being sandwiched between a thumb, an index finger, and a middle finger.

Images