WO2017061178A1

WO2017061178A1 - Haptic reproduction device

Info

Publication number: WO2017061178A1
Application number: PCT/JP2016/074283
Authority: WO
Inventors: 萩原　康嗣
Original assignee: アルプス電気株式会社
Priority date: 2015-10-05
Filing date: 2016-08-19
Publication date: 2017-04-13
Also published as: JPWO2017061178A1

Abstract

[Problem] To provide a haptic reproduction device that can apply to fingers reaction force that simulates grasping and operating a virtual held-object with the fingers. [Solution] The present invention has an input device 20. The input device 20 is configured such that a first facing operation body 33A, a second facing operation body 33B, and a thumb operation body 43 protrude from a case 21. When the thumb operation body 43 is held with the thumb and the facing operation bodies 33A, 33B are held with the forefinger and the middle finger, respectively, actions can be performed as if a held-object were being grasped. Control signals are provided from a control unit to a motor that is inside the case 21, and reaction force is applied to the fingers from the facing operation bodies 33A, 33B and the thumb operation body 43. The present invention also produces sound that corresponds to changes in the state of the held-object.

Description

Tactile reproduction device

The present invention relates to a tactile sensation reproducing device that can feel a reaction force imitating that a virtual object to be held is held with a finger when an operating body provided in the input device is held with the finger.

Patent Document 1 describes an invention related to a virtual space display device.
This virtual space display device can communicate with a terminal communication unit and a server, and the terminal communication unit is equipped with a touch panel including a liquid crystal display and an input unit.

The shopping mall image is displayed on the LCD of the touch panel through communication from the server. When the user drags the touch panel, the displayed scene in the shopping mall can be moved, and when the user taps a product thumbnail in the shopping mall screen, detailed information on the product is displayed on the screen. The user can temporarily collect the products to be purchased in the stock area, and can purchase the products by performing a settlement process on the stock products.

JP 2012-234355 A

In the virtual space display device described in Patent Document 1, it is possible to check the price and color of a product displayed in a store of a shopping mall, and further search for a product to be purchased with reference to detailed product information.

However, since the product cannot actually be touched, the size and texture of the product cannot be felt by hand. In addition, when a product operates or is deformed, it is impossible to feel by hand how much force is required for the operation or deformation.

The present invention solves the above-described conventional problems, and can mechanically generate a reaction force imitating an operation feeling or a crushing tactile sensation when a predetermined held object is operated by hand. It is an object of the present invention to provide a tactile sensation reproducing device that can obtain a touch equivalent to that of holding an actual held member by emitting a sound imitating holding of a holding object.

The tactile reproduction device of the present invention has an input device and a control unit,
The input device is provided with a plurality of operating bodies projecting from a case, a position detecting device for detecting the projecting position of each operating body from the case, and a motor for applying a force to each operating body,
The controller drives the motor to apply a reaction force to the operating body when it is detected that the operating body has been pushed and moved in the direction of the case based on a detection signal from the position detecting device. ,
When it is detected that any of the operating bodies has moved in the case direction based on a detection signal from the position detection device, control is performed to generate a sound from the sound generation device. .

In the tactile sensation reproducing device of the present invention, the input device includes a thumb operating body that is pressed with the thumb, a first opposing operating body and a second opposing operating body that are individually pressed with the index and middle fingers. And
With respect to the protruding direction of the thumb operating body, the first opposing operating body and the second opposing operating body may protrude in opposite directions.

In the tactile reproduction device of the present invention, the control unit displays a virtual held object image and a hand image on the display screen of the display device,
When the operating body of the input device is pressed, a display for changing the state of the held object in the image of the hand is performed,
A sound corresponding to a change in the state of the held object is emitted from the sound generation device.

The tactile reproduction device of the present invention is, for example, a cutting tool that is operated by pinching the object to be held with a finger, and when the operation for cutting the workpiece by the cutting tool is displayed on the display screen, the sound generation is performed. A cutting sound is emitted from the device.

Alternatively, the object to be held is a squeeze bottle held by a finger, and when the operation for discharging the content from the squeeze bottle is displayed on the display screen, the sound generation device emits a discharge sound of the content. It is what

Alternatively, the object to be held is a spray bottle operated with a finger, and when the operation for discharging the liquid from the spray bottle is displayed on the display screen, the sound generating device emits a liquid discharge sound. It is.

The tactile sensation reproducing device of the present invention can make a finger feel a reaction force imitating that a virtual object to be held is moved and deformed by grasping the operating body with the finger. Further, when the operating body is pushed in, a sound imitating the movement or deformation of the virtual held object is emitted.

The operator feels as if he / she is moving or deforming an actual held object by feeling the change in the image displayed on the display screen, the sound emitted, and the reaction force applied to the finger from the operating body. You can get a good feel.

Explanatory drawing which shows the example which uses the haptic reproduction apparatus of the 1st Embodiment of this invention, Explanatory drawing which shows the example which uses the haptic reproduction apparatus of the 2nd Embodiment of this invention, FIG. 2 illustrates an input device provided in the tactile reproduction device shown in FIG. 1, (A) is a perspective view seen from above, (B) is a perspective view seen from below, FIG. 3 is an exploded perspective view of the input device shown in FIG. The perspective view which shows the tactile sense generation unit provided in the input device shown in FIG. The block diagram which shows the structure of the tactile reproduction apparatus of embodiment of this invention, Explanatory drawing which shows the example of use of the tactile reproduction device of an embodiment, and shows a display image when operating a cutting tool as a virtual held object, FIG. 4 is a diagram illustrating a usage example of the tactile reproduction device according to the embodiment, and is an explanatory diagram illustrating a display image that reproduces a tactile sensation when a squeeze bottle is grasped as a virtual held object; Explanatory drawing which shows the example of use of the tactile reproduction device of an embodiment, and shows the display image which reproduces the tactile sense when grasping a spray bottle as a virtual held object, (A) is explanatory drawing which shows operation | movement of each operation body when holding a cutting tool or a squeeze bottle as a virtual to-be-held object, (B) is each operation body when operating a spray bottle as a virtual to-be-held object. Explanatory diagram showing the operation, Explanatory drawing of the reaction force that acts on the thumb operating body when operating the cutting tool as a virtual held object, Explanatory drawing of the reaction force which acts on the 1st counter operation body, when operating a cutting tool as a virtual held object, Explanatory drawing of the reaction force which acts on the 2nd counter operation body, when operating a cutting tool as a virtual to-be-held object, Explanatory drawing of the reaction force that acts on the thumb operating body when grasping the squeeze bottle as a virtual held object, Explanatory drawing of reaction force which acts on the 1st counter operation body, when grasping a squeeze bottle as a virtual held object, Explanatory drawing of the reaction force which acts on the 2nd counter operation body, when grasping a squeeze bottle as a virtual held object, Explanatory drawing of the reaction force acting on the thumb operating body when grasping the spray bottle as a virtual held object, Explanatory drawing of the reaction force which acts on the 1st counter operation body, when grasping a spray bottle as a virtual held object, Explanatory drawing of the reaction force which acts on the 2nd counter operation body, when grasping a spray bottle as a virtual held object,

<Overall structure>
1A and 1B show a state in which the

haptic reproduction apparatuses

1A and 1B of the present invention are used.

A haptic reproduction apparatus 1A according to the first embodiment shown in FIG. 1A includes an apparatus main body 10A and an input apparatus 20. In FIG. 1A, one input device 20 is used, and this input device 20 is operated with the right hand.

The input device 20 is connected to the apparatus main body 10A by a cord 52. A display device 13 is provided in the apparatus main body 10A. The display device 13 is a color liquid crystal display panel, an electroluminescence display panel, or the like. The apparatus main body 10A is a personal computer, a demonstration display apparatus having a relatively large display screen, or the like.

As shown in FIG. 5, the apparatus main body 10 A is provided with a display driver 14 for driving the display device 13 and a control unit 15 for controlling the display form of the display driver 14. The control unit 15 is composed mainly of a CPU and a memory. In addition, an interface 16 is provided for exchanging signals between the control unit 15 and each input device 20.

The tactile reproduction device 1B according to the second embodiment shown in FIG. 1B includes a device main body 10B and an input device 20. In FIG. 1B, two identical input devices 20 are used, and the input device 20 is operated with the right hand and the left hand.

The apparatus main body 10B has a mask type main body 11 to be mounted in front of the eyes and a strap 12 for mounting the mask type main body 11 on the head.

A display device 13 is provided on the mask-type main body 11 of the apparatus main body 10B. This display device 13 is installed in front of the eyes of the operator and is visible. The display driver 14, the control unit 15, the interface 16, and the like illustrated in FIG. 5 are mounted on the mask type main body 11.

2A is a perspective view showing the external appearance of the input device 20 from above, and FIG. 2B is a perspective view showing the external appearance of the input device 20 viewed from below. FIG. 3 is an exploded perspective view of the input device 20. FIG. 4 shows the structure of the first tactile sensation generating unit 30 A among the three sets of tactile sensation generating units built in the input device 20. 2A, FIG. 3 and FIG. 4 show XYZ coordinates based on the input device 20. FIG. In the input device 20, the Z direction is the pressing direction of each operating body.

In the usage example shown in FIGS. 1A and 1B, the input device 20 is held by a human hand in a posture in which the Y direction is directed up and down.

As shown in FIG. 2, the input device 20 has a case 21 made of synthetic resin. The case 21 is large enough to be held with one hand. The case 21 is configured by combining an upper case 22 and a lower case 23. As shown in FIG. 3, the upper case 22 and the lower case 23 can be divided in the Z direction. The upper case 22 and the lower case 23 are fixed to each other by screwing means or the like, and a mechanism housing space is formed inside the two

cases

22 and 23.

The surface of the upper case 22 facing the Z direction is the first surface 22a, and the surface of the lower case 23 facing the Z direction is the second surface 23a. As shown in FIG. 3, the upper case 22 has operation holes 24, 24 penetrating in the Z direction on the first surface 22a. The lower case 23 has an operation hole 25 penetrating the second surface 23a in the Z direction. The operation holes 24 and 24 are formed side by side in the Y direction, and the opening size in the Y direction is larger in the operation holes 25 than in the individual operation holes 24.

A connector mounting hole 26 is opened on the end surface of the upper case 22 facing the Y direction, and a power plug mounting hole 27 is opened on the end surface of the lower case 23 facing the Y direction.

As shown in FIG. 3, a mechanism chassis 28 is stored in a mechanism storage space inside the case 21. The mechanism chassis 28 is bent from a metal plate to form a mounting plate portion 28a parallel to the XY plane and a partition plate portion 28b parallel to the YZ plane.

The first tactile sensation generating unit 30A and the second tactile sensation generating unit 30B are fixed to one side in the X direction across the sorting plate portion 28b. The first tactile sensation generating unit 30A and the second tactile sensation generating unit 30B are arranged side by side in the Y direction. One set of the third tactile sensation generating unit 40 is provided on the other side in the X direction across the sorting plate portion 28b.

<Structure of tactile generating unit>
FIG. 4 shows the structure of the first tactile sensation generating unit 30A.

The first tactile sensation generating unit 30A has a frame 31 in which a metal plate 30 is bent. The first tactile sensation generating unit 30A is mounted on the mechanism chassis 28 by fixing the frame 31 to the sorting plate portion 28b.

The moving member 32A is provided on the frame 31. The moving member 32A is made of a synthetic resin material, and the first opposing operation body 33A is fixed to the tip thereof. The first opposing operation body 33A is formed of a synthetic resin material. As shown in FIG. 2, the first opposing operation body 33 A protrudes outward from the operation hole 24 formed in the upper case 22.

As shown in FIG. 1A and FIG. 1B, when the input device 20 is held with the right hand, the first opposing operation body 33A is pushed with the index finger, and as shown in FIG. When the device 20 is held with the left hand, the first opposing operation body 33A is operated with the middle finger.

As shown in FIG. 4, a guide long hole 31 c extending in the Z direction is formed in one side plate portion 31 a of the frame 31. A sliding protrusion 32a is integrally formed on the side of the moving member 32A, and the moving member 32A slides on the frame 31 in the Z direction by sliding the sliding protrusion 32a inside the guide slot 31c. It is supported to move freely. The moving member 32A has a recess 32b. A compression coil spring 34 is interposed between the moving member 32A and the lower end portion of the frame 31 inside the recess 32b. Due to the elastic force of the compression coil spring 34, the moving member 32 A is biased upward in the figure in the Z direction, which is the direction in which the first opposing operation body 33 A protrudes from the upper case 22.

The motor 35A is fixed to one side wall portion 31a of the frame 31. An output gear 36a is fixed to the output shaft of the motor 35A. A reduction gear 36b is rotatably supported on the outer surface of the side wall 31a, and the output gear 36a and the reduction gear 36b are engaged with each other. A gear box 37 is fixed to the side wall 31 a of the frame 31, and a speed reduction mechanism is housed inside the gear box 37. The rotational force of the reduction gear 36 b is reduced by a reduction mechanism in the gear box 37. The speed reduction mechanism in the gear box 37 includes a sun gear and a planetary gear.

The pinion gear 37a is fixed to the reduction output shaft of the gear box 37. A rack part 32c is formed on the surface of the thick part of the moving member 32A, and the pinion gear 37a and the rack part 32c are engaged with each other. The tooth part of the pinion gear 38a and the tooth part of the rack part 32c are helical teeth inclined with respect to the Y direction orthogonal to the moving direction of the moving member 32A.

By providing the compression coil spring 34, it is possible to eliminate backlash between the pinion gear 38a and the rack portion 32c. However, the compression coil spring 34 may not be provided in each tactile sensation generating unit.

The position detection device 38A is fixed to the other side wall 31b of the frame 31. The position detection device 38A has a stator portion fixed to the side wall portion 31b and a rotor portion that rotates to face the stator portion. The rotor shaft provided in the rotor portion rotates together with the pinion gear 37a. The position detection device 38A is a resistance change type, and an arc-shaped resistor pattern is provided in the stator portion, and a slider for sliding the resistor pattern is provided in the rotor portion. The position detection device 38A is of a magnetic detection type, in which a rotating magnet is fixed to the rotor portion, a magnetic detection element such as a GMR element is provided in the stator portion, and the rotation angle of the rotor portion is detected by the magnetic detection element. It may be a thing. Alternatively, the position detection device 38A may be an optical position detection device.

As shown in FIG. 3, the second tactile sensation generating unit 30B is fixed alongside the first tactile sensation generating unit 30A on one side in the X direction across the sorting plate portion 28b. Since the structure of the second tactile sensation generating unit 30B is the same as that of the first tactile sensation generating unit 30A, detailed description of the structure is omitted.

In the second tactile sensation generating unit 30B, the second opposing operation body 33B is fixed to the upper part on the Z side of the moving member 32B. The second opposing operating body 33B has the same shape and dimensions as the first opposing operating body 33A.

In the second tactile sensation generating unit 30B, the motor is indicated by 35B and the position detecting device is indicated by 38B. These are the motor 35A and the position detecting device 38A provided in the first tactile sensation generating unit 30A. The same.

As shown in FIG. 1A and FIG. 1B, when the input device 20 is held with the right hand, the second opposing operation body 33B is pushed with the middle finger, and as shown in FIG. When the device 20 is held with the left hand, the second opposing operation body 33B is operated with the index finger.

As shown in FIG. 3, a third tactile sensation generating unit 40 is provided on the other side of the partition plate portion 28 b of the mechanism chassis 28.

The third tactile generating unit 40 has the same basic structure as the first tactile generating unit 30A and the second tactile generating unit 30B, but the third tactile generating unit 40 is configured to be slightly larger. Yes. In the third tactile sensation generating unit 40, a moving member 42 is supported by a frame 41 so as to be movable in the Z direction, and a thumb operating body 43 is fixed to the front portion of the moving member 42. The thumb operation body 43 projects downward from the operation hole 25 of the lower case 23 in the figure. The moving member 42 is biased by a compression coil spring 44 in a direction in which the thumb operating body 43 protrudes from the operation hole 25. As described above, the compression coil spring 44 can be omitted.

The thumb operating body 43 has a width dimension in the Y direction that is larger than that of the first opposing operating body 33A and the second opposing operating body 33B, and the first opposing operating body 33A and the second opposing operating body. Both 33B oppose the thumb operating body 43 in the Z direction. As shown in FIGS. 1A and 1B, the thumb operating body 43 is operated with the thumb both when the input device 20 is held with the right hand and with the left hand.

Also in the third tactile sensation generating unit 40, the motor 45 is fixed to the frame 41, and the output gear 46a fixed to the output shaft of the motor 45 is engaged with the reduction gear 46b. The rotational force of the reduction gear 46b is reduced by a reduction mechanism in the gear box 47, and the reduction output is transmitted from the pinion gear to the rack portion formed on the moving member 42. Then, the rotation of the pinion gear is detected by the position detection device 48.

As shown in FIG. 3, a signal connector 17 and a power plug 29 are built in the case 21. The signal connector 17 is exposed inside a connector mounting hole 26 formed in the upper case 22, and the power plug 29 is exposed inside a power plug mounting hole 27 formed in the lower case 23.

As shown in the block diagram of FIG. 5, a motor driver 51 is provided in each of the first tactile sensation generating unit 30A, the second tactile sensation generating unit 30B, and the third tactile sensation generating unit 40. The motor 35A provided in the first tactile sensation generating unit 30A, the motor 35B provided in the second tactile sensation generating unit 30B, and the motor 45 provided in the third tactile sensation generating unit 40 are rotated by respective motor drivers 51. Driven.

Each motor driver 51 is connected to the signal connector 17 via an interface 17a.

As shown in FIG. 5, an attitude detection unit 53 is provided inside the case 21 of the input device 20. The posture detection unit 53 is, for example, a magnetic sensor that detects a geomagnetic sensor or a vibration type gyro device, and can detect the posture of the input device 20 in the operation space and the position in the operation space. The attitude detection unit 53 is connected to the signal connector 17 via the interface 17a.

As shown in FIG. 5, an interface 16 is provided in the apparatus main bodies 10 A and 10 B, and a signal connector to which each interface 16 is connected and the signal connector 17 to which each interface 17 a is connected are represented by a cord 52. It is connected. The cord 52 includes a power line, and the power line is connected to the power plug 29. Power is supplied to the input device 20 from the apparatus

main bodies

10A and 10B through the power supply line.

Note that the apparatus

main bodies

10A and 10B and the respective input devices 20 can communicate with each other by an RF signal, and the input device 20 may include a battery. In this case, the cord 52 that connects the apparatus

main bodies

10A and 10B and the input device 20 is not necessary.

Further, the apparatus

main bodies

10A and 10B may further have a communication function with the server.

Further, both the apparatus main body 10A shown in FIG. 1A and the apparatus main body 10B shown in FIG. 1B are provided with a sounding device. The sound generation device is a speaker that emits sound in space, or a receiver that applies sound to an operator's ear.

Next, an operation method and operation of the haptic reproduction apparatus 1 will be described.
<Operation of input device 20 and setting of reaction force>
As shown in FIG. 2, in the input device 20, the first opposing operation body 33A and the second opposing operation body 33B protrude from the first surface 22a of the case 21, and one thumb operation is performed on the second surface 22b. The body 43 protrudes, and the two opposing

operation bodies

33A and 33B and the thumb operation body 43 protrude in opposite directions in the Z direction. As shown in FIGS. 1A and 1B, the input device 20 is held with one hand, the thumb operating body 43 is pressed with the thumb, and the first and second opposing operating

bodies

33A and 33B are pressed with the index and middle fingers. Is pressed.

In the input device 20, a control command is given from the control unit 15 to each motor driver 51, and the motor 35A of the first tactile sensation generating unit 30A, the motor 35B of the second tactile sensation generating unit 30B, and the third tactile sensation generating unit 40 are provided. The motor 45 is operated based on the control command.

By controlling the rotation of the

motors

35A and 35B and the motor 45, the moving

members

32A and 32B and the moving member 42 can be moved to arbitrary positions and stopped at those positions. For example, the first opposing operating body 33A, the second opposing operating body 33B, and the thumb operating body 43 can be stopped at a position where they protrude from the case 21 to the maximum extent, or the operating

bodies

33A, 33B, 43 can be stopped. The case 21 can be stopped at the maximum retracted position. Further, the operating

bodies

33A and 33B and the operating body 43 can be stopped at any position between the maximum projecting position and the maximum retracted position.

Further, by controlling the electric power applied to the

motors

35A, 35B and the motor 45, the

motors

35A, 35B, 45 are controlled so that they do not move even if the operating

bodies

33A, 33B, 40 protruding from the case 21 are pushed with a finger. The rotor can be held with a strong force.

When each of the moving

members

32A, 32B, and 42 is in a movable state, any one of the first opposing operating body 33A, the second opposing operating body 33B, and the thumb operating body 43 is pressed to move the moving

members

32A, 32B, When 42 moves in the push-in direction, the movement position is detected by the

position detection devices

38A, 38B or the position detection device 48, and the detection output is given to the control unit 15. The control unit 15 holds data relating to a reaction force action line (reaction force action coefficient) indicating the relationship between the moving distance and the reaction force, and the motor 35A according to the push-in positions of the operating

bodies

33A, 33B, and 43. , 35B or the motor 45 is controlled to generate a torque corresponding to the reaction force action line. Accordingly, a reaction force is applied to the index finger and the middle finger pressing the

opposing operation bodies

33A and 33B, and the thumb pressing the thumb operation body 43.

10A to 12C show examples of data of reaction force action lines (reaction force action coefficients) stored in the memory in the control unit 15. In either case, the horizontal axis represents the push amount (push position) of the operating

bodies

33A, 33B, 43, and the push amount increases toward the right in the figure.

The vertical axis represents the moving force applied from the

motors

35A, 35B, 45 to the moving

members

32A, 32B, 42, and the moving force is applied to each finger from the opposing operating

bodies

33A, 33B and the thumb operating body 43. It becomes. As the positive number on the vertical axis increases, the force for causing the opposing

operation bodies

33A and 33B and the thumb operation body 43 to protrude from the case 21 increases, and the reaction force felt by the finger increases. In FIG. 12A and FIG. 12C, the vertical axis is a negative number, but the negative number on the vertical axis means a force for pulling the opposing operation body 33 B and the thumb operation body 43 toward the case 21. Yes. The numbers on the vertical axis of the diagrams shown in FIGS. 10A to 12C are numerical values for control for setting the driving torque of the motor, and do not mean units of physical force.

The solid lines in the graphs shown in FIGS. 10A to 12C indicate changes in force applied to the moving

members

32A, 32B, and 42 when the operating

bodies

33A, 33B, and 43 are pushed and moved toward the case 21. ing. The broken lines in the graph indicate changes in the force applied to the moving

members

32A, 32B, and 42 when the operating

bodies

33A, 33B, and 43 return and move in the direction protruding from the case 21.

For example, in FIGS. 11A to 11C, the solid line is a horizontal straight line. This means that when each operating

body

33A, 33B, 43 is pushed toward the case 21, the reaction force felt by the finger is constant no matter where it is pushed.

10A to 10C and 12B, there is a region in which the solid line in the graph rises in a substantially linear function toward the right. This means that when each operating

body

33A, 33B, 43 is pushed toward the case 21, the reaction force felt by the finger increases in proportion to the pushing amount, and the slope of the solid line in this case is This corresponds to the elastic modulus when the virtual object to be held is pressed.

<Tactile reaction force when operating a virtual cutting tool>
In the

tactile reproduction devices

1A and 1B, an operator's hand can feel a reaction force imitating holding a plurality of types of virtual objects to be held by hand. Data of reaction force action lines (reaction force action coefficients) of a plurality of types of virtual held objects are stored in a memory provided in the control unit 15. Further, the display driver 14 is controlled by the control unit 15 so that images of a plurality of types of virtual held objects can be selected on the display device 13 shown in FIG. 1A or FIG. 1B, and hand images are also displayed. . These displays are based on computer graphics.

FIG. 6 shows a state in which the cutting tool 60 is displayed on the display screen 13a of the display device 13 as a virtual object to be held. The cutting tool 60 is a nipper, and is provided with a pair of

handles

61 and 61 and a cutting unit 62 that performs cutting by operating the

handles

61 and 61. On the display screen 13a, a work 63 to be cut by the cutting tool 60 is displayed. The work 63 is an image of a metal wire.

The image of the hand H is displayed on the display screen 13a, and the image of the hand H appearing on the display screen 13a is moved by a predetermined operation, and the

handles

61 and 61 of the image of the cutting tool 60 are moved by the image of the hand H. The display changes so that is held. For example, when the input device 20 is moved while being held by hand, the movement posture is detected by the posture detection unit 53 and information on the posture is given to the control unit 15. Based on this information, the display driver 14 is controlled, and the image of the hand H appearing on the display screen 13a moves to go to grip the

handles

61, 61. Alternatively, when the cutting tool 60 is selected as an object to be held with another operation member such as a keyboard, the display changes so that the hand H appearing on the display screen 13a holds the image of the cutting tool 60.

When the cutting tool 60 is selected as a virtual object to be held, the

motors

35A, 35B, and 45 are controlled, and the initial positions of the opposing

operation bodies

33A and 33B and the thumb operation body 43 are set. When the virtual object to be held is the cutting tool 60, the opposing

operation bodies

33A and 33B and the thumb operation body 43 are set to an initial position that protrudes from the case 21 to the maximum as shown in FIG.

The control unit 15 reads the data of the reaction force action line (reaction force action coefficient) shown in FIGS. 10A to 10C from the memory, and the control unit 15 reads the

motors

35A, 35B, 45 based on the reaction force action line data. To control. FIG. 10A shows reaction force action lines given from the motor 45 to the moving member 42 and the thumb operation body 43 in the third tactile sensation generating unit 40, and FIG. 10B shows the motor in the first tactile sensation generating unit 30A. FIG. 10C shows reaction force action lines given from 35A to the moving member 32A and the first opposing operation body 33A, and FIG. 10C shows the moving member 32B and the second opposing operation from the motor 35B in the second tactile sensation generating unit 30B. The reaction force action line given to the body 33B is shown.

As shown in FIG. 6, when an image in which the hand H holds the

handles

61 and 61 of the cutting tool 60 is displayed on the display screen 13a, the input device 20 held by the right hand as shown in FIG. 1A. When the user presses the thumb operating body 43 with the thumb, presses the first opposing operating body 33A with the index finger, and presses the second opposing operating body 33B with the middle finger, the thumb F1 of the image of the hand H and the index finger are displayed on the display screen 13a. The display changes so that the

handles

61, 61 held by F2 and the middle finger F3 are brought closer to each other. When the

handles

61 and 61 approach each other to some extent, the image changes so that the linear workpiece 63 is cut by the cutting portion 62.

In this series of operations, the change in the reaction force Fa (see FIG. 9A) applied to the thumb operating body 43 is as shown by a solid line in FIG. 10A, and the reaction force indicated by a numerical value of approximately “190” at the beginning of pressing. Fa feels on the thumb. When the thumb operating body 43 is pushed, the reaction force Fa felt by the thumb increases with a substantially linear function, and approaches the distance where the

handles

61 and 61 are within the display screen 13a shown in FIG. When the workpiece 63 is cut, the reaction force Fa acting on the thumb operating body 43 is rapidly reduced from the maximum value, and the reaction force value becomes “0”. Thereafter, the reaction force Fa acting on the thumb operating body 43 is recovered in order to reproduce the resistance force acting on the thumb F1 holding the

handles

61, 61.

The change in the reaction force Fb applied to the first opposing operation body 33A is as shown by the solid line in FIG. 10B, and the basic change in the reaction force is the same as that in FIG. 10A. However, the initial reaction force Fb at which the first opposing operation body 33A starts to be pushed with the index finger is “0”. Further, the reaction force Fb applied to the first opposing operation body 33A is smaller than the reaction force Fa applied to the thumb operation body 43 from the start of pressing by the index finger to the maximum value of the reaction force just before the cutting operation. It is set to be.

The change in the reaction force Fc applied to the second opposing operation body 33B is as shown by the solid line in FIG. 10C, and the basic reaction force change is the same as in FIGS. 10A and 10B. The numerical value of the initial reaction force Fc at which the second opposing operation body 33B starts to be pushed with the middle finger is “approximately 110”, which is larger than the initial value of the reaction force Fb against the index finger and smaller than the initial value of the reaction force Fa against the thumb. Further, the maximum value of the reaction force Fc immediately before the cutting operation is almost the same value as the maximum value of the reaction force Fb acting on the index finger shown in FIG. 10B.

In the reaction force control, when the thumb operating body 43 is pushed with the thumb, the first opposing operating body 33A is pushed with the index finger, and the second opposing operating body 33B is pushed with the middle finger, it is as if the display screen 13a in FIG. The reaction force when grasping the

handles

61, 61 of the cutting tool 60 shown in FIG. 6 becomes large, and a tactile sensation in which the reaction force rapidly decreases after the workpiece 63 is cut can be obtained.

Here, when the cutting operation of the workpiece is performed by grasping the handle of the actual cutting tool 60 with an actual hand, one handle 61 is pushed only by the thumb, and the other handle 61 is operated by a plurality of fingers of the index finger and the middle finger. When pressed, the thumb and other fingers apply reaction forces to each other. Therefore, in an actual operation, a larger reaction force acts on the thumb than on the index finger and the middle finger. Further, between the middle finger and the index finger pressing the same handle 61, the handle 61 is strongly pressed by the middle finger, so that a larger reaction force than the index finger tends to act on the middle finger.

Also, in the structure of the human hand, the thumb is short and the index and middle fingers are long, so even if you recognize that each finger is moving with the same force, the force acting on the held object from the thumb is actually The force is larger than the force acting on the held object from the index finger or the middle finger.

Therefore, as shown in FIGS. 10A to 10C, the reaction force Fa acting on the thumb operation body 43 is changed from the start of pressing to the maximum value, the reaction force Fb acting on the first counter operation body 33A and the second reaction force Fb. The reaction force Fc acting on the opposing operation body 33B is made larger. That is, the reaction force applied from the thumb operation body 43 to the thumb is larger than the reaction force applied from the two opposing

operation bodies

33A and 33B to the index finger and the middle finger. When a difference is given to the reaction force in this way, it is possible to obtain a feel of reaction force equivalent to that actually holding the

handles

61, 61 in the human hand.

Further, as shown in FIGS. 10B and 10C, the initial value of the reaction force Fc acting on the second opposing operation body 33B is made larger than the initial value of the reaction force Fb acting on the first opposing operation body 33A. Yes. As a result, the initial value of the reaction force applied from the second opposing operation body 33B to the middle finger is slightly larger than the initial value of the reaction force applied from the first opposing operation body 33A to the index finger. This also makes it possible to feel the same operational feeling as when the cutting tool 60 is actually operated with the thumb, index finger, and middle finger operating the input device 20.

In addition, when the operation of the finger with respect to the operating

bodies

33A, 33B, 43 and the change of the image of the hand H in the display screen 13a shown in FIG. By generating cutting sounds such as “pick” and “click” from the sound generation unit, the operator can easily recognize the feeling that the cutting tool 60 is actually operated.

When the cutting operation by the cutting unit 62 is completed and the pressing force applied to each operating

body

33A, 33B, 43 is removed from the finger, as shown by a broken line in FIGS. 10A, 10B, and 10C, A return moving force is applied to the moving

members

32A, 32B, and 42 from the

motors

35A, 35B, and 45, and the operating

bodies

33A, 33B, and 43 return to the initial positions protruding from the case 21. As indicated by broken lines in FIGS. 10A, 10B, and 10C, the restoring forces applied to the moving

members

32A, 32B, and 42 from the

motors

35A, 35B, and 45 at this time are all controlled by the same numerical value “80”. .

<Tactile reaction force when holding a soft object that deforms flexibly as an object to be held>
FIG. 7 shows a display example when the squeeze bottle 70 is selected as a soft object that is a virtual object to be held that is deformed flexibly.

The squeeze bottle 70 displayed on the display screen 13a includes a bottle body 71 that is assumed to contain food contents such as mayonnaise and ketchup, and a nozzle cap 72 that is fixed to the opening end of the bottle body 71. And a discharge nozzle 73 formed in the nozzle cap 72.

When the input device 20 held with the right hand is moved and the image of the hand H displayed in the display screen 13a is moved to the position of the image of the squeeze bottle 70 in the same manner as when the cutting tool 60 is selected, The display screen 13 a changes to an image in which the squeeze bottle 70 is grasped by the hand H.

When the squeeze bottle 70 is displayed on the selected display screen 13a as a virtual object to be held, the initial positions of the first and second opposing operating

bodies

33A and 33B and the thumb operating body 43 of the input device 20 are displayed. Is set in a state protruding from the case 21, as shown in FIG.

Hold the thumb operation body 43 with the thumb, hold the first counter operation body 33A with the index finger, hold the second counter operation body 33B with the middle finger, and rotate the hand counterclockwise in the direction seen from the eyes. When the posture of the input device 20 is rotated, the operation is detected by the posture detection unit 53 shown in FIG. 5 and the information is given to the control unit 15. Based on this posture information, the display driver 14 is controlled by the control unit 15 so that the image of the hand H and the image of the squeeze bottle 70 displayed on the screen 13a rotate counterclockwise as shown in FIG. The display changes to.

In this state, when the thumb operating body 43 is pressed with the thumb, the first opposing operating body 33A is pressed with the index finger, and the second opposing operating body 33B is pressed with the middle finger, the screen is displayed on the display screen 13a shown in FIG. The thumb F1 of the hand H, the forefinger F2, and the middle finger F3 approach each other, and the image changes so that the bottle body 71 is narrowed and narrowed. Then, an image is displayed so that the food content 74 such as mayonnaise is squeezed out from the discharge nozzle 73.

At this time, the change in the reaction force applied from the motor 45 to the thumb operation body 43 is as shown by the solid line in the graph of FIG. 11A, and the change in the reaction force applied from the motor 35A to the first opposing operation body 33A is 11B, the change in the reaction force applied from the motor 35B to the second opposing operation body 33B is as indicated by the solid line in the graph of FIG. 11C. In any of the operating

bodies

33A, 33B, and 43, the reaction forces Fa, Fb, and Fc shown in FIG. 9A are always constant with respect to changes in the pushing stroke.

However, as shown in FIG. 11A, the reaction force Fa given to the thumb is set to be larger than the reaction forces Fb and Fc given to the index finger and middle finger shown in FIGS. 11B and 11C. The reaction force Fc applied to the middle finger is set larger than the reaction force Fb applied to the index finger.

When the same actual squeeze bottle 70 displayed in FIG. 7 is grasped and squeezed with an actual hand, since the index finger and the middle finger are opposed to one thumb, A large reaction force acts on the thumb. Further, a larger reaction force is more likely to act on the middle finger pushing the same handle 61 than on the index finger. Furthermore, in the structure of the human hand, the thumb is short and the index and middle fingers are long, so even if it is recognized that each finger is operated with the same force, the force acting on the held object from the thumb is actually The force acting on the held object from the index finger or the middle finger becomes larger.

Therefore, as shown in FIG. 11A, by increasing the reaction force of the thumb, it is possible to give each finger operating the input device 20 an operation feeling equivalent to that of squeezing the actual squeeze bottle 70. it can. In addition, the reaction force acting on the operating

bodies

33A, 33B, and 43 with each finger is a constant force even when the stroke in the pressing direction changes, so the contents 74 such as mayonnaise are actually squeezed out. You can get the same reaction force feeling as

Further, the operator operates the input device 20 while viewing the image shown in FIG. 7, and further generates a sound imitating that the content 74 is squeezed out of the squeeze bottle 70 (a discharge sound of the content). Can obtain an operational feeling as if actually handling the squeeze bottle 70.

After the operation imitating squeezing the contents 74 with the squeeze bottle 70 is completed, when the pressing force by each finger is weakened, the operating body 33A is caused by the reaction force indicated by the broken lines in the graphs of FIGS. 11A, 11B, and 11C. , 33B, 43 are returned to a posture protruding from the case 21.
<Tactile reaction force when operating a spray bottle as a virtual object to be held>
FIG. 8 shows a display example when the spray bottle 80 is selected as a virtual object to be held.

The image of the spray bottle 80 displayed on the display screen 13 a includes a bottle body 81 that is assumed to contain various liquids, a nozzle cap 82 that is fixed to the opening end of the bottle body 71, and a nozzle cap 82. A discharge nozzle 83 provided forward and a discharge button 84 provided on the nozzle cap 82 are provided.

When the input device 20 held with the right hand is moved and the image of the hand H displayed in the display screen 13a is moved to the position of the image of the spray bottle 80, the display screen 13a is moved to the position of the spray bottle 80 by the hand H. It changes to a grabbed image.

When the image of the spray bottle 80 is selected as a virtual object to be held and displayed on the display screen 13a, the moving member 42 is moved in the pull-in direction by the motor 45 as shown in FIG. 12A, as shown in FIG. 12C. In addition, the moving member 32B is moved in the retracting direction by the motor 35B. As a result, as shown in FIG. 9B, the initial state of the input device 20 is a state in which the thumb operation body 43 and the second opposing operation body 33B are retracted toward the case 21, and the first opposing operation body Only 33A protrudes from the case 21.

A thumb operation body 43 that is retracting toward the case 21 is held by the thumb, and a second counter operation body 33B that is also retracting is held by the middle finger, and the first counter operation body protruding from the case 21 When 33A is pushed in with the index finger, the index finger F2 displayed on the display screen 13a shown in FIG. 8 moves to retreat the image of the discharge button 84, and at the same time, the liquid 85 from the protruding nozzle 83 displayed on the display screen 13a. The image changes so that is sprayed in a mist.

At this time, the change in the reaction force applied from the motor 35A to the first opposing operation body 33A is as shown by the solid line in the graph of FIG. 12A, and the operation acting on the index finger as the first opposing operation body 33A is pressed. Reaction force gradually increases.

The operator actually operates the input device 20 while viewing the image shown in FIG. 8, and further generates a sound imitating that the liquid 85 is sprayed from the spray bottle 80 (liquid ejection sound). You can get an operational feel as if you were handling a bottle.

1A, 1B

Tactile reproduction device

10A, 10B Device main body 11 Mask type main body 13 Display device 15 Control unit 20 Input device 21 Case 28 Mechanism chassis 30A First tactile generation unit 30B Second

tactile generation unit

32A, 32B Moving member 33A First 1 counter operation body 33B second

counter operation bodies

35A, 35B

motors

38A, 38B position detection device 40 third tactile generating unit 42 moving member 43 thumb operation body 45 motor 48 position detection device

Claims

An input device and a control unit;
The input device is provided with a plurality of operating bodies projecting from a case, a position detecting device for detecting the projecting position of each operating body from the case, and a motor for applying a force to each operating body,
The controller drives the motor to apply a reaction force to the operating body when it is detected that the operating body has been pushed and moved in the direction of the case based on a detection signal from the position detecting device. ,
A tactile reproduction device characterized in that, when it is detected that any of the operating bodies has moved in the direction of the case based on a detection signal from the position detection device, control is performed to generate a sound from the sound generation device. .
The input device includes a thumb operating body that is pressed with a thumb, a first opposing operating body and a second opposing operating body that are individually pressed with an index finger and a middle finger,
The tactile sensation reproducing device according to claim 1, wherein the first opposing operating body and the second opposing operating body protrude in opposite directions with respect to the protruding direction of the thumb operating body.
A display device is provided,
The control unit displays a virtual held object image and a hand image on the display screen of the display device,
When the operating body of the input device is pressed, a display for changing the state of the held object in the image of the hand is performed,
The tactile reproduction device according to claim 1, wherein a sound corresponding to a change in the state of the held object is emitted from the sound generation device.
The said held object is a cutting tool that is operated by being sandwiched between fingers, and when the operation for cutting the workpiece by the cutting tool is displayed on the display screen, a cutting sound is emitted from the sounding device. The tactile reproduction device described.
The object to be held is a squeeze bottle held by a finger, and when the operation for discharging the content from the squeeze bottle is displayed on the display screen, a discharge sound of the content is emitted from the sound producing device. Item 4. The tactile sensation reproducing device according to Item 3.
The liquid to be held is a spray bottle operated by a finger, and when the operation for discharging liquid from the spray bottle is displayed on the display screen, a liquid discharge sound is emitted from the sound generating device. The tactile reproduction device described.