JP2015090516A - Viscosity sense presentation device, and method and program of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To artificially present tactile of the viscosity of fluid.SOLUTION: The viscosity sense presentation device 1 includes an input unit 11, a delay time acquisition unit 12, an imaging unit 13, and a display unit 15. The imaging unit 13 photographs video showing that a person moves while coming into contact with fluid with own body or an object carried by the body. The input unit 11 receives an index value corresponding to a desired viscosity. The delay time acquisition unit acquires the delay time corresponding to the index value received by the input unit 11, and the display unit 15 displays video obtained by delaying the video photographed by the imaging part 13 in accordance with the delay time acquired by the delay time acquisition unit 12.

Description

  The present invention relates to a technique for presenting a viscosity sensation that makes a person perceive the tactile sensation of the viscosity of a fluid such as a liquid.

  2. Description of the Related Art Conventionally, a method of delaying a mouse cursor displayed on a display is known as a method for artificially transmitting a resistance feeling of a fluid such as a liquid to a person (Non-Patent Document 1). In Non-Patent Document 1, when a cursor is operated on an image representing fluid, the movement of the cursor is delayed with respect to the user's input, thereby changing the resistance of the fluid in the image felt by the user. Is realized.

Keita Watanabe, Michiaki Yasumura, “RUI: Realizable User Interface Information Realization Using Cursors”, 27th Human Interface Society Meeting “VR Psychology and Physiology”, Human Interface Society Research Report, pp. 35-38 , (2004).

  The technique of Non-Patent Document 1 is a technique for changing the resistance of fluid in an image estimated by the user by delaying the cursor on the screen, but the mouse that the user's hand touches to operate the cursor. Or until now, an operation input unit such as a touch panel cannot be perceived as if the viscosity of what the user is touching has changed. For this reason, the tactile sensation of the viscosity of the fluid existing in the physical world could not be changed.

  An object of the present invention is to provide a technique for making the fluid itself perceived as if the viscosity of the fluid itself has changed, that is, providing a pseudo-tactile feel of the fluid viscosity.

  In order to solve the above-mentioned problems, a video of a person moving in contact with a fluid on his / her body or an object in contact with the body is photographed, and a delay time corresponding to an index value corresponding to a desired viscosity is obtained. Then, the captured video is displayed according to the delay time.

  With the above, it is possible to present a fluid tactile feel in a pseudo manner.

The figure for exemplifying the viscosity feeling presentation device of an embodiment. FIG. 4 is a diagram for illustrating the positional relationship between the imaging unit and the display unit according to the embodiment. The figure for illustrating the container in which the fluid was put. FIG. 4 is a diagram for illustrating the positional relationship between the imaging unit and the display unit according to the embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
As illustrated in FIG. 1, the viscous sensation presentation apparatus 1 according to the present embodiment includes an input unit 11, a delay time acquisition unit 12, a photographing unit 13, a video delay unit 14, and a display unit 15.

  The imaging unit 13 is an imaging device such as a camera, and is a generic term for a user (person) 's own body or a target that touches the user's body (hereinafter referred to as a "user's own body" and a "target that contacts the user's body"). Then, the user's own body etc.) is photographed while touching the fluid and exercising. The captured video is sent to the video delay unit 14. The “user's own body” may be any part of the user, but is preferably a part that can be directly seen by the user's own naked eye. Examples of such “user's own body” are hands, arms, legs, and the like. In addition, the “object that touches the user's body” may be anything, but the object that touches the user's own part (eg, hand, arm, leg, etc.) that can be directly seen by the user's own naked eye. It is desirable that In addition, there is no limitation on the shape of the “object that touches the user's body”, rod shape such as cylinder, prism, cylinder or square tube, plate shape, spherical shape, streamline shape, cube shape, rectangular parallelepiped shape, pyramid shape Any shape such as a cone shape or a frustum shape may be used. However, in this embodiment, the “user's own body etc.” can present a pseudo-viscosity higher than the viscosity of the fluid actually touched, but this “user's own body etc.” It is difficult to simulate a viscosity that is lower than the viscosity of the fluid touching the fluid. Therefore, in order to simulate various viscosities, it is desirable that the fluid that actually touches the user's own body or the like has a low viscosity (for example, a liquid such as water). In addition, in order to make it easy to perceive a large viscosity, it is desirable that the drag of this “target” against the fluid is larger. It is desirable that the shape has a large resistance against fluid such as. Further, in order to make the pseudo-viscosity strength to be presented symmetrical, it is desirable that the shape of the “object” be line-symmetric with respect to a center line perpendicular to the moving direction in the fluid. On the other hand, in order to make the pseudo viscosity to be presented asymmetrical, it is desirable that the shape of the “object” is not line symmetric with respect to a center line perpendicular to the moving direction in the fluid. In addition, the “target in contact with the user's body” may be a target that directly touches the user's body, or may be a target that touches the user's body indirectly. An example of a situation in which the user's own body is in contact with the fluid and moving is a situation in which the user's hand is in direct contact with the fluid and the object touching the user's body is in contact with the fluid and moves. An example of the situation is that the stick held by the user's hand is in contact with the fluid and moving. Moreover, there is no limitation on the fluid that the user's own body touches.

  The input unit 11 is an input device such as a mouse, a keyboard, a numeric keypad, and the like, and an index value (an index value corresponding to a desired viscosity) indicating the viscosity level of the fluid that the user wants to perceive is input. The index value may be the viscosity of the fluid that is desired to be perceived, or may be a value that represents how much higher the viscosity of the fluid that is perceived than the fluid that the user's own body is actually touching. good. Further, the larger the index value, the larger the viscosity of the fluid to be perceived, and the larger the index value, the smaller the viscosity of the fluid to be perceived. An example of the index value is absolute viscosity. The index value input to the input unit 11 is sent to the delay time acquisition unit 12.

  The delay time acquisition unit 12 is a processing unit configured by reading a predetermined program into a computer having a CPU (central processing unit), a RAM (random-access memory), and the like, and an index value input to the input unit 11 Accordingly, the delay time of the video (delay time corresponding to the index value input to the input unit 11) is determined. In the method of this embodiment, if the delay time is too small, the pseudo viscosity perceived by the user is reduced. On the other hand, if the delay time is too long, the difference between the actual movement of the user's own body etc. and the delayed movement becomes large, and the correlation between them becomes sparse. Viscosity becomes smaller. Therefore, in order to make the user perceive a large viscosity, it is preferable that the delay time is between 150 msec and 1000 msec, and the higher the viscosity represented by the input index value, the delay time becomes 600 msec or in the vicinity thereof. More preferably, they are set so as to be close. “Near 600 msec” is any value in the range of 600−α msec or more and 600 + β msec or less (where α and β are positive constants). In other words, the delay time acquired by the delay time acquisition unit 12 when the input index value is the first value is the delay time acquisition unit 12 when the index value is a second value smaller than the first value. More preferably, it is closer to 600 msec than the delay time to be acquired. However, the viscosity represented by the index value of the second value is smaller (lower) than the viscosity represented by the index value of the first value. That is, the second value corresponds to the fact that the index value is less viscous than the first value. In addition, when the user's own body or the like touches the fluid and makes a periodic motion, the delay time is desirably about 75% of the motion cycle (for example, 75% or less of the motion cycle or less). The delay time determined by the delay time acquisition unit 12 is sent to the video delay unit 14.

  The video delay unit 14 is a processing unit configured by reading a predetermined program into a computer, and a delayed image obtained by delaying the video input from the imaging unit 13 by the delay time input from the delay time acquisition unit 12. Is output to the display unit 15. That is, the video for each frame input from the imaging unit 13 is delayed by the delay time input from the delay time acquisition unit 12 and output to the display unit 15.

  The display unit 15 is a display or the like, and displays a delayed video obtained by delaying the video captured by the imaging unit 13 according to the delay time acquired by the delay time acquisition unit 12. The display unit 15 of the present embodiment displays a delayed video obtained by delaying each frame of the video captured by the imaging unit 13 by the delay time acquired by the delay time acquisition unit 12. The user visually senses the delayed image displayed from the display unit 15 while feeling the drag when the user's own body touches the fluid and moves. This allows the user to perceive a pseudo viscosity that is different from the actual viscosity of the fluid touched by the user's own body. In other words, the user can perceive (the illusion) that the viscosity of the liquid touched by the user's own body has changed.

  If the user can view the delayed video acquired by the delay time acquisition unit 12 while exercising the user's own body etc. while touching the fluid, the imaging unit 13 and the display unit 15 There is no limitation on the positional relationship, and the above-described effects can be obtained regardless of the positional relationship. However, by devising the positional relationship between the imaging unit 13 and the display unit 15, it is possible to make an illusion that the viscosity of the liquid has changed more realistically. For example, the display surface of the display unit 15 (the display surface facing the user's eyes) is disposed between the position where the “user's own body etc.” captured by the image capturing unit 13 actually exists and the user's eyes. When the above-described delayed video is displayed on this display surface, this user seems to have the object of the delayed video acquired by the delay time acquisition unit 12 at or near the position where the user's own body or the like actually exists. To perceive. Thereby, it is possible to make an illusion that the viscosity of the liquid has changed more realistically. Such a configuration can be realized if the imaging unit 13 is provided at a position where the outside of the back side of the display surface of the display unit 15 (the region on the back side of the display surface of the display unit 15) can be imaged.

  FIG. 2 illustrates such a positional relationship between the photographing unit 13 and the display unit 15. For simplification, the input unit 11, the delay time acquisition unit 12, and the video delay unit 14 are omitted in FIG. The imaging unit 13 in the example of FIG. 2 includes a camera 13a and a mirror 13b, and the display unit 15 includes a monitor 15a such as a liquid crystal monitor and a mirror 15b (display surface). The mirror 13b and the mirror 15b are mirror surfaces of a plate-like double-sided mirror disposed between the monitor 15a and the camera 13a. The screen 15aa of the monitor 15a faces the mirror 15b, and the lens 13aa of the camera 13a faces the mirror 13b. In the example of FIG. 2, one end of the support column 17 b is fixed to the plate-like base 17 a, and the chin rest 18 is fixed to the other end of the support column 17 b. The mirror 13b and the mirror 15b are disposed at a position closer to the base 17a side than the chin rest 18 and are fixed substantially parallel to the base 17a. The camera 13a is disposed closer to the base 17a than the mirror 13b, and is fixed to the support column 17b. The screen 15aa of the monitor 15a is directed toward the lens 13aa of the camera 13a, and the lens 13aa of the camera 13a is directed toward the screen 15aa of the monitor 15a. A container 16 containing a fluid 16a is disposed on the surface of the base 17a facing the mirror 13b (FIG. 3). The user 100 places the chin on the chin rest 18 and moves the hand 101 (such as the user's own body) directly touching the fluid 16a in the container 16 in the X direction and / or the Y direction. The images of the container 16, the fluid 16a, and the hand 101 are reflected by the mirror 13b and photographed by the camera 13a. The delayed video obtained from the video by the delay time acquisition unit 12 is displayed from the screen 15aa of the monitor 15a, reflected by the mirror 15b, and viewed by the user 100. Thereby, the user 100 perceives that the object of the delayed image exists at the position where the container 16, the fluid 16a, and the hand 101 actually exist or in the vicinity thereof.

  FIG. 4 illustrates the positional relationship between another imaging unit 13 and the display unit 15. For simplification, the input unit 11, the delay time acquisition unit 12, and the video delay unit 14 are also omitted in FIG. In this example, an electronic device such as a smartphone terminal device, a tablet terminal device, a mobile phone terminal device, or the like in which a photographing unit 13 such as a camera is attached to the back surface of the display unit 15 such as a liquid crystal screen is used. The lens of the imaging unit 13 in this example faces the back side outward of the display unit 15 and captures the back side outward of the display unit 15. In the example of FIG. 4, the user 100 moves the hand 101 that has touched the fluid 16 a in the container 16 in the X direction and / or the Y direction, and captures the image by the imaging unit 13. The delayed video obtained by the delay time acquisition unit 12 from the video is displayed on the display unit 15. Thereby, the user 100 perceives that the object of the delayed image exists at the position where the container 16, the fluid 16a, and the hand 101 actually exist or in the vicinity thereof.

[Second Embodiment]
The second embodiment is a modification of the first embodiment, and the delay time is determined using not only the above-described index value but also exercise information such as the user's own body. In the following, only differences from the items described so far will be described, and parts already described will be denoted by the same reference numerals and description thereof will be omitted.

  As illustrated in FIG. 1, the viscous sensation presentation device 2 according to the present embodiment includes an input unit 11, a delay time acquisition unit 22, a motion information acquisition unit 23, a photographing unit 13, a video delay unit 14, and a display unit 15.

  The exercise information acquisition unit 23 acquires exercise information such as a user's own body that moves by touching the fluid. Examples of motion information are a motion cycle, angular velocity, speed, acceleration, and the like. For example, in the example of FIG. 2, a motion information acquisition unit 23 such as a motion sensor device is installed on the base 17 a to acquire motion information of the hand 101 in the X direction and / or Y direction. The acquired exercise information is input to the delay time acquisition unit 22.

  The delay time acquisition unit 22 determines the delay time in consideration of the index value input from the input unit 11 and the exercise information input from the exercise information acquisition unit 23. For example, the delay time acquisition unit 22 determines the delay time so as not to exceed the vicinity of 75% of the exercise cycle of the user's own body or the like indicated by the exercise information (for example, 75% or less of the exercise cycle or less). Further, the delay time acquisition unit 22 may determine the delay time so that the upper limit of the delay time becomes smaller as the speed of the user's own body or the like becomes faster (the shorter the exercise cycle). The delay time obtained by the delay time acquisition unit 22 is input to the video delay unit 14. Others are the same as the first embodiment.

[Third Embodiment]
The third embodiment is a modification of the first and second embodiments, and sets a delay time for each video frame.

  As illustrated in FIG. 1, the viscous sensation presentation apparatus 3 according to the present embodiment includes an input unit 11, a delay time acquisition unit 32, a photographing unit 13, a video delay unit 34, and a display unit 15. In the video delay unit 14 of the first and second embodiments, all frames of the video shot by the shooting unit 13 are delayed by the same delay time. In this embodiment, the delay time acquisition unit 32 acquires the delay time for each frame of the video captured by the imaging unit 13, and each frame of the video captured by the video delay unit 34 is captured by the delay time acquisition unit 32. The display unit 15 displays the delayed video of each frame obtained by delaying the acquired delay time for each frame. Similar to the delay time acquisition unit 12, the delay time acquisition unit 32 determines a delay time for each frame according to the index value input to the input unit 11. However, the delay time is determined according to information corresponding to the frame as well as the index value. Thereby, the delay time of the video to be displayed can be dynamically changed. For example, the delay time for each frame acquired by the delay time acquisition unit 32 is longer in the later frame, and the delay time corresponding to the index value (for example, the first and second delay times) Control is performed so as not to exceed the delay time exemplified in the embodiment or a function value thereof. When the delay time of the image is gradually increased in this way, the delayed image displayed on the display unit 15 becomes a slow motion image, and the viscosity of the fluid touching the user's own body is higher. Perceived as if In addition, the motion information acquisition unit 23 described in the second embodiment is provided, and the delay time acquisition unit 32 further uses the motion information of each frame obtained by the motion information acquisition unit 23 to determine the delay time for each frame. Also good. Others are the same as the first or second embodiment.

[Fourth Embodiment]
The fourth embodiment is a modification of the first to third embodiments. In the fourth embodiment, the viscosity of a plurality of fluids and delay times that cause each perception are associated in advance, and the delay time acquisition unit determines the delay time corresponding to the index value according to the association.

  As illustrated in FIG. 1, the viscosity sensation presentation device 4 according to the present embodiment includes an input unit 41, a delay time acquisition unit 42, a photographing unit 13, a video delay unit 14, a display unit 15, and a storage unit 43. The storage unit 43 stores a database in which the viscosity of a plurality of fluids is associated with delay times that cause each perception. An index value (an index value corresponding to viscosity) corresponding to a desired fluid (fluid to be perceived) among a plurality of fluid candidates stored in the storage unit 43 is input to the input unit 41. At this time, the display unit 15 displays a list of a plurality of fluids indicated by the database stored in the storage unit 43, the user selects one of the displayed candidates, and sets an index value corresponding to the selected fluid. You may input into the input part 41. FIG. The index value input to the input unit 41 is input to the delay time acquisition unit 42. The delay time acquisition unit 42 refers to the database of the storage unit 43 and acquires a delay time corresponding to the index value input from the input unit 41. The subsequent processing of the delay time acquisition unit 42 is the same as any one of the delay time acquisition units 12 to 32 of the first to third embodiments. When motion information is necessary for the delay time acquisition unit 42 to acquire the delay time, the viscosity sensation presentation device 4 further includes a motion information acquisition unit 23, and the delay time acquisition unit 42 is input from the motion information acquisition unit 23. The delay time may be determined using the further exercise information. Others are the same as the first to third embodiments.

[Other variations]
In addition, this invention is not limited to the above-mentioned embodiment. For example, a delay time may be set according to the movement direction of the user's own body, or a different delay time may be set depending on the movement direction. Further, the delay time when the user's own body or the like moves in a specific direction (for example, the positive direction (right direction) of X in FIG. 2), the user's own body or the like moves in the opposite direction (for example, FIG. 2). It may be set so as to be closer to a specific value (for example, 600 msec) than the delay time when moving in the negative direction of X (left direction). Alternatively, the delay time when the user's own body or the like moves along a specific first axis (for example, the X direction (left and right direction) in FIG. 2), the user's own body or the like moves to the first axis. It may be set to be closer to a specific value (for example, 600 msec) than the delay time in the case of moving along the vertical second axis (for example, the Y direction (vertical direction in FIG. 2)). Alternatively, when the user's own body moves along a specific direction or along a specific axis, the delay time for each frame is longer in the later frames and the maximum delay time. Control is performed so that the delay time corresponding to the index value does not exceed (third embodiment, etc.), and when moving along other directions or axes, control is performed so that the delay time of each frame is the same. You may do (1st, 2nd embodiment etc.). By controlling the delay time in this way, the user can perceive (illusion) that the fluid is flowing (that is, the flow of the fluid).

  The various processes described above are not only executed in time series according to the description, but may also be executed in parallel or individually as required by the processing capability of the apparatus that executes the processes. Needless to say, other modifications are possible without departing from the spirit of the present invention.

  The above-described configuration can be realized by a computer (for example, a personal computer, a smartphone terminal device, a tablet terminal device, a mobile phone terminal device, or the like) that includes a camera, an input device, a monitor, a CPU, a RAM, and the like. When the configuration described above is realized by a computer, the processing contents of the functions that should be included in the processing functions of the delay time acquisition unit and the video delay unit are described by a program. By executing this program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium. An example of a computer-readable recording medium is a non-transitory recording medium. Examples of such a recording medium are a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, and the like.

  This program is distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing the process, this computer reads a program stored in its own recording device and executes a process according to the read program. As another execution form of the program, the computer may read the program directly from the portable recording medium and execute processing according to the program, and each time the program is transferred from the server computer to the computer. The processing according to the received program may be executed sequentially.

  In addition, at least a part of the processing functions described above may be realized by hardware such as an integrated circuit.

  In this way, by delaying an image in which a person is directly or indirectly touching and moving the fluid, the person can perceive (illusion) that the viscosity of the fluid has increased. The delay time of the video or the time change of the delay time can be manipulated according to the viscosity to be perceived. By using this technology, for example, the user can experience a pseudo sense of the viscosity of a fluid product such as cosmetics or adhesive without actually touching the product. Even when the product cannot be actually touched, such as Internet shopping, the user can know the feel of whether the product is a smooth touch or a thick touch. The liquid prepared at the user's hand is harmless, such as water, and can be easily obtained, so it is convenient even if you do not want to touch it like an adhesive but want to know the sense of viscosity. .

1-4 Viscous sensation presentation devices 11, 41 Input units 12, 22, 32, 42 Delay time acquisition unit 13 Imaging unit 23 Movement information acquisition units 14, 34 Video delay unit 15 Display unit 43 Storage unit

Claims (7)

A shooting unit that shoots an image of a person moving in contact with a fluid on his or her body,
An input unit for inputting an index value corresponding to a desired viscosity;
A delay time acquisition unit that acquires a delay time corresponding to the index value input to the input unit;
A display unit for displaying a video obtained by delaying the video captured by the imaging unit according to the delay time acquired by the delay time acquisition unit;
Viscous sensation presentation device. The viscous sensation presentation device according to claim 1,
The delay time acquired by the delay time acquisition unit when the index value is the first value is the delay time acquisition unit when the index value is a second value corresponding to the viscosity being smaller than the first value. Viscous sensation display device characterized in that it is closer to 600 msec than the delay time acquired by. The viscous sensation presentation apparatus according to claim 1 or 2,
A movement information acquisition unit that acquires a period of movement of the body that is in contact with the fluid or is in contact with the body;
The viscosity sensation presentation apparatus, wherein the delay time acquisition unit determines the delay time so as not to exceed 75% of the movement cycle acquired by the movement information acquisition unit. The viscous sensation presentation device according to any one of claims 1 to 3,
The delay time acquisition unit acquires a delay time for each frame of the video shot by the shooting unit,
The display unit displays a video obtained by delaying each frame of a video captured by the imaging unit by a delay time for each frame acquired by the delay time acquisition unit. The viscous sensation presentation apparatus according to claim 4,
The delay time for each frame acquired by the delay time acquisition unit is such that the later time frame has a larger delay time and the maximum delay time does not exceed the delay time corresponding to the index value. Viscous sensation presentation device. A shooting step for shooting an image of a person moving in contact with a fluid on his / her body or an object in contact with the body;
An input step in which an index value corresponding to a desired viscosity is input;
A delay time acquisition step of acquiring a delay time corresponding to the index value input in the input step;
A display step of displaying a video delayed by the delay time acquired in the delay time acquisition step, the video captured by the imaging unit;
A method for presenting a viscous sensation.   A program for causing a computer to function as the viscous sensation presentation device according to any one of claims 1 to 5.

Images