JP2000339490A - Vr sickness reducing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a VR(virtual reality) sickness reducing method by learning a virtual space since a measure when VR sickness occurs corresponds to only a case when VR sickness is considerably deteriorated such as a case when a user himself depresses an urgent stop key or a monitor stops a system by judgement by a monitor. SOLUTION: A user 11 learns a virtual space with an introduction process and a content adjusted to the state of the user 11 can be changed in accordance with the detection of VR sickness of the user 11 so as to prevent the deterioration of the VR sickness of the user 11 by an intoxication corresponding process. Then, influence using the virtual space is removed after the VR system is used and adverse influence after the VR system is used is avoided.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a general-purpose virtual reality system (hereinafter, referred to as a VR system).
The present invention relates to a VR sickness reduction method such as prevention of a user's sickness that occurs during use of the device and mitigation measures when a slight sickness occurs during use.

[0002]

2. Description of the Related Art FIG. 6 is a block diagram showing a conventional artificial reality simulating apparatus disclosed in, for example, Japanese Patent Application Laid-Open No. Hei 8-17147. In the figure, reference numeral 1 denotes a pseudo voice and an image to a user. Helmet, 2 is a vibration generating device that gives vibration to the user and the helmet 1, 3 is the user's blood pressure,
Sphygmomanometer, sweat gauge, electroencephalograph, which measures sweat and brain waves,
4 outputs an audio signal and an image signal to the helmet 1 and senses the user's pleasantness / discomfort, and uses a sphygmomanometer, a perspiration meter,
The relationship between the blood pressure, the amount of perspiration, and the brain wave input from the electroencephalograph 3 is obtained and stored, and based on the data, the vibration to be generated based on the measured current blood pressure, the amount of sweat, and the brain wave. Is a computer that calculates and outputs the calculated values to the vibration generator 2. FIG. 7 is a configuration diagram showing details of a helmet of a conventional artificial reality simulation apparatus. In the figure, reference numeral 1a denotes an audio output device that outputs a three-dimensional audio in accordance with an audio signal input from the computer 4, and 1b denotes a sound output device. This is an image display device that displays a three-dimensional image according to an input image signal.

Next, the operation will be described. Conventional VR
When a system is used, a user sometimes gets sick, but at present, no specific method for reducing the sickness has been proposed. However, as a conventional technique closest to the contents shown in the embodiment of the present invention, there is an artificial reality simulating apparatus as shown in FIGS. In FIG. 6, first, the user is set in a comfortable or uncomfortable state, and the blood pressure, the sweating amount, and the electroencephalograph 3 are measured by the sphygmomanometer / sweatometer / electroencephalograph 3, and the measured data is output to the computer 4. At this time, the computer 4 obtains and stores the relationship between the feeling of comfort or discomfort and the measured blood pressure, sweating amount, and brain wave.

[0004] Next, the artificial reality simulator is driven, and the current blood pressure, sweating amount, and brain wave are measured by the sphygmomanometer / sweatometer / electroencephalograph 3. The computer 4 captures the measured data, and calculates the generated vibration based on the data. At this time, the relationship between the initially obtained pleasant or unpleasant sensation and the blood pressure, the amount of sweating, and the electroencephalogram is considered. The vibration generator 2 generates a vibration according to a vibration signal output from the computer 4. At the same time, the image display device 1b in the helmet 1 displays a three-dimensional image, and the sound output device 1a outputs a three-dimensional sound. Therefore, the user listens to the stereoscopic sound output from the audio output device 1a while watching the stereoscopic image projected on the image display device 1b, and furthermore, the user can hear the vibration generating device 2 according to the situation at the place. Vibration is applied. Next, it is determined whether or not to end the operation. If the operation is not to be ended, the driving of the virtual reality simulation apparatus is continued and the above operation is repeated.

[0005]

Since the conventional artificial reality simulation device is configured as described above, the description of the conventional technology is very vague, and the most important is the feeling of pleasantness and discomfort. There is no mention of how to specifically verify the relationship between blood pressure, sweat volume, and brain waves, and how to feed back a vibration signal, which is not feasible. Further, there is no mention of the consistency between the vibration added to enhance the sense of reality and the vibration calculated from the physiological data. Furthermore, as a recovery method in the case of an unpleasant state, only changing the vibration is described, but a change of the entire content and a preventive method for preventing the unpleasant state are not considered.

As described above, in the related art, there is a problem that, although appropriate steady-state acceleration and inertial force cannot be generated, no countermeasures are taken, which may cause VR sickness. Was. In addition, in the conventional technology, the state of the user who is using the system cannot be grasped.
There has been a problem that the system only copes with a case where VR sickness is extremely deteriorated, such as when the user himself presses an emergency stop button or when a monitor judges and stops on a monitor. further,
In the related art, since only the case where the discomfort is extremely worsened is dealt with, there has been a problem that the VR sickness remains in the user even after the end of use, or the time is required for recovery such as further deterioration. . Furthermore, in the related art, there is no countermeasure that does not leave an effect after the use, and therefore, there is a problem that the effect may remain after the user such as dizziness or a feeling of floating. Furthermore, in the related art, since a slight VR sickness could not be caught, there was a problem that the content could not be changed according to the state of the user.

[0007] The present invention has been made to solve the above-described problems, and has as its object to provide a VR sickness reduction method capable of reducing VR sickness by learning a virtual space. In addition, the present invention provides a VR sickness reduction method that can change the content content according to the state of the user in response to detection of the VR sickness of the user, and can prevent the user from becoming worse with VR sickness. With the goal. It is a further object of the present invention to provide a VR sickness reduction method capable of removing an influence using a virtual space after using a VR system and avoiding adverse effects after using the VR system.

[0008]

SUMMARY OF THE INVENTION A VR sickness reduction method according to the present invention includes an introduction step of presenting to a user an image of a virtual space composed of an arrangement of objects that cannot exist in the real world and physical characteristics of the objects. It is a thing.

A VR sickness reduction method according to the present invention provides a virtual space image presented by a VR system in response to a user's subjective report input of VR sickness or determination of the user's VR sickness by measuring a physiological index. And a sickness response process for lowering the stimulus intensity.

[0010] The method for reducing VR sickness according to the present invention comprises the steps of:
The present invention includes a recovery process in which the stimulus intensity of the image in the virtual space presented by the system is gradually reduced, and a still image is presented, and then the process ends.

[0011] A VR sickness reduction method according to the present invention, in the introduction process, presents a moving object as an image of a virtual space to urge the user to move the viewpoint in the virtual space and to change the viewing direction. It is.

[0012] In the VR sickness reduction method according to the present invention, in the introduction process, the viewpoint movement and the line-of-sight direction change induced by the movement of the guide are first started only by horizontal movement.
Next, the vertical movement is added, and then the rotation in the line-of-sight direction is added in a stepwise manner.

[0013] In the VR sickness reduction method according to the present invention, in the introduction process, the moving speed of the guide that prompts the user to move the viewpoint and change the line of sight according to the degree of sickness in the VR sickness determination process in the sickness response process is reduced. The degree and the degree of restriction in the moving direction are controlled.

In the VR sickness reduction method according to the present invention, in the introduction process, after experiencing a movement sensation, a user is presented with a bird's-eye view of the experienced movement trajectory.

The method for reducing VR sickness according to the present invention comprises the steps of:
The system is a visual sway vibration VR system, which applies the sway and vibration to the user's sense of balance or somatic sensation, and the vibration frequency of which avoids the resonance frequency of each part of the user.

According to the VR sickness reduction method of the present invention, in a sickness response process, when the degree of sickness of a user due to VR sickness determination is high, the viewpoint movement to the user in the virtual space and the video of the virtual space are performed. Switching from the presentation of swaying and vibration to
When the degree of motion sickness determined by the VR motion sickness of the user is reduced, the user is again presented with the movement of the viewpoint in the virtual space and the shaking and vibration according to the image of the virtual space.

In the VR sickness reduction method according to the present invention, in a sickness response process, when the degree of sickness is high due to the VR sickness determination of the user, a gravity direction teaching image is added to the virtual space, and the VR sickness determination is performed. When the degree of sickness becomes low, the gravity direction teaching video is deleted from the virtual space.

According to the VR sickness reduction method of the present invention, when the degree of sickness determined by the VR sickness of a user is high, the movement of the viewpoint and the change in the direction of the line of sight presented to the user are restricted, and Sway and vibration are limited according to the image of the space, and when the degree of sickness by the VR sickness determination of the user is reduced, the movement of the viewpoint in the restricted virtual space, the change in the gaze direction, the sway and the vibration are gradually reduced. It is made to return to.

The method for reducing VR sickness according to the present invention comprises the steps of:
The determination of sickness uses at least one of the user's breathing frequency, breathing magnitude, and breathing irregularity.

The method for reducing VR sickness according to the present invention comprises the steps of:
The sickness determination is performed by measuring the center of gravity of the user and determining from the magnitude of the sway of the center of gravity.

The method for reducing VR sickness according to the present invention comprises the steps of:
For the determination of motion sickness, the heart rate of the user is measured, and at least one of the average value of the instantaneous heart rate, the respiratory component during heart rate variability, and the magnitude of the Mayer wave component during heart rate variability is used. It is like that.

The method for reducing VR sickness according to the present invention comprises the steps of:
The sickness determination is performed by measuring an electrocardiogram of the user and determining the sickness from the magnitude of the specific frequency component of the baseline fluctuation.

In the VR sickness reduction method according to the present invention, in the recovery process, the viewpoint movement and the line-of-sight direction change in the virtual space presented to the user are limited in a stepwise manner, and the user is shaken according to the image of the virtual space. And the vibration is limited in a stepwise manner, the still image in the virtual space is presented, and the shaking and vibration are stopped, and then the process ends.

The method for reducing VR sickness according to the present invention has a sufficient brightness as a recovery place for regaining the sense of movement in the real world after the use of the VR system in the recovery process. A guide line and a narrow passage with handrails are prepared, and the user inputs a subjective report of VR sickness or the user's V
The sequelae of VR sickness are reduced by continuing walking in the passage until the degree of R sickness determination is within the allowable range.

In the VR sickness reduction method according to the present invention, a moving image in a virtual space according to a user's operation of a metaphor is presented to the user.

[0026]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below. Embodiment 1 FIG. FIG. 1 is a block diagram showing a visual oscillating vibration VR (virtual reality) system according to Embodiment 1 of the present invention. In the figure, reference numeral 11 denotes a user, 12a denotes a mouse, a joystick operated by the hand of the user 11, and Or, an operation input unit such as a trackball,
Reference numeral 2b denotes an operation input unit such as a pedal operated by a foot of the user 11, and reference numeral 12c denotes a report input unit such as a keyboard reported by the user 11. 13 is a video presentation unit,
Reference numeral 14 denotes liquid crystal shutter glasses. By viewing the image presented by the image presentation unit 13 with the liquid crystal shutter glasses 14, the user 11 can see an image in a virtual space. Reference numeral 15 denotes a sway vibration generator (hereinafter, referred to as MTN). The MTN 15 operates so that the legs of the chair bend and stretch in response to the sway vibration signal, and performs sway and vibration according to the image of the virtual space. It gives 11 somatic sensations. Reference numeral 16 denotes a physiological information measuring unit for measuring a physiological state of the user 11, reference numeral 17 denotes an interface unit, and reference numeral 18 denotes an operation input unit 12.
Reference numerals 19 and 19 denote the operation input signals output from the a and 12b, respectively.

Reference numeral 20 denotes a main body of the VR device. In the VR device 20, reference numeral 21 denotes a physiological information analyzing unit that analyzes the physiological state of the user 11 measured by the physiological information measuring unit 16 through the interface unit 17, and reference numeral 22 denotes a use unit. It is a state estimating unit that determines VR sickness of the user 11 according to the report input signal 19 of VR sickness by the operation of the report input unit 12 c of the user 11 or the analysis of the physiological condition by the physiological information analysis unit 21. Reference numeral 23 denotes a control computer, which outputs video data based on a virtual space model stored in advance to a video drive unit 24 in response to the operation input signal 18 output from the operation input units 12a and 12b. At the same time, the vibration swing data corresponding to the video data is output to the vibration swing drive unit 25. The control computer 23 adjusts the video data and the vibration swing data output to the video drive unit 24 and the vibration swing drive unit 25 according to the VR sickness determination output from the state estimation unit 22. . Reference numeral 24 denotes a video driving unit that outputs a video signal corresponding to video data to the video presenting unit 13;
Reference numeral denotes a vibration rocking drive unit that outputs a vibration rocking signal corresponding to the vibration rocking data to the MTN 15.

Next, the operation will be described. The visual agitation vibration VR system shown in the first embodiment is applied to, for example, a medical system (a bedside wellness system, an operation simulation system, a rehabilitation system, etc.), an amusement system, and an edumentation system. For example, when applied as an amusement system, a user selects content such as a sightseeing flight, a fighter game, and a stroll on the sea floor, and uses the visual agitation vibration VR system.
If the user is unfamiliar with the visual sway vibration VR system, VR sickness may occur. Therefore, in the first embodiment, first, in order for the user to become accustomed to the visual sway vibration VR system, the user is made to learn the virtual space in the introduction process described later, and the image elements are increased step by step. Then, the user is presented with an image having a strong stimulus intensity, and a motion and a vibration, and the user is allowed to use the finally selected content. If VR sickness occurs during this time,
In the sickness response process described below, the stimulus intensity of the image, the sway and the vibration is reduced. Further, after using the visual sway vibration VR system, images and sway,
In this method, the stimulus intensity of the vibration is gradually reduced, a still image is presented, and the effect of utilizing the virtual space is removed.

The details of the processing will be described below with reference to FIGS. FIGS. 2 to 5 are flowcharts showing the processing of the visual sway vibration VR system according to the first embodiment of the present invention. FIGS. 2 to 4 show a user learning a virtual space, and an image having a strong stimulus intensity stepwise. And upset,
This is an introduction process in which vibrations are presented to the user and finally the selected content is used. In addition, in FIGS. 2 to 4, which are the introduction process, ST-5, ST-10 to ST-1.
8, ST-20, ST-23, ST-24, ST-27
~ ST-33, ST-38, ST-39, ST-44 ~
ST-47 is a sickness response process that reduces the stimulus intensity of the image and the sway and vibration when VR sickness occurs in the user. Further, FIG. 5 shows a recovery process in which the stimulus intensity of the image and the shaking and the vibration is gradually reduced, a still image is presented, and the effect using the virtual space is removed.

In FIG. 1, when the visual oscillation vibration VR system is activated, the control computer 23 initializes various coefficients (ST-1, introduction process). The user 11 has M
The user sits on the chair of the TN 15, puts on the liquid crystal shutter glasses 14, and first selects the content to be used by operating the report input unit 12c (eg, sightseeing flight, fighter game, seabed stroll, etc.). The input report input signal 19 is output to the control computer 23. Further, the physiological information measuring unit 16 measures the electrocardiogram, respiration, and blood pressure of the initial value (normal value) of the user 11, and outputs the measured values to the physiological information analyzing unit 21 through the interface unit 17. Physiological information analyzer 21
Analyzes the electrocardiogram, the respiratory curve, and the blood pressure from the measurement data and outputs the result to the state estimating unit 22. State estimation unit 2
2 records the input electrocardiogram, respiratory curve, and blood pressure as normal values (ST-2, introduction process).

At the start of use, a common first video is presented regardless of which content is selected (ST-3,
Introduction process). The first video is presented by the control computer 23
Outputs video data corresponding to the virtual space model of the first video, which is held in advance, to the video driving unit 24, and outputs vibration oscillation data corresponding to the video data to the vibration oscillation driving unit 2.
5 and outputs the video signal and the vibration swing signal from the video drive unit 24 and the vibration swing drive unit 25 to the video presentation unit 13 and the MTN 15.
, The image of the virtual space of the first image and the vibration swing according to the virtual space can be presented. The first image makes the user 11 aware that the environment created by the VR system is different from the environment in the real space, and also learns the sense of movement of the viewpoint movement and the line-of-sight direction change in the virtual space. It was created for the purpose. For example, the space is made up of the arrangement of objects that do not exist in the real space and the physical characteristics of the objects, such as floating characters, symbols, or graphic models, and cannot be distinguished from the top and bottom. Here, the user 11 obtains the premise information that the gravity basically basically works downward, and operates the operation input units 12a and 12b.
To learn the sensation in a virtual environment where you can move freely while feeling the vibration and swing according to the virtual space. The setting may be such that the user is riding on a device that generates gravity.

The user 11 operates the operation input units 12a and 12b in accordance with guidance given by the given task of the first video (eg, following a ball that generates a sound) and moves in the space (ST-). 4, introduction process). At this time, the physiological information measuring unit 16 outputs an electrocardiogram when the user 11 uses the VR system,
The respiration and the blood pressure are measured, and the physiological information analysis unit 21 analyzes the electrocardiogram, the respiration curve, and the blood pressure from the measurement data, and outputs the result to the state estimation unit 22. The state estimating unit 22
It is determined whether or not the user 11 has VR sickness according to a comparison between the input electrocardiogram, respiratory curve, and blood pressure and the recorded normal value. If the user 11 is aware that VR sickness has developed, the report input unit 12c
Input of the report of VR sickness by the operation of
2 is the VR of the user 11 according to the declaration input signal 19.
Recognize the onset of sickness (ST-5, sickness response process). If VR sickness has not developed in the user 11, the control computer 23 measures the task achievement rate and checks whether or not the task of the first video has been successfully achieved (ST).
-6, introduction process). If the user 11 has a slight VR sickness or has not achieved the task well, the task of the first video is stopped and a bird's-eye view (overhead view)
The viewpoint in the video is switched from diagonally upward as in the above, and how the user 11 moves in the task up to that point is set by placing a model in place of the user 11 in the video.
To learn about the virtual environment.
This process is repeated a predetermined number of times (i <
x) Perform, and if the slight VR sickness is not recovered by the predetermined number of times, use of the VR system is stopped. If the slight VR sickness has been recovered by the predetermined number of times, the process proceeds to ST-16 (ST-10 to ST-15, sickness handling process).

A third party grasps how the user 11 was moving in the task of the first video, and if there is no slight VR sickness, the procedure returns to the task of the first video again. Sets the upper limit of the guidance speed low by about 20%, and changes the content of the task so that only horizontal movement is not performed and rotation or up-and-down movement is performed (decrease in stimulus intensity). This process is performed for a predetermined time (t0 <t1), and if a slight VR sickness occurs by the predetermined time, a third-party grasp process of ST-10 to ST-15 is performed again. If no slight VR sickness has occurred, the process proceeds to ST-4, and the task of the original first video is performed (ST-16 to ST-20, sickness handling process, recovery process). Then, the task of the original first video is performed a predetermined number of times (j
<Y) Performed, there was no slight VR sickness by the predetermined number of times, and the first
If the achievement rate of the video task is also good, the process proceeds to ST-21 (S
T-4 to ST-9, introduction process, sickness response process).

It should be noted that the video presented to the user 11 and the vibration and oscillation always have a constant synchronization in control, while the operation input section 12b operated and input by the user 11
Is like an accelerator pedal of a car (metaphor: for example, an accelerator and a handle with play), and even if there is a slight delay between the image presented to the user 11 and the vibration swing, the user 11 To make it uncomfortable. Further, the problem of the first video is that the sense of movement of the viewpoint movement and the line-of-sight direction change of the user 11 in the virtual space starts with only horizontal movement first, and then gradually increases in the order of adding vertical movement. The moving speed is accelerated in response to the operation input of the user 11 and gradually increases. However, it is assumed that the moving speed is constant at a certain value, and in such an initial stage, the maximum speed is 1 m.
/ S. At this time, the vibration swing does not cause any jerk. Furthermore, the added vibration swing
At a low frequency of 2 Hz or less, only at the time of change of the acceleration, a sway giving a slight initial speed acceleration is given, thereby avoiding the occurrence of extreme disagreement. Also, in general, humans capture the high-frequency environment not with vision, but with otoliths and somatic sensations,
For a frequency of 2 Hz or more, if the VR system is capable of attenuating the vibration in the image and providing vibration fluctuation and environmental sound to the user 11, the system 11 gives the environmental sound mainly to the user 11. Furthermore, the added vibration swing avoids the resonance frequency of each part of the human.

In FIG. 3, next, a second video in which contents indicating up and down are added to the virtual environment of the first video is presented (ST-21, introduction process), and roll, pitch, and yaw are performed at a constant speed. (ST-22, introduction process). Here, in the virtual space, if the motion is not a motion that causes an acceleration, no information comes to the otolith, and it is learned that gravity always works below itself. Then, similarly, it is determined whether or not mild VR sickness has developed (ST-23, ST-24, sickness handling process). If the state where light VR sickness does not develop continues for a predetermined time (t0 <t2), the process proceeds to ST-34. Go on (ST-2)
6, introduction process). When a slight VR sickness develops, a humanoid representing the user 11 can be used to objectively view the state. At this time, an arrow indicating the direction of gravity of the user 11 is added to the presentation image, and the fact that gravity is below the user regardless of rotation is emphasized and recognized. This is performed a predetermined number of times z (k <z), and if the slight VR sickness is recovered by the predetermined number of times z, the process returns to the task of the second video in ST-22.
When the predetermined number z has been reached, the process proceeds to ST-30 (ST-27 to ST-29, sickness handling process). ST above
If the slight VR sickness has not been recovered in the processing of -27 to ST-29, the content is switched to the resting state or the content that does not move, and waits for the recovery of the light VR sickness (ST
-30 to ST-32, sickness handling process). And a light V
If R sickness recovers, the maximum rotation angle will be 50% of the initial setting
The control mode is changed to the following control mode (ST-33, sickness handling process), and the process proceeds to ST-34 (ST-26, introduction process).

In FIG. 4, the first video is first displayed on the second video.
1 sequentially adds the objects constituting the content selected, gives continuity between the virtual space practiced in the first video and the second video and the virtual space of the selected content to be experienced from now on, and retains the learning content. (ST
-34, introduction process). Then, the user 11 experiences the main content (ST-35, introduction process). However, the conditions for presenting information as a virtual environment are the same as those in the processing shown in FIGS. 2 and 3, and the video and the vibration are always in constant synchronization in control. In addition, the moving speed accelerates in response to the operation input and gradually increases, but is made to move at a constant speed at a certain value (ST-37, introduction process). Then, similarly, it is determined whether mild VR sickness has developed (ST-38, S
(T-39, sickness response process) If light VR sickness has developed, the stimulus intensity of the following elements of the content is reduced to prevent light VR sickness from worsening.・ Movement speed: Reduce to a speed at which no physical danger is felt (avoid sympathetic nerve activation) ・ Rotation speed: Perform only parallel movement without performing rotational movement (common sense in the simulator field) ・ Brightness / contrast: 20% reduction Yes (unexplained, somehow it could induce a resting state) In ST-39, when it is determined that the patient has recovered from VR sickness, the state is gradually returned to the original state. Repeat this.
Every time the content usage time t of the main subject elapses t3 (ST-
(40, introduction process) or, in the case of falling into mild sickness many times, prompts the user 11 to stop or continue (ST-41, introduction process). If the user 11 selects the cancellation, the process proceeds to ST-48 (ST-42, introduction process). If the total time of using the content of the subject exceeds t4 (ST-43, recovery process), the process forcibly shifts to ST-48 (ST-42, introduction process). (ST-36 to ST-47, introduction process, sickness response process, recovery process).

In FIG. 5, the user 1 in the VR system
When the experience of the selected content is completed, the following steps are taken in order to avoid the aftereffects of using the VR system without suddenly ending the content. MTN
15 while performing the reverse of the introduction process, restricting the viewpoint movement and the line-of-sight direction change in the virtual space presented to the user 11 step by step, and according to the image of the virtual space. The sway and the vibration are limited in a stepwise manner, and the presentation of the still image in the virtual space and the sway and the vibration are stopped, and the process ends. By having the user 11 observe this video, it is possible to recognize that what has been experienced so far is a virtual environment, and by taking the time to view the still video, there is an effect of promoting recovery from vection. Further, the physiological information analysis by the physiological information analysis unit 21 is continued, and the state estimation unit 22 estimates the VR sickness state, the residual state of fatigue, and the stress state of the user 11 (ST-48, recovery process).

Then, the user 11 stands up from the MTN 15 and is guided out of the VR system (ST-49, recovery process). At this time, the guidance destination has sufficient brightness (to the extent that a book can be read), narrows the width of the taxiway, draws a line on the floor surface, and attaches a handrail. If you stagger or leave the center of gravity excessively in the handrail during the passage (ST-51, recovery process) or ST-
In the process by 48, if the user 11 inputs a subjective report of VR sickness or the state estimating unit 22 estimates the VR sickness state, residual fatigue state, or stress state of the user 11, the user may continue walking here. , Take a rest (ST-5)
3, recovery process). If no abnormality is found, the process is terminated (ST-52, recovery process).

In the first embodiment, there is provided a visual oscillation vibration VR system which presents an image of a virtual space to a user and provides the user with somatic sensation according to the image of the virtual space. Although shown, the invention of the first embodiment may be applied to a VR system that presents an image of a virtual space to a user. Further, the invention of the first embodiment may be applied to a visual auditory sway vibration VR system that provides a user with sound corresponding to a video in a virtual space.

Further, the V of the user 11 is determined by the physiological information measuring unit 16, the physiological information analyzing unit 21, and the state estimating unit 22.
The R sickness determination may use at least one of the respiration frequency, respiration magnitude, and respiration irregularity of the user 11. Further, the center of gravity of the user 11 may be measured, and the determination may be made based on the magnitude of the sway of the center of gravity. Further, the heart rate of the user 11 is measured, and at least one of the average value of the instantaneous heart rate, the respiratory component during the heart rate variability, and the magnitude of the Mayer wave component during the heart rate variability is used. You may do it. Further, the electrocardiogram of the user 11 may be measured, and the determination may be made based on the magnitude of the specific frequency component of the baseline fluctuation.

As described above, according to the first embodiment, VR sickness can be reduced by causing the user 11 to learn the virtual space during the introduction process. In addition, according to the sickness response process, the content of the content can be changed according to the state of the user 11 in accordance with the detection of the VR sickness of the user 11, and the deterioration of the VR sickness of the user 11 can be prevented. Further, by the recovery process, the effect of using the virtual space is removed after the use of the VR system, and the effect of avoiding the adverse effects after the use of the VR system is obtained.

[0042]

As described above, according to the present invention, there is provided an introduction process for presenting to a user an image of a virtual space composed of the arrangement of objects that cannot exist in the real world and the physical characteristics of the objects. Therefore, instead of suddenly presenting the user with the virtual space of the desired content with a strong stimulus intensity, the user can learn the virtual space through the introduction process and then present the virtual space of the desired content, The effect of reducing VR sickness is obtained.

According to the present invention, the stimulus intensity of the image in the virtual space presented by the VR system is determined according to the subjective report input of VR sickness by the user or the VR sickness determination of the user by measuring the physiological index. Since the system is provided with a sickness response process for reducing the sickness, if VR sickness occurs during the use of the VR system, the stimulus intensity is reduced, the VR sickness of the user is alleviated, and the use of the VR system is continued. Thus, it is possible to expect the user to be used to the VR system.

According to the present invention, the stimulus intensity of the image in the virtual space presented by the VR system is reduced step by step, and a restoring step of ending the presentation of the still image is provided, so that the VR system is provided. After the use of the VR system, the effect of using the virtual space can be removed, and the effect of avoiding the adverse effects after using the VR system can be obtained.

According to the present invention, in the introduction process, the moving object is presented as an image of the virtual space so as to prompt the user to move the viewpoint in the virtual space and change the direction of the line of sight. In this case, the effect of being able to present an image of the virtual space necessary for allowing the user to learn the virtual space is obtained.

According to the present invention, in the introduction process, the viewpoint movement and the line-of-sight direction change induced by the movement of the guidance object are first started from only the horizontal movement, then the vertical movement is added, and further the rotation in the line of sight is added. , The stimulus intensity can be increased step by step, and the effect of reducing the possibility of the onset of VR sickness can be obtained.

According to the present invention, in the introduction process, depending on the degree of sickness in the VR sickness determination in the sickness response process,
Since the degree of reduction of the moving speed of the guide that prompts the user to move the viewpoint and change the direction of the line of sight and the degree of restriction of the moving direction are controlled, the heavier the degree of sickness, the weaker the stimulation intensity and An agitation vibration can be given, and the effect of expecting that the user's VR sickness can be alleviated and that the user can endure a strong stimulus intensity in accordance with the recovery of the user's VR sickness can be obtained.

According to the present invention, in the introduction process, after the user experiences the movement sensation, the user is presented with a bird's-eye view of the experienced movement trajectory. The user can be made to recognize the operation that has been performed, and the user can learn the virtual space effectively.

According to the present invention, the VR system is a visual sway vibration VR system, which applies the sway and vibration to the user's sense of balance or somatic sensation, and the vibration frequency is the resonance of each part of the user. Since the system is configured to avoid the frequency, an effect is obtained that can prevent the user's body from being adversely affected even if the visual oscillation vibration VR system is used.

According to the present invention, in the process of dealing with sickness, when the degree of sickness is high due to the VR sickness determination of the user, the viewpoint moves to the user in the virtual space and the shaking and vibration according to the image of the virtual space. Is switched to a bird's-eye view of the travel trajectory experienced, and the user's VR
When the degree of motion sickness due to motion sickness is reduced, the user is again presented with the movement of the viewpoint in the virtual space and the shaking and vibration according to the image of the virtual space. , Can reduce the degree of sickness and allow the user to objectively recognize the operation performed by the user, effectively using the virtual space in preparation for operation when the degree of sickness is reduced The effect that can be made to learn is obtained.

According to the present invention, in the sickness response process, when the degree of sickness is high due to the VR sickness determination of the user, the gravity direction teaching image is added to the virtual space, and the user's V
When the degree of sickness determined by the R sickness determination is reduced, the gravitational direction teaching image is deleted from the virtual space, so that when the degree of sickness is high, the degree of sickness can be reduced and the user can be relieved. Can recognize the direction of gravity, and the effect of effectively learning the direction of gravity in the virtual space in preparation for an operation when the degree of sickness is reduced is obtained.

According to the present invention, when the degree of sickness determined by the VR sickness of the user is high, the movement of the viewpoint and the change in the direction of the gaze in the virtual space presented to the user are restricted, and the image of the virtual space is displayed. When the degree of motion sickness due to the VR sickness determination of the user is reduced, the movement of the viewpoint and the change in the direction of the line of sight, the motion, and the vibration in the restricted virtual space are gradually restored. With this configuration, when the degree of sickness is high, it is expected that the degree of sickness can be reduced, and if the degree of sickness is reduced, the original stimulus intensity can be used in stages. In consideration of the degree of VR sickness, an effect that can be used effectively can be obtained.

According to the present invention, the VR sickness determination is configured to use at least one of the user's breathing frequency, breathing magnitude, and breathing irregularity. The effect that the VR sickness determination can be favorably determined is obtained.

According to the present invention, the VR sickness is determined by measuring the center of gravity of the user and determining the magnitude of the sway of the center of gravity. The effect that can be obtained is obtained.

According to the present invention, VR sickness determination is performed by measuring the user's heart rate, and determining the average value of the instantaneous heart rate, the respiratory component during heart rate fluctuation, and the magnitude of the Mayer wave component during heart rate fluctuation. Is configured to use at least one of the above, the effect of being able to determine the VR sickness of the user satisfactorily is obtained.

According to the present invention, the VR sickness is determined by measuring the user's electrocardiogram and judging from the magnitude of the specific frequency component of the baseline fluctuation.
The effect of being able to determine the R sickness satisfactorily is obtained.

According to the present invention, in the recovery process, the viewpoint movement and the line-of-sight change in the virtual space presented to the user are limited in a stepwise manner, and the shaking and the vibration are stepwise controlled in accordance with the image of the virtual space. The system is configured to stop and end the presentation of the still image in the virtual space and the sway and vibration before stopping. It is possible to recognize that the virtual environment is a virtual environment, and to effectively shift to adaptation to the real world.

According to the present invention, in the recovery process, after the use of the visual agitation vibration VR system is completed, there is sufficient brightness as a recovery place for regaining the sense of movement in the real world, and the guide line on the floor surface and the handrail are provided. Preparing a narrow passage with noisy road and continuing to walk in that passage until the user inputs a subjective report of VR sickness or the degree of VR sickness judgment by the user with physiological index measurement is within the allowable range As a result, since the aftereffect of VR sickness is reduced, the effect of using the virtual space is removed after the use of the VR system, and the effect of avoiding the adverse effects after the use of the VR system is obtained.

According to the present invention, the moving image of the virtual space according to the operation of the metaphor by the user is configured to be presented to the user, so that the image presented to the user and the vibration swing slightly change. Even if there is a delay, it is possible to obtain an effect that the user can be prevented from feeling uncomfortable.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing a visual oscillation vibration VR system according to Embodiment 1 of the present invention.

FIG. 2 is a flowchart showing processing of the visual fluctuation vibration VR system according to the first embodiment of the present invention.

FIG. 3 is a flowchart showing processing of the visual oscillation vibration VR system according to the first embodiment of the present invention.

FIG. 4 is a flowchart showing processing of the visual oscillation vibration VR system according to the first embodiment of the present invention.

FIG. 5 is a flowchart showing processing of the visual oscillation vibration VR system according to the first embodiment of the present invention.

FIG. 6 is a configuration diagram showing a conventional artificial reality simulation device.

FIG. 7 is a configuration diagram showing details of a helmet of the conventional artificial reality simulation device.

[Explanation of symbols]

11 users, ST-1 to ST-4, ST-6 to ST-
9, ST-21, ST-22, ST-25, ST-2
6, ST-34 to ST-37, ST-40 to ST-42
Introduction process, ST-5, ST-10 to ST-18, ST
-20, ST-23, ST-24, ST-27 to ST-
33, ST-38, ST-39, ST-44 to ST-4
7. Process of dealing with sickness, ST-19, ST-25, ST-4
3, ST-48 to ST-53 Recovery process.

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B050 BA11 EA12 EA24 5E501 AA17 AA25 AC16 AC37 CA02 CA04 CB02 CB04 CB09 CB10 EA32 EB01 FA15 FA27

Claims (18)

[Claims] 1. A VR sickness reduction method for a VR system that presents a virtual space image corresponding to a virtual space model to a user and presents a moving image of the virtual space to the user according to an operation by the user. , A method for reducing VR sickness, characterized by comprising an introduction step of presenting a user with an image of a virtual space composed of an arrangement of objects that cannot exist in the real world and physical characteristics of the objects. 2. A VR sickness reduction method for a VR system that presents a virtual space image corresponding to a virtual space model to a user and presents a moving image of the virtual space to the user according to an operation by the user. In, VR by the user
According to a subjective report input of a sickness, or a sickness response process of reducing a stimulus intensity of an image of a virtual space presented by the VR system according to a VR sickness determination of a user by measuring a physiological index. VR sickness reduction method. 3. A VR sickness reduction method for a VR system that presents a virtual space image corresponding to a virtual space model to a user and presents a moving image of the virtual space to the user according to an operation by the user. 5. The VR sickness reduction method according to claim 1, further comprising the step of gradually reducing the stimulus intensity of the image in the virtual space presented by the VR system, presenting the still image, and terminating the still image. 4. The VR according to claim 1, wherein the introduction step presents a moving object as an image of the virtual space, and prompts the user to move the viewpoint and change the line of sight in the virtual space. How to reduce sickness. 5. The introduction process is performed in such a manner that viewpoint movement and line-of-sight direction change induced by movement of a guide starts with horizontal movement only, then adds vertical movement, and then adds rotation in line-of-sight direction. The method of reducing VR sickness according to claim 4, wherein the method is to increase the number of times. 6. A sickness response that lowers the stimulus intensity of an image in a virtual space presented by a VR system according to a user's subjective report input of VR sickness or determination of the user's VR sickness by measuring a physiological index. The introduction step includes a degree of reduction of a moving speed of a guide that prompts a user to move a viewpoint and a change in a line of sight, and a degree of restriction of a moving direction in accordance with a degree of sickness in the VR sickness determination in the sickness response step. 2. The V according to claim 1, wherein
R sickness reduction method. 7. The VR system presents an image of a virtual space according to a virtual space model to a user, and gives a user's somatic sensation vibration and vibration according to the presented image of the virtual space. A visual sway vibration VR system,
In the introduction process, a moving object is presented as an image of the virtual space, and the user is prompted to move the viewpoint and change the direction of the line of sight in the virtual space, and at the same time, shakes and vibrates according to the presented image of the virtual space. The VR according to claim 1, wherein the VR is given to the user's somatic sensation, and after experiencing the movement sensation, the user is presented with a bird's-eye view of the experienced movement trajectory.
How to reduce sickness. 8. The VR system presents to the user an image of the virtual space according to the virtual space model, and gives the user a sway and vibration according to the presented image of the virtual space. A visual sway vibration VR system,
In accordance with the movement of the viewpoint in the virtual space presented to the user and the displacement, speed, and acceleration in the direction of the line of sight, vibration and vibration are given to the user's sense of balance or somatic sensation,
3. The VR sickness reduction method according to claim 2, wherein the vibration frequency avoids a resonance frequency of each part of the user. 9. The VR system presents an image of a virtual space according to a virtual space model to a user, and gives a user's somatic sensation vibration and vibration according to the presented image of the virtual space. A visual sway vibration VR system,
The motion sickness process is based on the movement trajectory experienced by the user when the degree of motion sickness determined by VR motion sickness is high, by moving the viewpoint in the virtual space to the user and presenting the shaking and vibration according to the image of the virtual space. Switch to a bird's-eye view of
3. The method according to claim 2, wherein when the degree of sickness determined by the VR sickness determination of the user is reduced, the viewpoint movement in the virtual space and the shaking and vibration according to the image of the virtual space are presented to the user again. The VR sickness reduction method described in the paragraph. 10. The VR system presents an image of a virtual space according to a virtual space model to a user, and gives the user a sway and vibration according to the presented image of the virtual space to the user's somatic sensation. It is a visual agitation vibration VR system. In the motion sickness response process, when the degree of motion sickness due to the VR motion sickness of the user is high, a gravity direction instruction image is added to the virtual space, and the degree of motion sickness due to the VR motion sickness of the user is low. 3. The VR sickness reduction method according to claim 2, wherein the gravitational direction teaching image is deleted from the virtual space when the virtual space becomes unavailable. 11. The VR system presents an image of a virtual space corresponding to a virtual space model to a user, and gives a user's somatic sensation vibration and vibration according to the presented image of the virtual space. This is a visual agitation vibration VR system, and the motion sickness response process limits the movement of the viewpoint and the change in the direction of the line of sight presented to the user when the degree of motion sickness by the VR motion sickness determination is high. Sway and vibration are limited according to the image of the space, and when the degree of sickness by the VR sickness determination of the user is reduced, the movement of the viewpoint in the restricted virtual space, the change in the gaze direction, the sway and the vibration are gradually reduced. 3. The method according to claim 2, wherein
The VR sickness reduction method described in the paragraph. 12. The determination of VR sickness of a user by measuring physiological indices in a sickness response process is based on the use of at least one of the user's respiration frequency, respiration magnitude, and respiration irregularity. The method of reducing VR sickness according to claim 2, characterized in that: 13. The VR sickness determination of a user by measuring physiological indices in a sickness response process is performed by measuring a center of gravity of the user and determining from the magnitude of the sway of the center of gravity. VR sickness reduction method. 14. The determination of VR sickness of a user by measuring physiological indices in a sickness response process is performed by measuring a user's heart rate, determining an average value of instantaneous heart rate, a respiratory component during heart rate variability, and a respiratory component during heart rate variability. 3. The VR sickness reduction method according to claim 2, wherein at least one of the magnitudes of the Mayer wave component is used. 15. The determination of VR sickness of a user by measuring a physiological index in a sickness correspondence process is performed by measuring an electrocardiogram of the user and determining from a magnitude of a specific frequency component of the baseline fluctuation. 3. The method for reducing VR sickness according to item 2. 16. The VR system presents an image of a virtual space corresponding to a virtual space model to a user, and gives a user's somatic sensation a vibration and a vibration corresponding to the presented image of the virtual space. This is a visual sway vibration VR system. In the recovery process, the movement of the viewpoint and the change in the direction of the line of sight in the virtual space presented to the user are limited in a stepwise manner. 4. The VR sickness reduction method according to claim 3, further comprising: stopping the presentation of the still image in the virtual space, the shaking, and the vibration, and then ending. 17. The VR system presents an image of a virtual space corresponding to a virtual space model to a user, and gives the user a shaking and a vibration corresponding to the presented image of the virtual space to a somatic sensation of the user. A visual agitation vibration VR system, in which the recovery process has sufficient brightness as a recovery place for regaining the sense of movement in the real world after the use of the visual agitation vibration VR system, and provides guidance lines and handrails on the floor. Preparing a narrow passage with noisy road and continuing to walk in that passage until the user inputs a subjective report of VR sickness or the degree of VR sickness judgment by the user with physiological index measurement is within the allowable range 4. The method of reducing VR sickness according to claim 3, wherein the after-effects of VR sickness are reduced. 18. The VR system presents an image of a virtual space corresponding to a virtual space model to a user, and gives a user's somatic sensation vibration and vibration according to the presented image of the virtual space. 4. The visual sway vibration VR system, wherein a moving image of a virtual space according to a user's operation of a metaphor is presented to the user. VR of
How to reduce sickness.