WO2021095143A1

WO2021095143A1 - Vr riding device

Info

Publication number: WO2021095143A1
Application number: PCT/JP2019/044419
Authority: WO
Inventors: 晃弘安藤
Original assignee: 株式会社ハシラス
Priority date: 2019-11-12
Filing date: 2019-11-12
Publication date: 2021-05-20

Abstract

Provided is a VR riding device with which VR motion sickness of a user is suppressed, public viewing by a person besides an occupant is enabled, and with which the user can achieve a sense of immersion in a video by significantly changing, through rotation, etc., a display image of a VR video display unit, the VR video being optimized to the view point position of the user as a result of the user performing operations on a riding unit while simultaneously viewing the VR video. The VR riding device comprises a body, a riding unit, a VR video display unit, a sensor, and a control unit. The body is provided with a blowing unit that is installed so as to face the riding unit and blows air towards the riding unit. The control unit is equipped with: a video management and playback means that manages the VR video and implements a playback process on the VR video display unit; and an integrated control means that directs and controls operation of the blowing unit. The control unit controls the video management and playback means and the integrated control means on the basis of information from the sensor.

Description

Boarding device for VR

The present invention relates to a device for a user used for VR (Virtual Reality) to board and enjoy VR, and in particular, by operating on the boarding section after boarding the boarding section at the same time as viewing a virtual reality image. By changing the display image of the VR image display unit optimized for the user's viewpoint position based on the user's movement, it is possible to obtain a feeling of immersion in the user's image without going through a goggle-type image viewing device. The present invention relates to a VR boarding device that suppresses a passenger from causing VR sickness and enables a non-passenger to perform public viewing.

Conventionally, many technologies related to virtual reality (VR) have been developed and used in various situations, which enables users to obtain various simulated experiences by boarding while watching videos. Technology related to virtual reality has made progress and is being used in all fields, and many VR technologies have been developed and used that make it possible to get the feeling of being there while staying indoors. Has been done.

Virtual reality refers to a technology that allows a user to recognize and perceive a virtual space created by a computer as if the space were real, and a technology that creates such an environment. The technology related to virtual reality is particularly attracting attention for entertainment using virtual reality technology, and various amusement devices using such technology have been developed to entertain users, but medical care, advertising, and education It is widely used in such fields, and has the potential for further use and utilization in the future.

For example, as an amusement device using virtual reality technology, after the user has boarded a dedicated boarding device, the image on the field of sports or the image seen when boarding a roller coaster is displayed to the user on the dedicated viewing device. By viewing it, the user can participate in sports such as soccer and baseball while staying at home, and experience various attractions such as boarding a roller coaster in a simulated manner.

In a simulated experience using such virtual reality, images are often viewed through a goggle-type video viewing device, but the goggle-type video viewing device includes a gyro, an acceleration sensor, and position tracking. It is equipped with a mechanism, etc., and when the user turns or moves in any direction, the sensor detects the direction or movement of the user and adds a control device that changes the image to be seen from the user's point of view. ..

On the other hand, in the case of a device for viewing VR video via a monitor, the displayed video is controlled by tracking the user's position using a sensor or the like instead of a gyro or the like.

As a technique related to a boarding device used for virtual reality, for example, Japanese Patent Application Laid-Open No. 2005-253871 exists. Here, it is a technique relating to a sports device using virtual reality technology, in which a computer displays a game screen including a ball figure on the screen and includes a ball position and a ball speed according to a player's swing. A technique for creating return ball data, calculating the trajectory of the ball figure based on the return ball data, and displaying the flying ball figure on the screen is disclosed.

According to this technology, it is possible to virtually experience ball sports by matching the VR image displayed on the screen with the user's movement, but since information on the user's position is not taken into consideration, There is a problem that it is not possible to reflect changes in the image in consideration of the movement of the user, and the image experienced by the user lacks immersiveness and power.

Further, in Japanese Patent Application Laid-Open No. 6-175582, a personal computer in which a time code or the like is input from the VTR operates the drive unit in synchronization with these time codes or the like by a program, and the image and sound from the VTR and the drive unit generate the image and sound. A structure in which a chair is moved up and down or a vibration drive device is used to move the chair back and forth and left and right in synchronization with the moving vibration and the like, and a wind speed experience technique using an electric fan are disclosed.

According to this technology, it is possible to watch a changing VR image while certainly obtaining a feeling synchronized with the image or sound of VTR or the like, but it reflects the change of the image in consideration of the movement of the user. There is a problem that it lacks an immersive feeling because the image that the user experiences is not realistic and lacks a sense of reality. In addition, if there is a large difference between the image and the user's movement, there is a problem that the difference from the actual experience of the body causes so-called VR sickness, and it can be said that it is an excellent boarding device for virtual reality. There wasn't.

Therefore, by displaying a changing image according to the user's movement when the user boarded the device, the user can get an immersive feeling and the difference from the actual experience of the body is optimized. As a result, it has been desired to develop a VR boarding device that suppresses the user from causing VR sickness and allows the user to experience an immersive virtual reality.

Japanese Unexamined Patent Publication No. 2005-253871 Japanese Unexamined Patent Publication No. 6-175582

The present invention is a device for a user used for VR to board and experience and enjoy VR. In particular, the user operates on the boarding unit at the same time as viewing a virtual reality image, so that the user can move to the viewpoint position of the user. By greatly changing the display image of the optimized VR image display such as turning, it is possible for the user to get an immersive feeling in the image without going through a goggle type image viewing device, and at the same time, the user can feel immersive. It is an object of the present invention to provide a VR boarding device capable of suppressing VR sickness and allowing non-passengers to perform public viewing.

In order to achieve the above object, the boarding device for VR according to the present invention includes the main body of the boarding device used for VR (Virtual Reality), the boarding section for the user to board, and the boarding section in front of the boarding section. Boarding for VR consisting of a VR image display unit for viewing VR images installed toward the boarding unit, a sensor installed in front of the boarding unit that can detect the movement of the user, and a control unit installed on the main body. The main body of the device is provided with a blower unit for blowing air toward the boarding unit installed so as to face the boarding unit, and the control unit manages VR images and VR. It is equipped with a video management / playback means for performing playback processing on the video display unit and an integrated control means for instructing / controlling the operation of the blower unit, and the video management / playback means and the integration based on information from the sensor. It is a configuration that controls the control means.

Further, since the VR boarding device performs the ventilation processing by the ventilation unit while synchronizing with the VR image displayed on the VR image display unit, the image management / playback means stores the VR image data in the storage means. And event information are recorded, the VR video data is transmitted to the VR video display unit, and event information including the recording of the presence or absence of an event at the reproduction location of the VR video data is transmitted to the integrated control means, and the integrated control is performed. The means is configured to control the amount of air blown toward the boarding unit by the air blower unit according to the received event information.

Further, since the VR boarding device controls the VR video data displayed on the VR video display unit according to the movement of the user detected by the sensor, the sensor acquires the position information of the user. At the same time, the video management / playback means calculates the display area of the VR video data displayed on the VR video display unit from the acquired position information, and then transmits the VR video data to the VR video display unit. Is.

Further, the sensor is composed of a depth sensor, and the user depth image is acquired by the depth sensor, and accurate position information of the user is obtained as a coordinate value consisting of an X value, a Y value, and a Z value based on the user's head. The configuration is such that the amount of movement of the user within a certain period of time is acquired while being calculated and acquired as.

Further, the video management / playback means generates virtual position information of the user by multiplying each value by a coefficient based on the position information of the user consisting of the X value, the Y value, and the Z value acquired by the sensor. , A movement amount value obtained by multiplying the acquired movement amount by a movement coefficient and a turning coefficient is generated, and a display area of VR image data displayed on the VR image display unit is calculated from the virtual position information and the movement amount value. Then, the VR video data is transmitted to the VR video display unit.

Further, the VR boarding device has a configuration in which a VR image display unit installation height adjusting means is installed so that the installation height of the VR image display unit can be automatically or manually adjusted.
Further, the VR image display unit is configured to be installed after being adjusted to a height position which is the front part of the boarding unit and is a viewpoint of the user.

Further, the boarding unit includes a vibration generating unit for generating vibration to vibrate the boarding unit, and while synchronizing with the VR image displayed on the VR image display unit, or the boarding unit. In order to perform vibration processing on the boarding unit by the vibration generating unit in response to the user's movement detected by the sensor in the unit, the integrated control means is in line with the received event information or the user's movement. In response to this, the vibration generating unit controls the amount of vibration to the boarding unit to instruct and control the operation of the vibration generating unit.

Further, the event information is event flag data indicating the presence or absence of an event at a specific playback location of the VR video data, and includes at least a ventilation flag, and the video management playback means is the current VR video data. The event flag data at the reproduction location is transmitted to the integrated control means as event information, and the integrated control means receives the event information, acquires the user's virtual position information from the sensor, and performs calculation processing. When the event information is a ventilation flag, the configuration is such that the ventilation unit is instructed and controlled to blow air toward the boarding unit for a certain period of time.

Since the present invention has the configuration as described in detail above, it has the following effects.
1. 1. Since the configuration is provided with a blower unit and a vibration unit, it is possible to obtain a feeling of being linked to the image, and it is possible to obtain a high immersive feeling. Further, since the video management / playback means and the like are controlled based on the information from the sensor, the user's operation acquired by the sensor can be reflected in the VR video display unit. In addition, since the VR video display unit is installed in front of the boarding unit toward the boarding area, public viewing by non-passengers is possible, and many people can view the world experienced by the passengers. ..
2. Since the air blown by the blower unit is configured to synchronize with the VR image, the user can get a feeling of immersion in the VR image and suppress the onset of VR sickness caused by the discrepancy between the action perceived by the user and the realistic action. It becomes possible.

3. 3. Since the VR video data displayed on the VR video display is controlled according to the movement of the user detected by the sensor, the user can feel immersed in the video simply by making any movement while watching the VR video display. At the same time, the user can experience the movement with a sense of reality simply by controlling the change of the displayed image.
4. Since the user depth image is acquired by the depth sensor to obtain the user's position, it is possible to obtain accurate position information of the user who makes various movements on the boarding section.

5. Since the video management / playback means is configured to generate the user's virtual position information based on the acquired user's position information, it is possible to determine the user's position in the video and perform the video display processing. .. In addition, since the movement amount of the user is acquired and the movement amount value is generated by multiplying the movement amount by various coefficients, the normal movement of the user is converted into a realistic movement by using the virtual position information. It can be reflected in the VR image.
6. Since the VR image display unit installation height adjusting means is provided, the VR image display unit can be adjusted so as to have an optimum height for the user.

7. Since the VR image display unit is installed at the height of the user's viewpoint, the user can obtain a sufficient immersive feeling in the VR image.
8. Since it is equipped with a vibration generating unit, it can be vibrated in synchronization with the VR image or vibrated in accordance with the user's movement, and the user can obtain a sufficient immersive feeling in the VR image.

9. Since the integrated control means controls the blower based on the event information recorded in the video management / playback means, the blower process is performed by the blower according to the movement of the user while synchronizing with the VR video. It is possible to do this, and it is possible to give the user a more realistic and immersive feeling without VR sickness.

Hereinafter, the VR boarding device according to the present invention will be described in detail based on the examples shown in the drawings. FIG. 1 is a schematic view of a VR boarding device according to the present invention, and FIG. 2 is a schematic view showing a display example of a VR image. FIG. 3 is a conceptual diagram showing the operation of the control unit.

As shown in FIG. 1, the VR boarding device 1 according to the present invention includes a main body 100, a boarding unit 200, a VR image display unit 300, a sensor 400, and a control unit 500, and in particular, virtual reality. A device used for amusement using (VR) technology, which is displayed on a screen optimized for the user's viewpoint position in front of the user without using a wearable image display device such as goggles. By boarding while watching the VR video and operating on the boarding section, the display image of the VR video display section can be changed to give the user a feeling of immersion in the video without going through a goggle-type video viewing device. It is a device that can be obtained, suppresses the passenger from causing VR sickness, and enables non-passengers to perform public viewing. The VR boarding device according to the present invention can be used not only for amusement but also for various devices such as various simulators.

The main body 100 is a main body of a boarding device used for VR (Virtual Reality), and is a member to which various members and devices constituting the VR boarding device 1 are connected and stored. At the same time, it is a basic member for mounting the VR image display unit 300 on the upper part toward the boarding unit 200. In this embodiment, the main body 100 is composed of a rectangular frame made of iron, but the present invention is not limited to this, and a material such as steel or wood can be appropriately selected, and a flat type or a dome type is used. It is possible to select any shape.

In this embodiment, the main body 100 is configured to install the blower unit 110 and the vibration generating unit 210, which will be described later, but it is also possible to equip the main body 100 with an audio output unit that outputs audio accompanying the VR image. Is. Further, a touch panel for operating the VR boarding device 1 may be provided.

The boarding section 200 is a member installed in front of the main body 100, and as will be described later, a member for swinging the boarding section 200 is incorporated inside or below. The boarding unit 200 is a part on which the user boarded when using the VR boarding device 1, and the user stands on the boarding body 200 while watching the displayed virtual reality image and enjoys performing arbitrary operations. ing. In this embodiment, the boarding unit 200 is configured to be provided with fences for preventing the user from falling off on both sides and the main body side in order to prevent the user from falling off, but the present invention is limited to this. It is not necessary to install a fence surrounding the boarding section 200 on all sides, or conversely, there may be no fence. Further, in order to make the VR boarding device 1 compatible with all uses, it is possible to select a configuration that does not use the boarding unit 200.

The VR image display unit 300 is a device for reproducing and displaying an image used for reproducing a virtual reality image. In this embodiment, it is composed of a large monitor and is installed on the main body 100 at a position in front of the boarding unit 200 toward the boarding unit 200, so that the user can watch the VR image. .. In this embodiment, the VR image display unit 300 has a configuration including a large flat display. In the past, a head-mounted display worn on the user's head was often used, but when experiencing with the head-mounted display, there was a problem that it was difficult to convey satisfaction to an audience other than the user. Since a large display is used in the present invention, a public viewing effect can be expected. The configuration of the VR video display unit 300 is not limited to the above, and it is also possible to adopt a display having a shape that is curved left and right and surrounds the user.

The sensor 400 is a member for detecting the position and movement of the user who rides on the boarding unit 200 and performs an arbitrary operation, and is installed at an installable position in front of the boarding unit 200 and substantially in front of the user. To. In this embodiment, the sensor 400 is installed in the upper center of the display screen of the VR image display unit 300 toward the boarding unit 200, but is not limited to this configuration, for example, in the main body 100. It may be installed at a location away from the VR boarding device 1 such as the ceiling.

The control unit 500 is a device that processes a signal received from the sensor 400, controls the VR image displayed on the VR image display unit 300, the vibration of the boarding unit 200, the ventilation, and the like, and is installed in the main body 100. To. In this embodiment, the control unit 500 is composed of a computer 600 and is equipped with a storage means 530 made of an arbitrary storage medium.

The VR boarding device 1 according to this embodiment has a configuration in which the main body 100 is equipped with a blower 110. The blower unit 110 is a member that is installed at a position facing the boarding unit 200 and blows air of all strengths toward the user boarding the boarding unit 200. In this embodiment, the boarding unit 100 of the main body 100 is blown. It is installed on the 200 side and blows air toward the substantially front of the user who boarded the boarding unit 200. As a result, for example, when the VR video data 10 displayed on the VR video display unit 300 is a video in which the user moves forward steadily, the user is immersive in receiving the wind by being blown from the front. It is possible to obtain a new experience and suppress VR sickness caused by the discrepancy between the image and the actual experience.

In this embodiment, the blower unit 110 uses a propeller type blower, but the present invention is not limited to this, and any structure having a blower function can be appropriately selected and used. Further, the air blowing direction may be changed up, down, left and right. Further, it is also possible to install a device for spraying water with minute water droplets (mist-like body) toward the user via a compressor.

As shown in FIG. 3, the control unit 500 is configured to include the video management / playback means 510 and the integrated control means 520. The video management / playback means 510 is a means for managing the VR video to be displayed on the VR video display unit 300 and performing the VR video playback processing on the VR video display unit 300. In this embodiment, the video management / playback means 510 is configured to transmit the VR video data 10 recorded in the storage means 530 of the computer 600 to the VR video display unit 300.

The video management / playback means 510 is software for VR video playback installed in the computer 600 in this embodiment, but is not limited to this configuration, and the VR video playback process is installed in the main body 100 or the like. It may be configured by a dedicated device.

The integrated control means 520 is a means for instructing and controlling the operation of the blower unit 110. In this embodiment, the integrated control means 520 is composed of software installed on the computer 600, and the integrated control means 520 issues instructions and control commands from the computer 600. The structure is such that the blower unit 110 is operated by receiving the signal.

The VR boarding device 1 according to the present embodiment is configured to control the video management / playback means 510 and the integrated control means 520 based on the user's position information 30 and motion information acquired by the sensor 400. As a result, it is possible to reflect the information related to the change such as the position information of the user who operates arbitrarily acquired by the sensor 400 on the VR image display unit by performing calculation processing, and the amplification change of the image according to the operation of the user. By turning and blowing, it is possible to enhance the user's immersive feeling in the image and to perform control for suppressing VR sickness.

In this embodiment, the video management / playback means 510 has a configuration in which the VR video data 10 and the event information 20 are recorded in the storage means 530 of the computer 600. The VR video data 10 is video data in a moving image format expressing a virtual space that the user views on the VR video display unit 300 when using the VR boarding device 1, and various data formats can be adopted. It is a structure.

Further, the event information 20 includes recording of the presence / absence of an event at the reproduction location of the VR video data 10, and when the VR video data 10 is reproduced and displayed on the VR video display unit 300, the event information 20 is displayed at a specific video location. It is information recorded in a data file in which the presence / absence and contents of an event to be executed are recorded, and is managed and stored in the storage means 530 as a separate file or the same file as the VR video data 10.

The video management / playback means 510 performs a process of transmitting the VR video data 10 to the VR video display unit 300. At the same time, the video management / playback means 510 performs a process of transmitting the event information 20 to the integrated control means 520.

The integrated control means 520 receives the event information 20 transmitted from the video management / playback means 510, and the blower 110 controls the amount of air blown toward the boarding unit 200 in time / quantity according to the received event information 20. It is a configuration to perform.

With the above configuration, the VR boarding device 1 can perform the ventilation processing by the blower unit 110 while maintaining almost accurate synchronization with the VR image displayed on the VR image display unit 300. The details of the event information 20 will be described later.

In the present embodiment, the sensor 400 is the position information 30 of the user who performs an arbitrary operation on the boarding unit 200 when the VR image data flows to the VR image display unit 300 and the user is experiencing or enjoying the VR. Is a configuration that constantly acquires. The acquired position information 30 is sequentially transmitted to the video management / playback means 510.

The video management / playback means 510 calculates and processes the display area of the VR video data 10 displayed on the VR video display unit 300 from the acquired user position information 30. Specifically, for example, when the VR image viewed by the user is an image in which an item is acquired while moving forward, the user moves to the right on the boarding unit 200 in an attempt to pick up the item in the right direction. At that time, the sensor 400 acquires the position information 30 that has changed with the operation. The acquired position information 30 is sequentially transmitted to the video management / playback means 510. The video management / playback means 510 calculates and acquires the position information (virtual position information 36 described later) on the VR video from the acquired position information 30, and calculates the display area of the VR video data 10 that will be visible from that position. To process.

Further, for example, when the VR image viewed by the user is an image that jumps over an obstacle while moving forward, if the user jumps on the boarding unit 200 so as to jump over the obstacle in front of the user, the sensor The 400 continuously acquires the position information 30 changed according to the operation from the jump to the landing, and the acquired position information 30 is sequentially transmitted to the video management / playback means 510. The video management / playback means 510 calculates and acquires the position information (virtual position information 36 described later) on the VR video from the acquired position information 30, and obtains the display area of the VR video data 10 that will be visible when jumping. Calculate.

The calculated and acquired VR video data 10 is transmitted to the VR video display unit 300 and displayed. With this configuration, it is possible to dynamically control the VR video data 10 displayed on the VR video display unit 300 according to the movement of the user detected by the sensor 400, and the user can dynamically control the VR video display unit. You can get an immersive feeling in the VR image just by making an arbitrary movement while watching the 300, and by controlling the change of the displayed VR image, the user can experience the realistic movement. It was.

In this embodiment, the sensor 400 has a configuration including a depth sensor 410. The depth sensor is a sensor that makes it possible to capture the detection target in three dimensions. In this embodiment, the depth sensor acquires a user depth image from the user's position information to information related to gestures. It is transmitted to the control unit 500, and the image management / playback means 510 or the computer 600 calculates and processes the information to control the VR image, the user acquires the item in the image, the blower unit 110 performs the blower process, and the like. It is a configuration that performs the processing of.

In this embodiment, as the accurate position information 30 of the user, the sensor 400 calculates and acquires the coordinate values consisting of the X value, the Y value, and the Z value based on the user's head, and also obtains the other hands and hands. It is a configuration that also acquires movement information such as legs. Of course, the position information 30 is not limited to the user's head, and can be acquired based on other information.

The sensor 400 is further configured to acquire the movement amount 34 of the user within a certain period of time. The movement amount is a numerical value of how much the user has moved within a certain time, and based on this information, the image displayed on the VR image display unit 300 is controlled. For example, when a person moves quickly and greatly on a narrow boarding section 200, it is possible to perform an exaggerated deformation as if the vehicle has moved a considerable distance on the VR image, which gives an impact to the user and gives a high immersive feeling. It becomes possible to do.

The video management / playback means 510 generates virtual position information 36 based on the user's position information 30 consisting of X value, Y value, and Z value acquired by the sensor 400 and other accompanying depth image information such as limbs. .. The virtual position information 36 is obtained by multiplying the user's position information 30 by a coefficient, and this coefficient can be changed according to the VR video data 10.

The video management / playback means 510 further generates a movement amount value 38 based on the movement amount 34 of the user acquired by the sensor 400. The movement amount value 38 is the movement amount 34 acquired by the sensor 400 multiplied by the movement coefficient and the turning coefficient, and these coefficients can be changed according to the VR video data 10. Here, the movement coefficient is a coefficient for deforming the linear movement of the user, and the turning coefficient is a coefficient for deforming the movement in which the user draws a circle in consideration of yawing, pitching, and rolling. Is. By multiplying these by the movement amount 34 and processing, a deformed user movement amount value 38 is generated.

The video management / playback means 510 further performs calculation processing of the display area of the VR video data 10 displayed on the VR video display unit 300 from the generated virtual position information 36 and the movement amount value 38, and then displays the VR video. The VR video data 10 is transmitted to the unit 300. Since this processed display area has a position and movement amount (straight line / turning) that are considerably deformed from the actual movement of the user, it is displayed even when the user makes a slight lateral movement, for example. The VR image can be an image that moves laterally for many meters, jumps, or turns vigorously while observing an object around an object. That is, it is possible to give the user a high immersive feeling by converting the normal movement of the user into a realistic movement and reflecting it in the VR image.

As shown in FIG. 2, in the video management / playback means 510, for example, when the user moves his / her head left and right, the sensor 400 acquires the user's position information 30 and the movement amount 34, and the virtual position information 36 and the movement amount value 38. After generating (turning), the display area of the VR video data 10 displayed on the VR video display unit 300 is calculated. Since each value is deformed, even if the actual movement of the user is small, the subjective image displayed on the VR image display unit 300 moves left and right more than it actually is, and the center of the image is viewed. As described above, the behavior of yaw turning (yaw turning: FIG. 2 (1)) can be expressed.

Further, when the user moves his head up and down by standing or crouching, the display area of the VR video data 10 displayed on the VR video display unit 300 is calculated, and the actual movement of the user is small. However, the subjective image displayed on the VR image display unit 300 can express the behavior of pitch-turning (FIG. 2 (2)) so as to see the central part of the image while moving up and down more than the actual one.

Furthermore, when the user moves his / her head back and forth, the subjective image displayed on the VR image display unit 300 can similarly express the behavior of moving back and forth more than it actually is. That is, since the video management / playback means 510 has a configuration in which the movement amount 34 actually operated by the user is multiplied by a coefficient, the movement can be deformed and the movement on the video can be made realistic. It became.

In the VR boarding device 1, in this embodiment, the VR image display unit installation height adjusting means 310 is installed. The VR image display unit 300 is installed at a height position that is the front part of the boarding unit 200 and is the viewpoint of the user. The VR image display unit installation height adjusting means 310 is a device that can automatically or manually adjust the installation height of the VR image display unit 300 on the main body 100, and in this embodiment, as shown in FIG. The installation height of the VR image display unit 300 is adjusted by rotating the handle-shaped member installed on the main body 100 to the left and right.

Conventionally, there are many configurations in which a VR image is drawn on a wall surface, and there is a problem that some users have a problem that it is difficult to see and the immersive feeling in the VR image is insufficient. With the above configuration, the VR boarding device 1 can raise and lower the VR image display unit 300 according to the height of the user, and the VR image display unit can be adjusted to the optimum height for the user. At low cost, it has become possible to give every user a high immersive feeling in VR images.

In this embodiment, the boarding unit 200 is configured to include a vibration generating unit 210. The vibration generating unit 210 is a device for generating vibration to vibrate the boarding unit 200, and is synchronized with the VR image data 10 displayed on the VR image display unit 300, or a sensor in the boarding unit. The vibration generating unit 210 performs vibration processing on the boarding unit 200 in response to the movement of the user detected by the vibration generating unit 210.

The integrated control means 520 receives the event information 20 transmitted from the video management / playback means 510, and the vibration generating unit 210 sends the vibration generating unit 210 to the boarding unit 200 according to the received event information 20 or according to the movement of the user. By controlling the amount of vibration, the operation of the vibration generating unit 210 is instructed and controlled.

With this configuration, the VR boarding device 1 is subjected to vibration processing by the vibration generating unit 210 while maintaining substantially accurate synchronization with the VR image displayed on the VR image display unit 300 or in accordance with the movement of the user. Can be done.

More specifically, the event information 20 is event flag data composed of a plurality of types indicating the presence / absence and types of various events that occur at a specific playback location of the VR video data 10 viewed by the user. In this embodiment, the event information 20 is configured to include at least the ventilation flag 22. Further, in order to install the vibration generator 210, it is possible to configure the configuration to include the vibration flag 24.

The video management / playback means 510 extracts the event flag data at the current playback location of the VR video data 10 being played back, that is, displayed on the VR video display device 300 and viewed by the user, from the data file managed and saved in the storage means 530. It is transmitted as event information 20 to the integrated control means 520.

The integrated control means 520 receives the transmitted event information 20 and controls the blower unit 110 according to the content thereof. When the vibration generator 210 is installed, the vibration generator 210 is further controlled. That is, when the event information 20 is the ventilation flag 22, the integrated control means 520 instructs and controls the ventilation unit 110 to blow air toward the boarding unit 200 for a certain period of time. Further, when the event information 20 is the vibration flag 24, the vibration generator 210 is instructed and controlled to vibrate the boarding unit 200.

With this configuration, by control by the integrated control means 520 based on the event information 20, it is possible to generate an event according to the image such as moving forward or shaking in synchronization with the VR image, and the user can do so. It is possible to experience the same situation in a realistic and pseudo manner as if you were watching an event and a VR video while watching it.

Further, for example, when the event information 20 is the blast flag 22, the blast unit 110 performs a process of gradually reducing the blast amount during the blast operation toward the boarding unit 200 for a certain period of time before increasing the blast amount. It is possible to configure it to be performed. This makes it possible to simulate an experience similar to infinite acceleration. That is, at a certain VR image position, after the blower process is performed by the blower unit 110, the amount of air blown is gradually suppressed, and then the blower process is performed again by the blower unit 110. By repeating this, it is possible to obtain a feeling (experience) of further acceleration even if the actual mechanical wind speed does not change much. Also, the vibration flag 24 can be used as well.

With the above configuration, the user can feel as if he / she is in the space of the VR image, and can also experience and enjoy the deformed and realistic movement together with the ventilation. Is possible. That is, by using the VR boarding device 1 according to the present invention, it is possible to experience dynamic movements, obtain a high immersive feeling in the VR image, and suppress unexpected VR sickness. It has become possible to provide the device.

Schematic diagram of the boarding device for VR according to the present invention Schematic diagram showing a display example of VR video Conceptual diagram showing the operation of the control unit

1 VR boarding device 10 VR video data 20 Event information 22 Blower flag 24 Vibration flag 30 Position information 34 Movement amount 36 Virtual position information 38 Movement amount value 100 Main unit 110 Blower part 200 Boarding part 210 Vibration generation part 300 VR image display part 310 VR video display unit installation height adjustment means 400 sensor 500 control unit 510 video management playback means 520 integrated control means 530 storage means 600 computer

Claims

The main body (100) of the boarding device used for VR (Virtual Reality), the boarding section (200) for the user to board, and the VR image installed in front of the boarding section toward the boarding section. A VR boarding device (1) consisting of a VR image display unit (300), a sensor (400) installed in front of the boarding unit that can detect the movement of the user, and a control unit (500) installed in the main body. )
The main body (100) includes a blower portion (110) for blowing wind toward the boarding portion installed so as to face the boarding portion.
The control unit (500) manages the VR video, and also instructs and controls the operation of the video management / playback means (510) that performs playback processing on the VR video display unit (300) and the blower unit (110). For VR, which is equipped with an integrated control means (520) and controls the video management / playback means (510) and the integrated control means (520) based on the information from the sensor (400). Boarding device.
The VR boarding device is
In order to perform the air blowing process by the air blowing unit (110) while synchronizing with the VR image (10) displayed on the VR image display unit (300).
The video management / playback means (510) records VR video data (10) and event information (20) in the storage means (530), and transmits the VR video data (10) to the VR video display unit (300). At the same time, event information (20) including a record of the presence or absence of an event at the reproduction location of the VR video data (10) is transmitted to the integrated control means (520).
The first aspect of claim 1, wherein the integrated control means (520) controls the amount of air blown toward the boarding unit (200) by the air blower unit (110) according to the received event information (20). Boarding device for VR.
The VR boarding device (1) is
In order to control the VR video data (10) displayed on the VR video display unit (300) according to the movement of the user detected by the sensor (400).
The sensor (400) acquires the user's position information (30), and the video management / playback means (510) is displayed on the VR image display unit (300) from the acquired position information (30). The VR according to claim 1 or 2, wherein the display area of the VR video data (10) is calculated and then the VR video data (10) is transmitted to the VR video display unit (300). Boarding device.
The sensor (400) is composed of a depth sensor (410), and the depth sensor acquires a user depth image and at the same time.
The accurate position information (30) of the user is calculated and acquired as a coordinate value consisting of an X value, a Y value, and a Z value based on the user's head, and the amount of movement of the user within a certain period of time (34). The VR boarding device according to any one of claims 1 to 3, wherein the VR boarding device is characterized by obtaining the above.
The video management / playback means (510) is based on the user's position information (30) composed of the X value, the Y value, and the Z value acquired by the sensor (400), and the user's position information (30) is multiplied by a coefficient. Along with generating virtual position information (36), a movement amount value (38) obtained by multiplying the acquired movement amount (34) by a movement coefficient and a turning coefficient is generated, and the virtual position information (36) and the movement amount value ( After calculating the display area of the VR video data (10) displayed on the VR video display unit (300) from 38), the VR video data (10) is transmitted to the VR video display unit (300). The VR boarding device according to claim 4, wherein the VR boarding device is characterized by this.
The VR boarding device (1) is characterized in that the VR image display unit installation height adjusting means (310) is installed so that the installation height of the VR image display unit (300) can be adjusted automatically or manually. The VR boarding device according to any one of items 1 to 5.
The VR image display unit (300) is any of claims 1 to 6, wherein the VR image display unit (300) is installed at a height position which is a front portion of the boarding unit (200) and is a viewpoint of a user. The VR boarding device described.
The boarding unit (200) includes a vibration generating unit (210) for generating vibration to vibrate the boarding unit (200), and VR image data displayed on the VR image display unit (300). In order to perform vibration processing on the boarding section (200) by the vibration generating section (210) while synchronizing with (10) or in response to the movement of the user detected by the sensor in the boarding section.
The integrated control means (520) controls the amount of vibration to the boarding unit (200) by the vibration generating unit (210) according to the received event information (20) or according to the movement of the user. The VR boarding device according to claim 2, wherein the operation of the vibration generating unit (210) is instructed and controlled by performing the above.
The event information (20) is event flag data indicating the presence or absence of an event at a specific playback location of the VR video data (10), and includes at least a ventilation flag (22).
The video management / playback means (510) transmits the event flag data at the current playback location of the VR video data (10) as event information (20) to the integrated control means (520).
The integrated control means (520) receives the event information (20), acquires the user's virtual position information (36) from the sensor (400), performs calculation processing, and then performs the event information (20). ) Is the ventilation flag (22), the second to second aspects are characterized in that the ventilation unit (110) is instructed and controlled to blow air toward the boarding unit (200) for a certain period of time. The VR boarding device according to any one of claims 8.