JP2017199238A - Virtual space display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a virtual space display system which displays a virtual space having a virtual reality to clients (users) and giving them a feeling as if they actually enter the virtual space by making a virtual object appear in the space.SOLUTION: A virtual space display system includes: a head mount display mounted by a user in a predetermined real space; a detection part for detecting a position and/or a posture inside a real space of the head mount display; and an image generation part for generating an image of the virtual space viewable via the head mount display by the user on the basis of the detection result of the detection part. The image generation part includes a virtual object generation part for generating a virtual object in the virtual space according to a detection content of the detection part.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a virtual space display system for displaying a virtual space image on a head mounted display worn by a user.

  In recent years, games (game systems) related to virtual reality (virtual reality) using a head-mounted display have been realized (see Non-Patent Document 1, for example). In such a game, an image of the virtual space is displayed on a head mounted display worn by the user. And the image of the virtual space displayed on the same display changes according to the movement of the user moving. Thereby, the user can obtain a feeling (immersive feeling) as if the user actually entered the virtual space.

http://game.watch.impress.co.jp/docs/series/vrgaming/20150818_716564.html

  On the other hand, there are amusement attractions installed in amusement facilities such as so-called theme parks, which use large-scale facilities and give customers a simulated experience different from daily life. This type of attraction is very popular with customers, but there is a problem that it takes cost and time to install large-scale facilities.

  The present invention displays a virtual space of virtual reality to a customer (user) and makes a virtual object appear in the virtual space, thereby giving a sense (immersive feeling) as if actually entering the virtual space. An object is to provide a display system.

  A first virtual space display system of the present invention includes a head mounted display worn by a user in a predetermined real space, a detection unit for detecting the position and / or posture of the head mounted display in the real space, and a real space. An image generation unit that generates a corresponding virtual space and generates an image of the virtual space that the user can see through the head-mounted display based on the detection result of the detection unit, and the image generation unit detects the detection unit A virtual object generation unit that generates a virtual object in the virtual space according to the contents is included.

  The image generation unit may generate a virtual object in the vicinity of the position in the virtual space corresponding to the position of the user in the real space.

  The image generation unit displays a partition that partitions the virtual space, and is on the side opposite to the first virtual space on the side where the user of the virtual space partitioned by the partition is located and the user of the virtual space partitioned by the partition The virtual object may be divided into the second virtual space, and the virtual object may be generated in the first virtual space and moved (leaved) to the second virtual space.

  A second virtual space display system according to the present invention includes a head mounted display worn by a user in a predetermined real space, a detection unit for detecting the position and / or posture of the head mounted display in the real space, and a real space. An image generation unit that generates a corresponding virtual space and generates an image of the virtual space that the user can see through the head mounted display based on a detection result of the detection unit, and an operation unit. The image generation unit generates a virtual object in the virtual space according to the operation of the operation unit.

  The operation unit may include a control display unit and a touch panel provided in front of the control display unit, and a control image indicating the virtual space and the position of the user may be displayed on the control display unit.

  In the above invention, a real object may be further installed in the real space, and the virtual object generation unit may generate the virtual object at a position in the virtual space corresponding to the position of the real object in the real space.

  In the above invention, the virtual object generation unit may further include a moving mechanism that includes means for moving the virtual object in the virtual space, and moves the real object in the real space following the movement of the virtual object. .

  According to the present invention, a virtual object can be generated for a user wearing a head-mounted display, so that the user can actually enter the virtual space and feel that an event has occurred (immersive feeling). Can be given to the user.

It is a figure which shows the structure of the virtual space display system of embodiment to which this invention is applied. It is a block diagram of a virtual space control device, a head mounted display, and a detection device of the virtual space display system. It is a figure which shows the form of the display part and operation part of the virtual space control apparatus. It is a flowchart which shows operation | movement of the control part of the virtual space control apparatus. It is a flowchart which shows other operation | movement of the control part of the virtual space control apparatus.

  A virtual space display system according to an embodiment of the present invention will be described with reference to the drawings. The configuration of the present invention is not limited to the embodiment. Further, the processing procedures of the respective flowcharts are not limited to the embodiment and are in no particular order as long as no contradiction occurs.

  FIG. 1A is a diagram illustrating a configuration of the virtual space display system 1 of this embodiment, and FIG. 1B is a diagram illustrating a mounting form of a head mounted display (HMD) 3 by a user P. In this embodiment, an example in which the virtual space display system 1 is applied to an amusement / attraction using a virtual space VS is shown. The attraction of this embodiment is a haunted house that surprises the user P who is a customer by forming a ghost as a virtual object VO.

  The virtual space display system 1 includes a virtual space control device 2, a head mounted display 3, a laser irradiation device 4 (4A, 4B), an object (real object) 5, and an object driving device 6. The head mounted display 3 has a function of sensing its position and posture.

  The laser irradiation device 4 (4A, 4B) is installed in the vicinity of the inlet RI on the left side of the passage R in the drawing and in the vicinity of the outlet RO on the right side of the drawing. The irradiation range of these laser irradiation devices 4 (4A, 4B) is a display controllable range by the virtual space display system 1. The user P who is a customer of this attraction enters the passage R from the entrance RI and exits from the exit RO. A virtual object (ghost) VO is formed in the virtual space VS at a predetermined timing while the user P is in the passage R.

  In the attraction, other passages having a similar or similar configuration may be continuous before and after the passage R shown in the drawing. Moreover, although the wall surface W is provided in the side (upper and lower in the figure) of the channel | path R, the wall surface W is not essential in this invention. That is, the virtual space VS displayed to the user P is free from the actual shape of the passage R except for the user P's passable range.

  An actual object 5 that can be moved by the object driving device 6 is provided in the path R. The real object 5 is preferably a flexible object such as a curtain. The virtual space control device 2 moves the real object 5 in conjunction with the movement of the virtual object VO. The real object 5 can be moved within a moving range 60 by the object driving device 6. Thereby, the virtual object VO can be made more realistic by linking the virtual object VO and the sense of touch of the user P.

  In the virtual space display system 1 of the present embodiment, the position and posture of the head mounted display 3 worn by the user P is detected, so that the virtual space (ghost) corresponding to the movement (movement, change of posture, etc.) of the user P is detected. Mansion) An image of VS is displayed on the head mounted display 3. That is, an image of the virtual space VS corresponding to the line of sight of the user P is displayed, and a virtual object (ghost) VO is displayed in the virtual space VS.

  The virtual space control device 2 reads and executes the program 70 from the memory 22 (refer to FIG. 2) in which a virtual haunted house program (hereinafter simply referred to as a program) 70 is stored, and executes a tertiary corresponding to the real space including the passage R. Create the original virtual space. Then, the game image including the generated virtual space image is displayed on the head mounted display 3. As the virtual space control device 2, for example, a personal computer can be applied.

  2A and 2B are block diagrams showing configurations of the virtual space control device 2 and the head mounted display 3 of this embodiment. FIG. 3 is a diagram illustrating the configuration of the control display unit 27 and the operation unit 26 of the virtual space control device 2. 2B, the head mounted display 3 has an eye mask 52 that covers both eyes of the user P, and a left-eye display 46 and a right-eye display 47 are arranged on the left and right sides inside the eye mask. When the user P puts the eye mask 52 against the head (in front of both eyes) and the head mounted display 3 is mounted on each of the left eye display 46 and the right eye display 47, the eye mask 52 is attached to the real space of the user P. The field of view is blocked, and the left-eye display 46 and the right-eye display 47 are positioned in front of the left eye and right eye of the user P. As a result, the user P views only the virtual space VS displayed on the left-eye display 46 and the right-eye display 47.

  The laser irradiation devices (light emitting units) 4A and 4B scan the path R alternately with an infrared laser. The head mounted display 3 includes a plurality of light receiving sensors 50 for receiving the infrared laser, and the position and orientation of the head mounted display 3 are calculated based on which light receiving sensor 50 receives the laser at which scan timing ( Detected). In addition, the laser irradiation apparatus 4 is not limited to two, What is necessary is just one or more.

  2A, the virtual space control device 2 has a control unit 20, an operation unit 26, a display unit 27, a wireless communication circuit unit 28, and a peripheral device interface 29 on a bus 23. The control unit 20 includes a CPU 21, a memory 22, an image processor 24, and an audio processor 25.

  The wireless communication circuit unit 28 communicates with the head mounted display 3 by Wi-Fi communication. As shown in FIG. 3, the operation unit 26 includes a touch panel 260 and a plurality of button switches 261 and detects an operation by the user. The memory 22 includes a RAM, a ROM, a storage device, and the like, and stores a game program 70. The game program 70 includes data such as an image necessary for generating the virtual space VS and forming the virtual object VO, in addition to the program main body.

  The image processor 24 includes a GPU (Graphics Processing Unit) that can generate a game image. The image processor 24 generates a virtual space VO according to an instruction from the CPU 21 and generates an image of the virtual space viewed from the user's line of sight. The generated image is transmitted to the head mounted display 3. In the present embodiment, a left-eye game image and a right-eye game image corresponding to the user's line of sight estimated based on the position and orientation information of the head mounted display 3 are generated.

  The sound processor 25 has a DSP (Digital Signal Processor) that generates sound generated in the virtual space VS. The sound processor 25 transmits the generated sound to the head mounted display 3. The game sound is output from the earphone 49 connected to the head mounted display 3.

  The head mounted display 3 includes a control unit 40, a wireless communication circuit unit 44, a VRAM 45, an amplifier 48, and (a plurality of) light receiving sensors 50 on a bus 51. The control unit 40 includes a CPU 41, a memory 42 and a VRAM 45. A left-eye display 46 and a right-eye display 47 are connected to the VRAM 45. An earphone 49 is connected to the amplifier 48.

  The wireless communication circuit unit 44 communicates with the virtual space control device 2 by Wi-Fi communication. A game image received from the virtual space control device 2 is drawn on the VRAM 45 in accordance with an instruction from the CPU 41. The drawn game image is output to the left-eye display 46 and the right-eye display 47. The game sound received from the virtual space control device 2 is output to the amplifier 48. The amplifier 48 amplifies the game sound signal and outputs it to the earphone terminal 49. The earphone terminal 49 is connected to a stereo earphone worn by the user P on both ears, and game sound is output to the user P by the earphone.

  A plurality of light receiving sensors 50 are arranged on the peripheral surface of the head mounted display 3 (eye mask 52), detect each infrared laser irradiated from the laser irradiation device 4, and input a detection signal indicating the detection to the CPU 41. As described above, the CPU 41 detects the position and posture of the head mounted display 3 in the real space based on the timing when the infrared laser is scanned by the laser irradiation device 4 and which light receiving sensor 50 receives the laser. Information regarding the detected position and orientation is transmitted to the virtual space control device 2.

  The display unit 27 and the operation unit 26 of the virtual space control device 2 will be described with reference to FIG. The display unit 27 includes a liquid crystal display 270 and displays a control image different from the virtual space image generated by the image processor 24. In the example illustrated in FIG. 3, a plan view of the passage R viewed from above is displayed, and a graphic showing the position of the user P and the position of the real object 5 is displayed therein. It should be noted that the numbers in the figure in parentheses indicate not the constituent parts themselves but the images showing the constituent parts. In addition, a floating window 275 is displayed on the display 270. In the floating window 275, an image displayed on the head mounted display 3 of the user P, that is, an image of the virtual space VS viewed by the user P is displayed in 2D (two-dimensional). The floating window 275 is displayed obliquely behind the image (P) showing the user P on the display 270 and moves following the movement of the user P. A touch panel 260 is provided on the surface of the display 270. The touch panel 260 detects the touch of the display unit 27 by the staff member D. A plurality of virtual object selection buttons 261 are provided below the display 270. These virtual object selection buttons 261 are button switches, and each correspond to a different virtual object VO. When the attendant D presses one of the virtual object selection buttons 261 (261-1 to 261) with one finger and touches somewhere on the display 270 with the other finger, the touch panel 260 detects the touch position 271; The selected virtual object (ghost) VO appears at a position in the virtual space VS corresponding to the touch position 271. Press information and touch position information of the virtual object selection button 261 are transmitted from the operation unit 26 to the CPU 21, and the image processor 24 generates a virtual object VO in the virtual space VS according to an instruction from the CPU 21.

  The virtual object selection button 261-3 is a button switch for designating the virtual object VO associated with the real object 5. When any part of the display 270 is touched in a state where the virtual object selection button 261-3 is pressed, a line drawn from the touch position 272 in the direction of the path R and the real object as shown in FIG. A virtual object VO is generated at a position where the movement range 60 of 5 intersects, and the real object 5 is moved to that position. Press information and touch position information on the virtual object selection button 261-3 are transmitted from the operation unit 26 to the CPU 21. The CPU 21 instructs the image processor 24 to generate the virtual object VO, and controls the object driving device 6 via the peripheral device interface 29 to move the real object 5 to a position corresponding to the virtual object VO. When the clerk D moves the touch position 272, the position of the virtual object VO generated so as to follow this is moved, and the real object 5 is moved so as to follow this.

  As described above, where the user P is in the passage R is displayed on the display unit 27 (display 270), and the clerk D operates the operation unit 26 in response to this, so that the virtual space that the user P is viewing is displayed. Since the virtual object VO can appear in the VS, the virtual object (ghost) VO can appear at the timing and position where the highest effect can be obtained by looking at the position of the user P and the like. The control image is not limited to the plan view of the passage R. For example, a bird's-eye view or a bird's-eye view may be used.

  Next, the virtual space and virtual object generation processing described above will be described with reference to the flowchart of FIG. This processing operation is repeatedly executed at regular intervals, for example, in units of one frame (1/60 seconds).

  The control unit 20 acquires the position and direction of the head mounted display 3 via the wireless communication circuit unit 28 (S10). Based on this position and direction, an image in which the user P sees the virtual space VS is generated (S20). Further, it is determined whether the virtual object selection button 261 is pressed and the display 270 is touched (S30, S40). If the virtual object selection button 261 is pressed and the display 270 is touched (YES in S30 and YES in S40), is the pressed virtual object selection button 261 the third button 261-3? Is determined (S50). If the pressed virtual object selection button 261 is not the third button 261-3 (NO in S50), a virtual object VO is generated at a position corresponding to the touch position 271 (S60).

  On the other hand, when the pressed virtual object selection button 261 is the third button 261-3 (YES in S50), it intersects with a line extending in the direction of the path R from the touch position 272 within the moving range 60 of the real object 5. A virtual object VO is generated at the position (S70). Then, the object driving device 6 is driven to move the real object 5 to a position corresponding to the virtual object VO (S80). Then, the virtual space VS and the image of the virtual object VO in the virtual space VS are transmitted to the head mounted display 3 (S90).

  In the above-described embodiment, the light receiving sensor is arranged on the head mounted display 3 to detect the position and the like. However, the position is not particularly limited as long as the position and the like can be detected. For example, a configuration in which a light emitting element is provided in the head mounted display 3 and a light receiving element is provided at a predetermined position in the passage R may be employed.

<Other embodiments>
In the above-described embodiment, the clerk D operates the operation unit 26 while viewing the display on the display unit 27 to cause the virtual objects VO to appear in the virtual space OS. These areas may be allocated, and when the user P approaches the area, the corresponding virtual object VO may be automatically made to appear. In this case, the position where the virtual object VO appears may be determined in advance. In addition, when moving the virtual object VO, the route may be determined in advance. Further, the virtual object VO may be a moving image that operates by itself.

  With reference to the flowchart of FIG. 5, a process when the virtual object VO appears automatically will be described. This processing operation is repeatedly executed at regular intervals, for example, in units of one frame (1/60 seconds).

  The control unit 20 acquires the position and direction of the head mounted display 3 via the wireless communication circuit unit 28 (S110). Based on this position and direction, an image in which the user P sees the virtual space VS is generated (S120). Further, it is determined whether the position of the user P (head mounted display 3) is within the display area of the virtual object VO (S130). When the position of the user P is within the virtual object display area (YES in S130), a virtual object VO corresponding to the area is generated at a predetermined position (S140). Then, the generated virtual space image is transmitted to the head mounted display 3 (S150). At this time, the real object 5 may be linked to the virtual object VO.

  When the position of the user P is outside the virtual object display area (NO in S130), an image of the virtual space VS without the virtual object VO is transmitted to the head mounted display 3 (S150).

  Furthermore, in the above-described embodiment, the appearance of the user P is not generated in the virtual space, but may appear in the virtual space. In this case, for example, a light receiving sensor that receives an infrared laser may be provided in each part of the user P's body to detect the position and posture of the user P.

  In the above embodiment, an example in which the real object 5 is linked to the virtual object VO has been shown. However, other elements may be linked to the virtual object VO. For example, wind (hot air, cold air, etc.) or mist may be blown out and applied to the user P, or the floor or the like may be vibrated.

  In addition, an unevenness may be formed on the floor of the passage R in advance, or an entity such as a sponge that may sink the user's P foot may be disposed. In this case, blood pools, water pools, dead bodies, and the like may be displayed as images on the unevenness, and if the user P steps on the sponge, a sound is generated.

  A chair may be arranged as a real object, an image of the chair may be displayed at a corresponding position in the virtual space VS, and some event may be generated when the user P sits on the chair. As an event, for example, a ghost appears from around a chair.

  Further, the passage R may be divided into a plurality (two) of virtual or actual. When an actual partition is provided, the virtual partition is provided at a position corresponding to the actual partition. The partition includes opening / closing parts such as curtains and doors so that the user P can pass through.

  In the configuration in which the partition is provided, when the user P comes to a predetermined position, the virtual object (ghost) VO is generated on the side (first virtual space) where the user P of the virtual space VS divided by the partition is present. Also good. And you may produce this virtual object VO leaving the 2nd virtual space through a curtain or a door. Here, the second virtual space is a side where the user P of the virtual space VS divided by the partition is not present. Further, according to the movement of the virtual object VO, the display mode of the virtual opening / closing unit may be changed such that the curtain flutters and the door opens / closes.

  Furthermore, according to the user P performing a predetermined operation on the partition, the display mode of the virtual opening / closing unit may be changed such that the curtain flutters and the door opens. The predetermined operation on the partition of the user P is an operation such as opening a curtain or opening a door, or an operation such as standing in front of the door.

  INDUSTRIAL APPLICABILITY The present invention is useful for realizing a facility (such as a haunted house) that has been realized using a large-scale facility in real space with a simple facility using a virtual space and a virtual object. .

DESCRIPTION OF SYMBOLS 1 Virtual space display system 2 Virtual space control apparatus 3 Head mounted display 4 (4A, 4B) Laser irradiation apparatus 5 Real object 6 Object drive apparatus 260 Touch panel 261 Virtual object selection button P User (customer)
D Personnel R Passage RI Passage entrance RO Passage exit VO Virtual object

Claims (7)

A head mounted display worn by the user in a predetermined real space;
A detection unit for detecting a position and / or posture of the head-mounted display in the real space;
An image generation unit that generates a virtual space corresponding to the real space, and generates an image of the virtual space that the user sees through the head mounted display based on a detection result of the detection unit;
A virtual space display system comprising:
The image generation unit is a virtual space display system including a virtual object generation unit that generates a virtual object in the virtual space according to the detection content of the detection unit.   The virtual space display system according to claim 1, wherein the image generation unit generates the virtual object near a position in the virtual space corresponding to a position of a user in the real space. The image generation unit
A partition that divides the virtual space is displayed, and a first virtual space that is a side where the user of the virtual space partitioned by the partition is present and a user that is opposite to the user of the virtual space partitioned by the partition. Divided into two virtual spaces,
The virtual space display system according to claim 1, wherein the virtual object is generated in the first virtual space and moved to the second virtual space. A head mounted display worn by the user in a predetermined real space;
A detection unit for detecting a position and / or posture of the head-mounted display in the real space;
An image generation unit that generates a virtual space corresponding to the real space, and generates an image of the virtual space that the user sees through the head mounted display based on a detection result of the detection unit;
A virtual space display system comprising:
Furthermore, it has an operation part,
The virtual space display system, wherein the image generation unit includes a virtual object generation unit that generates a virtual object in the virtual space in accordance with an operation of the operation unit. The operation unit includes a control display unit, and a touch panel provided on the front surface of the control display unit,
The virtual space display system according to claim 4, wherein the control display unit displays a control image indicating the virtual space and the position of the user. Further installing a real object in the real space,
The virtual space display system according to claim 1, wherein the virtual object generation unit generates the virtual object at a position in the virtual space corresponding to a position of the real object in the real space. The virtual object generation unit includes means for moving the virtual object in the virtual space,
The virtual space display system according to claim 6, further comprising a moving mechanism that moves the real object in the real space following the movement of the virtual object.

Images