JP2021152665A - Display control device and display control method - Google Patents

Abstract

To improve user convenience of head-mounted display.SOLUTION: The display control device includes a display control unit that sets a viewpoint position and a line-of-sight direction, generates an image of a virtual space, and displays it on a head-mounted display 100. The display control unit can change the viewpoint position from a plurality of positions set in the virtual space to a position determined according to the user's operation. The display control unit causes the head-mounted display and a display device other than the head-mounted display to display an image based on the same virtual three-dimensional space.SELECTED DRAWING: Figure 1

Description

The present invention relates to a display control technique, and more particularly to a display control device and a display control method for controlling a display on a head-mounted display.

A head-mounted display connected to a game machine is attached to the head, and the game is played by operating a controller or the like while looking at the screen displayed on the head-mounted display. With a normal stationary display connected to a game console, the user's field of view extends beyond the display screen, making it difficult to concentrate on the display screen or lacking a sense of immersion in the game. There is. On the other hand, when the head-mounted display is attached, the user does not see anything other than the image displayed on the head-mounted display, which increases the immersive feeling in the image world and has the effect of further enhancing the entertainment of the game.

The present inventor has recognized that a more convenient display control technology is required in order to enable a larger number of users to enjoy games using a head-mounted display.

In order to solve the above problems, the display control device of a certain aspect of the present invention includes a display control unit that sets a viewpoint position and a line-of-sight direction to generate an image of a virtual space and displays it on a head-mounted display. The display control unit can change the viewpoint position from a plurality of positions set in the virtual space to a position determined according to the user's operation, and the display control unit is other than the head-mounted display and the head-mounted display. Display an image based on the same virtual three-dimensional space on the display device.

Another aspect of the present invention is a display control method. This method includes a step in which the display control unit sets the viewpoint position and the line-of-sight direction, generates an image of the virtual space, and displays it on the head-mounted display. The display control unit can change the viewpoint position from a plurality of positions set in the virtual space to a position determined according to the user's operation, and the display control unit is other than the head-mounted display and the head-mounted display. Display an image based on the same virtual three-dimensional space on the display device.

It should be noted that any combination of the above components and the conversion of the expression of the present invention between methods, devices, systems, programs and the like are also effective as aspects of the present invention.

According to the present invention, the convenience of the user of the head-mounted display can be improved.

It is a figure which shows the use environment of the game system which concerns on embodiment. It is an external view of the head-mounted display which concerns on embodiment. It is a functional block diagram of a head-mounted display. It is a figure which shows the appearance structure of an input device. It is a figure which shows the internal structure of an input device. It is a figure which shows the structure of the game apparatus. It is a functional block diagram of a game device. 8 (a) to 8 (c) are diagrams showing an example of an image displayed on the head-mounted display. It is a schematic diagram for demonstrating the setting method of a viewpoint position and a line-of-sight direction. 10 (a) and 10 (b) are diagrams showing an example of an image displayed on the head-mounted display. It is a schematic diagram for demonstrating the content of another game provided by a game control unit. 12 (a) to 12 (c) are diagrams showing an example of an image displayed on the head-mounted display. It is a schematic diagram for demonstrating the moving method of the viewpoint position in the game which concerns on embodiment.

In this embodiment, a display technique using a head-mounted display (HMD) will be described. The head-mounted display is a display device that is worn on the user's head so as to cover both eyes of the user and for viewing a still image, a moving image, or the like displayed on a display screen provided in front of the user's eyes. The target displayed on the head-mounted display may be content such as a movie or a TV program, but in the present embodiment, an example in which the head-mounted display is used as a display device for displaying an image of a game will be described. do.

FIG. 1 shows a usage environment of the game system 1 according to the embodiment. The game system 1 is composed of a game device 10 for executing a game program, an input device 20 for inputting a user's instruction to the game device 10, an imaging device 14 for imaging the real space around the user, and a game device 10. It includes a head mount display 100 for displaying the generated first game image, and a display device 12 for displaying the second game image generated by the game device 10.

The game device 10 executes a game program based on an instruction input input by the input device 20 or the head-mounted display 100, a position or orientation of the input device 20 or the head-mounted display 100, and generates a first game image. The second game image is generated and transmitted to the display device 12.

The head-mounted display 100 displays a first game image generated by the game device 10. In addition, information regarding the user's input to the input device provided on the head-mounted display 100 is transmitted to the game device 10. The head-mounted display 100 may be connected to the game device 10 with a wired cable, or may be wirelessly connected to the game device 10 by a wireless LAN or the like.

The display device 12 displays the second game image generated by the game device 10. The display device 12 may be a television having a display and speakers, a computer display, or the like.

The input device 20 has a function of transmitting an instruction input by the user to the game device 10, and is configured as a wireless controller capable of wireless communication with the game device 10 in the present embodiment. The input device 20 and the game device 10 may establish a wireless connection using the Bluetooth® protocol. The input device 20 is not limited to the wireless controller, and may be a wired controller connected to the game device 10 via a cable.

The input device 20 is battery-powered and includes a plurality of buttons for inputting instructions to advance the game. When the user operates the button of the input device 20, the instruction input by the operation is transmitted to the game device 10 by wireless communication.

The image pickup device 14 is a video camera composed of a CCD image pickup device, a CMOS image pickup device, or the like, and images the real space at a predetermined cycle to generate a frame image for each cycle. The image pickup device 14 is connected to the game device 10 via USB (Universal Serial Bus) or other interface. The image captured by the image pickup device 14 is used in the game device 10 to derive the positions and orientations of the input device 20 and the head-mounted display 100. The image pickup apparatus 14 may be a distance measuring camera or a stereo camera capable of acquiring a distance. In this case, the image pickup device 14 can acquire the distance between the image pickup device 14 and the input device 20, the head-mounted display 100, or the like.

In the game system 1 of this embodiment, the input device 20 and the head-mounted display 100 have a light emitting unit configured to be capable of emitting light in a plurality of colors. During the game, the light emitting unit emits light in the color instructed by the game device 10, and is imaged by the image pickup device 14. The image pickup device 14 takes an image of the input device 20, generates a frame image, and supplies the frame image to the game device 10. The game device 10 acquires a frame image and derives position information of the light emitting portion in the real space from the position and size of the image of the light emitting portion in the frame image. The game device 10 handles the position information as an operation instruction of the game, controls the operation of the player's character, and reflects it in the processing of the game.

Further, the input device 20 and the head-mounted display 100 have an acceleration sensor and a gyro sensor. The detected value of the sensor is transmitted to the game device 10 at a predetermined cycle, and the game device 10 acquires the detected value of the sensor to acquire the posture information of the input device 20 and the head-mounted display 100 in the real space. The game device 10 handles the posture information as an operation instruction of the game and reflects it in the processing of the game.

FIG. 2 is an external view of the head-mounted display 100 according to the embodiment. The head-mounted display 100 includes a main body 110, a head contact 112, and a light emitting unit 114.

The main body 110 is provided with a display, a GPS unit for acquiring position information, an attitude sensor, a communication device, and the like. The head contact portion 112 may be provided with a biometric information acquisition sensor capable of measuring biometric information such as a user's body temperature, pulse, blood component, sweating, electroencephalogram, and cerebral blood flow. As described above, the light emitting unit 114 emits light in the color instructed by the game device 10, and functions as a reference for calculating the position of the head-mounted display 100 in the image captured by the image pickup device 14.

The head-mounted display 100 may also be provided with a camera that captures the user's eyes. The camera mounted on the head-mounted display 100 can detect the user's line of sight, pupil movement, blinking, and the like.

In the present embodiment, the head-mounted display 100 will be described, but the display control technology of the present embodiment is not limited to the head-mounted display 100 in a narrow sense, and is limited to glasses, a glasses-type display, a glasses-type camera, headphones, and a headset. It can also be applied when wearing (headphones with a microphone), earphones, earphones, ear-hook camera, hat, hat with camera, hair band, etc.

FIG. 3 is a functional configuration diagram of the head-mounted display 100. The head mount display 100 includes an input interface 122, an output interface 130, a backlight 132, a communication control unit 140, a network adapter 142, an antenna 144, a storage unit 150, a GPS unit 161, a wireless unit 162, an attitude sensor 164, and an external input / output terminal. It includes an interface 170, an external memory 172, a clock unit 180, a display device 190, and a control unit 160. These functional blocks can also be realized in various ways by hardware only, software only, or a combination thereof.

The control unit 160 is a main processor that processes and outputs signals such as image signals and sensor signals, as well as instructions and data. The input interface 122 receives an operation signal or a setting signal from an input button or the like and supplies the operation signal to the control unit 160. The output interface 130 receives an image signal from the control unit 160 and displays it on the display device 190. The backlight 132 supplies a backlight to the liquid crystal display constituting the display device 190.

The communication control unit 140 transmits the data input from the control unit 160 to the outside via the network adapter 142 or the antenna 144 by wired or wireless communication. The communication control unit 140 also receives data from the outside via wired or wireless communication via the network adapter 142 or the antenna 144, and outputs the data to the control unit 160.

The storage unit 150 temporarily stores data, parameters, operation signals, and the like processed by the control unit 160.

The GPS unit 161 receives position information from GPS satellites and supplies it to the control unit 160 according to an operation signal from the control unit 160. The radio unit 162 receives the position information from the radio base station and supplies the position information to the control unit 160 according to the operation signal from the control unit 160.

The posture sensor 164 detects posture information such as the orientation and tilt of the main body 110 of the head-mounted display 100. The attitude sensor 164 is realized by appropriately combining a gyro sensor, an acceleration sensor, an angular acceleration sensor, and the like.

The external input / output terminal interface 170 is an interface for connecting peripheral devices such as a USB (Universal Serial Bus) controller. The external memory 172 is an external memory such as a flash memory.

The clock unit 180 sets the time information by the setting signal from the control unit 160, and supplies the time data to the control unit 160.

FIG. 4 shows the external configuration of the input device 20. FIG. 4A shows the upper surface configuration of the input device 20, and FIG. 4B shows the lower surface configuration of the input device 20. The input device 20 has a light emitter 22 and a handle 24. The light emitting body 22 is formed in a spherical shape with a light-transmitting resin on the outside thereof, and has a light emitting element such as a light emitting diode or a light bulb inside. When the inner light emitting element emits light, the entire outer sphere glows. Operation buttons 30, 32, 34, 36, 38 are provided on the upper surface of the handle 24, and operation buttons 40 are provided on the lower surface. The user operates the operation buttons 30, 32, 34, 36, and 38 with the thumb and the operation button 40 with the index finger while holding the end of the handle 24 by hand. The operation buttons 30, 32, 34, 36, and 38 are configured to be pressed, and the user operates them by pressing them. The operation button 40 may be capable of inputting an analog amount.

The user plays a game while looking at the game screen displayed on the display device 12. Since the image pickup device 14 needs to image the light emitting body 22 during the execution of the game application, it is preferable that the image pickup device 14 is arranged so that the image pickup range faces the same direction as the display device 12. Since a user generally plays a game in front of the display device 12, the image pickup device 14 is arranged so that the direction of its optical axis coincides with the front direction of the display device 12. Specifically, it is preferable that the image pickup device 14 is arranged in the vicinity of the display device 12 so that the position where the display screen of the display device 12 can be visually recognized by the user is included in the image pickup range. As a result, the image pickup device 14 can image the input device 20.

FIG. 5 shows the internal configuration of the input device 20. The input device 20 includes a wireless communication module 48, a processing unit 50, a light emitting unit 62, and operation buttons 30, 32, 34, 36, 38, 40. The wireless communication module 48 has a function of transmitting and receiving data to and from the wireless communication module of the game device 10. The processing unit 50 executes the desired processing in the input device 20.

The processing unit 50 includes a main control unit 52, an input reception unit 54, a 3-axis acceleration sensor 56, a 3-axis gyro sensor 58, and a light emission control unit 60. The main control unit 52 sends and receives necessary data to and from the wireless communication module 48.

The input receiving unit 54 receives the input information from the operation buttons 30, 32, 34, 36, 38, and 40 and sends it to the main control unit 52. The 3-axis acceleration sensor 56 detects the acceleration component in the 3-axis direction of XYZ. The 3-axis gyro sensor 58 detects the angular velocity in the XZ plane, the ZY plane, and the YX plane. Here, the width direction of the input device 20 is set as the X-axis, the height direction is set as the Y-axis, and the longitudinal direction is set as the Z-axis. It is preferable that the 3-axis acceleration sensor 56 and the 3-axis gyro sensor 58 are arranged in the handle 24 of the input device 20 and are arranged in the vicinity of the center in the handle 24. The wireless communication module 48 transmits the detected value information by the 3-axis acceleration sensor 56 and the detected value information by the 3-axis gyro sensor 58 to the wireless communication module of the game device 10 at a predetermined cycle together with the input information from the operation buttons. .. This transmission cycle is set to, for example, 11.25 ms.

The light emitting control unit 60 controls the light emission of the light emitting unit 62. The light emitting unit 62 has a red LED 64a, a green LED 64b, and a blue LED 64c, and can emit light of a plurality of colors. The light emission control unit 60 adjusts the light emission of the red LED 64a, the green LED 64b, and the blue LED 64c to cause the light emitting unit 62 to emit light in a desired color.

When the wireless communication module 48 receives the light emission instruction from the game device 10, it supplies the light emission instruction to the main control unit 52, and the main control unit 52 supplies the light emission instruction to the light emission control unit 60. The light emission control unit 60 controls the light emission of the red LED 64a, the green LED 64b, and the blue LED 64c so that the light emitting unit 62 emits light in the color specified by the light emission instruction. For example, the light emission control unit 60 may control each LED by PWM (pulse width modulation) control.

FIG. 6 shows the configuration of the game device 10. The game device 10 includes a frame image acquisition unit 80, an image processing unit 82, a device information derivation unit 84, a wireless communication module 86, an input reception unit 88, an output unit 90, and an application processing unit 300. The processing function of the game device 10 in this embodiment is realized by a CPU, a memory, a program loaded in the memory, and the like, and here, a configuration realized by their cooperation is drawn. The program may be built in the game device 10 or may be supplied from the outside in a form stored in a recording medium. Therefore, it will be understood by those skilled in the art that these functional blocks can be realized in various ways by hardware only, software only, or a combination thereof. Due to the hardware configuration, the game device 10 may have a plurality of CPUs.

The wireless communication module 86 establishes wireless communication with the wireless communication module 48 of the input device 20. As a result, the input device 20 can transmit the state information of the operation buttons and the detection value information of the 3-axis acceleration sensor 56 and the 3-axis gyro sensor 58 to the game device 10 at a predetermined cycle.

The wireless communication module 86 receives the state information of the operation buttons and the sensor detection value information transmitted from the input device 20 and supplies the information to the input reception unit 88. The input receiving unit 88 separates the button state information and the sensor detection value information and hands them over to the application processing unit 300. The application processing unit 300 receives the button state information and the sensor detection value information as game operation instructions. The application processing unit 300 handles the sensor detection value information as the posture information of the input device 20.

The frame image acquisition unit 80 is configured as a USB interface, and acquires a frame image from the image pickup device 14 at a predetermined imaging speed (for example, 30 frames / second). The image processing unit 82 extracts the illuminant image from the frame image. The image processing unit 82 specifies the position and size of the illuminant image in the frame image. By lighting the light emitter 22 of the input device 20 in a color that is unlikely to be used in the user environment, for example, the image processing unit 82 can extract the light emitter image from the frame image with high accuracy. The image processing unit 82 may binarize the frame image data using a predetermined threshold value to generate a binarized image. By this binarization process, the pixel value of the pixel having the brightness greater than the predetermined threshold value is encoded to "1", and the pixel value of the pixel having the brightness equal to or less than the predetermined threshold value is encoded to "0". NS. By lighting the illuminant 22 with a brightness exceeding the predetermined threshold value, the image processing unit 82 can specify the position and size of the illuminant image from the binarized image. For example, the image processing unit 82 specifies the coordinates of the center of gravity of the illuminant image in the frame image and the radius of the illuminant image.

The device information derivation unit 84 derives the position information of the input device 20 and the head-mounted display 100 as seen from the image pickup device 14 from the position and size of the illuminant image specified by the image processing unit 82. The device information derivation unit 84 derives the position coordinates in the camera coordinates from the coordinates of the center of gravity of the illuminant image, and derives the distance information from the image pickup device 14 from the radius of the illuminant image. The position coordinates and the distance information constitute the position information of the input device 20 and the head-mounted display 100. The device information derivation unit 84 derives the position information of the input device 20 and the head-mounted display 100 for each frame image and hands it over to the application processing unit 300. The application processing unit 300 receives the position information of the input device 20 and the head-mounted display 100 as an operation instruction of the game.

The application processing unit 300 advances the game from the position information and the posture information of the input device 20 and the button state information, and generates an image signal indicating the processing result of the game application. The image signal is sent from the output unit 90 to the display device 12, and is output as a display image.

FIG. 7 is a functional configuration diagram of the game device 10. The application processing unit 300 of the game device 10 includes a control unit 310 and a data holding unit 360. The control unit 310 includes a game control unit 311, an instruction input acquisition unit 312, an HMD information acquisition unit 314, an input device information acquisition unit 315, a first image generation unit 316, and a second image generation unit 317.

The data holding unit 360 holds program data of the game executed by the game device 10, various data used by the game program, and the like.

The instruction input acquisition unit 312 acquires information regarding instruction input by the user received by the input device 20 or the head-mounted display 100 from the input device 20 or the head-mounted display 100.

The HMD information acquisition unit 314 acquires information regarding the posture of the head-mounted display from the head-mounted display 100. Further, the HMD information acquisition unit 314 acquires information regarding the position of the head-mounted display 100 from the device information derivation unit 84. This information is transmitted to the game control unit 311. Information regarding the posture of the head-mounted display 100 may be acquired by the device information derivation unit 84 analyzing the captured image of the head-mounted display 100.

The input device information acquisition unit 315 acquires information regarding the posture of the input device 20 from the input device 20. Further, the input device information acquisition unit 315 acquires information regarding the position of the input device 20 from the device information derivation unit 84. This information is transmitted to the game control unit 311. The information regarding the posture of the input device 20 may be acquired by the device information derivation unit 84 analyzing the captured image of the input device 20.

When the input device 20 is out of the image pickup range of the image pickup device 14 or is hidden by the user's body or obstacles and is not imaged by the image pickup device 14, the input device information acquisition unit 315 was acquired last time. The position of the input device 20 is calculated based on the position of the input device 20 and the information regarding the posture of the input device 20 acquired after that time. For example, even if the current position of the input device 20 is calculated by calculating the deviation from the position of the input device 20 acquired last time based on the translational acceleration data acquired from the acceleration sensor of the input device 20. good. While the input device 20 is not imaged by the image pickup device 14, the position of the input device 20 is sequentially calculated in the same manner. When the input device 20 is imaged again by the image pickup device 14, the position of the input device 20 sequentially calculated from the acceleration data may not indicate an accurate position due to the accumulation of drift errors. The position of the input device 20 newly calculated by 84 may be used as the current position of the input device 20. The same applies to the head-mounted display 100.

The game control unit 311 executes a game program, and advances the game based on the instruction input by the user acquired by the instruction input acquisition unit 312 and the information regarding the position or posture of the input device 20 or the head-mounted display 100. The game control unit 311 is based on an input by the direction key of the input device 20 or an analog stick, a change in the position of the input device 20 or the head-mounted display 100, or the like in a game field composed of a virtual three-dimensional space. , Change the position of the player's character that is the operation target.

The first image generation unit 316 generates an image to be displayed on the head-mounted display 100. The first image generation unit 316 sets the viewpoint position based on the position of the operation target controlled by the game control unit 311 and sets the line-of-sight direction based on the posture of the head mount display 100 to create a virtual three-dimensional space. Generate an image of the game field by rendering. The first image generation unit 316 associates the posture of the head-mounted display 100 with the line-of-sight direction in the game field at a predetermined timing, and thereafter changes the line-of-sight direction as the posture of the head-mounted display 100 changes. As a result, the user can look around the game field by actually moving his / her head, and can experience as if he / she actually exists in the game field. The first image generation unit 316 generates the first image by adding information about the game, an image to be displayed on the head-mounted display 100, and the like to the generated image of the game field. The first image generated by the first image generation unit 316 is transmitted to the head-mounted display 100 via the wireless communication module or the wired communication module.

The second image generation unit 317 generates an image to be displayed on the display device 12. When the same image as the image displayed on the head-mounted display 100 is displayed on the display device 12, the first image generated by the first image generation unit 316 is also transmitted to the display device 12. When displaying an image different from the image displayed on the head-mounted display 100 on the display device 12, for example, a user wearing the head-mounted display 100 and a user viewing the display device 12 execute a battle game. In such a case, the second image generation unit 317 generates an image of the game field by setting a viewpoint position and a line-of-sight direction different from those of the first image generation unit 316 and rendering a virtual three-dimensional space. The second image generation unit 317 generates a second image by adding information about the game, an image to be displayed on the display device 12, and the like to the generated image of the game field. The second image generated by the second image generation unit 317 is transmitted to the display device 12 via the wireless communication module or the wired communication module.

FIG. 8 shows an example of an image displayed on the head-mounted display. The game control unit 311 provides a function of changing the viewpoint position among a plurality of positions set in the game field. On the display screen shown in FIG. 8A, an image of the game field generated with one of the plurality of positions set in the game field as the viewpoint position is displayed. Markers 500 and 502 indicating positions set as viewpoint positions in the game field are further displayed on the display screen. When the user shakes his / her head up / down / left / right to change the posture of the head-mounted display 100, the first image generation unit 316 changes the line-of-sight direction according to the posture of the head-mounted display 100. If a camera for photographing the user's eyeball is provided inside the head-mounted display 100 and it is possible to detect the user's line-of-sight direction, the line-of-sight direction may be changed in consideration of the user's line-of-sight. .. The user's line of sight may be detected using any known line-of-sight tracking technique.

When the user turns his face or line of sight in the direction of the marker and the marker enters a predetermined range set near the center of the display screen, the game control unit 311 sets the game control unit 311 as shown in FIG. 8 (b). The first image generation unit 316 is made to change the display mode of the marker 500, and indicates that the position indicated by the marker 500 has been selected as a setting candidate for the viewpoint position. When the user instructs to change the viewpoint position by inputting a predetermined button or executing a predetermined gesture while the viewpoint position setting candidate is selected, the game control unit 311 selects the viewpoint position. The first image generation unit 316 is instructed to change the viewpoint position to the position indicated by the marker 500. As shown in FIG. 8C, the first image generation unit 316 generates and displays an image of the game field with the position of the marker 500 as the viewpoint position. On the display screen shown in FIG. 8 (c), a marker 504 indicating the position set as the viewpoint position on the display screen shown in FIG. 8 (a) is displayed.

FIG. 9 is a schematic diagram for explaining a method of setting the viewpoint position and the line-of-sight direction. In the present embodiment, the viewpoint position is set on a spherical surface centered near the center of the game field, and the default line-of-sight direction is set in the direction of viewing the first position near the center of the game field from the viewpoint position. As a result, it is possible to display an image overlooking the game field regardless of where the viewpoint position is set. When changing the viewpoint position, the first image generation unit 316 smoothly moves the viewpoint position along the spherical surface, and even while the viewpoint position is moving, the line-of-sight direction is in the direction of viewing the first position of the game field from the viewpoint position. To generate an image of the game field. As a result, an image that can overlook the game field can be displayed even while the viewpoint position is changed, so that the viewpoint position is moved to where even if the viewpoint position is moved significantly. Can be shown to the user in an easy-to-understand manner. The viewpoint position may be provided on a spherical surface or a rotating elliptical surface centered on an arbitrary point in the game field, or may be provided on an arbitrary curved surface other than those. Further, when the viewpoint position is changed, the viewpoint position may be continuously changed in a linear or curved shape from the viewpoint position before the change to the viewpoint position after the change. In the example shown in FIG. 8, since the lower hemisphere is underground, the viewpoint position can be set only on the upper hemisphere, but when outer space or the like is used as the game field, the lower hemisphere is used. The viewpoint position may be set on the surface as well.

FIG. 10 shows an example of an image displayed on the head-mounted display. As shown in FIG. 10A, when an image of the game field viewed from a certain viewpoint position is displayed, when the user moves the head forward to move the head-mounted display 100 forward, The game control unit 311 causes the first image generation unit 316 to move the viewpoint position to a second position near the center of the game field. The game control unit 311 may move the viewpoint position when the head-mounted display 100 is moved forward by a predetermined distance or more, or the viewpoint position when the moving speed of the head-mounted display 100 is equal to or more than a predetermined value. May be moved. As a result, as shown in FIG. 10B, the viewpoint position can be moved from the spectator seat to the vicinity of the center of the game field, so that a user who is watching a game such as soccer from the spectator's viewpoint is in the competition. It can provide an experience that makes you feel like you are in the field. Further, it is possible to provide an easy-to-understand viewpoint moving method using the head-mounted display 100.

FIG. 11 is a schematic diagram for explaining the content of another game provided by the game control unit. In the game shown in this figure, the user hides in a box 510 with a hole 512, emerges from the hole 512 while preventing being hit by a hammer 514, and reads the characters written on the plate 516. The game control unit 311 changes the viewpoint position based on the position of the head-mounted display 100. The game control unit 311 determines the hole 512 to be hit by the hammer 514 at a predetermined timing, and swings the hammer 514 down on the determined hole 512. If the hammer 514 is swung down into the hole 512 when the user's viewpoint position is above the hole 512, it is assumed that the user is hit by the hammer 514. When the user is hit with the hammer 514 more than a predetermined number of times, the game is over.

FIG. 12 shows an example of an image displayed on the head-mounted display. FIG. 12A shows a game screen when the user looks up from the hole in the middle. A hammer is about to be swung down into the hole in the middle. FIG. 12B shows a game screen when the user moves the head-mounted display 100 to the right and the viewpoint position is moved below the hole on the right side. The hammer is about to be swung down into the middle hole, so it won't be swung down into the right hole for a while. At this time, when the user moves the head-mounted display 100 upward and the viewpoint position is moved upward from the hole on the right side, it is written on the plate arranged on the outside of the box as shown in FIG. 12 (c). You can see the characters.

FIG. 13 is a schematic diagram for explaining a method of moving the viewpoint position in the game according to the embodiment. When the user plays a game while sitting on a chair or the like, the position of the waist is fixed, so the head is moved in an arc shape, but the range in which the user can move without hindrance when playing the game is at most 100. It is about ~ 120 °. Therefore, in order to effectively utilize the movable range of the head-mounted display 100, the game control unit 311 has a viewpoint position larger when the head-mounted display 100 is moved in the horizontal direction than when it is moved in the vertical direction. To move. Further, when the head-mounted display 100 is moved to the left or right, if the amount of movement corresponding to the width of the center hole is exceeded, the area between the center hole and the left and right holes is skipped, and the area under the left and right holes is skipped. Move the viewpoint position to. Specifically, when the viewpoint position is below the center hole, when the head-mounted display 100 is moved to the right and the head-mounted display 100 reaches the position 520, the viewpoint position is moved to the right end of the center hole. Jump from the position to the leftmost position of the hole on the right side. Also, when the viewpoint position is below the hole on the right side and the head-mounted display 100 is moved to the left, when the head-mounted display 100 reaches the position 522, the viewpoint position is moved from the position at the left end of the hole on the right side to the center. Move to the rightmost position of the hole. As a result, the viewpoint position is not moved to an area where there is no need to move the viewpoint position or is small in the game, and the viewpoint position can be moved only to a predetermined area where it is necessary or large to move the viewpoint position. , The viewpoint position can be moved by effectively utilizing the movable range of the head-mounted display 100. Further, since it is possible to provide a user interface capable of easily moving the viewpoint position by moving the head-mounted display 100 without using the input device 20 or the like, it is possible to improve the convenience of the user. .. Further, since the hysteresis is provided by differentiating the position 520 for jumping the viewpoint position when moving to the right and the position 522 for jumping the viewpoint position when moving to the left, the angle of the head-mounted display 100 is near the threshold value. It is possible to reduce the situation where the viewpoint position frequently jumps to the left or right when the angle corresponds to the position.

When trying to move the viewpoint position over the left and right holes, it is necessary to move the head-mounted display 100 upward with the head-mounted display 100 tilted left and right, but with the user tilting the body left and right. It is not easy to move the head straight up. Therefore, in the present embodiment, when the head-mounted display 100 is moved up and down in a state of being tilted to the left and right, the game control unit 311 sets the viewpoint position in the vertical direction even if the moving direction is tilted. Move it, not horizontally. The game control unit 311 may move the viewpoint position in the vertical direction by the amount of movement corresponding to the vertical component of the movement vector of the head-mounted display 100, and may ignore the horizontal component, or the head-mounted display 100 may have the head-mounted display 100. The viewpoint position may be moved in the vertical direction by a movement amount corresponding to the magnitude of the movement vector. In this way, when the viewpoint position is changed according to the movement of the head-mounted display 100, the movement vector of the head-mounted display 100 is converted into a vector in a predetermined direction, so that the movement direction of the viewpoint position is changed to a predetermined direction. By limiting it, it is possible to prevent the viewpoint position from moving in an unnecessary direction. Further, since it is possible to provide a user interface capable of moving the viewpoint position only in a necessary direction, it is possible to improve the convenience of the user.

Such a technique can be applied to, for example, a game in which a player's character hides in an obstacle such as a wall and avoids flying bullets.

The present invention has been described above based on examples. This embodiment is an example, and it is understood by those skilled in the art that various modifications can be made to the combination of each component and each processing process, and such modifications are also within the scope of the present invention.

In the above example, the image for binocular stereoscopic vision is displayed on the display device 190 of the head-mounted display 100, but in another example, the image for monocular stereoscopic vision may be displayed.

In the above example, the head-mounted display 100 is used in the game system, but the technique described in the embodiment can also be used when displaying contents other than the game.

10 game device, 20 input device, 100 head-mounted display, 190 display device, 311 game control unit, 312 instruction input acquisition unit, 314 HMD information acquisition unit, 315 input device information acquisition unit, 316 first image generation unit, 317th 2 Image generator.

Claims (7)

It is equipped with a display control unit that sets the viewpoint position and line-of-sight direction, generates an image of the virtual space, and displays it on the head-mounted display.
The display control unit can change the viewpoint position to a position determined according to a user's operation from a plurality of positions set in the virtual space.
The display control unit is a display control device that displays an image based on the same virtual three-dimensional space on a display device other than the head-mounted display and the head-mounted display. The display control device according to claim 1, wherein the display control unit displays an image at the same viewpoint position on a display device other than the head-mounted display and the head-mounted display. The display control device according to claim 1, wherein the display control unit displays images at different viewpoint positions on a display device other than the head-mounted display and the head-mounted display. The display control device according to any one of claims 1 to 3, wherein the plurality of viewpoint positions are set discretely in the virtual space. The display control device according to any one of claims 1 to 4, wherein the plurality of viewpoint positions are statically set in the virtual space. The display control unit includes a step of setting the viewpoint position and the line-of-sight direction, generating an image of the virtual space, and displaying it on the head-mounted display.
The display control unit can change the viewpoint position to a position determined according to a user's operation from a plurality of positions set in the virtual space.
The display control unit is a display control method comprising displaying an image based on the same virtual three-dimensional space on a display device other than the head-mounted display and the head-mounted display. Computer,
It functions as a display control unit that sets the viewpoint position and line-of-sight direction, generates an image of the virtual space, and displays it on the head-mounted display.
The display control unit can change the viewpoint position to a position determined according to a user's operation from a plurality of positions set in the virtual space.
The display control unit is a computer-readable recording medium on which a display control program recording a display control program, which comprises displaying an image based on the same virtual three-dimensional space on a display device other than the head-mounted display and the head-mounted display.

Images