JP7064265B2 - Programs, information processing devices, and information processing methods for providing virtual experiences - Google Patents

Description

The present disclosure relates to programs, information processing devices, and information processing methods for providing virtual experiences.

In recent years, various devices have been developed that allow users to experience a virtual reality space (VR space, hereinafter also referred to as a virtual space). For example, a user can play a game in virtual space by wearing a head-mounted display and operating an avatar in virtual space. The position and movement of the user in the real space are tracked by the tracking sensor, and they are reflected in the avatar. Patent Document 1 discloses a technique that enables a user to experience a virtual space as a virtual user (avatar) of a different height.

Japanese Patent No. 3408263

For example, in a game in virtual space, the avatar's body or part of the body, or an object held by the avatar (eg, a melee assault weapon such as a sword) is another object in virtual space (eg, an enemy character or surroundings). Collision judgment as to whether or not it has come into contact with an obstacle) is important. If this collision determination is not performed correctly due to the difference in body size among users, the user's sense of play for the game will be different. For example, a short-armed user's avatar has a shorter reach than a long-armed user's avatar, so even if the distance between the avatar and the enemy character is the same, the long-armed user's avatar will reach the enemy character. , It is possible that the avatar of a short-armed user will not reach the enemy character. The technique of Patent Document 1 merely makes the body sizes of virtual users (avatars) different, and does not consider collisions between objects.

The present disclosure has been made in view of the above points, and one of the purposes thereof is to provide a method for improving the user experience in the virtual space.

In order to solve the above-mentioned problems, one aspect of the present disclosure relates to a computer for providing a virtual experience to the user via an image display device associated with the user's head, the user's body. A step of specifying a geometric feature, a step of specifying a virtual space for providing the virtual experience, and a step of controlling the view from a virtual viewpoint in the virtual space according to the movement of the user's head. A step of moving the first object in the virtual space according to the movement of the user, and a first region determined according to the first object and the geometric feature based on the geometric feature. , And a step of adjusting at least one of the second regions set for the second object in the virtual space, a step of generating a view image representing the view from the virtual viewpoint, and the view image as the image. It is a program for executing the steps to be displayed on the display device.

Another aspect of the present disclosure is an information processing device for providing a virtual experience to the user via an image display device associated with the user's head, which is a processor and a memory for storing a program. When executed by the processor, the program identifies to the processor a step of identifying geometric features associated with the user's body and a virtual space for providing the virtual experience. A step of controlling the view from the virtual viewpoint in the virtual space according to the movement of the user's head, and a step of moving the first object in the virtual space according to the movement of the user. , At least one of a first region determined according to the first object and the geometric feature based on the geometric feature, and a second region set for the second object in the virtual space. Is an information processing device configured to execute a step of adjusting, a step of generating a view image representing the view from the virtual viewpoint, and a step of displaying the view image on the image display device. ..

Further, another aspect of the present disclosure is an information processing method for providing a virtual experience to the user via an image display device associated with the user's head, which is a geometry related to the user's body. A step of specifying a geometric feature, a step of specifying a virtual space for providing the virtual experience, and a step of controlling the view from a virtual viewpoint in the virtual space according to the movement of the user's head. A step of moving a first object in the virtual space according to the movement of the user, and a first region determined according to the first object and the geometric feature based on the geometric feature. And a step of adjusting at least one of the second regions set for the second object in the virtual space, a step of generating a view image representing the view from the virtual viewpoint, and displaying the view image as the image. It is an information processing method including a step to be displayed on the device.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a method for improving the user experience in a virtual space.

The configuration of the HMD system 100 is shown schematically. It is a block diagram which shows the example of the basic hardware composition of a computer by one Embodiment. It is a figure which conceptually represents the uvw field of view coordinate system set in the HMD by one Embodiment. It is a figure which conceptually represents one aspect which expresses a virtual space by one Embodiment. It is the figure which showed the head of the user who wears HMD110 by one Embodiment from the top. It is a figure which shows the yz cross section which looked at the visual recognition area from the x direction in a virtual space. It is a figure which shows the xz cross section which looked at the visual recognition area from the y direction in a virtual space. It is a figure which shows the schematic structure of the controller by one Embodiment. It is a block diagram which shows the function of the computer for realizing the display processing of the virtual space in the HMD system by one Embodiment. It is a flow diagram of a general process for displaying an image of a virtual space in which a user is immersive on a display unit. It is a flowchart of the method 1100 by one Embodiment of this disclosure. It is a figure which schematically explains one aspect example of the game assumed in one Embodiment of this disclosure. It is a flowchart of an exemplary method which shows the specific procedure for carrying out a step 1104. It is a figure which shows the 1st region and the 2nd region in embodiment of the method 1100. It is a figure which shows one aspect example of how the 1st region in an embodiment of a method 1100 is expanded. It is a flowchart of the method 1150 by another embodiment of this disclosure. It is a figure which shows the 1st region and the 2nd region in embodiment of the method 1150. It is a figure which shows one aspect example of how the 1st region in an embodiment of a method 1150 is reduced.

[Explanation of Embodiments of the present disclosure]
First, the contents of the embodiments of the present disclosure will be listed and described. One embodiment of the present disclosure comprises the following configurations.

(Item 1) A step of identifying a geometric feature related to the user's body on a computer for providing a virtual experience to the user via an image display device associated with the user's head, and the virtual. A step of specifying a virtual space for providing an experience, a step of controlling the view from a virtual viewpoint in the virtual space according to the movement of the user's head, and the virtual according to the movement of the user. For the step of moving the first object in space, the first region determined according to the first object and the geometric feature based on the geometric feature, and the second object in the virtual space. To execute a step of adjusting at least one of the second regions set in the above, a step of generating a view image representing the view from the virtual viewpoint, and a step of displaying the view image on the image display device. Program.

(Item 2) The adjustment step includes the size or shape of the first region, the position of the second object in the virtual space, the position of the second region in the virtual space, and the second region. The program of item 1, comprising adjusting at least one of size or shape.

(Item 3) The adjustment step is when the degree of overlap between the first region and the second region when the first object and the second object are in a predetermined positional relationship does not fall within a predetermined range. The size or shape of the first region, the position of the second object in the virtual space, the position of the second region in the virtual space, and the position of the second region so that the degree of overlap is within the predetermined range. The program of item 2, comprising adjusting at least one of the sizes or shapes of the second region.

(Item 4) The geometric feature includes the length of a specific part of the user's body, and the moving step is said in the virtual space in response to the movement of at least a part of the specific part. The first object comprises moving the first object, the first object is an object corresponding to the at least a portion of the particular part, and the adjusting step is such that the length of the particular part is shorter than the reference length. In the case, the size of the first area is increased, the position of the second object is brought closer to the first object, the position of the second area is brought closer to the first object, and the size of the second area is increased. 2. The item 2 includes performing at least one of changing the shape of the first region or the second region so that the degree of overlap between the first region and the second region becomes large. Or the program described in 3.

(Item 5) The geometric feature includes the length of a specific part of the user's body, and the moving step is said in the virtual space in response to the movement of at least a part of the specific part. The first object comprises moving the first object, the first object is an object corresponding to the at least a portion of the particular part, and the adjusting step is such that the length of the particular part is longer than the reference length. In the case, the size of the first region is reduced, the position of the second object is moved away from the first object, the position of the second region is moved away from the first object, and the size of the second region is reduced. 2. The item 2 includes performing at least one of changing the shape of the first region or the second region so that the degree of overlap between the first region and the second region is reduced. The program according to any one of 4 to 4.

(Item 6) The first area includes a movable area of the first object according to the movement of the user and a collision area set for a third object arranged in contact with the first object. The program according to any one of items 1 to 5, which is determined accordingly.

(Item 7) The geometric feature includes the height of the user, and the moving step includes moving the first object in the virtual space in response to the movement of the user's head. The first object is either a virtual camera arranged corresponding to the virtual viewpoint or an object including at least an object corresponding to the head, and in the adjusting step, the height of the user is higher than the reference height. If it is also high, the size of the first region is reduced, the position of the second object is raised, the position of the second region is raised, the size of the second region is reduced, and the first The program according to item 2 or 3, comprising performing at least one of changing the shape of the first region or the second region so that the degree of overlap between the regions and the second region is reduced. ..

(Item 8) The geometric feature includes the height of the user, and the moving step includes moving the first object in the virtual space in response to the movement of the user's head. The first object is either a virtual camera arranged corresponding to the virtual viewpoint or an object including at least an object corresponding to the head, and in the adjusting step, the height of the user is higher than the reference height. If it is also low, the size of the first region is increased, the position of the second object is lowered, the position of the second region is lowered, the size of the second region is increased, and the first Item 2, 3, or 7, which comprises performing at least one of changing the shape of the first region or the second region so that the degree of overlap between the region and the second region becomes large. The program described in any one of the items.

(Item 9) The program according to any one of items 1 to 3, 7, or 8, wherein the first area is a collision area set for the first object.

(Item 10) The program according to any one of items 1 to 9, wherein the second area is a collision area set for the second object.

(Item 11) The program according to any one of items 1 to 10, wherein the second object is included in the field of view from the virtual viewpoint.

(Item 12) The first object is an avatar in the virtual space corresponding to the user, and any of items 1 to 11 including a step of adjusting the height of the avatar based on the height of the user. Or the program described in Section 1.

(Item 13) The steps for specifying the geometric feature include a step of tracking at least a part of the user's body and a step of determining the geometric feature of the user's body based on the result of the tracking. The program according to any one of items 1 to 12, wherein the program comprises.

(Item 14) An information processing device for providing a virtual experience to a user via an image display device associated with the user's head, comprising a processor and a memory for storing the program. Is executed by the processor to identify to the processor the geometric features associated with the user's body, the virtual space for providing the virtual experience, and the user's. The step of controlling the view from the virtual viewpoint in the virtual space according to the movement of the head, the step of moving the first object in the virtual space according to the movement of the user, and the geometric feature. Based on the step of adjusting at least one of the first region determined according to the first object and the geometric feature, and the second region set for the second object in the virtual space, and the above. An information processing device configured to execute a step of generating a view image representing a view from a virtual viewpoint and a step of displaying the view image on the image display device.

(Item 15) An information processing method for providing a virtual experience to a user via an image display device associated with the user's head, the step of identifying a geometric feature related to the user's body. A step of specifying a virtual space for providing the virtual experience, a step of controlling the view from a virtual viewpoint in the virtual space according to the movement of the user's head, and a step according to the movement of the user. The step of moving the first object in the virtual space, the first region determined according to the first object and the geometric feature based on the geometric feature, and the first in the virtual space. A step of adjusting at least one of the second regions set for the two objects, a step of generating a view image representing the view from the virtual viewpoint, a step of displaying the view image on the image display device, and a step of displaying the view image on the image display device. Information processing methods including.

[Details of Embodiments of the present disclosure]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

The configuration of the head-mounted device (HMD) system 100 will be described with reference to FIG. 1. FIG. 1 schematically shows the configuration of the HMD system 100. In one example, the HMD system 100 is provided as a home system or a business system. The HMD may be a so-called head-mounted display provided with a display unit, or may be a head-mounted device to which a terminal such as a smartphone having a display unit can be attached.

The HMD system 100 includes an HMD 110 (image display device), a tracking sensor 120, a controller 160, and a computer 200. The HMD 110 includes a display unit 112 and a gaze sensor 140. The controller 160 may include a motion sensor 130.

In one example, the computer 200 may be able to connect to a network 192 such as the Internet, or may be able to communicate with a computer such as a server 150 connected to the network 192. In another embodiment, the HMD 110 may include a sensor 114 instead of the tracking sensor 120.

The HMD 110 may be mounted on the head of the user 190 and provide the user with virtual space during operation. More specifically, the HMD 110 displays an image for the right eye and an image for the left eye on the display unit 112, respectively. When each eye of the user visually recognizes the respective image, the user can recognize the image as a three-dimensional image based on the parallax of both eyes.

The display unit 112 is realized as, for example, a non-transparent display device. In one example, the display unit 112 is arranged on the main body of the HMD 110 so as to be located in front of both eyes of the user. Therefore, the user can immerse himself in the virtual space by visually recognizing the three-dimensional image displayed on the display unit 112. In certain embodiments, the virtual space includes, for example, a background, user-operable objects, user-selectable menu images, and the like. In certain embodiments, the display unit 112 can be realized as a liquid crystal display unit or an organic EL (Electroluminescence) display unit included in an information display terminal such as a smartphone.

In one example, the display unit 112 may include a sub-display unit for displaying an image for the right eye and a sub-display unit for displaying an image for the left eye. In another aspect, the display unit 112 may be configured to display the image for the right eye and the image for the left eye as a unit. In this case, the display unit 112 includes a high-speed shutter. The high-speed shutter operates so that the image for the right eye and the image for the left eye can be alternately displayed so that the image is recognized by only one of the eyes.

In one example, the HMD 110 includes a plurality of light sources (not shown). Each light source is realized by, for example, an LED (Light Emitting Diode) that emits infrared rays. The tracking sensor 120 has a position tracking function for detecting the movement of the HMD 110. More specifically, the tracking sensor 120 may read a plurality of infrared rays emitted by the HMD 110 and detect the position and inclination of the HMD 110 in the real space.

In some embodiments, the tracking sensor 120 may be implemented by a camera. In this case, the tracking sensor 120 can detect the position and tilt of the HMD 110 by executing the image analysis process using the image information of the HMD 110 output from the camera. Further, the tracking sensor 120 may be configured to detect the position of a part of the user's body (for example, the head or the hand) by analyzing the image of the user captured by the camera.

In another embodiment, the HMD 110 may include a sensor 114 as a position detector instead of the tracking sensor 120. The HMD 110 can detect the position and tilt of the HMD 110 itself by using the sensor 114. For example, when the sensor 114 is an angular velocity sensor, a geomagnetic sensor, an acceleration sensor, a gyro sensor, or the like, the HMD 110 uses one of these sensors instead of the tracking sensor 120 to detect its position and tilt. obtain. As an example, when the sensor 114 is an angular velocity sensor, the angular velocity sensor detects the angular velocity around the three axes of the HMD 110 in real space over time. The HMD 110 calculates the temporal change of the angle around the three axes of the HMD 110 based on each angular velocity, and further calculates the inclination of the HMD 110 based on the temporal change of the angle. Further, the HMD 110 may be provided with a transmissive display device. In this case, the transmissive display device may be temporarily configured as a non-transparent display device by adjusting its transmittance. Further, the view image may include a configuration for presenting the real space as a part of the image constituting the virtual space. For example, an image taken by a camera mounted on the HMD 110 may be superimposed on a part of the field of view image and displayed, or by setting a high transmittance of a part of the transmissive display device, the field of view image may be displayed. The real space may be visible from a part.

The gaze sensor 140 detects the direction (line of sight) to which the line of sight of the right eye and the left eye of the user 190 is directed. Detection in that direction is achieved, for example, by a known eye tracking function. The gaze sensor 140 is realized by a sensor having the eye tracking function. In some embodiments, the gaze sensor 140 preferably includes a sensor for the right eye and a sensor for the left eye. The gaze sensor 140 may be, for example, a sensor that detects the angle of rotation of each eyeball by irradiating the right eye and the left eye of the user 190 with infrared light and receiving the reflected light from the cornea and the iris with respect to the irradiation light. .. The gaze sensor 140 can detect the line of sight of the user 190 based on each detected rotation angle.

The server 150 may send the program to the computer 200. In another embodiment, the server 150 may communicate with another computer 200 to provide virtual reality to the HMD used by other users. For example, in an amusement facility, when a plurality of users play a participatory game, each computer 200 communicates a signal based on the operation of each user with another computer 200, and the plurality of users are common in the same virtual space. Allows you to enjoy the game.

The controller 160 is connected to the computer 200 by wire or wirelessly. The controller 160 receives an instruction input from the user 190 to the computer 200. In some embodiments, the controller 160 is configured to be grippable by the user 190. In another embodiment, the controller 160 is configured to be wearable on a part of the body or clothing of the user 190. In another embodiment, the controller 160 may be configured to output at least one of vibration, sound, and light based on the signal transmitted from the computer 200. In another embodiment, the controller 160 receives from the user 190 an operation for controlling the position and movement of an object arranged in the virtual space.

In some embodiments, the motion sensor 130 is attached to the user's hand to detect the movement of the user's hand. For example, the motion sensor 130 detects the rotation speed, the number of rotations, and the like of the hand. The detected signal is sent to the computer 200. The motion sensor 130 is provided in, for example, a glove-shaped controller 160. In certain embodiments, for safety in real space, it is desirable that the controller 160 be attached to something that does not easily fly by being attached to the user 190's hand, such as a glove type. In another embodiment, a sensor not attached to the user 190 may detect the movement of the user 190's hand. Optical sensors may be used to detect the position, orientation, direction of movement, distance of movement, etc. of various parts of the body of the user 190. For example, the signal of the camera that captures the user 190 may be input to the computer 200 as a signal representing the operation of the user 190. As an example, the motion sensor 130 and the computer 200 are wirelessly connected to each other. In the case of wireless communication, the communication mode is not particularly limited, and for example, Bluetooth (registered trademark) or other known communication method is used.

The computer 200 according to the embodiment of the present disclosure will be described with reference to FIG. FIG. 2 is a block diagram showing an example of a basic hardware configuration of a computer 200 according to an embodiment of the present disclosure. The computer 200 includes a processor 202, a memory 204, a storage 206, an input / output interface 208, and a communication interface 210 as main components. Each component is connected to bus 212, respectively.

The processor 202 executes a series of instructions contained in the program stored in the memory 204 or the storage 206 based on the signal given to the computer 200 or when a predetermined condition is satisfied. In some embodiments, the processor 202 is realized as a device such as a CPU (Central Processing Unit), an MPU (Micro Processor Unit), or an FPGA (Field-Programmable Gate Array).

Memory 204 temporarily stores programs and data. The program is loaded from storage 206, for example. The data includes data input to the computer 200 and data generated by the processor 202. In some embodiments, the memory 204 is realized as a volatile memory such as a RAM (Random Access Memory).

Storage 206 permanently holds programs and data. The storage 206 is realized as a non-volatile storage device such as a ROM (Read-Only Memory), a hard disk device, or a flash memory, for example. The program stored in the storage 206 includes a program for providing a virtual space in the HMD system 100, a simulation program, a game program, a user authentication program, a program for realizing communication with another computer 200, and the like. The data stored in the storage 206 includes data, objects, and the like for defining the virtual space.

In another embodiment, the storage 206 may be realized as a removable storage device such as a memory card. In yet another embodiment, a configuration using programs and data stored in an external storage device may be used instead of the storage 206 built into the computer 200. With such a configuration, it becomes possible to collectively update programs and data in a situation where a plurality of HMD systems 100 are used, for example, in an amusement facility.

In certain embodiments, the input / output interface 208 communicates signals with the HMD 110, the tracking sensor 120, and the motion sensor 130. In some embodiments, the input / output interface 208 is implemented using terminals such as USB (Universal Serial Bus, USB), DVI (Digital Visual Interface), HDMI® (High-Definition Multimedia Interface), and the like. The input / output interface 208 is not limited to the above.

In certain embodiments, the input / output interface 208 may further communicate with the controller 160. For example, the input / output interface 208 receives inputs of signals output from the controller 160 and the motion sensor 130. In another embodiment, the input / output interface 208 sends an instruction output from the processor 202 to the controller 160. The command instructs the controller 160 to vibrate, output voice, emit light, and the like. Upon receiving the command, the controller 160 executes vibration, voice output, light emission, and the like in response to the command.

The communication interface 210 is connected to the network 192 and communicates with another computer (for example, the server 150) connected to the network 192. In some embodiments, the communication interface 210 is realized as, for example, a wired communication interface such as LAN (Local Area Network), or a wireless communication interface such as WiFi (Wireless Reference), Bluetooth (registered trademark), NFC (Near Field Communication), or the like. Will be done. The communication interface 210 is not limited to the above.

In some embodiments, the processor 202 accesses the storage 206, loads one or more programs stored in the storage 206 into the memory 204, and executes a series of instructions contained in the program. The one or more programs may include an operating system of the computer 200, an application program for providing the virtual space, game software that can be executed in the virtual space, and the like. The processor 202 sends a signal for providing virtual space to the HMD 110 via the input / output interface 208. The HMD 110 displays an image on the display unit 112 based on the signal.

In the example shown in FIG. 2, the computer 200 is provided outside the HMD 110. However, in another embodiment, the computer 200 may be built into the HMD 110. As an example, a portable information communication terminal (for example, a smartphone) including a display unit 112 may function as a computer 200.

Further, the computer 200 may have a configuration commonly used for a plurality of HMD 110s. According to such a configuration, for example, the same virtual space can be provided to a plurality of users, so that each user can enjoy the same application as other users in the same virtual space.

In one embodiment, the HMD system 100 has a preset global coordinate system. The global coordinate system has three reference directions (axises) that are parallel to the vertical direction in the real space, the horizontal direction orthogonal to the vertical direction, and the front-back direction orthogonal to both the vertical direction and the horizontal direction. In this embodiment, the global coordinate system is one of the viewpoint coordinate systems. Therefore, the horizontal direction, the vertical direction (vertical direction), and the front-back direction in the global coordinate system are defined as the x-axis, the y-axis, and the z-axis, respectively. More specifically, in the global coordinate system, the x-axis is parallel to the horizontal direction of the real space. The y-axis is parallel to the vertical direction in real space. The z-axis is parallel to the front-back direction of the real space.

In some embodiments, the tracking sensor 120 includes an infrared sensor. When the infrared sensor detects infrared rays emitted from each light source of the HMD 110, the presence of the HMD 110 is detected. The tracking sensor 120 further detects the position and inclination of the HMD 110 in the real space according to the movement of the user 190 wearing the HMD 110 based on the value of each point (each coordinate value in the global coordinate system). More specifically, the tracking sensor 120 can detect a temporal change in the position and inclination of the HMD 110 by using each value detected over time. Further, as will be described later, the tracking sensor 120 may be configured to detect the position and tilt of the controller 160 in the real space by detecting the infrared rays emitted from the controller 160.

The global coordinate system is parallel to the coordinate system in real space. Therefore, each inclination of the HMD 110 detected by the tracking sensor 120 corresponds to each inclination of the HMD 110 around three axes in the global coordinate system. The tracking sensor 120 sets the uvw field coordinate system to the HMD 110 based on the tilt of the HMD 110 in the global coordinate system. The uvw field-of-view coordinate system set in the HMD 110 corresponds to the viewpoint coordinate system when the user 190 wearing the HMD 110 sees an object in the virtual space.

The uvw field coordinate system will be described with reference to FIG. FIG. 3 is a diagram conceptually representing the uvw field coordinate system set in the HMD 110 according to an embodiment. The tracking sensor 120 detects the position and tilt of the HMD 110 in the global coordinate system when the HMD 110 is activated. Processor 202 sets the uvw field coordinate system to HMD110 based on the detected values.

As shown in FIG. 3, the HMD 110 sets a three-dimensional uvw visual field coordinate system centered (origin) on the head of the user wearing the HMD 110. More specifically, the HMD 110 has horizontal, vertical, and anteroposterior directions (x-axis, y-axis, z-axis) that define the global coordinate system, and each has an inclination around each axis of the HMD 110 in the global coordinate system. The three directions newly obtained by tilting each around the axis are set as the pitch direction (u-axis), the yaw direction (v-axis), and the roll direction (w-axis) of the uvw field coordinate system in the HMD 110.

In some embodiments, when the user 190 wearing the HMD 110 is upright and viewing the front, the processor 202 sets the uvw field coordinate system parallel to the global coordinate system to the HMD 110. In this case, the horizontal direction (x-axis), the vertical direction (y-axis), and the anteroposterior direction (z-axis) in the global coordinate system are the pitch direction (u-axis) and the yaw direction (v-axis) of the uvw field coordinate system in the HMD 110. And the roll direction (w-axis).

After the uvw visual field coordinate system is set to the HMD 110, the tracking sensor 120 can detect the inclination (change amount of the inclination) of the HMD 110 in the set uvw visual field coordinate system based on the movement of the HMD 110. In this case, the tracking sensor 120 detects the pitch angle (θu), yaw angle (θv), and roll angle (θw) of the HMD 110 in the uvw visual field coordinate system as the inclination of the HMD 110, respectively. The pitch angle (θu) represents the tilt angle of the HMD 110 around the pitch direction in the uvw visual field coordinate system. The yaw angle (θv) represents the tilt angle of the HMD 110 around the yaw direction in the uvw visual field coordinate system. The roll angle (θw) represents the tilt angle of the HMD 110 around the roll direction in the uvw visual field coordinate system.

The tracking sensor 120 sets the uvw field coordinate system in the HMD 110 after the HMD 110 has moved, based on the detected tilt angle of the HMD 110, in the HMD 110. The relationship between the HMD 110 and the uvw field coordinate system of the HMD 110 is always constant regardless of the position and inclination of the HMD 110. When the position and inclination of the HMD 110 change, the position and inclination of the uvw visual field coordinate system of the HMD 110 in the global coordinate system changes in conjunction with the change of the position and inclination.

In some embodiments, the tracking sensor 120 is an HMD 110 based on the infrared light intensity acquired based on the output from the infrared sensor and the relative positional relationship between the points (eg, the distance between the points, etc.). The position in the real space may be specified as a relative position with respect to the tracking sensor 120. Further, the processor 202 may determine the origin of the uvw visual field coordinate system of the HMD 110 in the real space (global coordinate system) based on the specified relative position.

The virtual space will be further described with reference to FIG. FIG. 4 is a diagram conceptually representing an aspect of expressing a virtual space 400 according to an embodiment. The virtual space 400 has an all-sky spherical structure that covers the entire center 406 in the 360-degree direction. In FIG. 4, the celestial sphere in the upper half of the virtual space 400 is illustrated so as not to complicate the explanation. Each mesh is defined in the virtual space 400. The position of each mesh is predetermined as a coordinate value in the XYZ coordinate system defined in the virtual space 400. The computer 200 associates each partial image constituting the contents (still image, moving image, etc.) expandable in the virtual space 400 with each corresponding mesh in the virtual space 400, and creates a virtual space image that can be visually recognized by the user. The virtual space 400 to be expanded is provided to the user.

In some embodiments, the virtual space 400 defines an xyz coordinate system with the center 406 as the origin. The xyz coordinate system is, for example, parallel to the global coordinate system. Since the xyz coordinate system is a kind of viewpoint coordinate system, the horizontal direction, the vertical direction (vertical direction), and the front-back direction in the xyz coordinate system are defined as the x-axis, the y-axis, and the z-axis, respectively. Therefore, the x-axis (horizontal direction) of the xyz coordinate system is parallel to the x-axis of the global coordinate system, and the y-axis (vertical direction) of the xyz coordinate system is parallel to the y-axis of the global coordinate system. The z-axis (front-back direction) is parallel to the z-axis of the global coordinate system.

At the time of starting the HMD 110, that is, in the initial state of the HMD 110, the virtual camera 404 is arranged at the center 406 of the virtual space 400. In some embodiments, the processor 202 displays an image captured by the virtual camera 404 on the display unit 112 of the HMD 110. The virtual camera 404 moves in the virtual space 400 in the same manner as the movement of the HMD 110 in the real space. As a result, changes in the position and orientation of the HMD 110 in the real space can be similarly reproduced in the virtual space 400.

As in the case of the HMD 110, the virtual camera 404 is defined by the uvw field coordinate system. The uvw field-of-view coordinate system of the virtual camera 404 in the virtual space 400 is defined to be linked to the uvw field-of-view coordinate system of the HMD 110 in the real space (global coordinate system). Therefore, when the tilt of the HMD 110 changes, the tilt of the virtual camera 404 also changes accordingly. Further, the virtual camera 404 can also move in the virtual space 400 in conjunction with the movement of the user wearing the HMD 110 in the real space.

The processor 202 of the computer 200 defines a viewing area 410 in the virtual space 400 based on the placement position of the virtual camera 404 and the reference line of sight 408. The viewing area 410 corresponds to the area of the virtual space 400 that is visually recognized by the user wearing the HMD 110.

The line of sight of the user 190 detected by the gaze sensor 140 is a direction in the viewpoint coordinate system when the user 190 visually recognizes an object. The uvw field-of-view coordinate system of the HMD 110 is equal to the viewpoint coordinate system when the user 190 visually recognizes the display unit 112. Further, the uvw field-of-view coordinate system of the virtual camera 404 is linked to the uvw field-of-view coordinate system of the HMD 110. Therefore, the HMD system 100 according to a certain aspect can consider the line of sight of the user 190 detected by the gaze sensor 140 as the line of sight of the user in the uvw field-of-view coordinate system of the virtual camera 404.

The determination of the line of sight of the user will be described with reference to FIG. FIG. 5 is a top view of the head of a user 190 wearing an HMD 110 according to an embodiment.

In some embodiments, the gaze sensor 140 detects each line of sight of the user 190's right and left eyes. In some embodiments, when the user 190 is looking near, the gaze sensor 140 detects the lines of sight R1 and L1. In another embodiment, when the user 190 is looking far away, the gaze sensor 140 detects the lines of sight R2 and L2. In this case, the angle formed by the lines of sight R2 and L2 with respect to the roll direction w is smaller than the angle formed by the lines of sight R1 and L1 with respect to the roll direction w. The gaze sensor 140 transmits the detection result to the computer 200.

When the computer 200 receives the detection values of the lines of sight R1 and L1 from the gaze sensor 140 as the detection result of the line of sight, the computer 200 identifies the gaze point N1 which is the intersection of the lines of sight R1 and L1 based on the detected values. On the other hand, when the computer 200 receives the detected values of the lines of sight R2 and L2 from the gaze sensor 140, the computer 200 identifies the intersection of the lines of sight R2 and L2 as the gaze point. The computer 200 identifies the line of sight N0 of the user 190 based on the position of the identified gazing point N1. The computer 200 detects, for example, the extending direction of the straight line passing through the midpoint of the straight line connecting the right eye R and the left eye L of the user 190 and the gazing point N1 as the line of sight N0. The line of sight N0 is the direction in which the user 190 actually directs the line of sight with both eyes. Further, the line of sight N0 corresponds to the direction in which the user 190 actually directs the line of sight with respect to the visual recognition area 410.

In another aspect, the HMD system 100 may include a microphone and a speaker in any part constituting the HMD system 100. The user can give a voice instruction to the virtual space 400 by speaking to the microphone.

In another aspect, the HMD system 100 may include a television broadcast reception tuner. According to such a configuration, the HMD system 100 can display a television program in the virtual space 400.

In still another aspect, the HMD system 100 may be provided with a communication circuit for connecting to the Internet or a telephone function for connecting to a telephone line.

The visual recognition area 410 will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram showing a yz cross section of the visual recognition area 410 viewed from the x direction in the virtual space 400. FIG. 7 is a diagram showing an xz cross section of the visual recognition area 410 viewed from the y direction in the virtual space 400.

As shown in FIG. 6, the visible region 410 in the yz cross section includes the region 602. The area 602 is defined by the arrangement position of the virtual camera 404, the reference line of sight 408, and the yz cross section of the virtual space 400. The processor 202 defines a range including the polar angle α around the reference line of sight 408 in the virtual space as a region 602.

As shown in FIG. 7, the visible region 410 in the xz cross section includes the region 702. The area 702 is defined by the arrangement position of the virtual camera 404, the reference line of sight 408, and the xz cross section of the virtual space 400. The processor 202 defines a range including the azimuth angle β centered on the reference line of sight 408 in the virtual space 400 as a region 702. The polar angles α and β are determined according to the arrangement position of the virtual camera 404 and the orientation of the virtual camera 404.

In one embodiment, the HMD system 100 provides the user 190 with a field of view in virtual space by displaying a field of view image on the display unit 112 based on a signal from the computer 200. The view image corresponds to a portion of the virtual space image 402 that is superimposed on the view area 410. When the user 190 moves the HMD 110 attached to the head, the virtual camera 404 also moves in conjunction with the movement. As a result, the position of the visual recognition area 410 in the virtual space 400 changes. As a result, the view image displayed on the display unit 112 is updated to an image superimposed on the visual recognition area 410 in the direction facing the user in the virtual space 400 among the virtual space images 402. The user can visually recognize the desired direction in the virtual space 400.

As described above, the direction (tilt) of the virtual camera 404 corresponds to the user's line of sight (reference line of sight 408) in the virtual space 400, and the position where the virtual camera 404 is arranged corresponds to the user's viewpoint in the virtual space 400. Therefore, by moving the virtual camera 404 (including the operation of changing the arrangement position and the operation of changing the direction), the image displayed on the display unit 112 is updated, and the field of view (including the viewpoint and the line of sight) of the user 190 is moved. Will be done.

While wearing the HMD 110, the user 190 can visually recognize only the virtual space image 402 developed in the virtual space 400 without visually recognizing the real world. Therefore, the HMD system 100 can give the user a high sense of immersion in the virtual space 400.

In some embodiments, the processor 202 may move the virtual camera 404 in the virtual space 400 in conjunction with the movement of the user 190 wearing the HMD 110 in real space. In this case, the processor 202 identifies an image area (that is, a viewing area 410 in the virtual space 400) projected onto the display unit 112 of the HMD 110 based on the position and orientation of the virtual camera 404 in the virtual space 400.

According to certain embodiments, the virtual camera 404 may include two virtual cameras, a virtual camera for providing an image for the right eye and a virtual camera for providing an image for the left eye. Further, appropriate parallax may be set in the two virtual cameras so that the user 190 can recognize the three-dimensional virtual space 400.

An example of the controller 160 will be described with reference to FIG. FIG. 8 is a diagram showing a schematic configuration of a controller 160 according to an embodiment.

In some embodiments, the controller 160 may include a right controller and a left controller. For simplicity of explanation, only the right controller 800 is shown in FIG. The right controller 800 is operated by the right hand of the user 190. The left controller is operated by the left hand of the user 190. In some embodiments, the right controller 800 and the left controller are symmetrically configured as separate devices. Therefore, the user 190 can freely move the right hand holding the right controller 800 and the left hand holding the left controller. In another embodiment, the controller 160 may be an integrated controller that accepts the operation of both hands. Hereinafter, the right controller 800 will be described.

The right controller 800 includes a grip 802, a frame 804, and a top surface 806. The grip 802 is configured to be gripped by the right hand of the user 190. For example, the grip 802 may be held by the palm of the right hand of the user 190 and three fingers (middle finger, ring finger, little finger).

The grip 802 includes buttons 808 and 810 and a motion sensor 130. The button 808 is arranged on the side surface of the grip 802 and accepts an operation by the middle finger of the right hand. The button 810 is arranged on the front surface of the grip 802 and accepts an operation by the index finger of the right hand. In some embodiments, the buttons 808, 810 are configured as trigger-type buttons. The motion sensor 130 is built in the housing of the grip 802. If the operation of the user 190 can be detected from around the user 190 by a camera or other device, the grip 802 may not include the motion sensor 130.

The frame 804 includes a plurality of infrared LEDs 812 arranged along its circumferential direction. The infrared LED 812 emits infrared rays as the program progresses while the program using the controller 160 is being executed. The infrared rays emitted from the infrared LED 812 can be used by the tracking sensor 120 to detect each position and orientation (tilt, orientation) of the right controller 800 and the left controller (not shown). In the example shown in FIG. 8, infrared LEDs 812 arranged in two rows are shown, but the number of arrays is not limited to that shown in FIG. An array with one column or three or more columns may be used.

The top surface 806 includes buttons 814 and 816 and an analog stick 818. Buttons 814 and 816 are configured as push buttons. Buttons 814 and 816 accept operations by the thumb of the user 190's right hand. In some embodiments, the analog stick 818 accepts an operation in any direction 360 degrees from the initial position (neutral position). The operation includes, for example, an operation for moving an object arranged in the virtual space 400.

In some embodiments, the right controller 800 and the left controller include a battery for driving a member such as an infrared LED 812. The battery may be either a primary battery or a secondary battery, and the shape thereof may be arbitrary such as a button type and a dry battery type. In another embodiment, the right controller 800 and the left controller may be connected to, for example, the USB interface of the computer 200. In this case, the right controller 800 and the left controller may be powered via the USB interface.

FIG. 9 is a block diagram showing a function of the computer 200 for realizing display processing of the virtual space 400 in the HMD system 100 according to the embodiment of the present disclosure. The computer 200 controls the image output to the display unit 112 mainly based on the inputs from the tracking sensor 120, the motion sensor 130, the gaze sensor 140, and the controller 160.

The computer 200 includes a processor 202, a memory 204, and a communication control unit 205. The processor 202 includes a virtual space identification unit 902, an HMD motion detection unit 903, a line-of-sight detection unit 904, a reference line-of-sight determination unit 906, a field-of-view area determination unit 908, a controller motion detection unit 910, and a field-of-view image generation unit 912. And the field of view image output unit 926 may be included. The memory 204 may be configured to store various information. In one example, memory 204 may include virtual space data 928, object data 930, application data 932, and other data 934. The memory 204 also includes various data necessary for calculation to provide output information corresponding to inputs from the tracking sensor 120, the motion sensor 130, the gaze sensor 140, the controller 160, etc. to the display unit 112 associated with the HMD 110. But it may be. The object data 930 may include data related to operation objects, virtual objects, etc. arranged in the virtual space. The display unit 112 may be built in the HMD 110, or may be a display of another device (for example, a smartphone) that can be attached to the HMD 110.

In FIG. 9, the component included in the processor 202 is only one example of expressing the function executed by the processor 202 as a concrete module. The functionality of multiple components may be realized by a single component. Processor 202 may be configured to perform the functions of all components.

FIG. 10 is a flow chart of a general process for displaying an image of a virtual space in which a user is immersed on the display unit 112.

With reference to FIGS. 9 and 10, a general process of the HMD system 100 for providing an image of a virtual space will be described. The virtual space 400 may be provided by the interaction of the tracking sensor 120, the gaze sensor 140, the computer 200, and the like.

The process starts in step 1002. As an example, the game application included in the application data may be executed by the computer 200. In step 1004, the processor 202 (virtual space specifying unit 902) generates a celestial spherical virtual space image 402 constituting the virtual space 400 in which the user is immersed by referring to the virtual space data 928 or the like. The position and tilt of the HMD 110 are detected by the tracking sensor 120. The information detected by the tracking sensor 120 is transmitted to the computer 200. In step 1006, the HMD motion detection unit 903 acquires the position information and the tilt information of the HMD 110. In step 1008, the viewing direction is determined based on the acquired position information and inclination information.

When the gaze sensor 140 detects the movement of the eyeballs of the user's left and right eyes, the information is transmitted to the computer 200. In step 1010, the line-of-sight detection unit 904 specifies the directions to which the lines of sight of the right eye and the left eye are directed, and determines the line-of-sight direction N0. In step 1012, the reference line-of-sight determination unit 906 determines the view direction or the user's line-of-sight direction N0 determined by the inclination of the HMD 110 as the reference line-of-sight 408. The reference line of sight 408 may also be determined based on the position and tilt of the virtual camera 404 that follows the position and tilt of the HMD 110.

In step 1014, the field of view area determination unit 908 determines the field of view area 410 of the virtual camera 404 in the virtual space 400. As shown in FIG. 4, the field of view area 410 is a part of the virtual space image 402 that constitutes the user's field of view. The field of view 410 is determined based on the reference line of sight 408. The yz cross-sectional view of the view area 410 seen from the x direction and the xz cross-sectional view of the view area 410 seen from the y direction are shown in FIGS. 6 and 7, respectively, which have already been described.

In step 1016, the field of view image generation unit 912 generates a field of view image based on the field of view region 410. The visibility image includes two two-dimensional images, one for the right eye and one for the left eye. These two-dimensional images are superimposed on the display unit 112 (more specifically, the image for the right eye is output to the display unit for the right eye, and the image for the left eye is output to the display unit for the left eye), so that the three-dimensional image is three-dimensional. The virtual space 400 as an image is provided to the user. In step 1018, the field of view image output unit 926 outputs information about the field of view image to the display unit 112. The display unit 112 displays the view image based on the information of the received view image. The process ends in step 1020.

FIG. 11 is a flowchart of Method 1100 according to an embodiment of the present disclosure. In one embodiment of the present disclosure, a computer program may cause the processor 202 (or computer 200) to perform each step shown in FIG. Further, another embodiment of the present disclosure can be implemented as a processor 202 (or computer 200) executing the method 1100.

Hereinafter, embodiments of the present disclosure will be specifically described. Here, as a specific example to which the embodiment of the present disclosure can be applied, it is assumed that a user can immerse himself / herself in a virtual space in which the user's avatar is arranged and enjoy the game. However, the embodiments of the present disclosure are not necessarily limited to such embodiments. It will be apparent to those skilled in the art that embodiments of the present disclosure may take various aspects within the scope of the claims.

FIG. 12 is a diagram schematically illustrating an example of one aspect of the game assumed in the present embodiment. In this example, user 1212 plays an action game in virtual space. It should be noted that the action games shown in FIG. 12 are merely exemplary for illustration of this embodiment, and any other type of game or non-game computer application may be applied to this embodiment. .. In the action game of FIG. 12, the user 1212 wears the HMD 110 on the head and further grips and operates the controller 160. In one example, the controller 160 has the configuration described above with respect to FIG.

In the virtual space 1200, an avatar 1214 operated by the user 1212, an enemy character 1215 operated by the computer 200, and a game field 1222 in which the avatar 1214 and the enemy character 1215 are battled are arranged. The avatar 1214 and the enemy character 1215 hold the melee weapons (for example, the sword) 1214B and 1215B in their hands 1214A and 1215A, respectively, and attack each other. The avatar 1214 and the enemy character 1215 may further hold a defensive equipment (eg, a shield) (not shown) in their hands 1214A, 1215A, respectively. The game field 1222 may be composed of various objects such as the ground, buildings, trees, and rocks. While playing the game, the user 1212 can enjoy the action game on the virtual space as the avatar 1214 in the virtual space 1200 by performing various actions in the real space.

As shown in FIG. 12, the virtual camera 1204 is arranged at the position of the avatar 1214. The virtual camera 1204 captures the virtual space 1200 from the viewpoint of the avatar 1214. For example, the view image from the viewpoint of the avatar 1214 captured by the virtual camera 1204 includes the game field 1222 and the enemy character 1215 which is an opponent on the game field 1222. Further, the field of view image captured by the virtual camera 1204 may include the hand 1214A of the avatar 1214 itself and the sword 1214B held by the hand 1214A. The image of the virtual space 1200 obtained by the virtual camera 1204 is displayed on the HMD 110. The user 1212 can visually recognize the virtual space 1200 from the viewpoint of the avatar 1214 by seeing the image displayed on the HMD 110.

It should be noted that the avatar 1214 of the user 1212 does not play against the enemy character 1215 operated by the computer 200, but plays against the second avatar operated by the second user, or by a plurality of other users. The action game may be configured to play against a plurality of avatars operated by each. Further, the avatar 1214 of the user 1212 is an enemy character operated by the computer 200 in cooperation with a second avatar operated by the second user or a plurality of avatars operated by each of the other plurality of users. An action game may be configured to play against 1215.

Returning to FIG. 11, the process starts in step 1102. The processor 202 reads and executes the game program included in the application data 932 stored in the memory 204.

Processing proceeds to step 1104, where processor 202 identifies geometric features associated with the body of user 1212 in preparation for the start of the game. The geometric feature of the body is an index showing the size or shape of the body or a part of the body. As an example, the geometric feature of the body may be either the arm length or the height of the user 1212. However, this should not be understood to be limited. In addition to the length and height of the arm, for example, the length of the user 1212 with both hands spread out, the size of the circle drawn by the user 1212 making one round of the extended hand, when the user 1212 sits on a chair. Anything can be used as a geometric feature of the body, such as the height of the head position, the difference in the height of the head position when the user 1212 is standing and crouching. Geometric features of the body may be specified as specific numerical values (eg, arm length 70 cm, height 170 cm, etc.) or may be classified into a specific numerical range (eg,). Arm length is "long", "medium", "short", height is "high", "medium", "low", etc.).

FIG. 13 is a flowchart of the exemplary method 1300 showing a specific procedure for carrying out the above step 1104. In step 1302, processor 202 tracks the body or body portion of user 1212. Tracking of the user 1212 can be performed using, for example, the controller 160. First, the user 1212 holds the hand holding the controller 160 in the first posture and presses a predetermined button of the controller 160. The first posture may be, for example, a posture in which the hand is contracted and positioned near the chest, or a “careful” posture in which the hand is hung down. The controller 160 sends a tracking signal upon pressing a button by the user 1212, and the tracking sensor 120 receives the tracking signal from the controller 160. Based on the tracking signal received by the tracking sensor 120, the processor 202 identifies the position coordinates of the controller 160 at the time when the user 1212 presses the button of the controller 160, that is, the position coordinates of the user's hand in the first posture. do. Next, the user 1212 holds the hand holding the controller 160 in the second posture and similarly presses a predetermined button of the controller 160. The second posture may be, for example, a posture in which the hand is straight ahead, sideways, or extended over the head. In response to the user pressing a button, the processor 202 identifies the position coordinates of the user 1212's hand in the second posture, as in the case of the first posture described above. In this way, the user 1212's hand is tracked in the first and second postures.

Tracking of the user 1212 can also be done by other methods. For example, the tracking sensor 120 may receive a tracking signal emitted from the HMD 110, in which case the processor 202 identifies the position coordinates of the HMD 110 based on the tracking signal from the HMD 110, thereby the user 1212. You can track your head. Further, as described above, the tracking sensor 120 may be realized as a camera. In this case, the processor 202 performs an image analysis process on the image of the user 1212 captured by the camera, so that the body of the user 1212 or the body of the user 1212 or A part of it (eg hand or head) can be tracked. Also, instead of tracking the user 1212 in the first and second (ie, two) postures as described above, it is only necessary to locate the body or part of the user 1212 in one particular posture. It may be present, or the change in the position of the hand or the head accompanying the movement of the body of the user 1212 may be continuously tracked by repeatedly detecting the position coordinates of the controller 160 or the HMD 110 at predetermined short time intervals. ..

Processing proceeds to step 1304, where the processor 202 determines the geometric features of the user 1212's body based on the tracking results in step 1302 above. For example, the processor 202 can determine the arm length of the user 1212 based on the difference in the position coordinates of the user's hand in the first and second postures as described above. As another example, the processor 202 can determine the height of the user 1212 based on the position coordinates of the HMD 110 mounted on the user 1212, that is, the position coordinates of the head of the user 1212. As yet another example, the processor 202 uses the tracking results of the user 1212's body or a portion thereof performed in an appropriate manner, and the length of the user 1212 with both hands extended, as illustrated above, the user 1212. The size of the circle drawn by turning the extended hand, the height of the head position when the user 1212 sits on the chair, the height of the head position when the user 1212 is standing and crouching. The difference between the heights and the like can also be determined as a geometrical feature of the body of the user 1212.

With reference to FIG. 11 again, the process proceeds to step 1106. In step 1106, the processor 202 identifies a virtual space 1200 for an action game as shown in FIG. 12, based on virtual space data 928, object data 930, and the like. As mentioned above, the virtual space 1200 includes the user 1212's avatar 1214, the enemy character 1215, the game field 1222, and the virtual camera 1204. The virtual space data 928 is the initial placement of the avatar 1214, the enemy character 1215, the virtual camera 1204, and various other objects (eg, buildings, trees, rocks, etc. that may be on the game field 1222) in the virtual space 1200. Specify the position. The object data 930 contains various properties related to each of these various objects (for example, the appearance of the avatar 1214 and the enemy character 1215, various ability values in the game, and the like, the shape, size, and color of each object on the game field 1222. , And patterns, etc.). The processor 202 reads the virtual space data 928 and the object data 930 from the memory 204, and arranges each object according to the read data to specify the virtual space 1200.

The process proceeds to step 1108, and the processor 202 controls the field of view from the virtual viewpoint (position of the virtual camera 1204) in the virtual space 1200 according to the movement of the head of the user 1212. For example, the position and inclination of the HMD 110 worn by the user 1212 on the head are continuously detected by the tracking sensor 120 at predetermined time intervals. The processor 202 defines a position in the virtual space 1200 corresponding to the detected position of the HMD 110 as a virtual viewpoint, and arranges the virtual camera 1204 at the virtual viewpoint. Further, the processor 202 defines the direction in the virtual space 1200 corresponding to the inclination of the HMD 110 detected by the tracking sensor 120 as the reference line of sight (for example, the reference line of sight 408 shown in FIG. 4), and the virtual camera 1204 is in the direction of the reference line of sight. To orient. As described above with reference to FIG. 4, the visual field (for example, the visual field 410 as shown in FIG. 4) that can be visually recognized by the user 1212 in the virtual space 1200 by the position of the virtual camera 1204 and the reference line of sight (reference line of sight 408). ) Is determined. In this way, when the user 1212 moves the head, the field of view captured by the virtual camera 1204 changes in conjunction with the movement.

The process proceeds to step 1110, and the processor 202 moves the hand 1214A (first object) of the avatar 1214 in the virtual space 1200 in response to the movement of the hand of the user 1212. For example, the position and tilt of the controller 160 held by the user 1212 are continuously detected by the tracking sensor 120 at predetermined time intervals. The processor 202 controls the movement of the hand 1214A of the avatar 1214 in the virtual space 1200 so as to match the detected position and tilt of the controller 160. The hand 1214A of the avatar 1214 holds the sword 1214B (third object) for making a melee attack against the enemy character 1215 (second object). The user 1212 can operate the hand 1214A and the sword 1214B of the avatar 1214 and attack the enemy character 1215 with the sword 1214B by appropriately combining the movement of the hand and the input operation to the controller 160.

Further, in step 1110, the processor 202 moves the avatar 1214 (first object) in the virtual space 1200 according to the movement of the head of the user 1212. For example, similar to step 1108 described above, the position and tilt of the HMD 110 mounted on the user 1212 are continuously detected by the tracking sensor 120 at predetermined time intervals. The processor 202 determines the position and tilt of the head 1214C of the avatar 1214 in the virtual space 1200 so as to match the detected position and tilt of the HMD 110. Then, the processor 202 controls the portion of the avatar 1214 other than the head 1214C so that the posture of the whole body of the avatar 1214 becomes a natural posture in relation to the determined position and inclination of the head 1214C. For example, by moving the user 1212 back and forth and left and right, the avatar 1214 in the virtual space 1200 can be moved back and forth and left and right, and the relative position of the avatar 1214 with respect to the enemy character 1215 can be changed. Further, for example, when the user 1212 takes a crouched posture, the head 1214C of the avatar 1214 is arranged at a relatively low position reflecting the detection position of the HMD 110, and the position of the head 1214C of the avatar 1214 is relatively low. Each part of the body of the avatar 1214 is automatically controlled so that the avatar 1214 takes a crouching posture according to the low position. In this way, the user 1212 can also avoid the attack from the enemy character 1215 by squatting the avatar 1214.

In the example of the virtual space 1200 shown in FIG. 12, the avatar 1214 may be represented to have only the head 1214C without the torso and hands 1214A. In this case, the processor 202 controls only the position and tilt of the head 1214C (first object) of the avatar 1214 to match the position and tilt of the HMD 110 detected by the tracking sensor 120. Furthermore, in the example of the virtual space 1200 shown in FIG. 12, the virtual camera 1204 and the sword 1214B may be arranged without the appearance of the avatar 1214. In this case, the processor 202 controls the position and tilt of the virtual camera 1204 (first object) so as to match the position and tilt of the HMD 110 detected by the tracking sensor 120.

The process proceeds to step 1112, and the processor 202 determines whether the arm length of the user 1212 identified in step 1104 described above is longer or shorter than a predetermined reference length. The predetermined reference length may be, for example, a value (for example, 70 cm) arbitrarily set in advance as a standard arm length of the user assumed in the action game. If the arm length of the user 1212 is shorter than the predetermined reference length, the process proceeds to step 1114, and if it is longer than the predetermined reference length, the process proceeds to step 1116.

If the arm length of the user 1212 is shorter than the predetermined reference length, in step 1114, the processor 202 sets the first region in the virtual space 1200 associated with the hand 1214A (first object) of the avatar 1214. Adjust so that the size is large. In the embodiment of the method 1100, the first region is a range (movable region) in which the avatar 1214 can move the hand 1214A at an arbitrary point in the virtual space 1200, and the sword 1214B held by the avatar 1214 in the hand 1214A ( It is an area defined by the collision area set in the third object).

FIG. 14 shows a first region 1410 in an embodiment of method 1100. In FIG. 14, the avatar 1214 is located at a certain point P in the virtual space 1200. The avatar 1214 can move the hand 1214A only within the movable area 1420 at point P. The movable area 1420 of the hand 1214A corresponds to the range in which the user 1212 can move the hand holding the controller 160. That is, the curved surface drawn as the locus of the hand when the user 1212 extends the hand to the maximum and moves it in various directions defines the outer edge of the movable region 1420. On the other hand, the collision region 1430 is predetermined for the sword 1214B. The collision region 1430 is an region where it is determined that an object or a part of the object that has entered the collision region 1430 has come into contact with the sword 1214B. For example, when a part of the body of the enemy character 1215 enters the collision area 1430, it is determined that the enemy character 1215 has been attacked by the sword 1214B. As shown in FIG. 14, the collision region 1430 is set, for example, in a columnar shape that encloses the entire sword 1214B inside. When the hand 1214A holding the sword 1214B is moved variously in the movable area 1420 by the avatar 1214, the trajectory of the collision area 1430 attached to the sword 1214B is wider than the movable area 1420 by the amount corresponding to the collision area 1430. Draw. This wide area is the first area 1410. In this way, the first region 1410 defines the range within which the attack by the sword 1214B of the avatar 1214 can reach.

In another example, when the avatar 1214 moves the hand 1214A in various directions, the region drawn by the locus of the collision region set in the hand 1214A may be defined as the first region. The first area in this case represents the range within which the attack by the hand 1214A of the avatar 1214 can reach.

FIG. 14 shows, in addition to the first region 1410, a second region 1440 associated with the enemy character 1215 (second object). In the embodiment of the method 1100, the second region 1440 is a collision region preset for the enemy character 1215. When an opponent's weapon (for example, the sword 1214B of the avatar 1214) or a part thereof enters the collision area 1440 of the enemy character 1215, it is determined that the enemy character 1215 has been attacked by the weapon. In this way, the second area 1440 defines the range in which the attack on the enemy character 1215 is determined to be effective.

As can be seen from the above description, the size of the first region 1410 depends on the arm length of the user 1212. Therefore, depending on the physique of the user 1212, even if the user 1212 reaches out to the maximum, the attack by the sword 1214B or the hand 1214A from the avatar 1214 will never hit the enemy character 1215, or vice versa. It is possible that an attack from the avatar 1214 with the sword 1214B or the hand 1214A can easily hit the enemy character 1215 with just a little reach. Referring to FIG. 14, if the first region 1410 of the avatar 1214 and the second region 1440 of the enemy character 1215 overlap, the avatar 1214 attacks the enemy character 1215 with the sword 1214B or the hand 1214A by launching an attack in an appropriate direction. Can be hit by. However, if the first area 1410 of the avatar 1214 and the second area 1440 of the enemy character 1215 do not overlap and are separated from each other, the avatar 1214 never hits the enemy character 1215 with an attack by the sword 1214B or the hand 1214A. Can't.

By performing step 1114, the first region 1410 is adjusted so that the size of the first region 1410 becomes larger when the arm length of the user 1212 is shorter than a predetermined value. For example, the processor 202 expands the first region 1410 by enlarging the collision region 1430 set on the sword 1214B of the avatar 1214. As an example, the processor 202 may increase only the collision region 1430 around the sword 1214B while keeping the size of the sword 1214B itself unchanged. In this case, the appearance of the sword 1214B does not change, but only the effective range 1430 of the attack of the sword 1214B is increased. As another example, the processor 202 may increase the sword 1214B as the collision region 1430 increases. In this case, both the appearance of the sword 1214B and the effective range of the attack 1430 are increased. By achieving the expansion of the first region 1410 in this way, the first region 1410 of the avatar 1214 and the second region 1440 of the enemy character 1215 can be overlapped, whereby the short-armed user 1212 can be generated. It is possible to avoid the occurrence of an irrational event that the attack by the sword 1214B from the operating avatar 1214 never hits the enemy character 1215.

In step 1114, the first region 1410 may be expanded so that the degree of overlap between the first region 1410 and the second region 1440 falls within a predetermined range. FIG. 15 shows an example of how the first region 1410 is expanded. In FIG. 15, the avatar 1214 and the enemy character 1215 are located at points P and Q in the virtual space 1200, respectively. At point P and point Q, when a user with a standard physique assumed in the action game operates the avatar 1214, the attack by the sword 1214B from the avatar 1214 at point P reaches the enemy character 1215 at point Q. There are two points in a close relationship. That is, the first area (not shown) in the case of the user of the standard physique has an overlap with the second area 1440 of the enemy character 1215. However, for example, since the arm length of a specific user 1212 is shorter than the reference length, as shown in FIG. 15, the first region 1410 of the avatar 1214 operated by the user 1212 and the second region of the enemy character 1215 are operated. The 1440s have no overlap and are separated from each other. This first region 1410 is expanded into a larger first region 1415 so as to partially overlap the second region 1440 by performing step 1114.

The degree of overlap between the first region 1410 (or the enlarged first region 1415) and the second region 1440 can be defined by any method. For example, when the internal volume of the first region 1410 is V1, the internal volume of the second region 1440 is V2, and the volume of the portion where the first region 1410 and the second region 1440 overlap is V12, the degree of overlap D is , D = V12 / (V1 + V2) or D = V12 / V1. Further, for example, the center point of the first region 1410 is C1, the center point of the second region 1440 is C2, the point where the line segment connecting the points C1 and C2 intersects the first region 1410 is X1, and the points C1 and C2 are connected. When the point where the line segment intersects the second region 1440 is X2, the distance between the points C1 and C2 is d12, the distance between the points C1 and X1 is d1, and the distance between the points C2 and X2 is d2, they overlap. The degree D may be defined as D = (d1 + d2) / d12. The processor 202 expands the first region 1410 to the first region 1415 so that the overlap degree D defined by any of these methods is within a predetermined numerical range. The predetermined numerical range may be a numerical range (for example, a range of 5% to 15%) sandwiched between any two appropriate numerical values.

If it is determined in step 1112 that the arm length of the user 1212 is longer than the predetermined reference length, in step 1116, the processor 202 reduces the size of the first region 1410 of the avatar 1214. Adjust to be. For example, the processor 202 reduces the first region 1410 by reducing the collision region 1430 set on the sword 1214B of the avatar 1214. As in the case of step 1114 described above, the processor 202 may reduce only the collision region 1430, or may reduce both the collision region 1430 and the sword 1214B. The reduction of the first region 1410 is performed so that the degree of overlap between the first region 1410 and the second region 1440 is within a predetermined numerical range, as in the case of step 1114. By reducing the first area 1410, the overlap between the first area 1410 of the avatar 1214 and the second area 1440 of the enemy character 1215 can be reduced, whereby the long-armed user 1212 moves his hand a little. It is possible to avoid the unfair phenomenon that the attack by the sword 1214B from the avatar 1214 easily hits the enemy character 1215.

After steps 1114 and 1116, processing proceeds to step 1118. The processor 202 generates a field of view image in which the virtual space 1200 is captured by the virtual camera 1204. The field of view image represents the position of the virtual camera 1204, that is, the field of view from the virtual viewpoint. The view image can be generated according to the method described above as steps 1006 to 1016 of FIG.

The process proceeds to step 1120, and the processor 202 causes the display unit 112 of the HMD 110 to display the field of view image. As a result, the user 1212 can enjoy the experience of immersing himself in the virtual space 1200.

In the embodiment of the method 1100 described above, in step 1114 and step 1116, a method of enlarging or reducing the first region 1410 was adopted. However, other methods other than enlarging or reducing the first region 1410 may be adopted. Referring to FIG. 15, for example, when the arm length of the user 1212 is shorter than a predetermined reference length, the position of the enemy character 1215 is brought closer to the avatar 1214, so that even the user 1212 having a short arm length can have the avatar 1214. It is possible to hit the enemy character 1215 with an attack from the sword 1214B or the hand 1214A, and if the arm length of the user 1212 is longer than the predetermined reference length, the position of the enemy character 1215 should be moved away from the avatar 1214. Therefore, it is possible to prevent an attack by the sword 1214B or the hand 1214A from the avatar 1214 operated by the user 1212 having a long arm from easily hitting the enemy character 1215.

Further, even if the position of the second region 1440 set for the enemy character 1215 is moved closer to or away from the avatar 1214 as described above without changing the position of the enemy character 1215 itself. good. Further, the size of the second region 1440 may be adjusted. For example, when the arm length of the user 1212 is shorter than the predetermined reference length, by increasing the size of the second region 1440, even the user 1212 having a short arm length can use the sword 1214B or the hand from the avatar 1214. It is possible to hit the enemy character 1215 with an attack by 1214A, and when the arm length of the user 1212 is longer than the predetermined reference length, the arm length is reduced by reducing the size of the second region 1440. It is possible to prevent an attack by the sword 1214B or the hand 1214A from the avatar 1214 operated by the long user 1212 from easily hitting the enemy character 1215. Further, one or both of the shape of the first region 1410 and the shape of the second region 1440 are appropriately overlapped with each other so that the first region 1410 and the second region 1440 overlap each other (that is, the length of the arm of the user 1212 is a predetermined reference). If it is shorter than the length, the degree of overlap between the first region 1410 and the second region 1440 becomes larger, and if the arm length of the user 1212 is longer than the predetermined reference length, the first region 1410 And the second region 1440 (so that the degree of overlap is smaller)), it may be deformed.

FIG. 16 is a flowchart of Method 1150 according to another embodiment of the present disclosure. The method 1150 comprises step 1113 instead of step 1112 in method 1100 described above, step 1115 instead of step 1114 in method 1100, and step 1117 instead of step 1116 in method 1100. In the following, only step 1113, step 1115, and step 1117, which are different from the method 1100, will be described.

In step 1113, the processor 202 determines whether the height of the user 1212 identified in step 1104 described above is higher or lower than a predetermined reference length. The predetermined reference length may be, for example, a value (for example, 170 cm) arbitrarily set in advance as the standard height of the user assumed in the action game. If the height of the user 1212 is higher than the predetermined reference length, the process proceeds to step 1115, and if it is shorter than the predetermined reference length, the process proceeds to step 1117.

If the height of the user 1212 is higher than the predetermined reference length, in step 1115, the processor 202 reduces the size of the first region in the virtual space 1200 associated with the avatar 1214 (first object). Adjust to.

FIG. 17 shows a first region 1710 and a second region 1740 in an embodiment of method 1150. As shown in FIG. 17, an avatar 1214 and an enemy character 1215 (second object) exist in the virtual space 1200. The first area 1710 is associated with the avatar 1214, and the second area 1740 is associated with the enemy character 1215. In the above-described embodiment of the method 1100, a scene in which the avatar 1214 attacks the enemy character 1215 is assumed, but in the embodiment of the method 1150, a scene in which the avatar 1214 is attacked by the enemy character 1215 is assumed.

In an embodiment of method 1150, the first region 1710 is a collision region set for the avatar 1214. For example, the height direction of the first region 1710 is determined according to the height position coordinates of the HMD 110 worn by the user 1212. A weapon (eg, sword 1215B) possessed by the enemy character 1215 or a part thereof in the first region 1710, which is a collision area of the avatar 1214, or an ejector emitted from the enemy character 1215 (for example, a weapon for ranged attack such as a gun). When a bullet or laser beam, or a magic bullet released from the body of an enemy character 1215 (hereinafter collectively referred to as a weapon or the like) enters, it is determined that the avatar 1214 has been attacked by the weapon or the like. As described above, the first region 1710 defines the range in which the attack on the avatar 1214 is determined to be effective. On the other hand, the second region 1740 in the embodiment of the method 1150 is a region defined for the enemy character 1215 in the same manner as the first region 1410 in the embodiment of the method 1100. Therefore, the second area 1740 defines the range in which the attack of the enemy character 1215 can reach.

The height of the first region 1710 depends on the height of the user 1212. Therefore, depending on the physique of the user 1212, the avatar 1214 cannot avoid the attack from the enemy character 1215, or vice versa, even if the user 1212 takes a crouching posture to maximize the contraction. It is possible that the avatar 1214 can easily avoid an attack from the enemy character 1215 just by lowering the head position of the user 1212.

By performing step 1115, the first region 1710 is adjusted so that the size of the first region 1710 becomes smaller when the height of the user 1212 is higher than a predetermined value. For example, the processor 202 reduces the size of the first region 1710 in the height direction. FIG. 18 shows an example of how the first region 1710 is reduced. In FIG. 18, a portion 1742 of the second region 1740 of the enemy character 1215 projects toward the avatar 1214. The protruding portion 1742 represents, for example, a collision region associated with a sword 1215B (or a bullet fired from a gun, etc.) with an enemy character 1215 protruding in the direction of the avatar 1214. Further, in FIG. 18, the first region 1710 of the avatar 1214 represents the first region when the avatar 1214 operated by a specific user 1212 takes a crouching posture to avoid an attack from the enemy character 1215. There is. When the user 1212 squats down the avatar 1214, the first region 1710 of the avatar 1214 is the second region 1740 of the enemy character 1215 because the height of the user 1212 is higher than the reference length. It may overlap with our protruding part 1742. However, this first region 1710 is reduced to a smaller first region 1715 by performing step 1115 so that it does not overlap the protruding portion 1742 of the second region 1740. As a result, it is possible to prevent the event that the attack from the enemy character 1215 hits the avatar 1214 even though the tall user 1212 properly crouches.

If it is determined in step 1113 that the height of the user 1212 is lower than the predetermined reference length, in step 1117, the processor 202 increases the size of the first region 1710 of the avatar 1214. adjust. For example, the processor 202 increases the size of the first region 1710 in the height direction. This eliminates the unfairness that the short user 1212 can easily avoid the attack from the enemy character 1215 by just lowering his head (HMD110).

In the embodiment of the method 1150 described above, in step 1115 and step 1117, a method of reducing or expanding the first region 1710 was adopted. However, other methods other than reducing or enlarging the first region 1710 may be adopted. Referring to FIG. 18, for example, when the height of the user 1212 is higher than the predetermined reference length, the position of the enemy character 1215 is placed higher, and when the height of the user 1212 is lower than the predetermined reference length, the enemy character is placed. The position of 1215 may be placed low. Also, for example, instead of changing the height of the placement position of the enemy character 1215, when the height of the user 1212 is higher than a predetermined reference length, the position of the second region 1740 (for example, the protruding portion 1742) of the enemy character 1215. The position of the second region 1740 may be lowered when the height of the user 1212 is lower than the predetermined reference length. Further, when the height of the user 1212 is higher than the predetermined reference length, the size of the second region 1740 (for example, the protruding portion 1742) of the enemy character 1215 is reduced, and the height of the user 1212 is larger than the predetermined reference length. If it is low, the size of the second region 1740 may be increased. Further, one or both of the shape of the first region 1710 and the shape of the second region 1740 are appropriately overlapped with each other so that the first region 1710 and the second region 1740 overlap each other (that is, the height of the user 1212 is larger than the predetermined reference length). When it is high, the degree of overlap between the first region 1410 and the second region 1440 becomes smaller, and when the height of the user 1212 is shorter than the predetermined reference length, the first region 1410 and the second region 1440 are used. It may be deformed so that the degree of overlap is larger). By any of these methods, similarly to the above, it is possible to prevent the attack from the enemy character 1215 from hitting the avatar 1214 when the tall user 1212 properly squats down, and the short user. It is possible to prevent the attack from the enemy character 1215 from hitting the avatar 1214 by simply lowering the position of the head of the 1212.

Methods 1100 and 1150 may include additional steps in addition to each of the steps described above. For example, methods 1100 and 1150 may include adjusting the height of the avatar 1214 based on the height of the user 1212 identified in step 1104. Specifically, when the height of the user 1212 is high, the height of the avatar 1214 is also adjusted to be high, and when the height of the user 1212 is short, the height of the avatar 1214 is also adjusted to be low. As an example, a model of a plurality of avatars 1214 having different heights is prepared, and a model having a height corresponding to the height of the user 1212 is selected and used as a model representing the avatar 1214 from among the models of the plurality of avatars 1214. To. As a result, the avatar 1214 can be expressed in an appropriate appearance in the virtual space 1200.

The embodiments of the present disclosure have been described primarily as being carried out as processor 202 (or computer 200) or method 1100 or 1150. However, it will be apparent to those skilled in the art that embodiments of the present disclosure can be implemented as computer programs that cause the processor 202 to perform methods 1100 or 1150.

Although embodiments of the present disclosure have been described, it should be understood that these are examples only and do not limit the scope of the present disclosure. It should be understood that the embodiments can be changed, added, improved, etc. as appropriate without departing from the spirit and scope of the present disclosure. The scope of the present disclosure should not be limited by any of the embodiments described above, but should be defined only by the claims and their equivalents.

Further, in the various embodiments described above, an example of providing a virtual space in which a user is immersed by a non-transparent HMD device has been described, but a transmissive HMD device may be adopted as the HMD device. In such an embodiment, an image containing a virtual object is superimposed and displayed on a real space visually recognized by a user via a transmissive HMD device, thereby displaying an augmented reality (AR) space or mixed reality (MR). : Mixed Reality) May provide a user experience in space.

100 ... HMD system, 110 ... HMD, 112 ... Display, 114 ... Sensor, 120 ... Tracking sensor, 130 ... Motion sensor, 140 ... Gaze sensor, 150 ... Server, 160 ... Controller, 190 ... User, 192 ... Network, 200 ... Computer, 202 ... Processor, 204 ... Memory, 205 ... Communication control unit, 206 ... Storage, 208 ... Input / output interface, 210 ... Communication interface, 212 ... Bus, 400 ... Virtual space, 402 ... Virtual space image, 404 ... Virtual Camera, 406 ... Center, 408 ... Reference line of sight, 410 ... Visual area, 602, 702 ... Area, 800 ... Controller, 802 ... Grip, 804 ... Frame, 806 ... Top surface, 808, 810, 814, 816 ... Button, 818 ... Analog stick, 902 ... Virtual space identification unit, 903 ... HMD motion detection unit, 904 ... Line-of-sight detection unit, 906 ... Reference line-of-sight determination unit, 908 ... View area determination unit, 910 ... Controller motion detection unit, 912 ... View image generation Unit, 926 ... Visibility image output unit, 928 ... Virtual space data, 930 ... Object data, 923 ... Application data, 934 ... Other data, 1200 ... Virtual space, 1204 ... Virtual camera, 1212 ... User, 1214 ... Avatar, 1214A ... Avatar's hand, 1214B ... Sword, 1214C ... Avatar's head, 1215 ... Enemy character, 1215A ... Enemy character's hand, 1215B ... Sword, 1222 ... Game field, 1410 ... First area, 1415 ... Enlarged first Region, 1420 ... Movable region, 1430 ... Collision region, 1440 ... Second region, 1710 ... First region, 1715 ... Reduced first region, 1740 ... Second region

Claims (13)

To a computer for providing a virtual experience to the user via an image display device associated with the user's head.
The steps to identify the geometric features associated with the user's body,
The steps to identify the virtual space to provide the virtual experience,
A step of controlling the field of view from a virtual viewpoint in the virtual space according to the movement of the user's head,
A step of moving the first object in the virtual space according to the movement of the user,
Based on the geometric feature, at least one of the first region determined according to the first object and the geometric feature, and the second region set for the second object in the virtual space. In the step of adjusting, when the degree of overlap between the first region and the second region when the first object and the second object are in a predetermined positional relationship does not fall within the predetermined range, the overlap is performed. The size or shape of the first region, the position of the second object in the virtual space, the position of the second region in the virtual space, and the second region so that the degree is within the predetermined range. With steps, including adjusting at least one of the size or shape of the area .
The step of generating a field of view image representing the field of view from the virtual viewpoint, and
The step of displaying the view image on the image display device,
A program to execute. The geometric feature includes the length of a particular part of the user's body.
The moving step comprises moving the first object in the virtual space in response to the movement of at least a portion of the particular portion.
The first object is an object corresponding to at least a part of the specific part.
The adjusting step increases the size of the first region when the length of the specific portion is shorter than the reference length, brings the position of the second object closer to the first object, and the second region. The position of the first region or the second region is increased so that the position of the first object is brought closer to the first object, the size of the second region is increased, and the degree of overlap between the first region and the second region is increased. The program of claim 1 , comprising performing at least one of changing the shape. The geometric feature includes the length of a particular part of the user's body.
The moving step comprises moving the first object in the virtual space in response to the movement of at least a portion of the particular portion.
The first object is an object corresponding to at least a part of the specific part.
The adjusting step reduces the size of the first region when the length of the specific portion is longer than the reference length, moves the position of the second object away from the first object, and the second region. The position of the first region or the second region is reduced so that the position of the first object is kept away from the first object, the size of the second region is reduced, and the degree of overlap between the first region and the second region is reduced. The program of claim 1 or 2 , comprising performing at least one of changing the shape. The first area is determined according to the movable area of the first object according to the movement of the user and the collision area set for the third object arranged in contact with the first object. The program according to any one of claims 1 to 3 . The geometric feature includes the height of the user.
The moving step comprises moving the first object in the virtual space in response to the movement of the user's head.
The first object is either a virtual camera arranged corresponding to the virtual viewpoint or an object including at least an object corresponding to the head.
The adjusting step reduces the size of the first region, raises the position of the second object, raises the position of the second region, and raises the position of the second region when the height of the user is higher than the reference height. At least one of reducing the size of the second region and changing the shape of the first region or the second region so that the degree of overlap between the first region and the second region is reduced. The program according to claim 1 , wherein the program comprises the above. The geometric feature includes the height of the user.
The moving step comprises moving the first object in the virtual space in response to the movement of the user's head.
The first object is either a virtual camera arranged corresponding to the virtual viewpoint or an object including at least an object corresponding to the head.
The adjusting step increases the size of the first region, lowers the position of the second object, lowers the position of the second region, and lowers the position of the second region when the height of the user is lower than the reference height. At least one of increasing the size of the second region and changing the shape of the first region or the second region so that the degree of overlap between the first region and the second region is increased. The program according to claim 1 or 5 , which comprises performing. The program according to any one of claims 1, 5, or 6 , wherein the first area is a collision area set for the first object. The program according to any one of claims 1 to 7 , wherein the second area is a collision area set for the second object. The program according to any one of claims 1 to 8 , wherein the second object is included in the field of view from the virtual viewpoint. The first object is an avatar in the virtual space corresponding to the user.
The program according to any one of claims 1 to 9 , further comprising a step of adjusting the height of the avatar based on the height of the user. The step of identifying the geometric feature is
The step of tracking at least a part of the user's body,
Steps to determine the geometric features of the user's body based on the tracking results,
The program according to any one of claims 1 to 10 . An information processing device for providing a virtual experience to a user via an image display device associated with the user's head.
With the processor
Memory for storing programs and
Equipped with
When the program is executed by the processor, the processor receives the program.
The steps to identify the geometric features associated with the user's body,
The steps to identify the virtual space to provide the virtual experience,
A step of controlling the field of view from a virtual viewpoint in the virtual space according to the movement of the user's head,
A step of moving the first object in the virtual space according to the movement of the user,
Based on the geometric feature, at least one of the first region determined according to the first object and the geometric feature, and the second region set for the second object in the virtual space. In the step of adjusting, when the degree of overlap between the first region and the second region when the first object and the second object are in a predetermined positional relationship does not fall within the predetermined range, the overlap is performed. The size or shape of the first region, the position of the second object in the virtual space, the position of the second region in the virtual space, and the second region so that the degree is within the predetermined range. With steps, including adjusting at least one of the size or shape of the area .
The step of generating a field of view image representing the field of view from the virtual viewpoint, and
The step of displaying the view image on the image display device,
An information processing device configured to execute. An information processing method for providing a virtual experience to a user via an image display device associated with the user's head.
The steps to identify the geometric features associated with the user's body,
The steps to identify the virtual space to provide the virtual experience,
A step of controlling the field of view from a virtual viewpoint in the virtual space according to the movement of the user's head,
A step of moving the first object in the virtual space according to the movement of the user,
Based on the geometric feature, at least one of the first region determined according to the first object and the geometric feature, and the second region set for the second object in the virtual space. In the step of adjusting, when the degree of overlap between the first region and the second region when the first object and the second object are in a predetermined positional relationship does not fall within the predetermined range, the overlap is performed. The size or shape of the first region, the position of the second object in the virtual space, the position of the second region in the virtual space, and the second region so that the degree is within the predetermined range. With steps, including adjusting at least one of the size or shape of the area .
The step of generating a field of view image representing the field of view from the virtual viewpoint, and
The step of displaying the view image on the image display device,
Information processing methods including.

Images