JP6403843B1 - Information processing method, information processing program, and information processing apparatus - Google Patents

Abstract

An information processing method capable of providing a user with a rich virtual experience is provided.
An information processing method executed by a processor includes: (a) generating virtual space data defining a virtual space 200 including an enemy character object EC; and (b) a head mounted on a user's head. Updating the visual field image data indicating the visual field image displayed on the HMD based on the movement of the mount device (HMD) and the virtual space data; and (c) identifying the first play area in the real space; d) in the virtual space 200, the step of specifying the second play area A2 corresponding to the first play area; and (e) the user and the enemy character object EC in the virtual space 200 according to the range of the second play area A2. Adjusting virtual space data to allow interaction between the two.
[Selection] Figure 11

Description

  The present disclosure relates to an information processing method, an information processing program, and an information processing apparatus.

  Before experiencing a virtual space using a head-mounted device (hereinafter simply referred to as HMD), it is necessary to set a play area that defines the user's action range in the real space. The play area is set, for example, within a range in which the behavior of the user wearing the HMD can be detected by a position sensor or the like (hereinafter referred to as a detectable range).

  Patent Document 1 discloses a method for outputting a warning when a user is not positioned in a safe area after providing a safe area and a warning area within a measurable area (detectable range) of a measurement device (position sensor). Disclosure.

  Further, in Non-Patent Document 1, a user walks around in a room where two position sensors located on a diagonal line are arranged while holding an external controller, so that a play area in a real space is manually set. Is disclosed.

JP 2005-165848 A

“Vive-Set up Vive for Room-scale”, [online], April 5, 2016, Vive Tutorials, [Search May 12, 2017], Internet <https://www.youtube.com/ watch? v = rv6nVPPDmEI>

  By the way, after a play area is set in the real space, a play area (virtual play area) corresponding to the play area in the real space is set in the virtual space. For this reason, when the range of the play space in the real space is narrow, the virtual play area set in the virtual space is also reduced. In such a case, since the action range of the user (avatar) in the virtual space is limited, there is a possibility that inconveniences such as an inability to attack the enemy avatar object arranged in the virtual space may occur. In this way, there is room for further improvement of the user experience (virtual experience) in the virtual space by eliminating the above-mentioned disadvantages that occur according to the size of the range of the play area in the real space.

  An object of the present disclosure is to provide an information processing method capable of providing a user with a rich virtual experience. Furthermore, this indication aims at providing the information processing program and information processing apparatus which can provide a rich virtual experience to a user.

According to one aspect of the present disclosure, an information processing method executed by a processor is:
(A) generating virtual space data defining a virtual space including the first object;
(B) updating the visual field image data indicating the visual field image displayed on the head mounted device based on the movement of the head mounted device mounted on the user's head and the virtual space data;
(C) identifying a first area in real space;
(D) identifying a second area corresponding to the first area in the virtual space;
(E) adjusting the virtual space data to allow interaction between the user and the first object in the virtual space according to a range of the second area;
including.

  According to the present disclosure, it is possible to provide an information processing method, an information processing program, and an information processing apparatus that can provide an information processing method capable of providing a user with a rich virtual experience.

It is the schematic which shows a user terminal. It is a figure which shows the head of the user with which HMD was mounted | worn. It is a figure which shows the hardware constitutions of a control apparatus. It is a figure which shows an example of the specific structure of an external controller. It is a flowchart which shows the process which displays a visual field image on HMD. It is xyz space figure which shows an example of virtual space. The state (a) is a yx plan view of the virtual space shown in FIG. The state (b) is a zx plan view of the virtual space shown in FIG. It is a figure which shows an example of the visual field image displayed on HMD. 5 is a flowchart for explaining an example of an information processing method according to the first embodiment of the present disclosure. The state (a) is a diagram showing the first play area in the real space. State (b) is a diagram showing the second play area in the virtual space. State (a) is a diagram showing a state in which the action range of the enemy character object overlaps with a part of the second play area. State (b) is a diagram showing a state where the action trajectory of the enemy character object overlaps with a part of the second play area. 12 is a flowchart for describing an example of an information processing method according to a second embodiment of the present disclosure. It is a figure which shows a mode that the action range of an enemy character object overlaps with a part of user's attack range. 14 is a flowchart for describing an example of an information processing method according to a third embodiment of the present disclosure. State (a) is a diagram showing a state where the action range of the enemy character object overlaps with a part of the user's maximum attack range. The state (b) is a diagram illustrating a state where the action range of the enemy character object does not overlap with the attack range of the user. 14 is a flowchart for describing an example of an information processing method according to a fourth embodiment of the present disclosure. The state (a) is a diagram illustrating a state where the action range of the enemy character object does not overlap with the attack range of the user. The state (b) is a diagram illustrating a state in which the action range of the enemy character object overlaps with the attack range of the user as the range of the equipped weapon object increases.

[Description of Embodiments Presented by the Present Disclosure]
An overview of an embodiment indicated by the present disclosure will be described.
(1) (a) generating virtual space data defining a virtual space including the first object;
(B) updating the visual field image data indicating the visual field image displayed on the head mounted device based on the movement of the head mounted device mounted on the user's head and the virtual space data;
(C) identifying a first area in real space;
(D) identifying a second area corresponding to the first area in the virtual space;
(E) adjusting the virtual space data to allow interaction between the user and the first object in the virtual space according to a range of the second area;
An information processing method executed by a processor.

  According to the above method, it is possible to reliably cause an interaction between the user and the first object. Therefore, it is possible to provide a rich virtual experience to the user.

(2) The step (e)
(E1) The information processing method according to item (1), including a step of setting an action range or action locus of the first object according to the range of the second area.

  According to the above method, it is possible to reliably cause an interaction between the user and the first object.

(3) The step (e1)
The information according to item (2), including the step of setting the action range or action trajectory of the first object so that the action range or action trajectory of the first object overlaps at least a part of the second area. Processing method.

  According to the above method, it is possible to reliably cause an interaction between the user and the first object in the virtual space.

(4) (f) further comprising the step of specifying the user's action range based on the range of the second area and the range of the user's range,
The step (e1)
The information processing according to item (2), including the step of setting the action range or action trajectory of the first object so that the action range or action trajectory of the first object overlaps at least a part of the action range. Method.

  According to the above method, it is possible to reliably cause an interaction between the user and the first object in the virtual space.

(5) (g) further including a step of moving the operation object in accordance with a movement of a part of the user's body,
The information processing method according to item (4), wherein the range of the user is a range of an action object operated by the operation object.

  According to the above method, it is possible to reliably cause an interaction between the user and the first object in the virtual space.

(6) (g) moving the operation object in accordance with the movement of a part of the user's body;
(H) identifying an action object operated by the operation object from a plurality of candidate objects according to the operation of the user;
(I) identifying the maximum action range of the user based on the range of the second area and the maximum range of the range of the plurality of candidate objects;
Further including
The step (e1)
The information according to item (2), including the step of setting the action range or action trajectory of the first object so that the action range or action trajectory of the first object overlaps at least a part of the maximum action range. Processing method.

  According to the above method, since the user can be prompted to equip an action object having an appropriate range from a plurality of candidate objects, the entertainment property of the virtual space can be improved.

(7) (g) further includes a step of moving the operation object in accordance with a movement of a part of the user's body,
The step (e)
(E2) The information processing method according to item (1), including a step of setting a range of an action object operated by the operation object according to the range of the second area.

  According to the above method, it is possible to reliably cause an interaction between the user and the first object.

  (8) An information processing program for causing a computer to execute the information processing method according to any one of items (1) to (7).

  According to the above, it is possible to provide an information processing program that can provide a rich virtual experience to a user.

(9) a processor;
An information processing apparatus comprising a memory for storing computer-readable instructions,
When the computer readable instruction is executed by the processor, the information processing apparatus executes the information processing method according to any one of items (1) to (7).

  According to the above, it is possible to provide an information processing apparatus that can provide a rich virtual experience to a user.

[Details of Embodiments Presented by the Present Disclosure]
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In addition, about the member which has the same reference number as the member already demonstrated in description of this embodiment, the description is not repeated for convenience of explanation.

  First, the configuration of the user terminal 1 will be described with reference to FIG. FIG. 1 is a schematic diagram showing a user terminal 1. As shown in FIG. 1, the user terminal 1 includes a head mounted device (HMD) 110, a headphone 116, a microphone 118, a position sensor 130, an external controller 320, and a control device mounted on the head of the user U. 120.

  The HMD 110 includes a display unit 112, an HMD sensor 114, and a gaze sensor 140. The display unit 112 includes a non-transmissive display device configured to completely cover the field of view (field of view) of the user U wearing the HMD 110. Thereby, the user U can immerse in the virtual space by viewing only the visual field image displayed on the display unit 112. The display unit 112 includes a left-eye display unit configured to provide an image to the user U's left eye and a right-eye display unit configured to provide an image to the user U's right eye. Also good. Further, the HMD 110 may include a transmissive display device. In this case, the transmissive display device may be temporarily configured as a non-transmissive display device by adjusting the transmittance.

  The HMD sensor 114 is mounted in the vicinity of the display unit 112 of the HMD 110. The HMD sensor 114 includes at least one of a geomagnetic sensor, an acceleration sensor, and a tilt sensor (such as an angular velocity sensor and a gyro sensor), and detects various movements (tilt and the like) of the HMD 110 mounted on the user U's head. be able to.

  The gaze sensor 140 has an eye tracking function that detects the line of sight of the user U. The gaze sensor 140 may include, for example, a right eye gaze sensor and a left eye gaze sensor. The right eye gaze sensor irradiates, for example, infrared light to the right eye of the user U, and detects reflected light reflected from the right eye (particularly the cornea and iris), thereby acquiring information related to the rotation angle of the right eye's eyeball. May be. On the other hand, the left eye gaze sensor irradiates the left eye of the user U with, for example, infrared light, and detects reflected light reflected from the left eye (particularly the cornea and iris), thereby providing information on the rotation angle of the left eye's eyeball. May be obtained.

  The headphones 116 are respectively attached to the left ear and the right ear of the user U. The headphones 116 are configured to receive audio data (electrical signals) from the control device 120 and output audio based on the received audio data. The microphone 118 is configured to collect the voice uttered by the user U and generate voice data (electrical signal) based on the collected voice. Furthermore, the microphone 118 is configured to transmit audio data to the control device 120.

  The position sensor 130 is configured by, for example, a position tracking camera, and is configured to detect the positions of the HMD 110 and the external controller 320. The position sensor 130 is communicably connected to the control device 120 by wireless or wired communication, and is configured to detect information on the position, inclination, or light emission intensity of a plurality of detection points (not shown) provided in the HMD 110. . Further, the position sensor 130 is configured to detect information on the position, inclination and / or light emission intensity of a plurality of detection points (not shown) provided in the external controller 320. The detection point is, for example, a light emitting unit that emits infrared light or visible light. The position sensor 130 may include an infrared sensor and a plurality of optical cameras.

  The external controller 320 detects the movement of a part of the body of the user U (a part other than the head, which is the user U's hand in the present embodiment), thereby moving the hand object displayed in the virtual space. Used to control. The external controller 320 is an external controller 320R for right hand operated by the right hand of the user U (hereinafter simply referred to as controller 320R) and an external controller 320L for left hand operated by the left hand of the user U (hereinafter simply referred to as controller 320L). And).

  The controller 320R is a device that indicates the position of the right hand of the user U and the movement of the finger of the right hand, and may include a plurality of operation buttons that are operated by the finger of the right hand. The right-hand object 400R (see FIG. 10B) existing in the virtual space moves according to the movement of the controller 320R. For example, when the user U presses a predetermined operation button of the controller 320R, the predetermined finger of the right hand object 400R bends, while when the user U releases the predetermined operation button of the controller 320R, the predetermined finger of the right hand object 400R May extend. As described above, the finger of the right hand object 400R may be controlled in accordance with an operation on the operation button of the controller 320R.

  The controller 320L is a device that indicates the position of the left hand of the user U and the movement of the finger of the left hand, and may include a plurality of operation buttons operated by the finger of the left hand. The left hand object 400L (see FIG. 10B) that exists in the virtual space moves according to the movement of the controller 320L. For example, when the user U presses a predetermined operation button of the controller 320L, the predetermined finger of the left hand object 400L bends, while when the user U releases the predetermined operation button of the controller 320L, the predetermined finger of the left hand object moves. It may stretch. As described above, the finger of the left hand object 400L may be controlled in accordance with an operation on the operation button of the controller 320L.

  The control device 120 is a computer configured to control the HMD 110. The control device 120 identifies the position information of the HMD 110 based on the information acquired from the position sensor 130, and installs the position of the virtual camera in the virtual space and the HMD 110 in the real space based on the identified position information. Thus, the position of the user U can be accurately associated. Furthermore, the control device 120 identifies the operation of the external controller 320 based on the information transmitted from the position sensor 130 and / or the external controller 320, and in the virtual space based on the identified operation of the external controller 320. The motion of the hand object displayed on the screen can be accurately associated with the motion of the external controller 320 in the real space. In particular, the control device 120 identifies the operation of the controller 320L based on information transmitted from the position sensor 130 and / or the controller 320L, and is displayed in the virtual space based on the identified operation of the controller 320L. The motion of the left hand object and the motion of the controller 320L in the real space (the motion of the left hand of the user U) can be accurately associated with each other. Similarly, the control device 120 identifies the operation of the controller 320R based on the information transmitted from the position sensor and / or the controller 320R, and is displayed in the virtual space based on the identified operation of the controller 320R. The movement of the right hand object and the movement of the controller 320R in the real space (the movement of the right hand of the user U) can be accurately associated.

  Further, the control device 120 specifies the gaze of the right eye and the gaze of the left eye of the user U based on the information transmitted from the gaze sensor 140 (the left eye gaze sensor and the right eye gaze sensor), and the right eye gaze. It is possible to specify the point of gaze that is the intersection of the left eye gaze. Furthermore, the control device 120 can specify the line of sight of both eyes of the user U (the line of sight of the user U) based on the specified gazing point. Here, the line of sight of the user U is the line of sight of both eyes of the user U, and coincides with the direction of a straight line passing through the middle point of the line connecting the right eye and the left eye of the user U and the gazing point.

  Next, with reference to FIG. 2, a method for acquiring information related to the position and inclination of the HMD 110 will be described. FIG. 2 is a diagram illustrating the head of the user U wearing the HMD 110. Information on the position and inclination of the HMD 110 that is linked to the movement of the head of the user U wearing the HMD 110 can be detected by the position sensor 130 and / or the HMD sensor 114 mounted on the HMD 110. As shown in FIG. 2, three-dimensional coordinates (uvw coordinates) are defined centering on the head of the user U wearing the HMD 110. The vertical direction in which the user U stands up is defined as the v-axis, the direction orthogonal to the v-axis and passing through the center of the HMD 110 is defined as the w-axis, and the direction orthogonal to the v-axis and the w-axis is defined as the u-axis. The position sensor 130 and / or the HMD sensor 114 is an angle around each uvw axis (that is, a yaw angle indicating rotation around the v axis, a pitch angle indicating rotation around the u axis, and a center around the w axis). The inclination determined by the roll angle indicating rotation) is detected. The control device 120 determines angle information for controlling the visual axis of the virtual camera based on the detected angle change around each uvw axis.

  Next, the hardware configuration of the control device 120 will be described with reference to FIG. FIG. 3 is a diagram illustrating a hardware configuration of the control device 120. As shown in FIG. 3, the control device 120 includes a control unit 121, a storage unit 123, an I / O (input / output) interface 124, a communication interface 125, and a bus 126. The control unit 121, the storage unit 123, the I / O interface 124, and the communication interface 125 are connected to each other via a bus 126 so as to communicate with each other.

  The control device 120 may be configured as a personal computer, a tablet, or a wearable device separately from the HMD 110, or may be built in the HMD 110. In addition, some functions of the control device 120 may be mounted on the HMD 110, and the remaining functions of the control device 120 may be mounted on another device separate from the HMD 110.

  The control unit 121 includes a memory and a processor. The memory includes, for example, a ROM (Read Only Memory) in which various programs are stored, a RAM (Random Access Memory) having a plurality of work areas in which various programs executed by the processor are stored, and the like. The processor is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and / or a GPU (Graphics Processing Unit), and a program specified from various programs embedded in the ROM is expanded on the RAM. It is comprised so that various processes may be performed in cooperation with.

  In particular, the control unit 121 may control various operations of the control device 120 by a processor developing a control program on a RAM and executing the control program in cooperation with the RAM. The control unit 121 displays a field image on the display unit 112 of the HMD 110 based on the field image data. Thereby, the user U can be immersed in the virtual space.

  The storage unit (storage) 123 is a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a USB flash memory, and is configured to store programs and various data. The storage unit 123 may store a control program for causing a computer to execute at least a part of the information processing method according to the present embodiment, or a control program for realizing sharing of a virtual space by a plurality of users. In addition, the storage unit 123 may store an authentication program of the user U and data regarding various images and objects. Furthermore, a database including tables for managing various data may be constructed in the storage unit 123.

  The I / O interface 124 is configured to connect the position sensor 130, the HMD 110, the external controller 320, the headphones 116, and the microphone 118 to the control device 120 so that they can communicate with each other, for example, a USB (Universal) The terminal includes a serial bus (D) terminal, a digital visual interface (DVI) terminal, a high-definition multimedia interface (HDMI) (registered trademark) terminal, and the like. The control device 120 may be wirelessly connected to each of the position sensor 130, the HMD 110, the external controller 320, the headphones 116, and the microphone 118.

  The communication interface 125 is configured to connect the control device 120 to a communication network 30 such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. The communication interface 125 includes various wired connection terminals for communicating with an external device such as a server via the communication network 30 and various processing circuits for wireless connection, for communicating via the communication network 30. It is configured to conform to the communication standard.

  Next, an example of a specific configuration of the external controller 320 will be described with reference to FIG. Since the controller 320R and the controller 320L have substantially the same configuration, only the specific configuration of the controller 320R will be described below with reference to FIG. In the following description, the controllers 320L and 320R may be simply referred to as the external controller 320 for convenience.

  As shown in FIG. 4, the controller 320R includes an operation button 302, a plurality of detection points 304, a sensor (not shown), and a transceiver (not shown). Only one of the detection point 304 and the sensor may be provided. The operation button 302 includes a plurality of button groups configured to accept an operation input from the user U. The operation button 302 includes a push button, a trigger button, and an analog stick. The push-type button is a button operated by an operation of pressing with a thumb. For example, two push buttons 302 a and 302 b are provided on the top surface 322. The trigger type button is a button operated by an operation of pulling a trigger with an index finger or a middle finger. For example, a trigger button 302 e is provided on the front surface portion of the grip 324, and a trigger button 302 f is provided on the side surface portion of the grip 324. The trigger type buttons 302e and 302f are operated by the index finger and the middle finger, respectively. The analog stick is a stick-type button that can be operated by being tilted 360 degrees from a predetermined neutral position in an arbitrary direction. For example, an analog stick 320i is provided on the top surface 322, and is operated using a thumb.

  The controller 320R includes a frame 326 that extends from both side surfaces of the grip 324 in a direction opposite to the top surface 322 to form a semicircular ring. A plurality of detection points 304 are embedded on the outer surface of the frame 326. The plurality of detection points 304 are, for example, a plurality of infrared LEDs arranged in a line along the circumferential direction of the frame 326. After the position sensor 130 detects information on the position, inclination, or light emission intensity of the plurality of detection points 304, the control device 120 detects the position or orientation (inclination / posture) of the controller 320R based on the information detected by the position sensor 130. Get information about (orientation).

  The sensor of the controller 320R may be, for example, a magnetic sensor, an angular velocity sensor, an acceleration sensor, or a combination thereof. When the user U moves the controller 320R, the sensor outputs a signal (for example, a signal indicating information related to magnetism, angular velocity, or acceleration) according to the orientation and position of the controller 320R. The control device 120 acquires information related to the position and orientation of the controller 320R based on the signal output from the sensor.

  The transceiver of the controller 320R is configured to transmit and receive data between the controller 320R and the control device 120. For example, the transceiver may transmit an operation signal corresponding to the operation input of the user U to the control device 120. The transceiver may receive an instruction signal for instructing the controller 320 </ b> R to emit light at the detection point 304 from the control device 120. Further, the transceiver may send a signal to the controller 120 indicating the value detected by the sensor.

  Next, processing for displaying a field-of-view image on the HMD 110 will be described with reference to FIGS. FIG. 5 is a flowchart showing a process for displaying the visual field image on the HMD 110. FIG. 6 is an xyz space diagram showing an example of the virtual space 200. The state (a) in FIG. 7 is a yx plan view of the virtual space 200 shown in FIG. The state (b) in FIG. 7 is a zx plan view of the virtual space 200 shown in FIG. FIG. 8 is a diagram illustrating an example of the visual field image V displayed on the HMD 110.

  As shown in FIG. 5, in step S1, the control unit 121 (see FIG. 3) generates virtual space data indicating the virtual space 200 including the virtual camera 300 and various objects. As shown in FIG. 6, the virtual space 200 is defined as an omnidirectional sphere centered on the center position 210 (in FIG. 6, only the upper half celestial sphere is shown). In the virtual space 200, an xyz coordinate system with the center position 210 as the origin is set. The virtual camera 300 defines a visual axis L for specifying the visual field image V (see FIG. 8) displayed on the HMD 110. The uvw coordinate system that defines the visual field of the virtual camera 300 is determined so as to be linked to the uvw coordinate system that is defined around the head of the user U in the real space. Further, the control unit 121 may move the virtual camera 300 in the virtual space 200 in conjunction with the movement of the user U wearing the HMD 110 in the real space.

  Next, in step S <b> 2, the control unit 121 specifies the field of view CV (see FIG. 7) of the virtual camera 300. Specifically, the control unit 121 acquires information on the position and inclination of the HMD 110 based on data indicating the state of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114. Next, the control unit 121 identifies the position and orientation of the virtual camera 300 in the virtual space 200 based on information regarding the position and tilt of the HMD 110. Next, the control unit 121 determines the visual axis L of the virtual camera 300 from the position and orientation of the virtual camera 300 and specifies the visual field CV of the virtual camera 300 from the determined visual axis L. Here, the visual field CV of the virtual camera 300 corresponds to a part of the virtual space 200 visible to the user U wearing the HMD 110 (in other words, a part of the virtual space 200 displayed on the HMD 110). Equivalent to Further, the visual field CV includes a first region CVa set as an angular range of the polar angle α around the visual axis L in the xy plane shown in the state (a) of FIG. 7, and the state (b) of FIG. 7. The xz plane shown has a second region CVb set as an angle range of the azimuth angle β with the visual axis L as the center. The control unit 121 identifies the line of sight of the user U based on the data indicating the line of sight of the user U transmitted from the gaze sensor 140, and based on the information regarding the identified line of sight of the user U and the position and inclination of the HMD 110. The orientation of the virtual camera 300 (virtual camera field axis L) may be determined.

  As described above, the control unit 121 can specify the visual field CV of the virtual camera 300 based on the data from the position sensor 130 and / or the HMD sensor 114. Here, when the user U wearing the HMD 110 moves, the control unit 121 updates the visual field CV of the virtual camera 300 based on the data indicating the movement of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114. be able to. That is, the control unit 121 can update the visual field CV according to the movement of the HMD 110. Similarly, when the line of sight of the user U changes, the control unit 121 may update the visual field CV of the virtual camera 300 based on the data indicating the line of sight of the user U transmitted from the gaze sensor 140. That is, the control unit 121 may change the visual field CV according to the change in the line of sight of the user U.

  Next, in step S <b> 3, the control unit 121 generates visual field image data indicating the visual field image V displayed on the display unit 112 of the HMD 110. Specifically, the control unit 121 generates visual field image data based on virtual space data defining the virtual space 200 and the visual field CV of the virtual camera 300.

  Next, in step S4, the control unit 121 displays the field image V on the display unit 112 of the HMD 110 based on the field image data (see FIG. 8). As described above, the visual field CV of the virtual camera 300 is changed according to the movement of the user U wearing the HMD 110, and the visual field image V displayed on the display unit 112 of the HMD 110 is changed. I can immerse myself in 200.

  Note that the virtual camera 300 may include a left-eye virtual camera and a right-eye virtual camera. In this case, the control unit 121 generates left-eye view image data indicating the left-eye view image based on the virtual space data and the view of the left-eye virtual camera. Further, the control unit 121 generates right-eye view image data indicating a right-eye view image based on the virtual space data and the view of the right-eye virtual camera. Thereafter, the control unit 121 displays the left-eye field image on the left-eye display unit based on the left-eye field image data, and also displays the right-eye field image on the right-eye display unit based on the right-eye field image data. Is displayed. In this way, the user U can visually recognize the visual field image three-dimensionally due to the parallax between the left-eye visual field image and the right-eye visual field image. As will be described later, the virtual camera may be arranged at the position of the avatar eye operated by the user. For example, the left-eye virtual camera may be placed in the left eye of the avatar, while the right-eye virtual camera may be placed in the right eye of the avatar.

  Further, the processes in steps S1 to S4 shown in FIG. 5 may be executed for each frame (a still image constituting a moving image). For example, when the frame rate of the moving image is 90 fps, the processes in steps S1 to S4 may be repeatedly executed at intervals of ΔT = 1/90 (seconds). As described above, since the processes in steps S1 to S4 are repeatedly performed at predetermined intervals, the visual field of the virtual camera 300 is updated according to the operation of the HMD 110, and the visual field image V displayed on the display unit 112 of the HMD 110. Is updated.

(First embodiment)
Next, a first embodiment of the present disclosure (hereinafter simply referred to as the first embodiment) will be described below with reference to FIGS. 9 to 11. FIG. 9 is a flowchart for explaining an example of the information processing method according to the first embodiment. The state (a) in FIG. 10 is a diagram showing the first play area A1 (an example of the first area) in the real space. The state (b) of FIG. 10 is a diagram showing the second play area A2 (an example of the second area) in the virtual space 200. The state (a) in FIG. 11 is a diagram showing a state where the action range S1 of the enemy character object EC overlaps with a part of the second play area A2. The state (b) of FIG. 11 is a diagram showing a state where the action trajectory P1 of the enemy character object EC overlaps with a part of the second play area A2.

  As shown in FIG. 9, in step S10, the control unit 121 (see FIG. 3) specifies the first play area A1 that defines the action range of the user U in the real space. As shown in the state (a) of FIG. 10, the control unit 121 may automatically identify the first play area A1 based on the detectable areas of the two position sensors 130a and 130b arranged on the diagonal line. Good. Here, it is assumed that the position sensors 130a and 130b have the same configuration and function as the position sensor 130 described above. When the user U exists within the detectable region of the position sensor 130a (130b), the position sensor 130a (130b) can detect the movement of the user U (the movement of the HMD 110 or the movement of the external controller 320). On the other hand, when the user U exists outside the detectable region of the position sensor 130a (130b), the position sensor 130a (130b) cannot detect the movement of the user U (the movement of the HMD 110 or the movement of the external controller 320). . The first play area A1 may be provided inside a detectable area obtained by combining the detectable area of the position sensor 130a and the detectable area of the position sensor 130b. The first play area A1 may be specified by the user U. In this case, the control unit 121 may specify the first play area A1 according to the input operation of the user U.

  Further, when the user U moves outside the first play area A1, a warning sound may be output from the headphones 116, or warning information may be displayed on the visual field image. Specifically, when the control unit 121 determines that the user U is located outside the first play area A based on the data acquired by the position sensors 130a and 130b, the control unit 121 generates a warning sound from the headphones 116. The warning information may be displayed on the HMD 110.

  Next, in step S11, the control unit 121 specifies a second play area A2 corresponding to the first play area A1 in the virtual space 200. As shown in the state (b) of FIG. 10, the virtual space 200 includes a virtual camera 300, a left hand object 400L (an example of an operation object), a right hand object 400R (an example of an operation object), and an enemy character object EC (first object). An example of one object).

  As described above, the virtual camera 300 defines the field of view of the user U. The control unit 121 generates virtual space data defining the virtual space 200 and then updates the field of view of the virtual camera 300 according to the movement of the HMD 110 attached to the user U's head. Thereafter, the control unit 121 updates the visual field image data indicating the visual field image V (see FIG. 8) displayed on the HMD 110 based on the virtual space data indicating the visual field of the virtual camera 300 and the virtual space 200.

  The left hand object 400L is an object that indicates the movement of the left hand of the user U. The control unit 121 moves the left hand object 400L in the virtual space 200A according to the movement of the controller 320L (see FIG. 1) indicating the movement of the user U's left hand. In particular, the control unit 121 specifies the operation of the controller 320L based on the information transmitted from the position sensor 130 and / or the controller 320L, and determines the operation of the left hand object 400L based on the specified operation of the controller 320L. The operation of the controller 320L (the operation of the left hand of the user U) is accurately associated. For example, the control unit 121 may move the left hand object 400L according to the movement of the controller 320L and move the finger of the left hand object 400L according to an operation on the operation button of the controller 320L.

  The right hand object 400R is an object that indicates the movement of the right hand of the user U. The control unit 121 moves the right hand object 400R in the virtual space 200A according to the movement of the controller 320R (see FIG. 1) indicating the movement of the user U's right hand. In particular, the control unit 121 specifies the operation of the controller 320R based on the information transmitted from the position sensor 130 and / or the controller 320R, and determines the operation of the right hand object 400R based on the specified operation of the controller 320R. The operation of the controller 320R (the operation of the right hand of the user U) is accurately associated. For example, the control unit 121 may move the right hand object 400R according to the movement of the controller 320R and move the finger of the right hand object 400R according to an operation on the operation button of the controller 320R.

  The enemy character object EC is an object that attacks the user U (user U's avatar) in the virtual space 200, for example. In the virtual space 200, a collision effect between the user U and the enemy character object EC is generated by the interaction (interaction) between the user U and the enemy character object EC. For example, the user U can damage the enemy character object EC due to the interaction between the user U and the enemy character object EC. On the other hand, the user U is damaged by the enemy character object EC due to the interaction. Further, the operation of the enemy character object EC may be controlled by the control unit 121 (processor).

  The second play area A2 is an area that defines the action range of the user U in the virtual space 200. The user U (user U's avatar) can move in the second play area A2, but cannot move outside the second play area A2. The range of the second play area A2 is determined based on the range of the first play area A1. For example, the range of the second play area A2 may be equal to the range of the first play area A1. Furthermore, as the range of the first play area A1 becomes smaller or larger, the range of the second play area A2 becomes smaller or larger.

  Next, in step S12, the control unit 121 sets the action range S1 of the enemy character object EC so that the action range S1 of the enemy character object EC overlaps at least a part of the second play area A2. As shown in the state (a) of FIG. 11, the action range S1 of the enemy character object EC overlaps with a part of the second play area A2. Thus, according to the first embodiment, the action range S1 of the enemy character object EC is set according to the range of the second play area A2, so that the user U and the enemy character object EC in the virtual space 200 are set. It is possible to reliably cause an interaction between the two. In particular, when the action range S1 of the enemy character object EC overlaps with the second play area A2, it is possible to avoid the inconvenience that the user U cannot attack the enemy character object EC. In this way, a rich virtual space can be provided to the user U. The control unit 121 may start the battle between the user U and the enemy character object EC after adjusting the virtual space data so that the action range S1 overlaps at least a part of the second play area A2.

  Further, as shown in the state (b) of FIG. 11, the control unit 121 sets the action trajectory P1 so that the action trajectory P1 of the enemy character object EC overlaps at least a part of the second play area A2. Also good. In this case as well, since the action trajectory P1 is set according to the range of the second play area A2, it is possible to reliably cause an interaction between the user U and the enemy character object EC in the virtual space 200. It becomes.

  In the example shown in FIG. 11, a part of the action range S1 or the action trajectory P1 overlaps a part of the second play area A2, but the entire action range S1 or the action trajectory P1 is the second play area A2. It may overlap with a part of. Furthermore, a part of the action range S1 or the action locus P1 may overlap the entire second play area A2.

  The action range S1 of the enemy character object EC may have an action range S0 as an initial setting value. In this case, in step S12, the control unit 121 may determine whether or not the action range S0 of the enemy character object EC overlaps the second play area A2. Thereafter, when it is determined that the action range S0 overlaps the second play area A2, the control unit 121 may start a battle between the user U and the enemy character object EC. On the other hand, if the control unit 121 determines that the action range S0 does not overlap with the second play area A2, the action is performed so that the action range S1 of the enemy character object EC overlaps at least a part of the second play area A2. The range S1 may be set.

(Second Embodiment)
Next, a second embodiment of the present disclosure (hereinafter simply referred to as the second embodiment) will be described below with reference to FIGS. 12 and 13. FIG. 12 is a flowchart for explaining an example of the information processing method according to the second embodiment. FIG. 13 is a diagram illustrating a state in which the action range S1 of the enemy character object EC overlaps with a part of the attack range C1 of the user U.

  As shown in FIG. 12, in step S20, the control unit 121 specifies the first play area A1 in the real space. Next, the control part 121 specifies 2nd play area A2 in the virtual space 200 (step S21). In step S <b> 22, the control unit 121 is equipped with a weapon object (an example of an action object) equipped from a plurality of weapon objects (an example of a candidate object) that is possessed by the user U and can be equipped on the user U according to an input operation of the user U. ). In the description of the second embodiment, it is assumed that the sword object 500 (an example of an action object) is selected from a plurality of weapon objects and is equipped to the user U. In this case, as shown in FIG. 13, the sword object 500 is operated by the left hand object 400L. The sword object 500 may be operated by the right hand object 400R. The user U can operate the sword object 500 by moving the left hand, and can also damage the enemy character object EC by operating the sword object 500.

  Next, in step S23, the control unit 121 specifies the range R1 of the sword object 500 that is the equipped weapon object. In this regard, since each weapon object has attribute information such as attack power and range, the control unit 121 specifies the range R1 of the sword object 500 based on the attribute information of the sword object 500. Also good. The range R1 of the sword object 500 is equal to the range of the user U.

  In step S24, the control unit 121 determines the attack range C1 of the user U (an example of the range of action of the user U) based on the second play area A2 and the range R1 of the sword object 500 (the range of the user U). Identify. The attack range C1 of the user U is a range in which the user U can attack the enemy character object EC using the sword object 500. As shown in FIG. 13, a part of the boundary line of the range R1 of the sword object 500 when the user U is positioned on the boundary line of the second play area A2 forms the boundary line of the attack range C1 of the user U. As the range of the equipped weapon object increases (or decreases), the attack range C1 of the user U increases (or decreases).

  Next, in step S25, the control unit 121 sets the action range S1 of the enemy character object EC so that the action range S1 of the enemy character object EC overlaps at least a part of the attack range C1 of the user U. As shown in FIG. 13, the action range S1 overlaps with a part of the attack range C1. Thus, according to the second embodiment, since the action range S1 is set according to the attack range C1, it is possible to reliably cause an interaction between the user U and the enemy character object EC in the virtual space 200. Is possible. In particular, when the action range S1 overlaps the attack range C1, it is possible to avoid the inconvenience that the user U cannot attack the enemy character object EC. In this way, a rich virtual space can be provided to the user U. The control unit 121 may start the battle between the user U and the enemy character object EC after adjusting the virtual space data so that the action range S1 overlaps at least a part of the attack range C1.

  Further, as shown in the state (b) of FIG. 11, the control unit 121 may set the action trajectory P1 so that the action trajectory P1 of the enemy character object EC overlaps at least a part of the attack range C1. . In this case as well, since the action locus P1 is set according to the attack range C1, it is possible to surely cause an interaction between the user U and the enemy character object EC in the virtual space 200.

  In the example shown in FIG. 13, part of the action range S1 overlaps with part of the attack range C1, but all of the action range S1 may overlap with part of the attack range C1. Furthermore, a part of the action range S1 may overlap the entire attack range C1.

  The action range S1 of the enemy character object EC may have an action range S0 as an initial setting value. In this case, in step S25, the control unit 121 may determine whether or not the action range S0 of the enemy character object EC overlaps the attack range C1. Thereafter, when it is determined that the action range S0 overlaps the attack range C1, the control unit 121 may start a battle between the user U and the enemy character object EC. On the other hand, when the control unit 121 determines that the action range S0 does not overlap with the attack range C1, the control unit 121 sets the action range S1 so that the action range S1 of the enemy character object EC overlaps at least a part of the attack range C1. May be.

(Third embodiment)
Next, a third embodiment of the present disclosure (hereinafter simply referred to as a third embodiment) will be described below with reference to FIGS. 14 and 15. FIG. 14 is a flowchart for explaining an example of the information processing method according to the third embodiment. The state (a) of FIG. 15 is a diagram showing a state where the action range S1 of the enemy character object EC overlaps with a part of the maximum attack range C2 of the user U. The state (b) of FIG. 15 is a diagram showing a state where the action range S1 of the enemy character object EC does not overlap with the attack range C1 of the user U.

  As shown in FIG. 14, in step S30, the control unit 121 specifies the first play area A1 in the real space. Next, the control unit 121 specifies the second play area A2 in the virtual space 200 (step S31). In step S <b> 32, the control unit 121 specifies a weapon object to be equipped from a plurality of weapon objects that are possessed by the user U and can be equipped by the user U. In the description of the third embodiment, it is assumed that the user U has two weapon objects, a sword object 500 and a spear object (not shown), and can equip the sword object 500 or the spear object (that is, The sword object 500 and the spear object are examples of candidate objects). Furthermore, it is assumed that the sword object 500 (an example of an action object) is selected from the sword object 500 and the spear object and is mounted on the user U. As shown in FIG. 15, in the virtual space 200, the user U is equipped with a sword object 500, and the sword object 500 is operated by the left hand object 400L.

  Next, in step S33, the control unit 121 identifies the maximum range of the range of the plurality of weapon objects. Here, the range R2 of the spear object is assumed to be larger than the range R1 of the sword object 500. In this case, the control unit 121 specifies the range R1 of the sword object 500 based on the attribute information of the sword object 500, and specifies the range R2 of the spear object based on the attribute information of the spear object. After that, the control unit 121 compares the range R1 of the sword object 500 with the range R2 of the spear object to identify the range R2 of the spear object as the maximum range.

  In step S34, the control unit 121 determines the maximum attack range C2 of the user (an example of the maximum action range of the user U) based on the second play area A2 and the range R2 (maximum range of the candidate object) of the spear object Is identified. The maximum attack range C2 of the user U refers to a range in which the user U can attack the enemy character object EC using the trap object having the maximum range. As shown in the state (a) of FIG. 15, when the user U is positioned on the boundary line of the second play area A2, a part of the boundary line of the range R2 of the heel object is the boundary of the maximum attack range C2 of the user U Form a line.

  Next, in step S35, the control unit 121 sets the action range S1 of the enemy character object EC so that the action range S1 of the enemy character object EC overlaps at least a part of the maximum attack range C2 of the user U. As shown in the state (a) of FIG. 15, the action range S1 overlaps with a part of the maximum attack range C2. On the other hand, as shown in the state (b) of FIG. 15, the action range S1 overlaps the range R1 of the equipped sword object 500 and the attack range C1 of the user U specified based on the second play area A2. It does not have to be. As described above, according to the third embodiment, since the action range S1 is set according to the maximum attack range C2, an interaction between the user U and the enemy character object EC in the virtual space 200 is surely generated. It becomes possible. In particular, when the action range S1 and the maximum attack range C2 overlap, it is possible to avoid the inconvenience that the user U cannot attack the enemy character object EC. Furthermore, since the user U can be prompted to equip a weapon object having an appropriate range from a plurality of weapon objects, the entertainment property of the virtual space 200 can be improved. The control unit 121 may start the battle between the user U and the enemy character object EC after adjusting the virtual space data so that the action range S1 overlaps at least a part of the maximum attack range C2.

  Further, as shown in the state (b) of FIG. 11, the control unit 121 sets the action trajectory P1 so that the action trajectory P1 of the enemy character object EC overlaps at least a part of the maximum attack range C2. Good. In this case as well, since the action locus P1 is set according to the maximum attack range C2, it is possible to surely cause an interaction between the user U and the enemy character object EC in the virtual space 200.

  In the example shown in the state (a) of FIG. 15, a part of the action range S1 overlaps with a part of the maximum attack range C2, but the entire action range S1 overlaps with a part of the maximum attack range C2. May be. Furthermore, a part of the action range S1 may overlap the entire maximum attack range C2.

  The action range S1 of the enemy character object EC may have an action range S0 as an initial setting value. In this case, in step S35, the control unit 121 may determine whether or not the action range S0 of the enemy character object EC overlaps the maximum attack range C2. Thereafter, when it is determined that the action range S0 overlaps the maximum attack range C2, the control unit 121 may start a battle between the user U and the enemy character object EC. On the other hand, if the control unit 121 determines that the action range S0 does not overlap the maximum attack range C2, the action range S1 so that the action range S1 of the enemy character object EC overlaps at least a part of the maximum attack range C2. May be set.

(Fourth embodiment)
Next, a fourth embodiment of the present disclosure (hereinafter simply referred to as the fourth embodiment) will be described below with reference to FIGS. 16 and 17. FIG. 16 is a flowchart for explaining an example of the information processing method according to the fourth embodiment. The state (a) of FIG. 17 is a diagram illustrating a state where the action range S1 of the enemy character object EC does not overlap with the attack range C1 of the user U. The state (b) of FIG. 17 is a diagram showing a state where the action range S1 of the enemy character object EC overlaps the attack range C1 of the user U as the range R1 of the equipped sword object 500 increases.

  As shown in FIG. 16, in step S40, the control unit 121 specifies the first play area A1 in the real space. Next, the control part 121 specifies 2nd play area A2 in the virtual space 200 (step S41). In step S <b> 42, the control unit 121 specifies a weapon object (an example of an action object) to be equipped from a plurality of weapon objects (an example of a plurality of candidate objects) possessed by the user U and equipable to the user U. In the description of the fourth embodiment, it is assumed that the sword object 500 is selected from a plurality of weapon objects and is equipped by the user U.

  Next, in step S43, the control unit 121 sets the range R1 of the equipped sword object 500 so that the action range S1 of the enemy character object EC overlaps at least a part of the attack range C1 of the user U. As described above, the fourth embodiment differs from the first to third embodiments in that the range R1 is set instead of the action range S1. As shown in the state (a) of FIG. 17, in the range R1 of the sword object 500 specified based on the attribute information of the sword object 500, the action range S1 of the enemy character object EC is the second play area A2. It does not overlap with the attack range C1 of the user U specified based on the range R1. On the other hand, as shown in the state (b) of FIG. 17, the control unit 121 can increase the attack range C1 of the user U by increasing the range R1 of the sword object 500. As a result, the action range S1 of the enemy character object EC can be overlapped with at least a part of the attack range C1 of the user U.

  Therefore, according to the fourth embodiment, since the range R1 of the sword object 500 is set according to the range of the second play area A2, the interaction between the user U and the enemy character object EC in the virtual space 200 is set. Can be reliably generated. In particular, when the action range S1 overlaps the attack range C1, it is possible to avoid the inconvenience that the user U cannot attack the enemy character object EC. In this way, a rich virtual space can be provided to the user U. The control unit 121 may start the battle between the user U and the enemy character object EC after adjusting the virtual space data so that the action range S1 overlaps at least a part of the attack range C1.

  Further, as shown in the state (b) of FIG. 11, the control unit 121 increases the range R1 of the sword object 500 so that the action trajectory P1 of the enemy character object EC overlaps at least a part of the attack range C1. You may change the size. Similarly, in this case, since the range R1 is set according to the range of the second play area A2, it is possible to reliably cause an interaction between the user U and the enemy character object EC in the virtual space 200. It becomes.

  In the example shown in the state (b) of FIG. 17, a part of the action range S1 overlaps with a part of the attack range C1, but the whole action range S1 overlaps with a part of the attack range C1. Also good. Furthermore, a part of the action range S1 may overlap the entire attack range C1.

  Further, in order to implement various processes executed by the control unit 121 of the user terminal 1 by software, a control program for causing the computer (processor) to execute various processes may be incorporated in the storage unit 123 or the memory in advance. Good. Alternatively, the control program can be a magnetic disk (HDD, floppy disk), optical disk (CD-ROM, DVD-ROM, Blu-ray (registered trademark) disk, etc.), magneto-optical disk (MO, etc.), flash memory (SD card, It may be stored in a computer-readable storage medium such as a USB memory or SSD. In this case, when the storage medium is connected to the control device 120, the control program stored in the storage medium is incorporated into the storage unit 123. The control unit 121 executes various processes by loading the control program incorporated in the storage unit 123 onto the RAM and executing the loaded program.

  The control program may be downloaded from a computer on the communication network 30 via the communication interface 125. Similarly in this case, the downloaded control program is incorporated into the storage unit 123.

  As mentioned above, although embodiment of this indication was described, the technical scope of this invention should not be limitedly interpreted by description of this embodiment. This embodiment is an example, and it is understood by those skilled in the art that various modifications can be made within the scope of the invention described in the claims. The technical scope of the present invention should be determined based on the scope of the invention described in the claims and the equivalents thereof.

  In this embodiment, the movement of the hand object (left hand object, right hand object) is controlled according to the movement of the external controller 320 indicating the movement of the user U's hand (left hand, right hand). The movement of the hand object in the virtual space may be controlled according to the amount of movement. For example, instead of using an external controller, by using a glove-type device or a ring-type device worn on the user's finger, the position sensor 130 can detect the position and movement amount of the user U's hand, The movement and state of the user U's finger can be detected. Further, the position sensor 130 may be a camera configured to image the user U's hand (including a finger). In this case, the position and amount of movement of the user U's hand can be captured based on the image on which the user's hand is displayed without capturing any device directly on the user's finger by imaging the user's hand using the camera. And the movement and state of the finger of the user U can be detected.

  In the present embodiment, hand objects (left hand object and right hand object) are moved according to the movement of the hands (left hand, right hand) that are part of the user U's body. It is not limited. For example, the foot objects (left foot object and right foot object) may be moved according to the movement of the user U's foot (left foot, right foot) which is a part of the user U's body. A weapon object such as a sword object may be operated by a foot object.

  In this embodiment, the virtual space is used to provide a virtual experience such as VR (Virtual Reality), AR (Arranged Reality), and MR (Mixed Reality) to the user. When the virtual space provides VR, background data stored in the memory is used as the background of the virtual space. When the virtual space provides AR or MR, the real space is used as the background of the virtual space. In this case, the HMD 110 includes a transmissive display device (optical see-through or video see-through display device), so that the real space can be used as the background of the virtual space. If virtual space is applied to MR, the object may be influenced by real space. As described above, when the virtual space includes at least a part of a virtual scene such as a background or a virtual object, the user can be provided with a virtual experience capable of interacting with the virtual scene. When the virtual space is applied to AR or MR, the user's hand may be used instead of the hand object. In this case, the user's left hand is placed in the virtual space 200 instead of the left hand object 400L, and the user's right hand is placed in the virtual space 200 instead of the right hand object 400R. A weapon object such as a sword object may be operated by the left hand or right hand of the user.

1: User terminal 30: Communication network 110: Head mounted device (HMD)
112: Display unit 114: HMD sensor 116: Headphone 118: Microphone 120: Control device 121: Control unit 123: Storage unit 124: I / O interface 125: Communication interface 126: Bus 130, 130a, 130b: Position sensor 140: Gaze Sensor 200: Virtual space 210: Center position 300: Virtual camera 302: Operation button 302a, 302b: Push button 302e, 302f: Trigger button 304: Detection point 320: External controller 320i: Analog stick 320L: External controller for left hand ( controller)
320R: External controller for right hand (controller)
322: Top surface 324: Grip 326: Frame 400L: Left hand object 400R: Right hand object 500: Sword object

Claims (8)

(A) generating virtual space data defining a virtual space including the first object;
(B) updating the visual field image data indicating the visual field image displayed on the head mounted device based on the movement of the head mounted device mounted on the user's head and the virtual space data;
(C) identifying a first area in real space;
(D) identifying a second area corresponding to the first area in the virtual space;
(E) setting an action range or action locus of the first object so as to enable interaction between the user and the first object in the virtual space according to the range of the second area; And an information processing method executed by a processor. The step ( e)
The information processing according to claim 1 , further comprising: setting an action range or an action trajectory of the first object so that an action range or an action trajectory of the first object overlaps at least a part of the second area. Method. (A) generating virtual space data defining a virtual space including the first object;
(B) updating the visual field image data indicating the visual field image displayed on the head mounted device based on the movement of the head mounted device mounted on the user's head and the virtual space data;
(C) identifying a first area in real space;
(D) identifying a second area corresponding to the first area in the virtual space;
(E) setting an action range or action locus of the first object so as to enable interaction between the user and the first object in the virtual space according to the range of the second area; When,
(F) the range of the second area, viewed including the steps of: identifying a working range of the user based on range range of the user,
The step ( e)
An information processing method executed by a processor , comprising: setting an action range or an action locus of the first object so that an action range or an action locus of the first object overlaps at least a part of the action range. (G) further comprising a step of moving an operation object in accordance with a movement of a part of the user's body;
The information processing method according to claim 3 , wherein the range of the user is a range of an action object operated by the operation object. (A) generating virtual space data defining a virtual space including the first object;
(B) updating the visual field image data indicating the visual field image displayed on the head mounted device based on the movement of the head mounted device mounted on the user's head and the virtual space data;
(C) identifying a first area in real space;
(D) identifying a second area corresponding to the first area in the virtual space;
(E) setting an action range or action locus of the first object so as to enable interaction between the user and the first object in the virtual space according to the range of the second area; When,
( F ) moving the operation object in accordance with the movement of a part of the user's body;
( G ) identifying an action object operated by the operation object from a plurality of candidate objects according to the operation of the user;
(H) the extent of the second area, based on the maximum range range of range range of the plurality of candidate objects, seen including the steps of: identifying a maximum working range of the user,
The step ( e)
An information processing method executed by a processor , including the step of setting the action range or action trajectory of the first object so that the action range or action trajectory of the first object overlaps at least a part of the maximum action range. . (A) generating virtual space data defining a virtual space including the first object;
(B) updating the visual field image data indicating the visual field image displayed on the head mounted device based on the movement of the head mounted device mounted on the user's head and the virtual space data;
(C) identifying a first area in real space;
(D) identifying a second area corresponding to the first area in the virtual space;
(E) adjusting the virtual space data to allow interaction between the user and the first object in the virtual space according to a range of the second area;
( F ) moving the operation object in accordance with the movement of a part of the user's body ;
Only including,
The step (e)
Before SL according to the range of the second area, comprising the step of setting a range range of action object being manipulated by the manipulation object, an information processing method performed by a processor. An information processing program for causing a computer to execute the information processing method according to any one of claims 1 to 6 . A processor;
An information processing apparatus comprising a memory for storing computer-readable instructions,
The information processing apparatus that executes the information processing method according to any one of claims 1 to 6 when the computer-readable instruction is executed by the processor.

Images