JP2019083022A - Information processing method and program for causing computer to execute the method - Google Patents

Abstract

To further improve virtual experience of a user.SOLUTION: An information processing method includes the steps of: generating virtual space data for defining a virtual space 200 containing a virtual camera 300, a right hand object 400R, and a button object 600; identifying a visual field of the virtual camera 300 on the basis of a position and an inclination of a HMD 110; displaying a visual field image in the HMD 110 on the basis of the visual field of the virtual camera 300 and the virtual space data; and identifying a position of the right hand object 400R on the basis of a position of a controller 320R. When it is determined that prescribed conditions for determining whether a collision area CA of the right hand object 400R intentionally come into contact with a collision area of the button object 600 are not satisfied, the right hand object 400R does not exert prescribed influences on the button object 600.SELECTED DRAWING: Figure 9

Description

  The present disclosure relates to an information processing method and a program for causing a computer to execute the information processing method.

  Non-Patent Document 1 discloses a VR game in which a virtual object for running a character object (bear character) is created by grasping a block object with a hand object. In this VR game, after the virtual object on which the character object runs is created by the operation of the hand object, the character object starts running on the virtual road when the hand object presses a button object (an example of a target object).

"VR" Fly to KUMA MARKER "Trailer", [online], August 10, 2016, COLOPL CHANNEL, [search December 19, 2016], Internet <1484704159050_0>

  By the way, in the VR game disclosed in Non-Patent Document 1, the hand object unintentionally touches the button object during the operation of the hand object (more specifically, the collision area of the hand object is the button object A situation where the button object is unintentionally pressed by the hand object by unintentionally touching the collision area) is conceivable. In this case, the character object starts running before the virtual path is completed. As described above, when operating the hand object in the virtual space, a situation in which the collision effect between the hand object and the target object is generated unintentionally due to the hand object touching the target object unintentionally Conceivable. Here, the virtual space includes a VR (Virtual Reality) space, an AR (Augmented Reality) space, and an MR (Mixed Reality) space. The collision effect between the hand object and the target object is an effect that defines the influence of the hand object on the target object due to the collision (collision) between the hand object and the target object.

  The present disclosure provides an information processing method capable of further improving a user's experience with a virtual object (hereinafter referred to as “user's virtual experience”) and a program for causing a computer to realize the information processing method. With the goal.

According to one aspect the present disclosure shows, a system comprising a head mount device and a position sensor configured to detect the position of the head mount device and a portion of a body other than the head of the user. An information processing method performed by a computer is provided.
The information processing method is
(A) generating virtual space data defining a virtual space including a virtual camera, an operation object, and a target object;
(B) identifying the field of view of the virtual camera based on the position and tilt of the head mount device;
(C) displaying a view image on the head mounted device based on the view of the virtual camera and the virtual space data;
(D) specifying the position of the operation object based on the position of the body part of the user;
If it is determined that the predetermined condition for determining whether the collision area of the operation object intentionally contacts the collision area of the target object is not satisfied, the operation object exerts a predetermined influence on the target object. I will not give.

  According to the present disclosure, it is possible to provide an information processing method capable of further improving the virtual experience of the user. Further, a program for causing a computer to realize the information processing method can be provided.

1 is a schematic view showing a head mounted device (HMD) system. It is a figure showing a user's head equipped with HMD. It is a figure which shows the hardware constitutions of a control apparatus. It is a figure which shows an example of a concrete structure of an external controller. It is a flowchart which shows the process which displays a visual field image on HMD. It is a xyz space figure which shows an example of virtual space. The state (a) is a yx plan view of the virtual space shown in FIG. The state (b) is a zx plan view of the virtual space shown in FIG. It is a figure which shows an example of the visual field image displayed on HMD. State (a) is a diagram showing a real space in which a user wearing the HMD and the external controller exists. State (b) is a diagram showing a virtual space including a virtual camera, a right hand object, a left hand object, a block object, and a button object. It is a top view of virtual space which shows a mode that the collision area of the right-hand object is contacting the operation part of a button object. It is a flowchart for demonstrating the information processing method which concerns on 1st Embodiment (Hereafter, it is only called 1st Embodiment.) Of this invention. It is a flowchart for demonstrating the information processing method which concerns on the modification of 1st Embodiment. It is a flowchart for demonstrating the information processing method which concerns on 2nd Embodiment of this invention (it is only hereafter called 2nd Embodiment). FIG. 10 is a plan view of a virtual space showing how a right hand object and a button object exist outside the field of view of the virtual camera. It is a flowchart for demonstrating the information processing method which concerns on the modification of 2nd Embodiment. It is a flowchart for demonstrating the information processing method which concerns on 3rd Embodiment (only henceforth 3rd Embodiment) of this invention.

[Description of Embodiments Presented by Present Disclosure]
An outline of an embodiment indicated by the present disclosure will be described.
(1) Information processing performed by a computer in a system comprising a head mount device, and a position sensor configured to detect the position of the head mount device and the position of a part of the body other than the head of the user Method,
(A) generating virtual space data defining a virtual space including a virtual camera, an operation object, and a target object;
(B) identifying the field of view of the virtual camera based on the position and tilt of the head mount device;
(C) displaying a view image on the head mounted device based on the view of the virtual camera and the virtual space data;
(D) specifying the position of the operation object based on the position of the body part of the user;
If it is determined that the predetermined condition for determining whether the collision area of the operation object intentionally contacts the collision area of the target object is not satisfied, the operation object exerts a predetermined influence on the target object. Do not give, information processing method.

  According to the above method, when it is determined that the predetermined condition for determining whether the collision area of the operation object intentionally contacts the collision area of the target object is not satisfied, the operation object is a predetermined target object. Not affect. Thus, when it is determined that the operation object has unintentionally touched the target object, no collision effect occurs between the operation object and the target object. For example, when a hand object (an example of an operation object) touches a button object (an example of a target object) without intention, a situation where the button object is unintentionally pressed by the hand object is avoided. Therefore, it is possible to provide an information processing method capable of further improving the virtual experience of the user.

(2) (e) further comprising the step of identifying an absolute velocity of the head mounted device;
The information processing method according to Item (1), wherein the predetermined condition is that an absolute velocity of the head mount device is equal to or less than a predetermined value.

  According to the above method, when it is determined that the absolute velocity of the head mount device (HMD) is not less than or equal to the predetermined value (that is, the absolute velocity of the HMD is greater than the predetermined value), the operation object is designated as the target object. Not affect. As described above, when the operation object contacts the target object in a state where the absolute velocity of the HMD is larger than a predetermined value, it is determined that the operation object unintentionally contacts the target object, and the operation object and the target object There is no collision effect between

(3) The predetermined condition includes a first condition and a second condition,
The first condition is a condition associated with the head mount device,
The second condition is a condition different from the first condition,
The information processing method according to Item (1) or (2), wherein the operation object does not exert the predetermined influence on the target object when it is determined that the first condition and the second condition are not satisfied.

  According to the above method, when it is determined that the first condition and the second condition for determining whether the collision area of the operation object intentionally contacts the collision area of the target object are not satisfied, the operation object is an object. It does not have a predetermined effect on the object. As described above, it is possible to more reliably determine whether the operation object has unintentionally touched the target object by using two different determination conditions.

(4) (e) further comprising the step of identifying an absolute velocity of the head mounted device;
The first condition is that the absolute velocity of the head mount device is equal to or less than a predetermined value, and
The information processing method according to Item (3), wherein the second condition is that the operation object is present in the field of view of the virtual camera.

  According to the above method, it is determined that the absolute velocity of the head mounted device (HMD) is not less than or equal to the predetermined value (that is, the absolute velocity of the HMD is greater than the predetermined value), and the operation object is within the field of view of the virtual camera. If it is determined that the object does not exist, the operation object does not have a predetermined influence on the target object. As described above, when the operation object contacts the target object in a state where the absolute velocity of the HMD is larger than a predetermined value and the operation object is not in the field of view of the virtual camera, the operation object is unintentionally targeted It is determined that an object has been touched, and no collision effect occurs between the operation object and the target object.

(5) (e) further comprising the step of identifying an absolute velocity of the head mounted device;
The first condition is that the absolute velocity of the head mount device is equal to or less than a predetermined value, and
The information processing method according to Item (3), wherein the second condition is that at least one of the operation object and the target object is present in the field of view of the virtual camera.

  According to the above method, it is determined that the absolute velocity of the head mounted device (HMD) is not less than the predetermined value (that is, the absolute velocity of the HMD is larger than the predetermined value), and both the operation object and the target object are If it is determined that the object does not exist in the field of view of the virtual camera, the operation object does not have a predetermined influence on the target object. As described above, when the operation object contacts the target object in a state where the absolute velocity of the HMD is larger than a predetermined value and both the operation object and the target object do not exist in the field of view of the virtual camera, the operation object is It is determined that the target object is touched unintentionally, and no collision effect occurs between the operation object and the target object.

(6) (e) specifying an absolute velocity of the head mount device;
(F) determining the relative velocity of the portion of the body of the user relative to the head mounted device.
The first condition is that the absolute velocity of the head mount device is equal to or less than a predetermined value, and
The information processing method according to Item (3), wherein the second condition is that the relative velocity is larger than a predetermined value.

  According to the above method, it is determined that the absolute velocity of the head mounted device (HMD) is not less than the predetermined value (that is, the absolute velocity of the HMD is larger than the predetermined value), and a part of the user's body for the HMD If it is determined that the relative velocity of the object is not greater than the predetermined value (that is, the relative velocity of the part of the user's body relative to the HMD is less than or equal to the predetermined value), the operation object has a predetermined effect on the target object. I will not give. As described above, when the operation object contacts the target object in a state where the absolute velocity of the HMD is larger than a predetermined value and the relative velocity of a part of the user's body is equal to or less than the predetermined value, the operation object is It is determined that the target object is touched unintentionally, and no collision effect occurs between the operation object and the target object.

  (7) A program for causing a computer to execute the information processing method according to any one of items (1) to (6).

  According to the above program, the virtual experience of the user can be further improved.

[Details of Embodiment Presented by Present Disclosure]
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In addition, about the member which has the same reference number as the member already demonstrated in description of this embodiment, the description is not repeated for convenience of explanation.

  First, the configuration of a head mounted device (HMD) system 1 will be described with reference to FIG. FIG. 1 is a schematic view showing an HMD system 1. As shown in FIG. 1, the HMD system 1 includes an HMD 110 mounted on the head of the user U, a position sensor 130, an external controller 320, and a control device 120.

  The HMD 110 includes a display unit 112, an HMD sensor 114, and a gaze sensor 140. The display unit 112 includes a non-transmissive display device configured to completely cover the field of view (field of view) of the user U wearing the HMD 110. Accordingly, the user U can immerse in the virtual space by viewing only the view image displayed on the display unit 112. The display unit 112 may be configured of a display unit for the left eye configured to provide an image to the left eye of the user U, and a display unit for the right eye configured to provide an image to the right eye of the user U . The HMD 110 may also include a transmissive display device. In this case, the transmissive display device may be temporarily configured as a non-transmissive display device by adjusting the transmittance thereof.

  The HMD sensor 114 is mounted near the display unit 112 of the HMD 110. The HMD sensor 114 includes at least one of a geomagnetic sensor, an acceleration sensor, and a tilt sensor (such as an angular velocity sensor or a gyro sensor), and can detect various movements of the HMD 110 mounted on the head of the user U.

  The gaze sensor 140 has an eye tracking function of detecting the line of sight of the user U. The gaze sensor 140 may include, for example, a right eye gaze sensor and a left eye gaze sensor. The right eye gaze sensor emits infrared light, for example, to the right eye of the user U, and detects reflected light reflected from the right eye (in particular, the cornea and the iris) to obtain information on the rotation angle of the right eye You may On the other hand, the gaze sensor for the left eye irradiates, for example, infrared light to the left eye of the user U, and detects the reflected light reflected from the left eye (in particular, the cornea and the iris). You may get

  The position sensor 130 is configured by, for example, a position tracking camera, and is configured to detect the position of the HMD 110 and the external controller 320. The position sensor 130 is communicably connected to the control device 120 wirelessly or by wire, and is configured to detect information on the position, inclination or light emission intensity of a plurality of detection points (not shown) provided on the HMD 110. . Furthermore, the position sensor 130 is configured to detect information on the position, the inclination, and / or the light emission intensity of a plurality of detection points 304 (see FIG. 4) (not shown) provided in the external controller 320. The detection point is, for example, a light emitting unit that emits infrared light or visible light. The position sensor 130 may also include an infrared sensor and a plurality of optical cameras.

  The external controller 320 detects the movement of a part of the user U's body (a part other than the head, and in this embodiment, the user U's hand) to detect the movement of the hand object displayed in the virtual space. Used to control the The external controller 320 is an external controller 320R for the right operated by the user U's right hand (hereinafter simply referred to as the controller 320R) and an external controller 320L for the left hand operated by the left hand of the user U (hereinafter referred to simply as the controller 320L). And. The controller 320R is a device that indicates the position of the user U's right hand and the movement of the right hand's finger. Further, the right hand object 400R (see FIG. 9) existing in the virtual space moves in accordance with the movement of the controller 320R. The controller 320L is a device that indicates the position of the user U's left hand and the movement of fingers of the left hand. Further, in accordance with the movement of the controller 320L, the left hand object 400L (see FIG. 9) existing in the virtual space is moved.

  Control device 120 is a computer configured to control HMD 110. The control device 120 specifies the position information of the HMD 110 based on the information acquired from the position sensor 130, and mounts the position of the virtual camera in the virtual space and the HMD 110 in the real space based on the specified position information. It is possible to accurately associate the position of the user U who has made the Furthermore, the control device 120 specifies the operation of the external controller 320 based on the information acquired from the position sensor 130, and the hand object displayed in the virtual space based on the operation of the specified external controller 320. And the operation of the external controller 320 in the real space can be accurately correlated. In particular, the controller 120 specifies the operation of the controller 320L (controller 320R) based on the information acquired from the position sensor 130, and based on the operation of the specified controller 320L (controller 320R), in the virtual space. The operation of the left-hand object 400L (right-hand object 400R) displayed on the and the operation of the controller 320L (controller 320R) in the real space can be accurately correlated.

  Further, the control device 120 identifies the line of sight of the right eye and the line of sight of the right eye of the user U based on the information transmitted from the gaze sensor 140 (the gaze sensor for left eye and the gaze sensor for right eye). A fixation point that is an intersection of the left eye's line of sight can be identified. Furthermore, the control device 120 can specify the line of sight of the user U (the line of sight of the user U) based on the specified fixation point. Here, the line of sight of the user U is the line of sight of the user U, and coincides with the direction of a straight line passing through the midpoint of the line connecting the right eye and the left eye of the user U and the gaze point.

  Next, with reference to FIG. 2, a method of acquiring information on the position and tilt of the HMD 110 will be described. FIG. 2 is a view showing the head of the user U wearing the HMD 110. As shown in FIG. Information on the position and tilt of the HMD 110 interlocked with the movement of the head of the user U wearing the HMD 110 can be detected by the position sensor 130 and / or the HMD sensor 114 mounted on the HMD 110. As shown in FIG. 2, three-dimensional coordinates (uvw coordinates) are defined around the head of the user U wearing the HMD 110. A vertical direction in which the user U stands is defined as a v-axis, a direction perpendicular to the v-axis and passing through the center of the HMD 110 as a w-axis, and a direction orthogonal to the v-axis and the w-axis as a u-axis. The position sensor 130 and / or the HMD sensor 114 is an angle about each uvw axis (ie, a yaw angle indicating rotation about the v axis, a pitch angle indicating rotation about the u axis, or w axis). The tilt determined by the roll angle indicating rotation is detected. The control device 120 determines angle information for controlling the visual axis of the virtual camera based on the detected angle change around each uvw axis.

  Next, the hardware configuration of the control device 120 will be described with reference to FIG. FIG. 3 is a diagram showing a hardware configuration of the control device 120. As shown in FIG. As shown in FIG. 3, the control device 120 includes a control unit 121, a storage unit 123, an I / O (input / output) interface 124, a communication interface 125, and a bus 126. The control unit 121, the storage unit 123, the I / O interface 124, and the communication interface 125 are communicably connected to one another via a bus 126.

  The control device 120 may be configured as a personal computer, a tablet or a wearable device separately from the HMD 110, or may be built in the HMD 110. Moreover, while the one part function of the control apparatus 120 is mounted in HMD110, the remaining function of the control apparatus 120 may be mounted in another apparatus separate from HMD110.

  The control unit 121 includes a memory and a processor. The memory is configured of, for example, a ROM (Read Only Memory) storing various programs and the like, and a RAM (Random Access Memory) having a plurality of work areas storing various programs and the like executed by the processor. The processor is, for example, a central processing unit (CPU), a micro processing unit (MPU) and / or a graphics processing unit (GPU), and develops a program specified from various programs incorporated in the ROM on the RAM. The system is configured to execute various processes in cooperation with the

  In particular, the control unit 121 develops a program (described later) for causing the computer to execute the information processing method according to the present embodiment on the RAM and executes the program in cooperation with the RAM. Various operations of the control device 120 may be controlled. The control unit 121 displays a virtual space (view image) on the display unit 112 of the HMD 110 by executing a predetermined application program (game program) stored in the memory or the storage unit 123. Thus, the user U can immerse in the virtual space displayed on the display unit 112.

  The storage unit (storage) 123 is, for example, a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a USB flash memory, and is configured to store programs and various data. The storage unit 123 may store a program that causes a computer to execute the information processing method according to the present embodiment. In addition, an authentication program of the user U, a game program including data regarding various images and objects, and the like may be stored. Furthermore, in the storage unit 123, a database including a table for managing various data may be constructed.

  The I / O interface 124 is configured to communicably connect the position sensor 130, the HMD 110, and the external controller 320 to the control device 120. For example, a USB (Universal Serial Bus) terminal, DVI (Digital) It comprises a Visual Interface) terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) terminal and the like. The control device 120 may be wirelessly connected to each of the position sensor 130, the HMD 110, and the external controller 320.

  The communication interface 125 is configured to connect the control device 120 to a communication network 3 such as a Local Area Network (LAN), a Wide Area Network (WAN), or the Internet. The communication interface 125 includes various wired connection terminals for communicating with an external device on the network via the communication network 3 and various processing circuits for wireless connection, and for communicating via the communication network 3. It is configured to conform to the communication standard.

  Next, an example of a specific configuration of the external controller 320 will be described with reference to FIG. The controller 320R and the controller 320L have substantially the same configuration, so only the specific configuration of the controller 320R will be described below with reference to FIG. In the following description, the controllers 320L and 320R may be simply referred to as the external controller 320 for convenience.

  As shown in FIG. 4, the controller 320R includes an operation button 302, a plurality of sensing points 304, a sensor (not shown), and a transceiver (not shown). Only one of the detection point 304 and the sensor may be provided. The operation button 302 is configured of a plurality of button groups configured to receive an operation input from the user U. The operation button 302 includes a push button, a trigger button, and an analog stick. The push-type button is a button operated by an operation of pressing with the thumb. For example, on the top surface 322, two push-type buttons 302a and 302b are provided. The trigger button is a button operated by an operation such as pulling a trigger with the index finger or the middle finger. For example, the front portion of the grip 324 is provided with a trigger button 302e, and the side portion of the grip 324 is provided with a trigger button 302f. The trigger buttons 302e and 302f are operated by the index finger and the middle finger, respectively. The analog stick is a stick-type button that can be operated by tilting it in any direction 360 degrees from a predetermined neutral position. For example, an analog stick 320i is provided on the top surface 322, and is operated using a thumb.

  The controller 320R includes a frame 326 extending from both sides of the grip 324 in the direction opposite to the top surface 322 to form a semicircular ring. A plurality of sensing points 304 are embedded in the outer surface of the frame 326. The plurality of detection points 304 are, for example, a plurality of infrared LEDs aligned in a row along the circumferential direction of the frame 326. After the position sensor 130 detects information on the positions, inclinations, or light emission intensities of the plurality of detection points 304, the control device 120 detects the position or attitude of the controller 320R based on the information detected by the position sensor 130. Get information on

  The sensor of the controller 320R may be, for example, either a magnetic sensor, an angular velocity sensor, or an acceleration sensor, or a combination thereof. When the user U moves the controller 320R, the sensor outputs a signal (for example, a signal indicating information on magnetism, angular velocity, or acceleration) according to the direction or position of the controller 320R. The control device 120 acquires information on the position and orientation of the controller 320R based on the signal output from the sensor.

  The transceivers of controller 320R are configured to transmit and receive data between controller 320R and controller 120. For example, the transceiver may transmit an operation signal corresponding to the operation input of the user U to the controller 120. The transceiver may also receive an instruction signal from the controller 120 instructing the controller 320R to emit light at the detection point 304. Additionally, the transceiver may transmit a signal to controller 120 indicating the value detected by the sensor.

  Next, processing for displaying a view image on the HMD 110 will be described with reference to FIGS. 5 to 8. FIG. 5 is a flowchart showing a process of displaying a view image on the HMD 110. FIG. 6 is an xyz space diagram showing an example of the virtual space 200. The state (a) of FIG. 7 is a yx plan view of the virtual space 200 shown in FIG. The state (b) of FIG. 7 is a zx plan view of the virtual space 200 shown in FIG. FIG. 8 is a view showing an example of the view image M displayed on the HMD 110. As shown in FIG.

  As shown in FIG. 5, in step S1, the control unit 121 (see FIG. 3) generates virtual space data indicating a virtual space 200 including the virtual camera 300 and various objects. As shown in FIG. 6, the virtual space 200 is defined as an omnidirectional sphere centered on the center position 21 (in FIG. 6, only the upper half celestial sphere is illustrated). Moreover, in the virtual space 200, an xyz coordinate system having the center position 21 as an origin is set. The virtual camera 300 defines a viewing axis L for specifying a view image V (see FIG. 8) displayed on the HMD 110. The uvw coordinate system defining the field of view of the virtual camera 300 is determined to interlock with the uvw coordinate system defined around the head of the user U in the real space. In addition, the control unit 121 may move the virtual camera 300 in the virtual space 200 according to the movement of the user U wearing the HMD 110 in the real space. The virtual space 200 also includes, for example, a left hand object 400L, a right hand object 400R, a block object 500, and a button object 600 (see FIG. 9).

  Next, in step S2, the control unit 121 specifies the field of view CV (see FIG. 7) of the virtual camera 300. Specifically, the control unit 121 acquires data indicating the state of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114, and then relates to the position and the inclination of the HMD 110 based on the acquired data. Get information. Next, the control unit 121 specifies the position and the orientation of the virtual camera 300 in the virtual space 200 based on the information on the position and the inclination of the HMD 110. Next, the control unit 121 determines the visual axis L of the virtual camera 300 from the position and the orientation of the virtual camera 300, and identifies the visual field CV of the virtual camera 300 from the determined visual axis L. Here, the visual field CV of the virtual camera 300 corresponds to a partial area of the virtual space 200 that can be viewed by the user U wearing the HMD 110. In other words, the visual field CV corresponds to a partial area of the virtual space 200 displayed on the HMD 110. Further, in the xy plane shown in the state (a) of FIG. 7, the visual field CV is a first region CVa set as an angle range of the polar angle α centering on the visual axis L, and the state (b) in FIG. In the xz plane shown, there is a second region CVb set as an angular range of the azimuth angle β centered on the visual axis L. The control unit 121 specifies the line-of-sight direction of the user U based on the data indicating the line-of-sight direction of the user U transmitted from the gaze sensor 140 and determines the direction of the virtual camera 300 based on the line-of-sight direction of the user U You may

  Thus, the control unit 121 can specify the field of view CV of the virtual camera 300 based on the data from the position sensor 130 and / or the HMD sensor 114. Here, when the user U wearing the HMD 110 moves, the control unit 121 changes the visual field CV of the virtual camera 300 based on the data indicating the movement of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114. be able to. That is, the control unit 121 can change the visual field CV according to the movement of the HMD 110. Similarly, when the gaze direction of the user U changes, the control unit 121 can move the field of view CV of the virtual camera 300 based on the data indicating the gaze direction of the user U transmitted from the gaze sensor 140. That is, the control unit 121 can change the visual field CV in accordance with the change in the line-of-sight direction of the user U.

  Next, in step S3, the control unit 121 generates view image data indicating the view image V displayed on the display unit 112 of the HMD 110. Specifically, the control unit 121 generates view image data based on virtual space data defining the virtual space 200 and the view CV of the virtual camera 300.

  Next, in step S4, the control unit 121 displays the view image V on the display unit 112 of the HMD 110 based on the view image data (see FIG. 7). Thus, according to the movement of the user U wearing the HMD 110, the visual field CV of the virtual camera 300 is updated, and the visual field image V displayed on the display unit 112 of the HMD 110 is updated. The space 200 can be immersed.

  The virtual camera 300 may include a left-eye virtual camera and a right-eye virtual camera. In this case, the control unit 121 generates left-eye view image data indicating a left-eye view image based on the virtual space data and the view of the left-eye virtual camera. Further, the control unit 121 generates right-eye view image data indicating a right-eye view image based on the virtual space data and the view of the right-eye virtual camera. Thereafter, the control unit 121 displays the left-eye view image on the left-eye display unit based on the left-eye view image data, and the right-eye view image on the right-eye display unit based on the right-eye view image data. Display In this manner, the user U can visually recognize the view image three-dimensionally by the parallax between the left-eye view image and the right-eye view image.

  Further, the processing of steps S1 to S4 shown in FIG. 5 may be executed for each frame (still images constituting a moving image). For example, when the frame rate of a moving image is 90 fps, the processes of steps S1 to S4 may be repeatedly performed at an interval of ΔT = 1/90 (seconds). As described above, since the processes of steps S1 to S4 are repeatedly executed at predetermined intervals, the visual field V of the virtual camera 300 is updated according to the operation of the HMD 110, and the visual field image V displayed on the display unit 112 of the HMD 110. Is updated.

  Next, a left hand object 400L (an example of an operation object), a right hand object 400R (an example of an operation object), a block object 500 (a virtual object), and a button object 600 (an example of a target object which is a virtual object) included in the virtual space 200 Will be described with reference to FIG. The state (a) of FIG. 9 is a figure which shows the user U who mounted HMD110 and controller 320L, 320R. State (b) of FIG. 9 is a diagram showing a virtual space 200 including a virtual camera 300, a left hand object 400L, a right hand object 400R, a block object 500, and a button object 600.

  As described above, the virtual space 200 includes the virtual camera 300, the left hand object 400L, the right hand object 400R, the block object 500, and the button object 600. The control unit 121 generates virtual space data that defines a virtual space 200 including these objects. Further, the control unit 121 may update virtual space data for each frame. As described above, the virtual camera 300 interlocks with the movement of the HMD 110 worn by the user U. That is, the field of view of the virtual camera 300 is updated according to the movement of the HMD 110.

  The left hand object 400L interlocks with the movement of the controller 320L attached to the left hand of the user U. Similarly, the right hand object 400R interlocks with the movement of the controller 320R attached to the right hand of the user U. In the following, for convenience of explanation, the left hand object 400L and the right hand object 400R may be simply referred to as a hand object 400.

  Also, when the user U operates the operation button 302 of the external controller 320, it becomes possible to operate each finger of the hand object 400. That is, the control unit 121 acquires the operation signal corresponding to the input operation on the operation button 302 from the external controller 320, and then controls the operation of the finger of the hand object 400 based on the operation signal. For example, when the user U operates the operation button 302, the hand object 400 can grasp the block object 500. Furthermore, with the hand object 400 gripping the block object 500, it is possible to move the hand object 400 and the block object 500 in accordance with the movement of the controller 320. Thus, the control unit 121 is configured to control the operation of the hand object 400 in accordance with the movement of the finger of the user U.

  The left hand object 400L and the right hand object 400R each have a collision area CA. The collision area CA is used for collision determination (collision determination) between the hand object 400 and a virtual object (for example, the block object 500 or the button object 600). When the collision area CA of the hand object 400 and the collision area of the block object 500 (button object 600) contact, a predetermined influence (collision effect) is given to the block object 500 (button object 600).

  For example, when the collision area CA of the hand object 400 and the collision area of the block object 500 are in contact with each other, predetermined damage can be given to the block object 500. Further, the hand object 400 and the block object 500 can be moved integrally while the hand object 400 holds the block object 500.

  As shown in FIG. 9, the collision area CA may be defined by, for example, a sphere having a diameter R centered on the center position of the hand object 400. In the following description, it is assumed that the collision area CA of the hand object 400 is formed in a spherical shape with a diameter R centered on the center position of the hand object 400.

  Block object 500 is a virtual object affected by hand object 400. The block object 500 also has a collision area, and in the present embodiment, it is assumed that the collision area of the block object 500 matches the area (outline area of the block object 500) that constitutes the block object 500.

  The button object 600 is a virtual object influenced by the hand object 400, and has an operation unit 620. The button object 600 also has a collision area, and in the present embodiment, the collision area of the button object 600 is assumed to coincide with the area constituting the button object 600 (the outer area of the button object 600). In particular, the collision area of the operation unit 620 is assumed to coincide with the outer shape area of the operation unit 620.

  When the operation unit 620 of the button object 600 is pressed by the hand object 400, a predetermined object (not shown) disposed in the virtual space 200 has a predetermined influence. Specifically, when the collision area CA of the hand object 400 and the collision area of the operation unit 620 come into contact with each other, the operation unit 620 is pressed by the hand object 400 as a collision effect. Then, when the operation unit 620 is pressed, predetermined effects are given to predetermined objects arranged in the virtual space 200. For example, when the operation unit 620 is pressed by the hand object 400, an object (character object) existing in the virtual space 200 may move.

First Embodiment
Next, an information processing method according to the first embodiment will be described with reference to FIGS. 9 to 11. FIG. 10 is a plan view of the virtual space 200 showing how the collision area CA of the right-hand object 400R is in contact with the operation unit 620 of the button object 600. FIG. 11 is a flowchart for explaining the information processing method according to the first embodiment. In the flowchart shown in FIG. 11, the process of determining whether or not the collision area CA of the right hand object 400R intentionally contacts the collision area of the operation unit 620 (determination process defined in step S13) is the right hand object 400R and the operation unit It is executed before the collision determination with 620 (the process defined in step S14).

  Further, in the description of the present embodiment, for convenience of description, it is referred to whether the right hand object 400R exerts a predetermined influence on the operation unit 620 of the button object 600, while the left hand object 400L is predetermined in the operation unit 620 of the button object 600. It does not mention whether it affects or not. Therefore, in FIG. 10, the illustration of the left hand object 400L is omitted. Further, the control unit 121 may repeatedly execute each process shown in FIGS. 10 and 12 for each frame. The control unit 121 may repeatedly execute each process illustrated in FIG. 10 at predetermined time intervals.

  As shown in FIG. 11, in step S <b> 10, the control unit 121 specifies the absolute velocity V (see FIG. 9) of the HMD 110. Here, the absolute velocity V refers to the velocity of the HMD 110 with respect to the position sensor 130 fixedly installed at a predetermined place in the real space. Further, since the user U wears the HMD 110, the absolute velocity of the HMD 110 corresponds to the absolute velocity of the user U. That is, in the present embodiment, the absolute velocity of the HMD 110 is identified to identify the absolute velocity of the user U. As shown in FIG. 10, when the HMD 110 moves in the real space, the virtual camera 300 also moves in the virtual space 200.

Specifically, the control unit 121 acquires the position information of the HMD 110 based on the data acquired by the position sensor 130, and specifies the absolute velocity V of the HMD 110 based on the acquired position information. For example, the position of the HMD 110 in the n-th (n is an integer of 1 or more) frame is P _n , the position of the HMD 110 in the (n + 1) -th frame is P _{n + 1,} and the time interval between each frame is ΔT Then, the absolute velocity V _n of the HMD 110 in the nth frame is V _n = | P _{n + 1} −P _n | / ΔT. Here, when the frame rate of the moving image is 90 fps, the time interval ΔT is 1/90. Further, the position P of the HMD 110 is a position vector that can be displayed in a three-dimensional coordinate system. Thus, the control unit 121 acquires the position Pn of the HMD 110 in the nth frame and the position Pn + 1 of the HMD 110 in the (n + 1) th frame, and then sets the position vectors Pn and Pn + 1 and the time interval ΔT. Based on this, it is possible to specify the absolute velocity Vn at the n-th frame.

The control unit 121 may specify the absolute velocity V of the HMD 110 in the w-axis direction, or may specify the absolute velocity V of the HMD 110 in a predetermined direction other than the w-axis direction. Eg, n-th (n is an integer of 1 or more) the position of the w-axis direction position _{P n} of HMD110 when the frame with _{w n,} (n + 1) th position _{P n + 1} of the w-axis of HMD110 when the frame Assuming that the position in the direction is w _{n + 1} and the time interval between the frames is ΔT, the absolute velocity V _n of the HMD 110 in the w-axis direction at the n-th frame is V _n = (w _{n + 1} −w _n ) / It becomes ΔT.

  Next, in step S11, the control unit 121 specifies the field of view CV of the virtual camera 300. Specifically, the control unit 121 specifies the position and the inclination of the HMD 110 based on the data from the position sensor 130 and / or the HMD sensor 114, and then determines the virtual camera 300 based on the position and the inclination of the HMD 110. Identify the field of view CV. Thereafter, the control unit 121 specifies the position of the right hand object 400R (step S12). Specifically, the control unit 121 specifies the position of the controller 320R in the real space based on the data from the position sensor 130 and / or the sensor of the controller 320R, and then based on the position of the controller 320R in the real space. The position of the right hand object 400R is specified.

  Next, the control unit 121 determines whether the absolute velocity V of the HMD 110 is equal to or less than a predetermined value Vth (V ≦ Vth) (step S13). Here, the predetermined value Vth (Vth ≧ 0) may be appropriately set according to the content of the content such as a game. In addition, whether the collision area CA of the right-hand object 400R (operation object) intentionally contacts the collision area of the operation unit 620 of the button object 600 (target object) as the determination condition (V ≦ Vth) defined in step S13. It corresponds to the determination condition (first condition) for determining whether or not.

  If the control unit 121 determines that the determination condition defined in step S13 is not satisfied (that is, if it is determined that the absolute velocity V is larger than the predetermined value Vth) (NO in step S13), steps S14 and S15. Do not execute the processing specified in. That is, since the control unit 121 does not perform the collision determination process defined in step S14 and the process for generating the collision effect defined in step S15, the right hand object 400R exerts a predetermined influence on the operation unit 620 of the button object 600. Absent.

  On the other hand, when control unit 121 determines that the determination condition defined in step S13 is satisfied (that is, when it is determined that absolute velocity V is equal to or less than predetermined value Vth) (YES in step S13), the button object It is determined whether the collision area of the operation unit 620 of 600 is in contact with the collision area CA of the right-hand object 400R (step S14). In particular, based on the position of the right hand object 400R and the position of the operation unit 620 of the button object 600, the control unit 121 determines whether the collision area of the operation unit 620 is in contact with the collision area CA of the right hand object 400R. If the determination result in step S14 is YES, the control unit 121 exerts a predetermined influence on the operation unit 620 in contact with the collision area CA of the right hand object 400R (step S14). For example, as a collision effect between the right hand object 400R and the operation unit 620, the control unit 121 may determine that the operation unit 620 is pressed by the right hand object 400R. As a result, a predetermined object (not shown) placed in the virtual space 200 may be given a predetermined influence. Furthermore, as a collision effect between the right-hand object 400R and the operation unit 620, the contact surface 620a of the operation unit 620 may move in the + X direction. On the other hand, when the determination result of step S14 is NO, the collision effect between the right hand object 400R and the operation unit 620 is not generated.

  According to the present embodiment, the absolute velocity V of the HMD 110 is less than or equal to the predetermined value Vth as a determination condition for determining whether the collision area CA of the right hand object 400R intentionally contacts the collision area of the operation unit 620. It is determined whether there is any. When it is determined that the absolute velocity V is larger than the predetermined value Vth (when it is determined that the determination condition of step S13 is not satisfied), the processes defined in steps S14 and S15 are not performed. As described above, when the right hand object 400R contacts the operation unit 620 in the state where the absolute velocity V of the HMD 110 is larger than the predetermined value Vth, it is determined that the right hand object 400R unintentionally contacts the operation unit 620. Therefore, collision determination between the right-hand object 400R and the operation unit 620 is not performed, and no collision effect between the right-hand object 400R and the operation unit 620 occurs.

  Therefore, when the right hand object 400R unintentionally contacts the operation unit 620, a situation in which the operation unit 620 is unintentionally pressed by the right hand object 400R is avoided. In this way, the virtual experience of the user can be further improved.

  Next, an information processing method according to a modification of the first embodiment will be described with reference to FIG. FIG. 12 is a flowchart for explaining the information processing method according to the modification of the first embodiment. In the flowchart shown in FIG. 12, the process of determining whether the collision area CA of the right hand object 400R intentionally contacts the collision area of the operation unit 620 (determination process defined in step S24) is the right hand object 400R and the operation unit It is executed after the collision determination with 620 (the process defined in step S23). In this point, the information processing method shown in FIG. 12 is different from the information processing method shown in FIG. In the following, only differences from the information processing method shown in FIG. 11 will be described.

  As shown in FIG. 12, after the control unit 121 executes the processes defined in steps S20 to S22, whether or not the collision area of the operation unit 620 of the button object 600 is in contact with the collision area CA of the right hand object 400R. Is determined (step S23). The process of steps S20 to S22 corresponds to the process of steps S10 to S12 shown in FIG.

  If the determination result in step S23 is NO, the collision area of the operation unit 620 does not contact the collision area CA of the right hand object 400R, and thus the process ends. On the other hand, when the determination result in step S23 is YES (when it is determined that the collision area of the operation unit 620 is in contact with the collision area CA of the right hand object 400R), the control unit 121 determines that the absolute velocity V of the HMD 110 is It is determined whether it is equal to or less than a predetermined value Vth (step S24).

  If the control unit 121 determines that the absolute velocity V is larger than the predetermined value Vth (NO in step S24), the process ends without executing the process defined in step S25. On the other hand, when the control unit 121 determines that the absolute velocity V is equal to or less than the predetermined value Vth (YES in step S24), the control unit 121 exerts a predetermined influence on the operation unit 620 in contact with the collision area CA of the right hand object 400R (collision Effect) is given (step S25).

  As described above, when it is determined that the absolute velocity V is larger than the predetermined value Vth (when it is determined that the determination condition of step S24 is not satisfied), the process defined in step S25 is not performed. As described above, when the right hand object 400R contacts the operation unit 620 in the state where the absolute velocity V of the HMD 110 is larger than the predetermined value Vth, it is determined that the right hand object 400R unintentionally contacts the operation unit 620. Therefore, no collision effect occurs between the right-hand object 400R and the operation unit 620. In this point, in the information processing method according to the present modification, although the collision determination between the right hand object 400R and the operation unit 620 is performed, the right hand object 400R and the operation unit are determined when the determination result in step S24 is NO. There is no collision effect between the two.

  Therefore, when the right hand object 400R unintentionally contacts the operation unit 620, a situation in which the operation unit 620 is unintentionally pressed by the right hand object 400R is avoided. In this way, the virtual experience of the user can be further improved.

Second Embodiment
Next, an information processing method according to the second embodiment will be described with reference to FIGS. 13 and 14. FIG. 13 is a flowchart for explaining the information processing method according to the second embodiment. FIG. 14 is a plan view of a virtual space 200 showing that the right hand object 400R and the button object 600 exist outside the field of view CV of the virtual camera 300. As shown in FIG. 13, the information processing method according to the second embodiment is different from the information processing method according to the first embodiment (see FIG. 11) in that the information processing method according to the second embodiment further includes the steps defined in step S34. In the following, items already described in the first embodiment will not be described repeatedly.

  As shown in FIG. 13, after performing the processes defined in steps S30 to S32, the control unit 121 determines whether the absolute velocity V of the HMD 110 is equal to or less than a predetermined value Vth (step S33). The processes of steps S30 to S32 correspond to the processes of steps S10 to S12 shown in FIG.

  If the determination result in step S33 is YES, the control unit 121 determines whether the collision area of the operation unit 620 of the button object 600 is in contact with the collision area CA of the right hand object 400R (step S35). On the other hand, if the determination result in step S33 is NO, the control unit 121 determines whether the right hand object 400R exists in the field of view CV of the virtual camera 300 based on the field of view CV of the virtual camera 300 and the position of the right hand object 400R. It determines (step S34). As shown in FIG. 14, when the right hand object 400R exists outside the field of view CV of the virtual camera 300, the control unit 121 determines that the determination condition (second condition) defined in step S34 is not satisfied, and step S35. The present process is terminated without executing the process of S36. That is, since the control unit 121 does not execute the collision determination process defined in step S35 and the process for generating the collision effect defined in step S36, the right hand object 400R exerts a predetermined influence on the operation unit 620 of the button object 600. I will not give. Here, the determination condition defined in step S34 corresponds to the determination condition (second condition) for determining whether or not the collision area CA of the right-hand object 400R intentionally contacts the collision area of the operation unit 620. .

  On the other hand, when the control unit 121 determines that the determination condition defined in step S34 is satisfied (that is, when it is determined that the right hand object 400R exists in the field of view CV of the virtual camera 300) (YES in step S34) The determination process (collision determination process) of step S35 is executed. If the determination result in step S35 is YES, the control unit 121 exerts a predetermined influence on the operation unit 620 in contact with the collision area CA of the right hand object 400R (step S36). On the other hand, when the determination result of step S35 is NO, this process is complete | finished without performing the process of step S36.

  According to the present embodiment, the absolute velocity V of the HMD 110 is less than or equal to the predetermined value Vth as a determination condition for determining whether the collision area CA of the right hand object 400R intentionally contacts the collision area of the operation unit 620. It is determined whether there is any (step S33), and it is determined whether the right hand object 400R exists in the field of view CV of the virtual camera 300 (step S34). Furthermore, when it is determined that the determination condition of step S33 and the determination condition of step S34 are not satisfied, the right hand object 400R does not exert a predetermined influence on the operation unit 620. As described above, it is possible to more reliably determine whether the right-hand object 400R has unintentionally touched the operation unit 620 by using two different determination conditions. In particular, when the right hand object 400R contacts the operation unit 620 in a state where the absolute velocity V of the HMD 110 is larger than the predetermined value Vth and the right hand object 400R does not exist in the field of view CV, the right hand object 400R is intended. It is determined that the user has touched the operation unit 620 without causing a collision effect between the right-hand object 400R and the operation unit 620. Therefore, when the right hand object 400R unintentionally contacts the operation unit 620, a situation in which the operation unit 620 is unintentionally pressed by the right hand object 400R is avoided. In this way, the virtual experience of the user can be further improved.

  In the present embodiment, in step S34, the control unit 121 determines whether the right hand object 400R exists in the field of view CV. Instead, the control unit 121 may determine whether at least one of the right hand object 400R and the button object 600 is present in the field of view CV. In this case, when the absolute velocity V of the HMD 110 is larger than the predetermined value Vth and both the right hand object 400R and the button object 600 do not exist in the field of view CV, the right hand object 400R contacts the operation unit 620. It is determined that the right hand object 400R is unintentionally touched to the operation unit 620, and no collision effect between the right hand object 400R and the operation unit 620 occurs.

  Next, an information processing method according to a modification of the second embodiment will be described with reference to FIG. FIG. 15 is a flowchart for explaining an information processing method according to a modification of the second embodiment. In the flowchart shown in FIG. 15, the process of determining whether or not the collision area CA of the right hand object 400R intentionally contacts the collision area of the operation unit 620 (determination process defined in steps S44 and S45) It is executed after the collision determination with the operation unit 620 (the process defined in step S43). In this point, the information processing method shown in FIG. 15 is different from the information processing method shown in FIG. In the following, only differences from the information processing method shown in FIG. 13 will be described.

  As shown in FIG. 15, after the control unit 121 executes the processes defined in steps S40 to S42, it is determined whether the collision area of the operation unit 620 of the button object 600 is in contact with the collision area CA of the right hand object 400R. Is determined (step S43).

  If the determination result in step S43 is NO, the collision area of the operation unit 620 is not in contact with the collision area CA of the right hand object 400R, and thus the process ends. On the other hand, when the determination result in step S43 is YES (when it is determined that the collision area of the operation unit 620 is in contact with the collision area CA of the right hand object 400R), the control unit 121 determines that the absolute velocity V of the HMD 110 is It is determined whether it is equal to or less than a predetermined value Vth (step S44).

  If the control unit 121 determines that the absolute velocity V is larger than the predetermined value Vth (NO in step S44), the control unit 121 executes the determination process defined in step S45. On the other hand, when the control unit 121 determines that the absolute velocity V is equal to or less than the predetermined value Vth (YES in step S44), the control unit 121 exerts a predetermined influence on the operation unit 620 in contact with the collision area CA of the right hand object 400R (collision Effect) is given (step S46).

  When the control unit 121 determines that the right hand object 400R is present in the field of view CV of the virtual camera 300 (YES in step S45), the control unit 121 exerts a predetermined influence (collision on the operation unit 620 in contact with the collision area CA of the right hand object 400R. Effect) is given (step S46). On the other hand, when the determination result of step S45 is NO, this process is complete | finished without performing the process of step S46.

  In the information processing method according to the present modification, although the collision determination between the right-hand object 400R and the operation unit 620 is performed, it is determined that the determination condition of step S44 and the determination condition of step S45 are not satisfied. No collision effect occurs between the right hand object 400R and the operation unit 620.

  Therefore, when the right hand object 400R unintentionally contacts the operation unit 620, a situation in which the operation unit 620 is unintentionally pressed by the right hand object 400R is avoided. In this way, the virtual experience of the user can be further improved.

Third Embodiment
Next, an information processing method according to the third embodiment will be described with reference to FIG. FIG. 16 is a flowchart for explaining the information processing method according to the third embodiment. As shown in FIG. 16, the information processing method according to the third embodiment is different from the information processing method according to the first embodiment (see FIG. 11) in that the information processing method according to the third embodiment further includes steps defined in steps S51 and S55. In the following, items already described in the first embodiment will not be described repeatedly.

As shown in FIG. 16, after executing the process defined in step S50, the control unit 121 specifies the relative velocity v (see FIG. 9) of the controller 320R (right hand of the user U) with respect to the HMD 110 (step S51). . For example, as described above, the position of the HMD 110 in the n-th (n is an integer of 1 or more) frame is P _n , the position of the HMD 110 in the (n + 1) -th frame is P _{n + 1} The absolute velocity V _n of the HMD 110 in the n-th frame is V _n = | P _{n + 1} −P _n | / ΔT, where ΔT is a time interval of ΔT. Further, assuming that the position of the controller 320R in the nth frame is P ′ _n , the position of the controller 320R in the (n + 1) th frame is P ′ _{n + 1,} and the time interval between each frame is ΔT The absolute velocity V ' _n of the controller 320R at the n-th frame is V' _n = | P ' _{n + 1} -P' _n | / ΔT. Thus, the relative velocity vn of the controller 320R with respect to the HMD 110 at the nth frame is vn = V'n-Vn. As described above, the control unit 121 can specify the relative velocity v n at the n-th frame based on the absolute velocity V n of the HMD 110 at the n-th frame and the absolute velocity V ′ n of the controller 320R. . The control unit 121 may specify the relative velocity v in the w-axis direction, or may specify the relative velocity v in a predetermined direction other than the w-axis direction.

  Next, after executing the processes defined in steps S52 and S53, the control unit 121 determines whether the absolute velocity V of the HMD 110 is less than or equal to a predetermined value Vth (step S54).

  If the determination result in step S54 is YES, the control unit 121 determines whether the collision area of the operation unit 620 of the button object 600 is in contact with the collision area CA of the right hand object 400R (step S56). On the other hand, when the determination result in step S54 is NO, the control unit 121 determines whether the relative velocity v of the controller 320R with respect to the HMD 110 is larger than a predetermined value vth (step S55). Here, the predetermined value vth (vth ≧ 0) can be appropriately set according to the content of the content such as a game. When the determination result of step S55 is NO, this process is complete | finished without performing the process of step S56 and S57. That is, since the control unit 121 does not execute the collision determination process defined in step S56 and the process for generating the collision effect defined in step S57, the right hand object 400R exerts a predetermined influence on the operation unit 620 of the button object 600. I will not give. Here, the determination condition defined in step S55 corresponds to the determination condition (second condition) for determining whether or not the collision area CA of the right-hand object 400R intentionally contacts the collision area of the operation unit 620. .

  On the other hand, when the control unit 121 determines that the determination condition defined in step S55 is satisfied (that is, when it is determined that the relative velocity v is larger than the predetermined value vth) (YES in step S55), step S56. The determination process (collision determination process) is executed. If the determination result in step S56 is YES, the control unit 121 exerts a predetermined influence on the operation unit 620 in contact with the collision area CA of the right hand object 400R (step S57). On the other hand, when the determination result of step S56 is NO, this process is complete | finished without performing the process of step S57.

  According to the present embodiment, the absolute velocity V of the HMD 110 is less than or equal to the predetermined value Vth as a determination condition for determining whether the collision area CA of the right hand object 400R intentionally contacts the collision area of the operation unit 620. It is determined whether there is any (step S54), and it is determined whether the relative velocity v of the controller 320R with respect to the HMD 110 is larger than vth (step S55). Furthermore, when it is determined that the determination condition of step S54 and the determination condition of step S55 are not satisfied, the right hand object 400R does not exert a predetermined influence on the operation unit 620. As described above, it is possible to more reliably determine whether the right-hand object 400R has unintentionally touched the operation unit 620 by using two different determination conditions. In particular, when the right hand object 400 contacts the operation unit 620 in a state where the absolute velocity V of the HMD 110 is larger than the predetermined value Vth and the relative velocity v of the controller 320R to the HMD 110 is equal to or less than the predetermined value vth, It is determined that the right hand object 400R is unintentionally touched to the operation unit 620, and no collision effect between the right hand object 400R and the operation unit 620 occurs. Therefore, when the right hand object 400R unintentionally contacts the operation unit 620, a situation in which the operation unit 620 is unintentionally pressed by the right hand object 400R is avoided. In this way, the virtual experience of the user can be further improved.

  An information processing program for causing a computer (processor) to execute the information processing method according to the present embodiment is incorporated in advance in the storage unit 123 or the ROM in order to realize various processes executed by the control unit 121 by software. It is also good. Alternatively, the information processing program may be a magnetic disk (HDD, floppy disk), an optical disk (CD-ROM, DVD-ROM, Blu-ray disk, etc.), a magneto-optical disk (MO etc.), a flash memory (SD card, USB memory, etc.) It may be stored in a computer readable storage medium such as an SSD). In this case, the storage medium is communicably connected to the control device 120, whereby the information processing program stored in the storage medium is incorporated in the storage unit 123. Then, the information processing program incorporated in the storage unit 123 is loaded onto the RAM, and the processor executes the loaded program, whereby the control unit 121 executes the information processing method according to the present embodiment.

  Also, the information processing program may be downloaded from a computer on the communication network 3 via the communication interface 125. Also in this case, the downloaded program is incorporated in the storage unit 123.

  Although the embodiments of the present disclosure have been described above, the technical scope of the present invention should not be construed as limited by the description of the present embodiments. It is understood by those skilled in the art that the present embodiment is an example, and that modifications of various embodiments are possible within the scope of the invention described in the claims. The technical scope of the present invention should be determined based on the scope of the invention described in the claims and the scope of equivalents thereof.

  In the present embodiment, the movement of the hand object is controlled according to the movement of the external controller 320 indicating the movement of the user U's hand, but the hand within the virtual space is controlled according to the movement amount of the user U's hand itself. Movement of the object 400 may be controlled. For example, instead of using an external controller, the position sensor 130 can detect the position and movement amount of the hand of the user U by using a glove type device or a ring type device attached to the user's finger. The movement and state of the user's U finger can be detected. Further, the position sensor 130 may be a camera configured to capture an image of a hand (including fingers) of the user U. In this case, by imaging the user's hand using a camera, the user U's hand position or movement is made based on the image data on which the user's hand is displayed, without putting any device directly on the user's finger. While being able to detect quantity, movement and the state of user's U finger can be detected.

  Further, in the present embodiment, a collision effect that defines the influence of the hand object on the operation unit of the button object is set according to the position and / or movement of the hand that is a part of the body other than the head of the user U. However, the present embodiment is not limited to this. For example, according to the position and / or movement of the foot that is a part of the body other than the head of the user U, the influence exerted on the target object by the foot object (an example of the operation object) linked to the movement of the foot of the user U A defined collision effect may be set. As described above, in the present embodiment, a collision effect may be set that defines the influence on the target object of the operation object linked to a part of the user U's body.

  Further, in the present embodiment, the block object 500 and the button object 600 are described as an example of a virtual object that is subject to a predetermined influence by a hand object, but the attribute of the virtual object is not particularly limited. For example, when the virtual object (target object) is an avatar operated by another user, the amount of damage given to the avatar may be set as a collision effect.

1: HMD system 3: communication network 21: central position 112: display unit 114: sensor 120: control device 121: control unit 123: storage unit 124: I / O interface 125: communication interface 126: bus 130: position sensor 140: Gaze sensor 200: virtual space 300: virtual camera 302: operation button 302a: push button 302b: push button 302e: trigger button 302f: trigger button 304: detection point 320: external controller (controller)
320i: Analog stick 320L: External controller (controller) for left hand
320R: Right-handed external controller (controller)
322: top surface 324: grip 326: frame 400: hand object 400L: left hand object 400R: right hand object 500: block object 600: button object 620: operation unit 620a: contact surface

Claims (7)

A computer implemented information processing method in a system comprising a head mounted device, and a position sensor configured to detect the position of the head mounted device and the position of a part of the body other than the head of the user. ,
(A) generating virtual space data defining a virtual space including a virtual camera, an operation object, and a target object;
(B) identifying the field of view of the virtual camera based on the position and tilt of the head mount device;
(C) displaying a view image on the head mounted device based on the view of the virtual camera and the virtual space data;
(D) specifying the position of the operation object based on the position of the body part of the user;
If it is determined that the predetermined condition for determining whether the collision area of the operation object intentionally contacts the collision area of the target object is not satisfied, the operation object exerts a predetermined influence on the target object. Do not give, information processing method. (E) further comprising the step of identifying an absolute velocity of the head mounted device;
The information processing method according to claim 1, wherein the predetermined condition is that an absolute velocity of the head mount device is equal to or less than a predetermined value. The predetermined condition includes a first condition and a second condition,
The first condition is a condition associated with the head mount device,
The second condition is a condition different from the first condition,
The information processing method according to claim 1, wherein the operation object does not exert the predetermined influence on the target object when it is determined that the first condition and the second condition are not satisfied. (E) further comprising the step of identifying an absolute velocity of the head mounted device;
The first condition is that the absolute velocity of the head mount device is equal to or less than a predetermined value, and
The information processing method according to claim 3, wherein the second condition is that the operation object is present in a field of view of the virtual camera. (E) further comprising the step of identifying an absolute velocity of the head mounted device;
The first condition is that the absolute velocity of the head mount device is equal to or less than a predetermined value, and
The information processing method according to claim 3, wherein the second condition is that at least one of the operation object and the target object is present in a field of view of the virtual camera. (E) identifying an absolute velocity of the head mounted device;
(F) determining the relative velocity of the portion of the body of the user relative to the head mounted device.
The first condition is that the absolute velocity of the head mount device is equal to or less than a predetermined value, and
The information processing method according to claim 3, wherein the second condition is that the relative velocity is larger than a predetermined value.   A program for causing a computer to execute the information processing method according to any one of claims 1 to 6.

Images