JP2019033906A - Information processing method, program, and computer - Google Patents

Abstract

To provide a user with a virtual experience in a virtual space which has a high entertainment property.SOLUTION: An information processing method to be executed by a computer for providing a virtual experience to a first user via an HMD (head mounted device) includes the steps of: specifying virtual space data defining a virtual space including a first avatar and first character object associated with the first user and a second avatar and second character object associated with a second user; and changing a parameter associated with at least one of the first avatar, first character object, second avatar, and second character object without operating an object in the virtual space to the second avatar when a relation between the field of view of the first avatar and the position of the second avatar satisfies a first condition and the operation input by the first user satisfies a second condition.SELECTED DRAWING: Figure 11

Description

  The present disclosure relates to an information processing method, a program, and a computer.

  Non-Patent Document 1 discloses a technique for causing a plurality of avatars corresponding to a plurality of users wearing head mounted devices to appear in a virtual space.

  According to the technology disclosed in Non-Patent Document 1, a user can only perform simple interactions such as throwing a ball against another user's avatar using his / her avatar in the virtual space. . Therefore, there is room for improvement in order to enhance the entertainment property of the virtual experience in the virtual space.

“It's VR, but laughter never stops !? PSVR“ Social VR Demo ”experience report”, [online], March 18, 2016, Internet <http://game.watch.impress.co.jp/docs/news/ 749003.html>

  An object of the present disclosure is to provide a user with a virtual experience in a virtual space with high entertainment properties.

According to an embodiment of the present disclosure, an information processing method executed by a computer that provides a virtual experience to a first user via a head mounted device,
Identifying virtual space data defining a virtual space including a first avatar and a first character object associated with the first user and a second avatar and a second character object associated with the second user;
When the relationship between the field of view of the first avatar and the position of the second avatar satisfies the first condition and the operation input input by the first user satisfies the second condition, The parameter associated with at least one of the first avatar, the first character object, the second avatar, and the second character object is changed without causing the second object to act on the second avatar. And a method is provided.

  According to another embodiment of the present disclosure, a program for causing a processor to execute the above method is provided.

  According to another embodiment of the present disclosure, there is provided a computer including at least a processor and executing the method under the control of the processor.

  According to the embodiment of the present disclosure, it is possible to provide a user with a virtual experience in a virtual space with high entertainment properties.

  Other features and advantages of the present disclosure will become apparent from the following description of embodiments, the accompanying drawings, and the appended claims.

1 is a diagram schematically showing a configuration of an HMD system. FIG. 3 is a block diagram illustrating an example of a basic hardware configuration of a computer according to an embodiment of the present disclosure. It is a figure which represents notionally the uvw visual field coordinate system set to HMD according to one Embodiment. FIG. 3 is a diagram conceptually illustrating one aspect of expressing a virtual space according to an embodiment. It is the figure showing the head of the user who wears HMD from the top according to one embodiment. It is a figure showing the yz cross section which looked at the visual recognition area from the x direction in virtual space. It is a figure showing the xz cross section which looked at the visual recognition area from the y direction in virtual space. It is a figure showing the schematic structure of a controller according to one Embodiment. It is a figure showing the schematic structure of a controller according to one Embodiment. FIG. 3 is a block diagram illustrating the functionality of a computer for providing a virtual experience to a user via an HMD system, according to one embodiment of the present disclosure. It is a flowchart of the general process for displaying the image of the virtual space where a user immerses on a display part. 3 is a flowchart of a method according to an embodiment of the present disclosure. It is a figure which illustrates schematically the mode of the game assumed in one embodiment of this indication. FIG. 3 is a diagram schematically illustrating a situation of a game including a virtual space according to an embodiment of the present disclosure. Combination of avatar gesture, first avatar parameter change, first character object parameter change, second avatar parameter change and second character object parameter change performed when the first condition and the second condition are satisfied An example of The example of the relationship between the attribute of an avatar and / or a character object, the parameter which should be changed, and the variation | change_quantity of the said parameter is shown.

[Description of Embodiment of Present Disclosure]
First, configurations of exemplary embodiments of the present disclosure will be listed and described. The method, program, and computer according to the embodiments of the present disclosure may include the following configurations.

(Item 1)
An information processing method executed by a computer providing a virtual experience to a first user via a head mounted device,
Identifying virtual space data defining a virtual space including a first avatar and a first character object associated with the first user and a second avatar and a second character object associated with the second user;
When the relationship between the field of view of the first avatar and the position of the second avatar satisfies the first condition and the operation input input by the first user satisfies the second condition, The parameter associated with at least one of the first avatar, the first character object, the second avatar, and the second character object is changed without causing the second object to act on the second avatar. A method comprising steps and.

(Item 2)
The method according to claim 1, wherein the operation input includes a state of the controller that changes in response to an operation by the first user on a controller connected to the computer.

(Item 3)
The method according to item 2, wherein the controller includes a plurality of input units, and the state of the controller includes that at least one of the plurality of input units is operated by the first user.

(Item 4)
When the relationship between the field of view of the first avatar and the position of the second avatar satisfies the first condition, and the operation input input by the first user satisfies the second condition, 4. The method according to any one of items 1 to 3, further comprising causing a first avatar to perform a gesture on the second avatar.

(Item 5)
Item 4 wherein the changed parameter associated with at least one of the second avatar and the second character object is a parameter associated with an emotion influenced by the gesture according to context in the virtual space. The method described in 1.

(Item 6)
That the relationship between the field of view of the first avatar and the position of the second avatar satisfies the first condition is that the second avatar exists on the line of sight of the first avatar, or the second 6. A method according to any of items 1 to 5, comprising the presence of an avatar in a particular part of the field of view of the first avatar.

(Item 7)
The item according to any one of items 1 to 6, further comprising a step of determining a parameter to be changed and an amount of change of the parameter based on a relationship between the attribute of the first avatar and the attribute of the second avatar. Method.

(Item 8)
The method according to any one of Items 1 to 7, further comprising: determining a parameter to be changed and a change amount of the parameter based on a relationship between the attribute of the first character object and the attribute of the second character object. The method described.

(Item 9)
A program that causes a processor to execute the method according to any one of items 1 to 8.

(Item 10)
A computer comprising at least a processor and executing the method according to any one of items 1 to 8 under the control of the processor.

[Details of Embodiment of the Present Disclosure]
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following description, similar elements are denoted by the same reference numerals. The names and functions are also the same. A duplicate description of such elements is omitted.

  With reference to FIG. 1A, the configuration of a head-mounted device (HMD) system 100 will be described. FIG. 1 schematically shows the configuration of the HMD system 100. In one example, the HMD system 100 is provided as a home system or a business system. The HMD may be a so-called head mounted display including a display unit, or may be a head mounted device on which a terminal such as a smartphone having the display unit can be attached.

  The HMD system 100 includes an HMD 110, an HMD sensor 120, a controller 160, and a computer 200. The HMD 110 includes a display unit 112 and a gaze sensor 140. The controller 160 may include a motion sensor 130.

  In one example, the computer 200 may be connectable to a network 192 such as the Internet, and may be communicable with a computer such as a server 150 connected to the network 192. In another aspect, the HMD 110 may include a sensor 114 instead of the HMD sensor 120.

  The HMD 110 may be worn on the head of the user 190 and provide a virtual space to the user during operation. More specifically, the HMD 110 displays an image for the right eye and an image for the left eye on the display unit 112, respectively. When each eye of the user visually recognizes each image, the user can recognize the image as a three-dimensional image based on the parallax of both eyes.

  The display unit 112 is realized as, for example, a non-transmissive display device. In one example, the display unit 112 is disposed on the main body of the HMD 110 so as to be positioned in front of both eyes of the user. Therefore, when the user visually recognizes the three-dimensional image displayed on the display unit 112, the user can be immersed in the virtual space. In an embodiment, the virtual space includes, for example, a background, an object that can be operated by the user, an image of a menu that can be selected by the user, and the like. In an embodiment, the display unit 112 may be realized as a liquid crystal display unit or an organic EL (Electro Luminescence) display unit included in an information display terminal such as a smartphone.

  In one example, the display unit 112 may include a sub display unit for displaying an image for the right eye and a sub display unit for displaying an image for the left eye. In another aspect, the display unit 112 may be configured to display an image for the right eye and an image for the left eye as a single unit. In this case, the display unit 112 includes a high-speed shutter. The high-speed shutter operates so that an image for the right eye and an image for the left eye can be displayed alternately so that the image is recognized only by one of the eyes.

  In one example, the HMD 110 includes a plurality of light sources (not shown). Each light source is realized by, for example, an LED (Light Emitting Diode) that emits infrared rays. The HMD sensor 120 has a position tracking function for detecting the movement of the HMD 110. More specifically, the HMD sensor 120 may read a plurality of infrared rays emitted from the HMD 110 and detect the position and inclination of the HMD 110 in the real space.

  In an aspect, the HMD sensor 120 may be realized by a camera. In this case, the HMD sensor 120 can detect the position and inclination of the HMD 110 by executing image analysis processing using image information of the HMD 110 output from the camera.

  In another aspect, the HMD 110 may include a sensor 114 instead of the HMD sensor 120 as a position detector. The HMD 110 can detect the position and inclination of the HMD 110 itself using the sensor 114. For example, when the sensor 114 is an angular velocity sensor, a geomagnetic sensor, an acceleration sensor, a gyro sensor, or the like, the HMD 110 detects its own position and inclination using any one of these sensors instead of the HMD sensor 120. obtain. As an example, when the sensor 114 is an angular velocity sensor, the angular velocity sensor detects angular velocities around the three axes of the HMD 110 in real space over time. The HMD 110 calculates a temporal change in the angle around the three axes of the HMD 110 based on each angular velocity, and further calculates an inclination of the HMD 110 based on the temporal change in the angle. The HMD 110 may include a transmissive display device. In this case, the transmissive display device may be temporarily configured as a non-transmissive display device by adjusting the transmittance. Moreover, the view field image may include a configuration for presenting the real space in a part of the image configuring the virtual space. For example, an image captured by a camera mounted on the HMD 110 may be displayed so as to be superimposed on a part of the field-of-view image, or a part of the field-of-view image is set by setting a high transmittance of a part of the transmissive display device. Real space may be visible from a part.

  The gaze sensor 140 detects a direction (line of sight) in which the lines of sight of the right eye and the left eye of the user 190 are directed. The detection of the direction is realized by, for example, a known eye tracking function. The gaze sensor 140 is realized by a sensor having the eye tracking function. In one aspect, the gaze sensor 140 preferably includes a right eye sensor and a left eye sensor. The gaze sensor 140 may be, for example, a sensor that irradiates the right eye and the left eye of the user 190 with infrared light and detects the rotation angle of each eyeball by receiving reflected light from the cornea and iris with respect to the irradiated light. . The gaze sensor 140 can detect the line of sight of the user 190 based on each detected rotation angle.

  Server 150 may send a program to computer 200. In another aspect, the server 150 may communicate with other computers 200 for providing virtual reality to HMDs used by other users. For example, when a plurality of users play a participatory game in an amusement facility, each computer 200 communicates a signal based on each user's operation with another computer 200, and a plurality of users are common in the same virtual space. Allows you to enjoy the game.

  The controller 160 is connected to the computer 200 by wire or wireless. The controller 160 receives input of commands from the user 190 to the computer 200. In an aspect, the controller 160 is configured to be gripped by the user 190. In another aspect, the controller 160 is configured to be wearable on the body of the user 190 or a portion of clothing. In another aspect, the controller 160 may be configured to output at least one of vibration, sound, and light based on a signal transmitted from the computer 200. In another aspect, the controller 160 receives an operation from the user 190 for controlling the position and movement of an object arranged in the virtual space.

  In an aspect, the motion sensor 130 is attached to the user's hand to detect movement of the user's hand. For example, the motion sensor 130 detects the rotation speed, rotation speed, etc. of the hand. The detected signal is sent to the computer 200. The motion sensor 130 is provided in, for example, a glove-type controller 160A. In some embodiments, for safety in real space, it is desirable that the controller 160A is attached to something that does not fly easily by being attached to the hand of the user 190, such as a glove shape. In another aspect, a controller 160B having a general structure having a plurality of operation buttons may be used. In another aspect, a sensor that is not worn by the user 190 may detect the movement of the user's 190 hand. Optical sensors that detect the position, orientation, direction of movement, distance of movement, etc. of various parts of the body of the user 190 may be used. For example, a signal from a camera that captures the user 190 may be input to the computer 200 as a signal representing the operation of the user 190. For example, the motion sensor 130 and the computer 200 are connected to each other wirelessly. In the case of wireless communication, the communication form is not particularly limited, and for example, Bluetooth (registered trademark) or other known communication methods are used.

  A computer 200 according to an embodiment of the present disclosure will be described with reference to FIG. FIG. 2 is a block diagram illustrating an example of a basic hardware configuration of the computer 200 according to an embodiment of the present disclosure. The computer 200 includes a processor 202, a memory 204, a storage 206, an input / output interface 208, and a communication interface 210 as main components. Each component is connected to the bus 212.

  The processor 202 executes a series of instructions included in a program stored in the memory 204 or the storage 206 based on a signal given to the computer 200 or when a predetermined condition is satisfied. In one aspect, the processor 202 is realized as a device such as a CPU (Central Processing Unit), an MPU (Micro Processor Unit), or an FPGA (Field-Programmable Gate Array).

  The memory 204 temporarily stores programs and data. The program is loaded from the storage 206, for example. The data includes data input to the computer 200 and data generated by the processor 202. In one aspect, the memory 204 is implemented as a volatile memory such as a RAM (Random Access Memory).

  The storage 206 holds programs and data permanently. The storage 206 is realized, for example, as a nonvolatile storage device such as a ROM (Read-Only Memory), a hard disk device, or a flash memory. Programs stored in the storage 206 include a program for providing a virtual space in the HMD system 100, a simulation program, a game program, a user authentication program, a program for realizing communication with another computer 200, and the like. Data stored in the storage 206 includes data and objects for defining the virtual space.

  In another aspect, the storage 206 may be realized as a removable storage device such as a memory card. In still another aspect, a configuration using a program and data stored in an external storage device may be used instead of the storage 206 built in the computer 200. According to such a configuration, for example, in a scene where a plurality of HMD systems 100 are used as in an amusement facility, it is possible to update programs and data collectively.

  In some embodiments, the input / output interface 208 communicates signals between the HMD 110, the HMD sensor 120, and the motion sensor 130. In one aspect, the input / output interface 208 is realized using a terminal such as USB (Universal Serial Bus, USB), DVI (Digital Visual Interface), HDMI (registered trademark) (High-Definition Multimedia Interface), or the like. The input / output interface 208 is not limited to the above.

  In certain embodiments, the input / output interface 208 may further communicate with the controller 160. For example, the input / output interface 208 receives signals output from the controller 160 and the motion sensor 130. In another aspect, the input / output interface 208 sends instructions output from the processor 202 to the controller 160. The command instructs the controller 160 to vibrate, output sound, emit light, and the like. When the controller 160 receives the command, the controller 160 executes vibration, sound output, light emission, and the like according to the command.

  The communication interface 210 is connected to the network 192 and communicates with other computers (for example, the server 150) connected to the network 192. In one embodiment, the communication interface 210 is realized as a wired communication interface such as a LAN (Local Area Network) or a wireless communication interface such as WiFi (Wireless Fidelity), Bluetooth (registered trademark), or NFC (Near Field Communication). Is done. The communication interface 210 is not limited to the above.

  In an aspect, the processor 202 accesses the storage 206, loads one or more programs stored in the storage 206 into the memory 204, and executes a series of instructions included in the program. The one or more programs may include an operating system of the computer 200, an application program for providing a virtual space, game software that can be executed in the virtual space, and the like. The processor 202 sends a signal for providing a virtual space to the HMD 110 via the input / output interface 208. The HMD 110 displays an image on the display unit 112 based on the signal.

  In the example shown in FIG. 2, the computer 200 is provided outside the HMD 110. However, in another aspect, the computer 200 may be embedded in the HMD 110. As an example, a portable information communication terminal (for example, a smartphone) including the display unit 112 may function as the computer 200.

  Further, the computer 200 may be configured to be used in common for a plurality of HMDs 110. According to such a configuration, for example, the same virtual space can be provided to a plurality of users, so that each user can enjoy the same application as other users in the same virtual space.

  In an embodiment, in the HMD system 100, a global coordinate system is preset. The global coordinate system has three reference directions (axes) parallel to the vertical direction in the real space, the horizontal direction orthogonal to the vertical direction, and the front-rear direction orthogonal to both the vertical direction and the horizontal direction. In the present embodiment, the global coordinate system is one of the viewpoint coordinate systems. Therefore, the horizontal direction, vertical direction (up-down direction), and front-rear direction in the global coordinate system are defined as an x-axis, a y-axis, and a z-axis, respectively. More specifically, in the global coordinate system, the x axis is parallel to the horizontal direction of the real space. The y axis is parallel to the vertical direction of the real space. The z axis is parallel to the front-rear direction of the real space.

  In certain aspects, the HMD sensor 120 includes an infrared sensor. When the infrared sensor detects the infrared rays emitted from each light source of the HMD 110, the presence of the HMD 110 is detected. The HMD sensor 120 further detects the position and inclination of the HMD 110 in the real space according to the movement of the user 190 wearing the HMD 110 based on the value of each point (each coordinate value in the global coordinate system). More specifically, the HMD sensor 120 can detect temporal changes in the position and inclination of the HMD 110 using each value detected over time.

  The global coordinate system is parallel to the real space coordinate system. Therefore, each inclination of the HMD 110 detected by the HMD sensor 120 corresponds to each inclination around the three axes of the HMD 110 in the global coordinate system. The HMD sensor 120 sets the uvw visual field coordinate system to the HMD 110 based on the inclination of the HMD 110 in the global coordinate system. The uvw visual field coordinate system set in the HMD 110 corresponds to a viewpoint coordinate system when the user 190 wearing the HMD 110 views an object in the virtual space.

  The uvw visual field coordinate system will be described with reference to FIG. FIG. 3 is a diagram conceptually showing the uvw visual field coordinate system set in the HMD 110 according to an embodiment. The HMD sensor 120 detects the position and inclination of the HMD 110 in the global coordinate system when the HMD 110 is activated. The processor 202 sets the uvw visual field coordinate system to the HMD 110 based on the detected value.

  As shown in FIG. 3, the HMD 110 sets a three-dimensional uvw visual field coordinate system with the head (origin) of the user wearing the HMD 110 as the center (origin). More specifically, the HMD 110 includes a horizontal direction, a vertical direction, and a front-rear direction (x-axis, y-axis, and z-axis) that define the global coordinate system by an inclination around each axis of the HMD 110 in the global coordinate system. Three directions newly obtained by tilting around the axis are set as the pitch direction (u-axis), yaw direction (v-axis), and roll direction (w-axis) of the uvw visual field coordinate system in the HMD 110.

  In an aspect, when the user 190 wearing the HMD 110 stands upright and is viewing the front, the processor 202 sets the uvw visual field coordinate system parallel to the global coordinate system to the HMD 110. In this case, the horizontal direction (x-axis), vertical direction (y-axis), and front-back direction (z-axis) in the global coordinate system are the pitch direction (u-axis) and yaw direction (v-axis) of the uvw visual field coordinate system in the HMD 110. And the roll direction (w-axis).

  After the uvw visual field coordinate system is set to the HMD 110, the HMD sensor 120 can detect the inclination (the amount of change in inclination) of the HMD 110 in the set uvw visual field coordinate system based on the movement of the HMD 110. In this case, the HMD sensor 120 detects the pitch angle (θu), yaw angle (θv), and roll angle (θw) of the HMD 110 in the uvw visual field coordinate system, respectively, as the inclination of the HMD 110. The pitch angle (θu) represents the inclination angle of the HMD 110 around the pitch direction in the uvw visual field coordinate system. The yaw angle (θv) represents the inclination angle of the HMD 110 around the yaw direction in the uvw visual field coordinate system. The roll angle (θw) represents the inclination angle of the HMD 110 around the roll direction in the uvw visual field coordinate system.

  The HMD sensor 120 sets the uvw visual field coordinate system in the HMD 110 after the HMD 110 has moved to the HMD 110 based on the detected tilt angle of the HMD 110. The relationship between the HMD 110 and the uvw visual field coordinate system of the HMD 110 is always constant regardless of the position and inclination of the HMD 110. When the position and inclination of the HMD 110 change, the position and inclination of the uvw visual field coordinate system of the HMD 110 in the global coordinate system change in conjunction with the change of the position and inclination.

  In one aspect, the HMD sensor 120 is based on the infrared light intensity acquired based on the output from the infrared sensor and the relative positional relationship between the points (for example, the distance between the points). The position in the real space may be specified as a relative position to the HMD sensor 120. Further, the processor 202 may determine the origin of the uvw visual field coordinate system of the HMD 110 in the real space (global coordinate system) based on the specified relative position.

  The virtual space will be further described with reference to FIG. FIG. 4 is a diagram conceptually illustrating one aspect of expressing a virtual space 400 according to an embodiment. The virtual space 400 has a spherical shape that covers the entire 360 ° direction of the center 406. In FIG. 4, the upper half of the celestial sphere in the virtual space 400 is illustrated in order not to make the description complicated. In the virtual space 400, each mesh is defined. The position of each mesh is defined in advance as coordinate values in the XYZ coordinate system defined in the virtual space 400. The computer 200 associates each partial image constituting content (still image, moving image, etc.) that can be developed in the virtual space 400 with each corresponding mesh in the virtual space 400 so that a virtual space image that can be visually recognized by the user is obtained. A virtual space 400 to be developed is provided to the user.

  In one aspect, the virtual space 400 defines an xyz coordinate system with the center 406 as the origin. The xyz coordinate system is, for example, parallel to the global coordinate system. Since the xyz coordinate system is a kind of viewpoint coordinate system, the horizontal direction, vertical direction (vertical direction), and front-rear direction in the xyz coordinate system are defined as the x-axis, y-axis, and z-axis, respectively. Therefore, the x axis (horizontal direction) of the xyz coordinate system is parallel to the x axis of the global coordinate system, the y axis (vertical direction) of the xyz coordinate system is parallel to the y axis of the global coordinate system, and the xyz coordinate system The z-axis (front-rear direction) is parallel to the global coordinate system z-axis.

  When the HMD 110 is activated, that is, in the initial state of the HMD 110, the virtual camera 404 is disposed at the center 406 of the virtual space 400. In an aspect, the processor 202 displays an image captured by the virtual camera 404 on the display unit 112 of the HMD 110. The virtual camera 404 similarly moves in the virtual space 400 in conjunction with the movement of the HMD 110 in the real space. Thereby, changes in the position and orientation of the HMD 110 in the real space can be similarly reproduced in the virtual space 400.

  As in the case of the HMD 110, the virtual camera 404 has a uvw visual field coordinate system. The uvw visual field coordinate system of the virtual camera 404 in the virtual space 400 is defined so as to be linked to the uvw visual field coordinate system of the HMD 110 in the real space (global coordinate system). Therefore, when the inclination of the HMD 110 changes, the inclination of the virtual camera 404 changes accordingly. The virtual camera 404 can also move in the virtual space 400 in conjunction with the movement of the user wearing the HMD 110 in the real space.

  The processor 202 of the computer 200 defines the viewing area 410 in the virtual space 400 based on the arrangement position of the virtual camera 404 and the reference line of sight 408. The visual recognition area 410 corresponds to an area of the virtual space 400 that is visually recognized by the user wearing the HMD 110.

  The line of sight of the user 190 detected by the gaze sensor 140 is the direction in the viewpoint coordinate system when the user 190 visually recognizes the object. The uvw visual field coordinate system of the HMD 110 is equal to the viewpoint coordinate system when the user 190 visually recognizes the display unit 112. Further, the uvw visual field coordinate system of the virtual camera 404 is linked to the uvw visual field coordinate system of the HMD 110. Therefore, the HMD system 100 according to an aspect can regard the line of sight of the user 190 detected by the gaze sensor 140 as the line of sight of the user in the uvw visual field coordinate system of the virtual camera 404.

  The determination of the user's line of sight will be described with reference to FIG. FIG. 5 is a top view of the head of a user 190 wearing the HMD 110 according to an embodiment.

  In one aspect, the gaze sensor 140 detects each line of sight of the user's 190 right eye and left eye. In an aspect, when the user 190 is looking nearby, the gaze sensor 140 detects the lines of sight R1 and L1. In another aspect, when the user 190 is looking far away, the gaze sensor 140 detects the lines of sight R2 and L2. In this case, the angle formed by the lines of sight R2 and L2 with respect to the roll direction w is smaller than the angle formed by the lines of sight R1 and L1 with respect to the roll direction w. The gaze sensor 140 transmits the detection result to the computer 200.

  When the computer 200 receives the detection values of the lines of sight R1 and L1 from the gaze sensor 140 as the detection result of the line of sight, the computer 200 specifies the gazing point N1 that is the intersection of the lines of sight R1 and L1. On the other hand, when the detected values of the lines of sight R2 and L2 are received from the gaze sensor 140, the computer 200 specifies the intersection of the lines of sight R2 and L2 as the point of sight. The computer 200 specifies the line of sight N0 of the user 190 based on the specified position of the gazing point N1. For example, the computer 200 detects, as the line of sight N0, the extending direction of the straight line passing through the midpoint of the straight line connecting the right eye R and the left eye L of the user 190 and the gazing point N1. The line of sight N0 is a direction in which the user 190 is actually pointing the line of sight with both eyes. The line of sight N0 corresponds to a direction in which the user 190 actually directs the line of sight with respect to the visual recognition area 410.

  In another aspect, the HMD system 100 may include a microphone and a speaker in any part of the HMD system 100. The user can give a voice instruction to the virtual space 400 by speaking to the microphone.

  In another aspect, the HMD system 100 may include a television broadcast receiving tuner. According to such a configuration, the HMD system 100 can display a television program in the virtual space 400.

  In still another aspect, the HMD system 100 may include a communication circuit for connecting to the Internet or a call function for connecting to a telephone line.

  The visual recognition area 410 will be described with reference to FIGS. FIG. 6 is a diagram illustrating a yz section when the visual recognition area 410 is viewed from the x direction in the virtual space 400. FIG. 7 is a diagram illustrating an xz cross section when the visual recognition area 410 is viewed from the y direction in the virtual space 400.

  As shown in FIG. 6, the visual recognition area 410 in the yz section includes an area 602. The area 602 is defined by the arrangement position of the virtual camera 404, the reference line of sight 408, and the yz section of the virtual space 400. The processor 202 defines a range including the polar angle α around the reference line of sight 408 in the virtual space as a region 602.

  As shown in FIG. 7, the visible region 410 in the xz cross section includes a region 702. The area 702 is defined by the arrangement position of the virtual camera 404, the reference line of sight 408, and the xz cross section of the virtual space 400. The processor 202 defines a range including the azimuth angle β around the reference line of sight 408 in the virtual space 400 as a region 702. The polar angles α and β are determined according to the arrangement position of the virtual camera 404 and the orientation of the virtual camera 404.

  In one aspect, the HMD system 100 provides the user 190 with a field of view in the virtual space by causing the display unit 112 to display a field of view image based on a signal from the computer 200. The view field image corresponds to a portion of the virtual space image 402 that is superimposed on the viewing area 410. When the user 190 moves the HMD 110 worn on the head, the virtual camera 404 moves in conjunction with the movement. As a result, the position of the visual recognition area 410 in the virtual space 400 changes. Thereby, the visual field image displayed on the display unit 112 is updated to an image that is superimposed on the visual recognition area 410 in the virtual space 400 in the direction in which the user faces in the virtual space image 402. The user can visually recognize a desired direction in the virtual space 400.

  Thus, the orientation (tilt) of the virtual camera 404 corresponds to the user's line of sight (reference line of sight 408) in the virtual space 400, and the position where the virtual camera 404 is arranged corresponds to the user's viewpoint in the virtual space 400. Therefore, by moving the virtual camera 404 (including the operation of changing the arrangement position and the operation of changing the orientation), the image displayed on the display unit 112 is updated, and the field of view (including the viewpoint and the line of sight) of the user 190 is moved. Is done.

  While wearing the HMD 110, the user 190 can visually recognize only the virtual space image 402 developed in the virtual space 400 without visually recognizing the real world. Therefore, the HMD system 100 can give the user a high sense of immersion in the virtual space 400.

  In an aspect, the processor 202 may move the virtual camera 404 in the virtual space 400 in conjunction with movement of the user 190 wearing the HMD 110 in real space. In this case, the processor 202 specifies an image region (that is, the visual recognition region 410 in the virtual space 400) projected on the display unit 112 of the HMD 110 based on the position and orientation of the virtual camera 404 in the virtual space 400.

  According to an embodiment, the virtual camera 404 may include two virtual cameras: a virtual camera for providing an image for the right eye and a virtual camera for providing an image for the left eye. Also, appropriate parallax may be set in the two virtual cameras so that the user 190 can recognize the three-dimensional virtual space 400.

  A controller 160A, which is an example of the controller 160, will be described with reference to FIG. 8A. FIG. 8A is a diagram illustrating a schematic configuration of a controller 160A according to an embodiment.

  In certain aspects, the controller 160A may include a right controller and a left controller. For ease of explanation, the controller 160A in FIG. 8A represents the right controller. The right controller is operated with the right hand of the user 190. The left controller is operated with the left hand of the user 190. In one aspect, the right controller and the left controller are configured symmetrically as separate devices. Therefore, the user 190 can freely move the right hand holding the right controller and the left hand holding the left controller. In another aspect, the controller 160 may be an integrated controller that accepts operations of both hands. Hereinafter, the right controller 160A will be described.

  The right controller 160A includes a grip 802, a frame 804, and a top surface 806. The grip 802 is configured to be gripped by the right hand of the user 190. For example, the grip 802 can be held by the palm of the right hand of the user 190 and three fingers (middle finger, ring finger, little finger).

  The grip 802 includes buttons 808 and 810 and a motion sensor 130. The button 808 is disposed on the side surface of the grip 802 and receives an operation with the middle finger of the right hand. The button 810 is disposed on the front surface of the grip 802 and receives an operation with the index finger of the right hand. In some embodiments, the buttons 808, 810 are configured as trigger buttons. The motion sensor 130 is built in the housing of the grip 802. Note that the grip 802 may not include the motion sensor 130 when the operation of the user 190 can be detected from around the user 190 by a camera or other device.

  The frame 804 includes a plurality of infrared LEDs 812 arranged along the circumferential direction thereof. The infrared LED 812 emits infrared rays in accordance with the progress of the program during execution of the program using the controller 160A. Infrared rays emitted from the infrared LED 812 can be used to detect the positions and postures (tilt and orientation) of the right controller 160A and the left controller (not shown). In the example shown in FIG. 8, infrared LEDs 812 arranged in two rows are shown, but the number of arrays is not limited to that shown in FIG. 8. An array of one column or three or more columns may be used.

  The top surface 806 includes buttons 814 and 816 and an analog stick 818. Buttons 814 and 816 are configured as push buttons. Buttons 814 and 816 receive an operation with the thumb of the right hand of user 190. In a certain aspect, the analog stick 818 accepts an operation in an arbitrary direction of 360 degrees from the initial position (neutral position). The operation includes, for example, an operation for moving an object arranged in the virtual space 400.

  In an aspect, the right controller 160A and the left controller include a battery for driving a member such as the infrared LED 812. The battery may be either a primary battery or a secondary battery, and the shape thereof may be arbitrary, such as a button type or a dry battery type. In another aspect, the right controller 160A and the left controller may be connected to a USB interface of the computer 200, for example. In this case, the right controller 800 and the left controller may be supplied with power via the USB interface.

  A controller 160B, which is an example of the controller 160, will be described with reference to FIG. 8B. FIG. 8B is a diagram illustrating a schematic configuration of a controller 160B according to an embodiment.

  The controller 160B includes a plurality of buttons 820 (820a, 820b, 820c, 820d) and 822 (822a, 822b, 822c, 822d), and left and right analog sticks 824L and 824R. Each button 820 and 822 is configured as a push button. Buttons 820 and 822 accept an operation with the thumb of the hand of user 190. A trigger-type button (not shown) that can accept an operation with an index finger or a middle finger of the user 190 may be further provided in the controller 160B. The analog sticks 824L and 824R each accept an operation in an arbitrary direction of 360 degrees from the initial position (neutral position) in a certain aspect. The operation includes, for example, an operation for moving an object arranged in the virtual space 400. Buttons 820 (820a, 820b, 820c, 820d) and 822 (822a, 822b, 822c, 822d) and analog sticks 824L and 824R (and trigger buttons (not shown if included)) are operated separately. A command is assigned. The operation command is, for example, a command for giving a command to an object in the virtual space 400, a command for making various settings on a menu screen of a game, and the computer when the user 190 is experiencing the virtual space 400. Any other command that can be entered into 200 is included. The operation command assigned to each button or analog stick may be dynamically changed according to, for example, the progress of the game or the change of the scene.

  In one aspect, the controller 160B may include a plurality of infrared LEDs (not shown) disposed on the outer surface thereof. The infrared LED emits infrared light in accordance with the progress of the program during execution of the program using the controller 160B. Infrared light emitted from the infrared LED can be used to detect the position and orientation (tilt, orientation) of the controller 160B. The controller 160B includes a battery for driving internal electronic components. The battery may be either a primary battery or a secondary battery, and the shape thereof may be arbitrary, such as a button type or a dry battery type. In another aspect, the controller 160B may be connected to a USB interface of the computer 200, for example. In this case, the controller 160B can be supplied with power via the USB interface.

  FIG. 9 is a block diagram illustrating functions of a computer 200 for providing a virtual experience to a user via the HMD system 100 according to an embodiment of the present disclosure. The computer 200 executes various processes mainly based on inputs from the HMD sensor 120, the motion sensor 130, the gaze sensor 140, and the controller 160.

  The computer 200 includes a processor 202, a memory 204, and a communication control unit 205. The processor 202 includes a virtual space specifying unit 902, an HMD motion detection unit 904, a line-of-sight detection unit 906, a reference line-of-sight determination unit 908, a visual field region determination unit 910, a virtual viewpoint specification unit 912, and a visual field image generation unit 914. An operation input detection unit 916, an object control unit 918, an avatar control unit 920, a positional relationship specifying unit 921, a condition determining unit 922, a parameter control unit 924, a context specifying unit 926, and a view image output unit. 928. Memory 204 may be configured to store various information. In one example, the memory 204 may include virtual space data 930, object data 932, application data 934, and other data 936. The memory 204 also includes various data necessary for calculation to provide output information corresponding to inputs from the HMD sensor 120, the motion sensor 130, the gaze sensor 140, the controller 160, etc. to the display unit 112 associated with the HMD 110. But you can. The object data 932 may include data relating to various objects including character objects arranged in the virtual space. The display unit 112 may be built in the HMD 110 or may be a display of another device (for example, a smartphone) that can be attached to the HMD 110.

  In FIG. 9, the components included in the processor 202 are just one example of expressing the function executed by the processor 202 as a specific module. The functions of multiple components may be realized by a single component. The processor 202 may be configured to perform the functions of all components.

  FIG. 10 is a flowchart of a general process for displaying an image of the virtual space in which the user is immersed on the display unit 112.

  A general process of the HMD system 100 for providing a virtual space image will be described with reference to FIGS. 9 and 10. The virtual space 400 may be provided by the interaction of the HMD sensor 120, the gaze sensor 140, the computer 200, and the like.

  Processing begins at step 1002. As an example, a game application included in the application data may be executed by the computer 200. In step 1004, the processor 202 (or the virtual space specifying unit 902) refers to the virtual space data 930 and generates a celestial spherical virtual space image 402 constituting the virtual space 400 in which the user is immersed. The position and inclination of the HMD 110 are detected by the HMD sensor 120. Information detected by the HMD sensor 120 is transmitted to the computer 200. In step 1006, the HMD motion detection unit 904 acquires position information and tilt information of the HMD 110. In step 1008, the viewing direction is determined based on the acquired position information and tilt information.

  When the gaze sensor 140 detects the movement of the left and right eyeballs of the user, the information is transmitted to the computer 200. In step 1010, the line-of-sight detection unit 906 identifies the direction in which the line of sight of the right eye and the left eye is directed, and determines the line-of-sight direction N0. In step 1012, the reference visual line determination unit 908 determines the visual field direction determined by the inclination of the HMD 110 or the user's visual line direction N0 as the reference visual line 408. The reference line of sight 408 may also be determined based on the position and tilt of the virtual camera 404 that follows the position and tilt of the HMD 110.

  In step 1014, the view area determination unit 910 determines the view area 410 of the virtual camera 404 in the virtual space 400. As shown in FIG. 4, the visual field area 410 is a part of the virtual space image 402 that constitutes the visual field of the user. The field of view area 410 is determined based on the reference line of sight 408. A yz sectional view of the visual field region 410 viewed from the x direction and an xz sectional view of the visual field region 410 viewed from the y direction are shown in FIGS. 6 and 7 described above, respectively.

  In step 1016, the visual field image generation unit 914 generates a visual field image based on the visual field region 410. The field-of-view image includes two two-dimensional images for the right eye and the left eye. These two-dimensional images are superimposed on the display unit 112 (more specifically, the right-eye image is output to the right-eye display unit, and the left-eye image is output to the left-eye display unit). A virtual space 400 as an image is provided to the user. In step 1018, the view image output unit 928 outputs information related to the view image to the display unit 112. The display unit 112 displays the view image based on the received view image information. The process ends at step 1020.

  FIG. 11 is a flowchart of a method 1100 according to one embodiment of the present disclosure. In an embodiment of the present disclosure, a computer program may cause the processor 202 (or the computer 200) to execute the steps illustrated in FIG. Another embodiment of the present disclosure may also be implemented as a computer that includes at least a processor and executes the method 1100 under the control of the processor.

  Hereinafter, embodiments of the present disclosure will be specifically described. Here, as specific examples to which the embodiment of the present disclosure can be applied, an avatar associated with each user, a game field, a character object associated with each user acting in the game field, and the like are arranged. A game that can be enjoyed by being immersed in a virtual space is assumed. However, embodiments of the present disclosure are not necessarily limited to such an aspect. It will be apparent to those skilled in the art that the embodiments of the present disclosure can take various forms that fall within the scope of the claims.

  FIG. 12 is a diagram schematically illustrating a game mode assumed in the present embodiment. In the present embodiment, the first user 1204A and the second user 1204B (hereinafter collectively referred to as “user 1204”) play the game. First user 1204 </ b> A and second user 1204 </ b> B wear HMDs 110 </ b> A and 110 </ b> B (hereinafter collectively referred to as “HMD110”) on their heads, respectively. In this example, the first user 1204A and the second user 1204B wear the controllers 160A1 and 160A2 having the configuration shown in FIG. 8A, respectively. It will be appreciated that this is just one example of a controller. The controller of the other aspect which can be mounted | worn with a user's body, a controller as shown to FIG. 8B, etc. are applicable to embodiment of this indication. In another example, the user 1204 does not wear the controller, and a sensor that is not worn by the user 1204 may detect the movement of the user 1204. For example, a signal from a camera that captures the user 1204 may be input to the computer 200 as a signal representing the movement of the user 1204.

  In the virtual space 1200, a first avatar 1206A and a second avatar 1206B (hereinafter collectively referred to as “avatar 1206”) operated by the first user 1204A and the second user 1204B, respectively, and a game field 1212 are arranged. The On the game field 1212, a first character object 1208A and a second character object 1208B (hereinafter collectively referred to as “character object 1208”) associated with each of the first user 1204A and the second user 1204B are arranged. . During the game play, the user 1204 can cause the avatar 1206 and the character object 1208 associated with the user 1204 to perform various actions.

  There may be more than two users 1204, and there may be more than two avatars 1206 and character objects 1208. Hereinafter, in order to simplify the description, an example in which each of the first avatar 1206A, the second avatar 1206B, the first character object 1208A, and the second character object appears will be described.

  The user 1204 can enjoy a game performed on the game field 1212 in the virtual space 1200 via the avatar 1206. The first avatar 1206A and the second avatar 1206B may have a first operation object 1210A and a second operation object 1210B (hereinafter, collectively referred to as “operation object 1210”), respectively. The operation object 1210 may be a body part of the avatar 1206 corresponding to the body part of the user 1204 to which the controller 160 is attached. The operation object 1210 is not necessarily displayed as an object separate from the avatar 1206. For example, the hand of the avatar 1206 may be simply displayed.

  As shown in FIG. 12, virtual cameras 1202A and 1202B (hereinafter collectively referred to as “virtual camera 1202”) may be disposed at the positions of the first avatar 1206A and the second avatar 1206B, respectively. The user 1204 can view the video of the virtual space 1200 obtained by the virtual camera 1202 (from the viewpoint of the avatar 1206).

  Returning to FIG. 11, the process starts at step 1102. The processor 202 reads and executes the game program included in the application data 934 stored in the memory 204.

  The process proceeds to step 1104, and the virtual space specifying unit 902 specifies virtual space data for the executed game based on the virtual space data 930, the object data 932, and the like. Data regarding the avatar 1206 and the character object 1208 may be included in the object data 930. The virtual space data defines a virtual space that includes an avatar 1206 and a character object 1208 associated with the user 1204.

  The virtual viewpoint specifying unit 912 specifies a virtual viewpoint in the virtual space 1200. In the example of FIG. 12, the virtual viewpoint may be the position of the virtual camera 1202. The virtual viewpoint may be appropriately determined according to the progress of the game.

  The view image generation unit 914 generates a view image based on the virtual space data, the virtual viewpoint, and the direction of the HMD. The field-of-view image is generated by, for example, the processing already described with reference to FIG. The generated view field image is output by the view field image output unit 928 to the display unit 112 associated with the HMD 110 and displayed by the display unit 112. A user 1204 wearing the HMD 110 can view the field-of-view image displayed on the display unit 112. The user 1204 can obtain an immersive feeling as if he / she has entered the virtual space 1200.

  The process proceeds to step 1106, and the operation input detection unit 916 detects an operation input by the user 1204. Here, it is assumed that the operation input is performed by the first user 1204A. In this example, the first user 1204A operates a controller 160A1 as shown in FIG. 8A. The detected operation input may include a state of the controller 160A1 that changes according to an operation by the first user 1204A on the controller 160A1. The state of the controller 160A1 may include that at least one of the plurality of input units of the controller 160A1 is operated by the first user 1204A. For example, the detected operation input indicates how the buttons 808, 810, 814, and 816 and the analog stick 818 of the controller 160A1 are operated by the first user 1204A. In one example, the operation input when the button 808 is pressed may be defined as “input 1”, and the operation input when the button 810 is pressed may be defined as “input 2”. In another example, when the first user 1204A does not wear the controller and the sensor not worn by the first user 1204A detects the movement of the first user 1204A, the hand shape of the first user 1204A is detected as an operation input. May be. These are merely examples of operation inputs that can be applied in the present disclosure. It will be understood that various operation inputs can be defined depending on the type of controller, the type of application, and the like. Information regarding operation inputs, including definitions of operation inputs, may be included in other data 936 stored in memory 204. The avatar control unit 920 can move the first avatar 1206A according to the detected operation input. The object control unit 918 may move the character object 1208A according to the detected operation input, the movement of the first avatar 1206A, and the like.

  The process proceeds to step 1108, and the positional relationship specifying unit 921 specifies the relationship between the field of view of the first avatar 1206A and the position of the second avatar 1206B. The field of view of first avatar 1206A may be determined by step 1014 of FIG. The position of the second avatar 1206B may be determined by the operation of the HMD 110B, the controller 160A2, etc. by the second user 1204B. The relationship between the field of view of the first avatar 1206A and the position of the second avatar 1206B is based on whether the second avatar 1206B exists on the line of sight of the first avatar 1206A, and the field of view of the first avatar 1206A. It may include whether or not it exists in a specific part. Information including the definition of the relationship between the field of view of the first avatar 1206A and the position of the second avatar 1206B may be included in other data 936 stored in the memory 204.

  The process proceeds to step 1110, and the condition determination unit 922 determines whether the relationship between the field of view of the first avatar 1206A and the position of the second avatar 1206B satisfies the first condition, and the detected operation input is the first. It is determined whether or not two conditions are satisfied. The first condition is that the second avatar 1206B exists on the line of sight of the first avatar 1206A, or the second avatar 1206B exists in a specific part of the visual field of the first avatar 1206A. Good. The second condition is that a predetermined input by pressing a predetermined button of the controller 160A1 (for example, “input 1” by pressing a button 808, “input 2” by pressing a button 810, etc.) is performed. May be.

  If both the first condition and the second condition are not met, or if only one condition is met (“N” in step 1110), the process returns to before step 1106.

  If both the first condition and the second condition are satisfied (“Y” in step 1110), the process proceeds to step 1112. In step 1112, the avatar control unit 920 causes the first avatar 1206A to perform a gesture for the second avatar 1206B.

  FIG. 13 is a diagram schematically showing the situation of the game including the virtual space 1200 when the process of step 1112 is executed. In this example, the second avatar 1206B exists on the line of sight 1214 of the first avatar 1206A. Therefore, the first condition is satisfied. Further, an operation input “input 1” is performed by the user 1204A. Therefore, the second condition is also satisfied. At this time, as an example, as shown in FIG. 13, the avatar control unit 920 may cause the first avatar 1206 </ b> A to perform a gesture of raising the thumb toward the second avatar 1206 </ b> B.

  The process proceeds to step 1114, and the parameter control unit 924 changes a parameter associated with at least one of the first avatar 1206A, the first character object 1208A, the second avatar 1206B, and the second character object 1208B. For example, as described above, when the first avatar 1206A performs a gesture of raising the thumb toward the second avatar 1206B, the level of the second avatar 1206B may be increased. At this time, various objects existing in the virtual space 1200 do not directly act on the second avatar 1206B. According to the present embodiment, the parameters of the avatar 1206 and / or the character object 1208 can be changed without causing an effect representing the use of a weapon, magic, or the like in the virtual space 1200. In step 1116, the process ends.

  The parameter associated with the second avatar 1206B and / or the second character object 1208B changed in step 1114 is a parameter associated with the emotion affected by the gesture performed in step 1112 according to the context in the virtual space 1200. It may be. For example, assume a context in which a first avatar 1206A that is an instructor teaches a second avatar 1206B that is a student. When the instructor makes a gesture to raise a thumb in the sense of “Good!” Or a gesture of pointing the thumb down in the sense of “Bad!”, The emotion of the student is influenced by these gestures. It is thought that it can receive. Dotted balloons 1216 and 1218 (which may not be displayed in the virtual space 1200) in FIG. 13 are illustrated to express such a situation. In such a case, parameters such as “level” and “skill” associated with the emotions of the second avatar 1206B and / or the related second character object 1208B who have been praised or deleted may be changed. It should be understood that a wide variety of emotions affected by gestures and parameters associated with emotions can be set according to a wide variety of contexts. Information about the context may be included in, for example, application data 934 and other data 936 in the memory 204. The context specifying unit 926 may specify the context in the virtual space 1200 from these data. Information regarding the identified context can be used for the processing as described above.

  FIG. 14 shows the gesture of the first avatar 1206A, the parameter change of the first avatar 1206A, the parameter change of the first character object 1208A, and the parameter change of the second avatar 1206B, which are performed when the first condition and the second condition are satisfied. An example of combinations of parameter changes of the second character object 1208B is shown. Such data may be stored in other data 936 in the memory 204 in advance.

  According to the example of FIG. 14, the second avatar 1206B exists on the line of sight of the first avatar 1206A (the first condition is satisfied), and the operation input is “input 1” (the second condition is satisfied). ), The avatar control unit 920 causes the first avatar 1206A to perform a gesture of raising the thumb against the second avatar 1206B. Furthermore, the parameter control unit 924 increases the compatibility of the first avatar 1206A with the second avatar 1206B and increases the level of the second avatar 1206B.

  Further, according to the example of FIG. 14, when the second avatar 1206B exists on the line of sight of the first avatar 1206A and the operation input is “input 2”, the avatar control unit 920 sets the second avatar 1206B. On the other hand, the first avatar 1206A is caused to perform the gesture of turning the thumb down. The parameter control unit 924 decreases the compatibility of the first avatar 1206A with the second avatar 1206B and decreases the level of the second avatar 1206B.

  Further, according to the example of FIG. 14, when the second avatar 1206B exists in a specific part of the field of view of the first avatar 1206A and the operation input is “input 1”, the avatar control unit 920 2 The first avatar 1206A is caused to perform a gesture of raising the thumb against the avatar 1206B. The parameter control unit 924 increases the compatibility of the first character object 1208A with the second character object 1208B and increases the skill of the second character object 1208B.

  Further, according to the example of FIG. 14, when the second avatar 1206B exists in a specific part of the field of view of the first avatar 1206A and the operation input is “input 2”, the avatar control unit 920 The first avatar 1206A is made to perform the gesture of turning the thumb downward with respect to the 2 avatar 1206B. The parameter control unit 924 reduces the compatibility of the first character object 1208A with the second character object 1208B and reduces the skill of the second character object 1208B.

  The combination of the first condition, the second condition, the gesture, and the parameter change shown in FIG. 14 is merely an example. It should be understood that various combinations can be defined and used depending on the type of application, the scene that occurs within the application, and the like.

  FIG. 15 shows an example of the relationship between the attribute of the avatar 1206 and / or the character object 1208, the parameter to be changed in the process of step 1114 in FIG. 11, and the amount of change of the parameter. For example, the attributes of the avatar 1206 may include “high level”, “low level”, and the like. The attributes of the character object 1208 may include “warrior”, “magician”, and the like. It should be understood that various attributes can be defined for the avatar 1206 and the character object 1208 depending on the type of application and the like.

  According to the example of FIG. 15, the attribute of the first avatar 1206A is “high level”, the attribute of the second avatar 1206B is “low level”, the attribute of the first character object 1208A is “warrior”, When the attribute of the second character object 1208B is “warrior”, the parameter control unit 924 may change the parameter “compatibility with the second avatar” of the first avatar 1206A. In a sense, the “high level” first avatar 1206A will give up or mess with the “low level” second avatar 1206B, so the amount of change in “compatibility with the second avatar” is set to be large. May be. The parameter control unit 924 may also change the parameter “level” of the second avatar 1206B. For the reasons described above, the amount of change in the parameter may be large. The parameter control unit 924 may also change the parameter “compatibility with the second character object 1208B” of the first character object 1208A. For the reasons described above, the amount of change in the parameter may be large. The parameter control unit 924 may also change the parameter “weapon skill” of the second character object 1208B. Since the attributes of both the first character object 1208A and the second character object 1208B are “warrior” and are common, the change amount of “weapon skill” may be set to be large.

  Further, according to the example of FIG. 15, the attribute of the first avatar 1206A, the attribute of the second avatar 1206B, the attribute of the first character object 1208A, and the attribute of the second character object 1208B are “high level” and “low”, respectively. In the case of “level”, “warrior”, and “magician”, the parameter “compatibility with the second avatar 1206B” of the first avatar 1206A, the parameter “level” of the second avatar 1206B, and the parameter “second” of the first character object 1208A The amount of change in the “compatibility with the character object 1208B” and the parameter “weapon skill” of the second character object 1208B may be set to medium.

  Further, according to the example of FIG. 15, the attribute of the first avatar 1206A, the attribute of the second avatar 1206B, the attribute of the first character object 1208A, and the attribute of the second character object 1208B are “high level” and “high”, respectively. In the case of “level”, “warrior” and “warrior”, the parameter “compatibility with the second avatar 1206B” of the first avatar 1206A, the parameter “level” of the second avatar 1206B, and the parameter “second” of the first character object 1208A The amount of change in the “compatibility with the character object 1208B” and the parameter “weapon skill” of the second character object 1208B may be set to medium.

  Further, according to the example of FIG. 15, the attribute of the first avatar 1206A, the attribute of the second avatar 1206B, the attribute of the first character object 1208A, and the attribute of the second character object 1208B are “high level” and “high”, respectively. In the case of “level”, “warrior”, and “magician”, the parameter “compatibility with the second avatar 1206B” of the first avatar 1206A, the parameter “level” of the second avatar 1206B, and the parameter “second” of the first character object 1208A The amount of change in the “compatibility with the character object 1208B” and the parameter “weapon skill” of the second character object 1208B may be set to be small.

  As shown in FIG. 15, according to the present embodiment, the relationship between the attributes of the first avatar 1206A and the attributes of the second avatar 1206B and / or the attributes of the first character object 1208A and the attributes of the second character object 1208B. Based on the relationship between the attributes, the parameter to be changed and the amount of change of the parameter can be determined.

  The combinations of the attributes of the avatar 1206 and the character object 1208, the type of parameter to be changed, and the amount of parameter change shown in FIG. 15 are merely examples. It should be understood that various combinations can be defined and used depending on the type of application, the scene that occurs within the application, and the like.

  As described above, according to the embodiment of the present disclosure, it is possible to provide a user with a virtual experience in a virtual space with high entertainment properties.

  It will be apparent to those skilled in the art that embodiments of the present disclosure can be implemented as a processor 202 (or computer 200), a method 1100, a computer program that causes the processor 202 (or computer 200) to perform the method 1100, and the like. Let's go.

  In the above-described embodiment, the virtual space (VR space) in which the user is immersed by the HMD device has been described as an example. However, a transmissive HMD device may be employed as the HMD device. In this case, an augmented reality (AR) space or mixed reality is output by outputting a view field image obtained by synthesizing a part of an image constituting a virtual space in a real space visually recognized by a user via a transmissive HMD device. A virtual experience in the (MR: Mixed Reality) space may be provided to the user. In this case, an action on the target object in the virtual space may be generated based on the movement of the user's hand instead of the hand object. Specifically, the processor may specify the coordinate information of the position of the user's hand in the real space and define the position of the target object in the virtual space in relation to the coordinate information in the real space. As a result, the processor can grasp the positional relationship between the user's hand in the real space and the target object in the virtual space, and can execute processing corresponding to the above-described collision control or the like between the user's hand and the target object. . As a result, it is possible to act on the target object based on the movement of the user's hand.

  While embodiments of the present disclosure have been described, it should be understood that these are only examples and are not intended to limit the scope of the present disclosure. It should be understood that changes, additions, improvements, and the like of the embodiments can be made as appropriate without departing from the spirit and scope of the present disclosure. The scope of the present disclosure should not be limited by any of the above-described embodiments, but should be defined only by the claims and their equivalents.

DESCRIPTION OF SYMBOLS 100 ... HMD system, 112 ... Display part, 114 ... Sensor, 120 ... HMD sensor, 130 ... Motion sensor, 140 ... Gaze sensor, 150 ... Server, 160A, 160A1, 160A2, 160B ... Controller, 190 ... User, 192 ... Network , 200 ... computer, 202 ... processor, 204 ... memory, 205 ... communication control unit, 206 ... storage, 208 ... input / output interface, 210 ... communication interface, 212 ... bus, 400 ... virtual space, 402 ... virtual space image, 404 ... Virtual camera, 406 ... Center, 408 ... Reference line of sight, 410 ... View field, 800 ... Right controller, 802 ... Grip, 804 ... Frame, 806 ... Top, 808, 810, 814, 816 ... Button, 818 ... Analog stick , 82 , 822 ... button, 824R, 824L ... analog stick, 902 ... virtual space specifying unit, 904 ... motion detecting unit, 906 ... gaze detecting unit, 908 ... reference gaze determining unit, 910 ... visual field region determining unit, 912 ... virtual viewpoint specifying 914 ... Visibility image generation unit, 916 ... Operation input detection unit, 918 ... Object control unit, 920 ... Avatar control unit, 921 ... Position relation specifying unit, 922 ... Condition determination unit, 924 ... Parameter control unit, 926 ... Context Specific part, 928 ... Visual field image output part, 930 ... Virtual space data, 932 ... Object data, 934 ... Application data, 936 ... Other data, 1200 ... Virtual space, 1202A, 1202B ... Virtual camera, 1204A ... First user, 1204B ... 2nd user, 1206A ... 1st avatar, 1206B 2nd avatar, 1208A ... character object, 1208A ... 1st character object, 1208B ... 2nd character object, 1210A ... 1st operation object, 1210B ... 2nd operation object, 1212 ... game field, 1214 ... gaze, 1216, 1218 ... Callout

Claims (10)

An information processing method executed by a computer providing a virtual experience to a first user via a head mounted device,
Identifying virtual space data defining a virtual space including a first avatar and a first character object associated with the first user and a second avatar and a second character object associated with the second user;
When the relationship between the field of view of the first avatar and the position of the second avatar satisfies the first condition and the operation input input by the first user satisfies the second condition, The parameter associated with at least one of the first avatar, the first character object, the second avatar, and the second character object is changed without causing the second object to act on the second avatar. A method comprising steps and.   The method of claim 1, wherein the operation input includes a state of the controller that changes in response to an operation by the first user on a controller connected to the computer.   The method according to claim 2, wherein the controller includes a plurality of input units, and the state of the controller includes that at least one of the plurality of input units is operated by the first user.   When the relationship between the field of view of the first avatar and the position of the second avatar satisfies the first condition, and the operation input input by the first user satisfies the second condition, The method according to claim 1, further comprising causing a first avatar to perform a gesture for the second avatar.   The changed parameter associated with at least one of the second avatar and the second character object is a parameter associated with an emotion influenced by the gesture according to a context in the virtual space. 4. The method according to 4.   That the relationship between the field of view of the first avatar and the position of the second avatar satisfies the first condition is that the second avatar exists on the line of sight of the first avatar, or the second 6. A method according to any of claims 1 to 5, comprising the presence of an avatar in a particular part of the field of view of the first avatar.   7. The method according to claim 1, further comprising: determining a parameter to be changed and an amount of change of the parameter based on a relationship between the attribute of the first avatar and the attribute of the second avatar. the method of.   8. The method according to claim 1, further comprising: determining a parameter to be changed and a change amount of the parameter based on a relationship between the attribute of the first character object and the attribute of the second character object. The method described in 1.   A program for causing a processor to execute the method according to claim 1.   A computer comprising at least a processor and executing the method according to claim 1 under the control of the processor.