JP2020113095A - Method of controlling character in virtual space - Google Patents

Abstract

To provide a control method which allows a character in a virtual space to be naturally expressed.SOLUTION: A method of controlling a character performed by a user in a virtual space includes the steps of: disposing a character in a virtual space; detecting a user input; converting input contents into output contents in other format; and outputting the output contents into the virtual space.SELECTED DRAWING: Figure 8

Description

The present invention relates to a character control method in a virtual space.

A technique for optimizing voice communication in a system in which a character such as an avatar is placed in a virtual space to virtually communicate has been disclosed. For example, Patent Document 1 discloses that an effect is produced in which a conversation using a real voice or a conversation using a wireless device is performed according to the distance between users in a virtual space.

JP, 2017-28390, A

However, with the realization of conversation in the virtual space, people with various backgrounds impersonate the character and live together in the same virtual space, and further convenience in communication in the virtual space is expected.

The present invention has been made in view of such a background, and an object thereof is to provide a communication method having further convenience in a conversation between characters in a virtual space.

A method of controlling a character played by a performer user in a virtual space, the step of placing the character in the virtual space, the step of detecting the user's input, the step of converting the input content to the output content of another format, Outputting the output content in the virtual space.

Other problems disclosed by the present application and a method for solving the problems will be clarified by the section of the embodiments of the invention and the drawings.

According to the present invention, it is possible to provide a communication method having further convenience in a conversation between characters in a virtual space.

It is a figure showing the example of whole composition of HMD system 300 concerning a 1st embodiment. It is a schematic diagram of the external appearance of HMD110 which concerns on 1st Embodiment. It is a functional block diagram of HMD110 which concerns on 1st Embodiment. It is a schematic diagram of the external appearance of the controller 210 which concerns on 1st Embodiment. It is a functional block diagram of the controller 210 which concerns on 1st Embodiment. It is a functional block diagram of the image generation apparatus 310 which concerns on 1st Embodiment. It is an example of a virtual space displayed on the HMD 110 according to the present embodiment according to the first embodiment. It is a figure which shows the flow of a process in the HMD system which concerns on 1st Embodiment. It is a functional block diagram of the image generation apparatus 310 which concerns on 2nd Embodiment. It is a figure which shows the flow of a process in the HMD system which concerns on 2nd Embodiment. It is a functional block diagram of the image generation apparatus 310 which concerns on 3rd Embodiment. It is a figure which shows the flow of a process in the HMD system which concerns on 3rd Embodiment. It is a functional block diagram of the image generation apparatus 310 which concerns on 4th Embodiment. It is a figure which shows the flow of a process in the HMD system which concerns on 4th Embodiment.

The contents of the embodiments of the present invention will be listed and described. A character control method in a virtual space according to the embodiment of the present invention has the following configuration.
[Item 1]
A method of controlling a character played by a performer user in a virtual space,
Placing the character in the virtual space,
Detecting user input,
Converting the input content into output content in another format,
Outputting the output content in a virtual space,
A control method comprising:
[Item 2]
The control method according to item 1,
The control method, wherein the input content is user's voice data, and the output content is text data corresponding to the voice data.
[Item 3]
The control method according to item 1,
The control method, wherein the input content is text data and the output content is voice data corresponding to the text data.
[Item 4]
The control method according to item 1,
The control method, wherein the input content is voice data regarding a first language, and the output content is voice data regarding a second language corresponding to the first language.
[Item 5]
The control method according to item 1,
The input content is voice data, the output content is voice data relating to an answer to the voice data, and the output content is output as a voice of a second performer user arranged in the virtual space. , A control method characterized by.

(First embodiment)
A specific example of the head mounted display (HMD) system 300 according to the first embodiment of the present invention will be described below with reference to the drawings. It should be noted that the present invention is not limited to these exemplifications, and is shown by the scope of the claims, and is intended to include meanings equivalent to the scope of the claims and all modifications within the scope. In the following description, the same reference numerals are given to the same elements in the description of the drawings, and overlapping description will be omitted.

FIG. 1 is a diagram showing an example of the overall configuration of an HMD system 300 according to this embodiment. The HMD system 300 can be configured by, for example, the HMD 110 and the controller 210 worn by the user, and the image generation device 310 that functions as a host computer. In FIG. 1, as an example, the HMD 110 and the controller 210 worn by the users A and B are displayed. In addition, the HMD system 300 can also add an infrared camera (not shown) for detecting the position, orientation, tilt, etc. of the HMD 110 and the controller 210. These devices can be connected to each other by wired or wireless means. For example, each device is provided with a USB port, and communication can be established by connecting with a cable. In addition, wired communication such as HDMI, wired LAN, infrared ray, Bluetooth (registered trademark), WiFi (registered trademark), etc. Alternatively, the communication can be established wirelessly. The image generation device 310 may be a device having a calculation processing function such as a PC, a game machine, or a mobile communication terminal. Further, the image generating device 310 can transmit the generated image to the HMD 110 in the form of streaming or download. The HMD 110 can reproduce the image transmitted from the image generation device 310. The image generation device 310 can directly send an image to the plurality of HMDs 110, or can send an image via another content server. In addition, as an example, each image generation device is connected to the HMD and controller of each user directly or via a local network, and the generated image is transmitted to the server via a network such as the Internet, and the server Images can also be sent to the HMDs of other users.

FIG. 2 is a schematic view of the outer appearance of the head mounted display (hereinafter referred to as HMD) 110 according to the present embodiment. The HMD 110 is mounted on the user's head and includes a display panel 120 so as to be placed in front of the left and right eyes of the user. As the display panel, an optically transmissive display and a non-transmissive display can be considered, but in the present embodiment, a non-transmissive display panel capable of providing a more immersive feeling is exemplified. An image for the left eye and an image for the right eye are displayed on the display panel 120, and it is possible to provide the user with an image having a stereoscopic effect by utilizing the parallax of both eyes. If it is possible to display an image for the left eye and an image for the right eye, it is possible to separately provide a display for the left eye and a display for the right eye, or it is possible to provide an integrated display for the left eye and the right eye. is there.

Furthermore, the housing unit 130 of the HMD 110 includes a sensor 140. Although not shown, the sensor may include, for example, a magnetic sensor, an acceleration sensor, or a gyro sensor, or a combination thereof, which is not illustrated, in order to detect a movement such as the orientation or inclination of the user's head. The vertical direction of the user's head is the Y axis, and among the axes orthogonal to the Y axis, the axis that connects the center of the display panel 120 and the user and that corresponds to the front-back direction of the user is the Z axis, and the Y axis and the Z axis. When an axis that is orthogonal to the horizontal direction of the user and corresponds to the left-right direction of the user is the X axis, the sensor 140 has a rotation angle around the X axis (so-called pitch angle), a rotation angle around the Y axis (so-called yaw angle), and Z. The rotation angle around the axis (so-called roll angle) can be detected.

Further, in addition to the sensor 140 or in place of the sensor 140, the housing unit 130 of the HMD 110 may include a plurality of light sources 150 (for example, infrared light LEDs, visible light LEDs), and the outside of the HMD 110 (for example, A camera (for example, an infrared light camera or a visible light camera) installed in a room (indoor, etc.) can detect the position, orientation, and tilt of the HMD 110 in a specific space. Alternatively, for the same purpose, the HMD 110 may be provided with a camera for detecting a light source installed in the housing unit 130 of the HMD 110.

Further, without providing the HMD 110 with the light source 150, it is also possible to detect the position, orientation, and inclination of the HMD 110 by photographing the appearance of the HMD 110 with a camera installed outside the HMD 110 and analyzing the photographed image. it can. In this case, the HMD 110 may acquire an image from an external camera and perform image analysis, or a computer different from the HMD 110 may perform image analysis and transmit the analysis result to the HMD 110.

Further, the HMD 110 can execute an application and transmit/receive data while network-linking with an external processing device such as a server or an image processing device as in the present example, or without depending on the external processing device. The HMD alone can function as a stand-alone type device that executes a built-in program.

FIG. 3 is a functional configuration diagram of the HMD 110 according to the present embodiment. As described in FIG. 2, the HMD 110 may include the sensor 140. Although not shown, the sensor 140 may include, for example, a magnetic sensor, an acceleration sensor, a gyro sensor, or a combination thereof, which is not shown in order to detect a movement such as the orientation or inclination of the user's head. Further, the LED 150 such as infrared light or ultraviolet light may be provided to detect the movement of the user's head such as the direction and inclination of the user or the position of the user's head with higher accuracy. In addition, a camera 160 for taking an external view of the HMD can be provided. Further, a microphone 170 for collecting a user's speech and a headphone 180 for outputting a voice can be provided. It should be noted that the microphone and headphone can be provided as a device independent of the HMD 110.

Further, the HMD 110 can include, for example, an input/output unit 190 for establishing a wired connection with peripheral devices such as the controller 210 and the image generation device 310, and infrared, Bluetooth (registered trademark), and WiFi (registered trademark). ) Etc. can be provided with a communication unit 115 for establishing a wireless connection. The information about the movement of the user such as the orientation and inclination of the head acquired by the sensor 140 is transmitted to the image generation apparatus 310 by the control unit 125 via the input/output unit 190 and/or the communication unit 115. The image generated by the image generation device 310 based on the movement of the user's head is received via the input/output unit 190 and/or the communication unit 115, and is output to the display unit 120 by the control unit 125.

FIG. 4 is a schematic view of the appearance of the controller 210 according to this embodiment. The user holds the controller 210 and gives a predetermined instruction. The controller 210 can support the user to make a predetermined input in the virtual space. For example, the user can perform text input by tilting the controller to bring the cursor to a desired key of the input keyboard displayed in the virtual space and pressing the button. The controller 210 may be configured as a set of left-hand 220 and right-hand 230 controllers. The left-hand controller 220 and the right-hand controller 230 can each include an operation trigger button 240, an infrared LED 250, a sensor 260, a joystick 270, and a menu button 280.

The operation trigger button 240 is arranged as positions 240a and 240b at positions where it is assumed that an operation such as pulling the trigger with the middle finger and the index finger is performed when the grip 235 of the controller 210 is held. A plurality of infrared LEDs 250 are provided on a frame 245 formed in a ring shape downward from both side surfaces of the controller 210, and the position of these infrared LEDs 250 is detected by a camera (not shown) provided outside the controller 210. By doing so, the position, orientation, and inclination of the controller 210 in the specific space can be detected.

It is also possible to detect the position, orientation, and inclination of the controller 210 by omitting the infrared LED 250 and photographing the appearance of the controller 210 with a camera arranged outside the controller 210 and analyzing the photographed image. In this case, the image from the camera may be transmitted to the HMD 110 and the HMD 110 may perform the image analysis, or a computer different from the HMD 110 and the controller 210 may perform the image analysis and transmit the analysis result to the HMD 110. Good.

Further, the controller 210 can include a sensor 260 in order to detect a movement such as a direction and a tilt of the controller 210. Although not shown, the sensor 260 may include, for example, a magnetic sensor, an acceleration sensor, a gyro sensor, or a combination thereof. Further, a joystick 270 and a menu button 280 may be provided on the upper surface of the controller 210. The joystick 270 can be moved in the direction of 360 degrees around the reference point, and it is assumed that the joystick 270 is operated by the thumb when the grip 235 of the controller 210 is gripped. It is envisioned that the menu button 280 will also be operated with the thumb as well. Further, the controller 210 may include a vibrator (not shown) for applying vibration to the hand of the user who operates the controller 210. In order to output information such as user input contents via buttons and joysticks, position, orientation, and tilt of the controller 210 via sensors, etc., and to receive information from the host computer, the controller 210 inputs/outputs. And a communication unit.

The system determines the movement and posture of the user's hand based on the presence/absence of the user holding the controller 210 and operating various buttons and joysticks, and the information detected by the infrared LED and the sensor. The user's hand can be displayed and operated.

FIG. 5 is a functional configuration diagram of the controller 210 according to the present embodiment. As described with reference to FIG. 4, the controller 210 can be configured as a set of controllers for the left hand 220 and the right hand 230, but in any of the controllers, the operation trigger button 240, the joystick 270, the menu button 280, etc. An operation unit 245 can be provided.

Further, the controller 210 can include a sensor 260 in order to detect a movement such as a direction and a tilt of the controller 210. Although not shown, the sensor 260 may include, for example, a magnetic sensor, an acceleration sensor, a gyro sensor, or a combination thereof.

Further, a plurality of infrared LEDs 250 are provided, and a camera (not shown) provided outside the controller detects the positions of these infrared LEDs to detect the position, orientation, and inclination of the controller 210 in a specific space. You may do it.

The controller 210 can include, for example, an input/output unit 255 for establishing a wired connection with a peripheral device such as the HMD 110 or the image generation device 310, and infrared rays, Bluetooth (registered trademark), WiFi (registered trademark), or the like. A communication unit 265 for establishing a wireless connection can be provided. Information input by the user via the operation unit 245, for example, text input information and information such as the orientation and inclination of the controller 210 acquired by the sensor 260 is input via the input/output unit 255 and/or the communication unit 265 to the image generation apparatus. Sent to 310.

FIG. 6 is a functional configuration diagram of the image generation apparatus 310 according to the present embodiment. As the image generation device 310, the user input information transmitted from the HMD 110 and the controller 210, the information regarding the user's head movement, the movement of the controller, and the operation acquired by the sensor are stored, and a predetermined calculation process is performed. A device such as a PC, a game machine, or a mobile communication terminal having a function of generating an image can be used. The image generation device 310 can include an input/output unit 320 for establishing a wired connection with a peripheral device such as the HMD 110 or the controller 210, for example, infrared rays, Bluetooth (registered trademark), WiFi (registered trademark), or the like. A communication unit 330 for establishing a wireless connection can be provided. The information about the movement of the user's head, the movement of the controller, and the operation received from the HMD 110 and/or the controller 210 via the input/output unit 320 and/or the communication unit 330 is stored in the control unit 340 as the position of the user, Characters are controlled by executing the control program stored in the storage unit 350, which is detected as input contents including motions such as line of sight and posture, utterances, and operations, and is executed according to the input contents of the user. Is generated. The control unit 340 may be configured by a CPU, but by further providing a GPU specialized for image processing, it is possible to decentralize information processing and image processing and improve the efficiency of the entire processing. The image generation device 310 can also communicate with another calculation processing device to allow the other calculation processing device to share information processing and image processing.

Furthermore, the control unit 340 of the image generation apparatus 310 relates to the movement of the head of the user and the utterance of the user received from the HMD 110 and/or the controller 210, the text input information by the controller operation, and the movement and operation of the controller. An input detection unit 610 that detects information, a character control unit 620 that executes a control program stored in a control program storage unit for a character stored in a character data storage unit 650 of a storage unit 350 in advance, and a character control unit. An image generation unit 630 that generates an image based on Here, regarding the control of the movement of the character, information such as the direction and inclination of the user's head and the movement of the hand detected via the HMD 110 and the controller 210 is created in accordance with the movement and restrictions of the joints of the human body. This is realized by converting the motion of each part of the bone structure and associating the bone structure with previously stored character data to apply the motion of the bone structure. Further, the control unit 340 includes a voice recognition unit 640 that recognizes a voice from the utterance content of the user and a text conversion unit 650 that converts the recognized voice into a text.

The storage unit 350 stores, in the above-described character data storage unit 650, information related to the character such as character image data as well as the character attribute. Further, the control program storage unit 670 stores a program for controlling the motion and facial expression of the character in the virtual space. The streaming data storage unit 660 stores the image generated by the image generation unit 630.

FIG. 7 is a diagram showing an example of a virtual space displayed on the HMD 110 according to this embodiment. In this embodiment, it is assumed that characters have a voice conversation in a virtual space. FIG. 7 shows, as an example, a virtual space in which a character 720(A) representing the user A and a character 720(B) representing the user B who is a partner of the user A's dialogue are face-to-face. The user A and the user B virtually conduct a voice conversation via the characters 720(A) and 720(B). The voice may be reproduced as the user's raw voice as it is, or the voice may be converted into text in the image generation device 310, and a synthetic voice may be created and reproduced based on the converted text. Good.

In the virtual space, the character 720 is arranged in a state where at least the chest and above are visible to each other. The eyes 721 of the character 720 are movable, and the line of sight 722 of the character 720 is set by moving the eyes 721.

In the present embodiment, the line of sight 722 of the character 720 is set by operating the controller 210. In the present embodiment, as an example, by tilting the controller 210 while pressing the trigger button 240, it is assumed that the line of sight 722 is set according to each tilt in the three axis directions.

The display panel 120 of the HMD 110 may display a user's virtual hand (not shown) in the virtual space. In addition, a ray (light ray) may be displayed from the virtual hand according to the inclination of the three axes. In this case, the ray can be used as a pointer, and when the trigger button 240 is pressed, the sight line 722 of the character 720 can be directed to the point indicated by the ray. Further, the point indicated by the ray may be the operation target. For example, displaying the contents on the display panel 120 with an object (for example, a print arranged on a desk in the example of FIG. 7) arranged ahead of the ray in the virtual space as an operation target. You can In this case, when the user has a conversation while reading the content of the print, the user is talking about the object to which the line of sight 722 of the character 720 in the virtual space is facing, so that the character 720 has a conversation in a natural atmosphere. be able to. Note that the image generating apparatus 310 may create a ray so that another user can view the ray in response to an instruction from the user.

Further, each part of the character 720 can be linked with the operation of the HMD 110 and the controller 210. For example, the orientation and inclination of the head of character 720 can be set according to the orientation and inclination of HMD 110. Further, when the line of sight 722 is moved as described above, the orientation and inclination of the head may be set according to the line of sight 722.

FIG. 8 is a diagram showing a flow of processing in the HMD system according to the present embodiment.

The input detection unit 610 of the control unit 340 of the image generation apparatus 310 receives the input data from the HMD 110, for example, the utterance data of the user (S101). The voice recognition unit 640 recognizes voice based on the received speech data. As a voice recognition method, for example, utterance data is recorded in advance as learning data, the features extracted from the input utterance data are compared with the features extracted from the learning data, and the closest language string is used as the voice recognition result. It is conceivable to use a hidden Markov model or the like.

Next, the text conversion unit 650 of the control unit 340 of the image generation apparatus 310 converts voice into text based on the voice recognition result (S102).

Next, the image generation unit 630 of the image generation apparatus 310 generates an image including the converted text, transmits the image to the user's HMD via the input/output unit 320 or the communication unit 330, and the text is displayed on the HMD. It is output and displayed on the panel (S103).

As described above, according to the HMD system 300 according to the present embodiment, by converting the voice uttered by the user into text in the virtual space and displaying the text, the conversation between the characters played by the user in the virtual space can be performed. Further convenience can be provided.

Although the present embodiment has been described above, the above embodiment is for the purpose of facilitating the understanding of the present invention and is not for limiting and interpreting the present invention. The present invention can be modified and improved without departing from the spirit thereof, and the present invention also includes equivalents thereof.

For example, in the present embodiment, the HMD 110 and the controller 210 respectively communicate with the image generation device 310, but the present invention is not limited to this, and a signal from the controller 210 is transmitted to the HMD 110, and the HMD 110 passes through the controller 210. The input data may be transmitted to the image generating device 310. In addition, input data from the HMD 110 and the controller 210 may be transmitted via a user terminal such as a smartphone.

Further, the HMD system 300 of the present embodiment is assumed to be a conversation system in the virtual reality space using the HMD 110, but the same processing can be performed in the augmented reality space or the mixed reality space. For example, the appearance of the HMT 110 can be photographed by the camera 160, and the character 720 can be superimposed and displayed with the photographed image as the background.

In addition, in the present embodiment, the user exemplifies that text input is performed via the controller 210, but the present invention is not limited to this. For example, a method for performing direct input using a touch panel or a keyboard of a smartphone or a hand tracking method is used for virtual A method of inputting by operating a keyboard in the space is also conceivable.

(Second embodiment)
The second embodiment of the present invention will be described below. The configuration and method implemented in this embodiment are the same as those in the first embodiment except what is particularly mentioned below. FIG. 9 is a functional configuration diagram of the image generation apparatus 310 according to the second embodiment. In this embodiment, the image generation apparatus 310 of the first embodiment has a translation execution unit 655 and a translation dictionary storage unit 690 related to the translation function.

FIG. 10 is a diagram showing a flow of processing in the HMD system according to the second embodiment.

The input detection unit 610 of the control unit 340 of the image generation apparatus 310 receives the input data from the HMD 110, for example, the utterance data of the user (S201). The voice recognition unit 640 recognizes voice based on the received speech data. As a voice recognition method, for example, utterance data is recorded in advance as learning data, the features extracted from the input utterance data are compared with the features extracted from the learning data, and the closest language string is used as the voice recognition result. It is conceivable to use a hidden Markov model or the like.

Next, the translation execution unit 655 of the control unit 340 of the image generation apparatus 310 refers to the translation dictionary storage unit 690 based on the voice recognition result and executes translation (S202). Regarding translation, for example, the contents uttered in Japanese may be translated into English, or depending on the document of the dictionary stored in the translation dictionary storage unit, it may be translated into another language other than English.

Next, the image generation unit 630 of the image generation device 310 generates an image including the converted translation text, transmits the image to the user's HMD via the input/output unit 320 or the communication unit 330, and the text is the HMD. Is displayed and displayed on the display panel (S203).

As described above, according to the HMD system 300 according to the present embodiment, in the virtual space, the voice uttered by the user is translated into another language and displayed, so that the conversation between the characters played by the user in the virtual space is performed. Further convenience can be provided.

(Third Embodiment)
The third embodiment of the present invention will be described below. The configuration and method implemented in this embodiment are the same as those in the first embodiment except what is particularly mentioned below. FIG. 11 is a functional configuration diagram of the image generation apparatus 310 according to the third embodiment. In the present embodiment, in addition to the voice recognition unit 640 and the text conversion unit 650 of the image generation device 310 of the first embodiment, a voice synthesis unit 645 for converting the input text into voice is provided.

FIG. 12 is a diagram showing a flow of processing in the HMD system according to the third embodiment.

The input detection unit 610 of the control unit 340 of the image generation apparatus 310 receives the input data from the HMD 110 or the controller 210, for example, text data (S301).

Next, the voice synthesis unit 645 of the control unit 340 of the image generation apparatus 310 generates voice corresponding to the text based on the input text data (S302). The voice synthesis is realized by extracting a voice corresponding to the text from a sound source (not shown) by a predetermined algorithm.

Next, the voice synthesis unit 645 of the image generation apparatus 310 transmits the generated voice to the user's HMD via the input/output unit 320 or the communication unit 330, and the voice is output through the speaker of the HMD. Is output and displayed on the display panel (S303).

As described above, according to the HMD system 300 according to the present embodiment, by converting the text input by the user into a voice in the virtual space and outputting the text, the conversation between the characters played by the user in the virtual space is further enhanced. It is possible to provide convenience.

(Fourth Embodiment)
Hereinafter, the fourth embodiment of the present invention will be described. The configuration and method implemented in this embodiment are the same as those in the first embodiment except what is particularly mentioned below. FIG. 13 is a functional configuration diagram of the image generation apparatus 310 according to the fourth embodiment. In the present embodiment, the image generation apparatus 310 of the first embodiment includes an answer generation unit 685 for generating an answer to the input content of the user and a voice synthesis unit 645 for generating a voice for the answer.

FIG. 14 is a diagram showing a flow of processing in the HMD system according to the fourth embodiment.

The input detection unit 610 of the control unit 340 of the image generation apparatus 310 receives the input data from the HMD 110, for example, the utterance data of the user (S401). The voice recognition unit 640 recognizes voice based on the received speech data. As a voice recognition method, for example, utterance data is recorded in advance as learning data, the features extracted from the input utterance data are compared with the features extracted from the learning data, and the closest language string is used as the voice recognition result. It is conceivable to use a hidden Markov model or the like.

Next, the text conversion unit 650 of the control unit 340 of the image generation apparatus 310 converts the voice into text based on the voice recognition result (S402).

Next, the answer generation unit 685 of the control unit 340 of the image generation apparatus 310 generates an answer to the user based on the converted text data (S403). Here, when generating an answer, a method for extracting an answer text corresponding to the question text data (not shown) by referring to a question/answer table (not shown) and a response text for a predetermined utterance by referring to a conversation table (not shown) Or a history of conversations between users in the virtual reality space is stored in advance as text data, a learning model for an answer/response corresponding to a given question/utterance is generated, and the learning model is referred to. A method of extracting an answer/response text by using the above method can be considered.

Next, the voice synthesis 645 of the image generating apparatus 310 generates voice corresponding to the converted text (S404).

Next, the voice synthesis unit 645 of the image generation apparatus 310 transmits the generated voice to the user's HMD via the input/output unit 320 or the communication unit 330, and the voice is output through the speaker of the HMD. Is output and displayed on the display panel (S405).

As described above, according to the HMD system 300 according to the present embodiment, the answer contents of the other user are generated based on the utterance contents of one user even if both users do not have a conversation in the virtual space. You can feel as if you are enjoying a conversation. As a result, it is possible to provide further convenience in the conversation between the characters played by the user in the virtual space.

110 HMD
120 Display Panel 130 Housing 140 Sensor 150 Light Source 160 Camera 170 Microphone 180 Headphones 210 Controller 220 Left Hand Controller 230 Right Hand Controller 235 Grip 240 Operation Trigger Button 250 Infrared LED
260 sensor 270 joystick 280 menu button 300 HMD system 310 image generation device

Claims (5)

A method of controlling a character played by a performer user in a virtual space,
Placing the character in the virtual space,
Detecting user input,
Converting the input content into output content in another format,
Outputting the output content in a virtual space,
A control method comprising: The control method according to claim 1, wherein
The control method, wherein the input content is user's voice data, and the output content is text data corresponding to the voice data. The control method according to claim 1, wherein
The control method, wherein the input content is text data and the output content is voice data corresponding to the text data. The control method according to claim 1, wherein
The control method, wherein the input content is voice data regarding a first language, and the output content is voice data regarding a second language corresponding to the first language. The control method according to claim 1, wherein
The input content is voice data, the output content is voice data relating to an answer to the voice data, and the output content is output as a voice of a second performer user arranged in the virtual space. , A control method characterized by.