JP2020121165A - Computer program for assisting user input - Google Patents

Abstract

To provide a computer program for assisting user input capable of minimizing user operation to a touch panel minimum by using voice input in order to facilitate input operation of contact information such as a stamp.SOLUTION: A computer program includes a view image generation section for generating a view image on the basis of an arrangement of a character associated with a user 1 in a virtual space, and displays the view image on a display included in a user terminal of a user; an input section for receiving voice input through a microphone included in the user terminal; and an output section for superposing the voice input based contact information on the view image, and displays the superposed image on the display. The computer program allows a contact information arrangement region for superposing the contact information to function as an output section in the user terminal for determining the contact information arrangement region in the view image according to at least a volume of the voice input.SELECTED DRAWING: Figure 4

Description

The present invention relates to a computer program for supporting user input. More specifically, the present invention relates to a computer program for assisting a user in facilitating input of contact information from a user terminal when a plurality of users share a virtual space and interact with each other. Is.

It is known that a plurality of users share a virtual space and interact with each other such as exchanging messages through online information transmission. For example, a message chat application using a smartphone is known. In particular, as the posted content of the user, image chat using not only text information but also icon image information called a stamp is known.

In addition, regarding the display of the posted content of the user, it is known that information input by each user in the virtual space is displayed in a balloon from a character (avatar) associated with the user. For example, in Patent Document 1, when displaying a post by a user who is following in SNS or the like, a post content of each follow user is displayed as a balloon from the character on a space field screen displaying a character associated with each user. To do.

In an online game using a smartphone, particularly in a battle-type online RPG in which a user can operate a character in a virtual space, when sharing the virtual space in the game with a plurality of users, the sharing users in the virtual space As a communication method, it is assumed that text information or contact information such as a stamp input by each user is displayed in a balloon from a character associated with the user.

2012-018569 gazette

In a battle-type online RPG, the input operation on the touch panel of the smartphone generally requires immediacy, whereas the contact information to be input by the user, particularly the operation of selecting the stamp, requires many touch operations. As such, it is not suitable to require the user to perform a conventional stamp input operation. In particular, since there are various kinds of stamps provided to users in recent image chats, it is not appropriate for the user to take a long time to select a desired stamp from the viewpoint of progress of a competitive online RPG game. ..

Therefore, in order to facilitate the input operation of contact information such as such a stamp, the present invention can minimize the user operation on the touch panel by using voice input, and further provide a screen display mode corresponding to voice. It is an object of the present invention to provide a computer program for supporting a user input to perform.

In order to solve the above-mentioned problem, according to the present invention, a visual field image is generated based on the arrangement of a character associated with one user in the virtual space, and the visual field is displayed on the display included in the user terminal of the user. An image generation unit, an input unit that receives a voice input through a microphone included in a user terminal, and an output unit that superimposes contact information based on the voice input on a visual field image and displays it on a display for superimposing contact information. A computer program for supporting user input, which causes the user terminal to function as an output unit, is obtained in which the contact information arrangement area is determined in the visual field image at least according to the volume of the voice input.

Features and advantages of the invention will be apparent from the following detailed description of the invention, the accompanying drawings, and the appended claims.

FIG. 1 is an overall schematic diagram of a computer system for executing a computer program according to an embodiment of the present invention. FIG. 2 is a schematic block diagram showing the configuration of the user terminal shown in FIG. FIG. 3 is an example game screen to which the computer program according to the embodiment of the present invention is applied as a game application. FIG. 4 is a game screen of another example in which the computer program according to the embodiment of the present invention is applied as a game application. FIG. 5 is a detailed main functional block diagram related to the control unit of the user terminal shown in FIG. FIG. 6 is a flow diagram related to an example of interaction between the own user and the other user via the server system realized by the embodiment of the present invention. FIG. 7 is a flow diagram regarding voice input processing implemented by the computer program according to the embodiment of the present invention. FIG. 8 is a flow chart relating to a contact information screen output process implemented by the computer program according to the embodiment of the present invention. FIG. 9 is a schematic image diagram of an example of determining a contact information arrangement area in a view image and superimposing the contact information on the view image according to the embodiment of the present invention. FIG. 10 is a schematic image diagram of another example in which the contact information arrangement area is determined in the view image and the contact information is superimposed on the view image according to the embodiment of the present invention. FIG. 11 is a schematic image diagram of an example in which a balloon image accommodating contact information in the contact information arrangement area is generated and superimposed on the view image according to the embodiment of the present invention.

[Description of Embodiments of the Present Invention]
First, the contents of the embodiments of the present invention will be listed and described. A computer program for supporting user input according to the embodiment of the present invention has the following configuration.

(Item 1)
A field-of-view image generation unit that generates a field-of-view image based on the arrangement of the character associated with one user in the virtual space and displays the field-of-view image on a display included in the user terminal of the user.
An input unit for receiving voice input through a microphone included in the user terminal;
An output unit that superimposes contact information based on the voice input on the visual field image and displays it on the display, wherein a contact information arrangement area for superimposing the contact information is at least according to the volume of the voice input. A computer program for supporting user input, which is determined in the view image and causes the user terminal to function as an output unit.

According to the computer program of this item, the contact information can be input by voice input through a microphone, so that the user can efficiently perform the input operation without requiring many touch operations on the touch panel. .. In particular, in the above battle-type online RPG, it is possible to allow the user to input a stamp according to the game situation without hindering the progress of the game.
Also, by adopting the volume at the time of voice input as a parameter during the output processing of contact information, it is possible to output the contact information on the screen more dynamically for the user, and to enhance the realism of real-time communication between users. can do.

(Item 2)
The computer program according to item 1, wherein the output unit displays the contact information together with a balloon image in the contact information arrangement area.

(Item 3)
The virtual space is shared with other characters associated with other users,
In the output unit, further, other contact information input by the other user is displayed on the display by superimposing it on the view image based on the arrangement of the character associated with the one user. Alternatively, the computer program according to item 2.

(Item 4)
In the output unit, another contact information arrangement area for superimposing the other contact information is determined in the view image at least according to the arrangement of the other character,
4. The computer program according to item 3, wherein the other contact information is displayed in the other contact information arrangement area together with a balloon image.

(Item 5)
5. The computer program according to any one of Items 1 to 4, wherein the contact information is text information based on text conversion of the voice input.

(Item 6)
6. The computer program according to any one of items 1 to 5, wherein the contact information is a stamp image that is associated with text based on the text conversion of the voice input and is stored in the user terminal.

[Details of the embodiment of the present invention]
Hereinafter, a computer program for supporting user input according to an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is an overall schematic diagram of a computer system for executing a computer program for supporting user input according to an embodiment of the present invention. In FIG. 1, only the major components of the computer system are shown. The computer system 100 includes user terminals 10-1 to 10-4 (hereinafter collectively referred to as "user terminal 10") and a computer server 50, and a network 30 (particularly, an internet network) between these elements. To communicate via. In the following, as an example, an online program in which the computer program according to the embodiment of the present invention is applied to a smartphone game as a game program to allow a plurality of users to communicate with each other in a shared game space (three-dimensional virtual space) It is assumed that a user plays a game, in particular, a battle-type online RPG in which each user can operate a character associated with himself/herself in a three-dimensional virtual space.

The user terminal 10 may be any device that can generate and display a game image by using the data sent from the computer server 50 and executing the program sent from the computer server 50. For example, it can be connected to the Internet. Including, but not limited to, mobile phones, smartphones, tablet terminals, game consoles, notebook PCs, and the like. As illustrated, the user terminal 10 includes a terminal display unit 11, a terminal input unit 12, a terminal processing unit 13, a terminal communication unit 14, a terminal storage unit 15, and the like, which are electrically connected to each other via a bus. To be done.

Data and programs received from the game server 50 by the terminal communication unit 14 are temporarily stored in the terminal storage unit 15, and a screen image is generated by the terminal processing unit 13 according to the progress of the game, and the terminal display unit 11 Displayed by. The terminal display unit 11 can be realized by, for example, a liquid crystal display (LCD) or the like, but it is particularly preferable to configure it as a touch display as described later in FIG. The terminal input unit 12 inputs a command for controlling the operation of a virtual camera arranged in a three-dimensional virtual space, a command input of general user actions for advancing a game (including voice input), and a virtual space. Send contact information to

The program is executed in the terminal processing unit 13 based on the input command received by the terminal input unit 12. Alternatively, a user command may be created, communicate with the computer server 50 through the terminal communication unit 14 and the network 30, and the computer server 50 may execute the program. The terminal storage unit 15 stores various data associated with the user terminal, an application such as a browser necessary for displaying image data, and contact data such as text data and stamp image data received from the game server 50. It also stores various data such as data and programs for generating screen images.

On the other hand, the computer server 50 includes a processing unit 51, a main memory 52, an external memory 53, a user interface 54, a communication unit 55, a disk drive 56, etc., which are electrically connected to each other via a bus. To be done. The processing unit 51 stores the program modules stored in the external memory 53 and various data such as user data, stamp image data, virtual space information, and game progress data stored in the disk drive 56 into the main memory 52. To control the progress of the game by sequentially executing various computer programs. In particular, the processing unit 51 is configured to manage data and programs such as virtual space information to be shared between the user terminals 10 and provide the data to the user terminals 10 via the communication unit 55 as necessary. The user interface 54 is accessed by the administrator of the game server 50 to make various server function settings and network settings.

The user terminal 10 may be configured to perform all or part of various functions of the computer server 50 as an information processing apparatus. In this case, the user terminal 10 itself constitutes the information processing apparatus, or the user terminal 10 and the computer server 50 are combined to constitute the information processing apparatus as a whole.

As an example of the user terminal 10, FIG. 2 shows a block diagram regarding the basic configuration of the mobile terminal (particularly a smartphone) 10. As illustrated, the mobile terminal 10 includes a touch display 110, a voice detection unit/microphone 130, a control unit 140, and a storage unit 150 as a basic configuration. The touch display 110 is a display unit/display 120 for displaying various data stored in the storage unit 150, and a touch operation on the display unit/display 120 with an object such as a human finger or a stylus (mainly, A touch detection unit/touch panel 125 that detects a touch operation, a physical contact operation such as a swipe (slide) operation, and a tap operation, and a voice detection unit (microphone) 130 that detects a voice input to a mobile terminal.

Due to the structure of the touch display, the contact detection unit 125 is arranged in the upper layer of the display 120 such as a liquid crystal panel, an organic EL, a plasma display. The contact detection unit 125 can adopt a pressure detection method, a resistance film method, a capacitance method, an electromagnetic induction method, or the like. When an input by contact of an object such as a finger or a stylus is received on the contact detection unit 125, the amount of change in pressure, electric resistance, electric capacity, energy of elastic wave, or the like is detected at the contact position, and the display unit 120 displays. The corresponding contact coordinates of are identified.

The voice detection unit 130 can be a microphone for voice communication that is standardly installed in a user terminal or the like. The control unit 140 is configured to execute the computer program according to the embodiment of the present invention to operate the mobile terminal 10 according to a processing instruction from the terminal processing unit. Details of the control unit 140 will be described later with reference to FIG. The storage unit 150 stores the computer program according to the present embodiment, a game program, data related to a user or a game, and contact information data in general, and registers, updates, or deletes information according to a command from the control unit. Etc. are carried out. The stamp image input through the computer program according to the present embodiment can also be stored when the user downloads it from the server 50 to the mobile terminal 10.

3 and 4, an outline of an example of game content of an online action RPG to which the computer program according to the embodiment of the present invention is applied will be shown. Here, a plurality of users share the same three-dimensional virtual space, and each can perform an action operation for their own character in the three-dimensional virtual space. In addition, each user can progress the game by operating actions on the character, and can interact with each other through the character, that is, real-time chat such as text chat and image chat at the same time as the game progresses. is there.

3A and 3B are a series of game images displayed on the user screen of the user (own user) operating the own character 1. Since the associated character and its arrangement are different for each user, the game screen displayed on the terminal is different for each user. The view field image 3 of FIGS. 3A and 3B is an image displayed on the screen of the user's terminal based on the arrangement of the character 1 (slightly above the center of the screen). On the other hand, the image displayed on the screen of the terminal of another user (an opponent user) who operates the opponent character 2 becomes a visual field image based on the arrangement of the opponent character 2 (slightly above the center of the screen), and FIG. It is different from the view image of the own user in (b).

As described above, the own character 1 is displayed near the upper center of the view image 3 of the own user. That is, the arrangement of the player character 1 is aligned with the predetermined position range on the display screen. The user can move his/her character 1 in the three-dimensional virtual space in accordance with a user command through the terminal input unit. A virtual camera is associated with the player character 1, the virtual camera is arranged behind and above the player character in the three-dimensional virtual space (not shown), and moves so as to follow the player character's movement. To do. The visual field image 3 is generated based on the visual field area of the own character 1 from the virtual camera, and is displayed on the display of the terminal. Here, each character has a character characteristic 5 and is displayed at the lower left of the screen. The character characteristics 5 include, for example, the type of the character, the character image, the strength as a character (hit points (HP: physical strength points of the character), skill points (SP: skill points for performing special moves), etc. Is included.

In the example of FIG. 3A, the opponent character 2 operated by the opponent user is located in the lower left part of the own character 1, and is reflected in the visual field image 3. Then, the self-user 1, are sent to their user contact information of "Hello" from the terminal (text data) three-dimensional virtual space by entering the. As a result, as shown, it is "Hello" and balloon image 4 displayed text displayed from the player character 1 in field image 3 is displayed on the screen of the host user. Of course, even on the screen of the other user, that the "Hello" and the text displayed balloon image is displayed from the own character 1 it is to be understood.

When the own user moves the own character 1 upward in the three-dimensional virtual space, the view image as shown in FIG. 3B is displayed. In this case, the opponent character 2 progresses in the game so as to be located at the lower left of the screen apart from the own character 1. In addition, in FIG. 3 (b), as the player character in FIGS. 3 (a) to respond to originated the contact information of "Hello" to the 3-dimensional virtual space, "Contact from the other users own terminal Enter the contact information "How are you?!" and send it out in the 3D virtual space. As a result, even in the visual field image 3 of the own user, the balloon image 4 in which the text "How are you!?" is displayed from the opponent character 2 is displayed.

Note that, in FIG. 3, the contact information transmitted to the characters sharing the in-game space is text information, but as shown in FIG. 4C, the contact information is a stamp (that is, image chat) like image chat. It may be an image (generally called an icon). Further, the content to which the computer program according to the embodiment of the present invention can be applied is not limited to the game application, particularly the online action RPG as shown in FIGS. 3 and 4. In addition to this, for applications such as SNS and electronic bulletin boards, which perform communication in a three-dimensional virtual space in which a plurality of users exchange messages and inform related users of their current status, It will be appreciated that the computer programs according to embodiments of the invention are widely applicable.

FIG. 4 is an image diagram when the own user transmits contact information to the three-dimensional virtual space by voice input at the same time as the game progresses. FIG. 4A shows a state in which the "voice input mode" is switched to while the game is in progress. The switching can be performed by the user performing a user operation such as long-pressing a predetermined screen area, tapping a predetermined button, or tilting the user terminal while the game is in progress. When the user utters "Thank you!" in the "voice input mode" in FIG. 4A, the voice detection unit 130 detects it. The input voice is subjected to processing such as recognition and analysis by the control unit 140, and is output as a contact information image in the game screen as shown in FIGS. 4B and 4C. Specifically, the character string "Thank you" is voice-recognized and analyzed, converted into "Thanks!" or a predetermined stamp image stored in the conversion table stored in the storage unit 150 of the user terminal in advance, and the screen is displayed. Is output. As will be described later, in the conversion processing, it is preferable to use the sound quality and volume of the input sound as a conversion parameter.

Based on the screen image examples of FIGS. 3 and 4, a computer program for supporting user input according to the embodiment of the present invention will be described with reference to FIGS. In particular, the information processing based on the voice input illustrated in FIG. 4 will be described in detail. FIG. 5 is a main functional block diagram implemented in the user terminal 10 to carry out the processing, and the whole corresponds to the control unit 140 in FIG. As shown in FIG. 5, the control unit 140 roughly includes a game progression unit 61, a contact input unit 71, and a contact output unit 91. In addition, the game progression unit 61 includes a self-character movement control unit 611, a virtual camera control unit (visual field determination unit) 613, and a visual field image generation unit 615. The contact input unit 71 includes a voice detection unit 711, a voice analysis unit 713, a voice conversion unit 715, and a good b contact information determination unit 717. Furthermore, the contact output unit 91 includes a contact information arrangement area determination unit 911, a contact image generation unit 913, and a contact information superposition unit 915. In addition to the above, the control unit 140 also includes a contact receiving unit 81, a character placement determining unit 83, and the like. It should be noted that FIG. 5 only describes the minimum set of main functions for implementing the computer program according to the embodiment of the present invention.

Referring now to the flow diagram of FIG. 6, relating to an example interaction between a user's and another user's server system implemented by a computer program for supporting user input according to an embodiment of the present invention. The information processing to be performed will be described. Here, the user terminal of the own user a capable of controlling the action of the own character and the user terminal of the other user b capable of controlling the action of the opponent character exchange messages via the server system while proceeding with the respective games. It is supposed to do.

In the information processing illustrated in FIG. 6, first, in step S1s, the server system distributes virtual space information shared among users, and the own user a and the other user b receive the virtual space information in steps S1a and S1b. By expanding, the virtual space is shared. Subsequent information processing is mainly composed of a game progressing process (normal game progressing; upper half of FIG. 7) associated with the movement of the character in space and a contact process (lower half of FIG. 7) relating to in-space contact.

The game progress process accompanying the movement of the character in the space is composed of steps S2a to S4a by the own user a, steps S2b to S4b by the opponent user b, and step S2s by the server system. In step S2a, the own user a operates the own character by the own character movement control unit 611 to move in the three-dimensional virtual space. In step S3a, the virtual camera control unit 613 causes the virtual camera to follow the self character as the self character moves in the three-dimensional virtual space. Then, the visual field area is determined which is associated with the arrangement of the own character associated with the own user in the three-dimensional virtual space. It should be noted that the movement information of the player character may be reflected in the server system one by one, periodically, or by one or more of event triggers. That is, in step S2s, the server system updates the virtual space information with the position information of the player character and feeds it back to each user. Then, in step S4a, a field-of-view image is generated by the field-of-view image generation unit 615 based on the field-of-view area determined in step S3a and displayed on the display of the user terminal. The same applies to the movement in space by the opponent character of the opponent user b (steps S2b to S4b).

The contact process regarding the in-space contact includes steps S5a to S6a by the own user a, steps S5b to S6b by the other user b, and step S3s by the server system. While the game proceeds while the own character of the own user a and the partner character of the other user b move while sharing the three-dimensional virtual space, in step S5a, the own user a uses the contact input unit 71, that is, the user. Contact information is transmitted in the three-dimensional virtual space by voice input through the microphone of the terminal. That is, the contact information as illustrated in FIGS. 3 and 4 is transmitted to the user (partner user b) who shares the three-dimensional virtual space (detailed in FIG. 7). The contact information may be text information based on text conversion or stamp image information associated with text based on text conversion. The contact information to be transmitted is used in the process of updating the spatial information on the server system side in step S3s, then transmitted in the three-dimensional virtual space and notified to both the own user a and the other user b.

Then, on the side of the user a, in step S6a, the contact output unit 91 superimposes the balloon image accommodating the contact information transmitted by itself on the view image of the character based on the arrangement of the character, and displays it on the display (FIG. 8). At the partner user b side, in step S5b, the contact receiving unit 81 receives the contact information from the own user a together with the input voice related information, and the character placement determining unit 83 identifies the placement position of the own character in the three-dimensional virtual space. To do. The input voice related information may include a volume parameter and a sound quality parameter used for determining the contact information arrangement area. Subsequently, in step S6b, the contact output unit 91 superimposes the balloon image accommodating the received contact information on the visual field image of the opponent user based on the arrangement of the own character and displays it on the display.

Next, with reference to FIGS. 7 to 11, in particular, the information processing of steps S5a and S6a by the own user a will be described in detail. Among these, FIG. 7 is a detailed flow chart of the contact calling process through voice input in step S5a of FIG. 6, and FIG. 8 corresponds to the contact process related to the screen image of FIG.

In step S51a of FIG. 7, first, the voice detection unit 711 receives a voice input through the microphone included in the user terminal, and then proceeds to step S52a to obtain and analyze voice information in the voice analysis unit 713. In the analysis of voice, the volume and sound quality of the input voice are mainly acquired as voice related information. The voice-related information can be used to determine the size of the contact information arrangement area and/or to determine the type of balloons to be accommodated in the contact information arrangement area and the display mode of the contact information. Here, the sound quality can be acquired by a known evaluation method. As an example, the frequency characteristics, distortion, SNR and dynamic range of a voice signal as a physical signal may be obtained, and/or the subjective quality of voice standardized by the International Telecommunication Union (ITU). You may acquire the score by an evaluation method and an objective quality evaluation method. However, it should be understood by those skilled in the art that the sound quality parameters are not limited to these.

In step S53a, the voice conversion unit 715 converts the input voice into text information. Specifically, in the example of FIG. 4A, the text input is converted to "Thank you" for the voice input. In step S54a, the contact information determining unit 717 determines contact information based on the converted text information. Specifically, the text converted “Thank you” in FIG. 4A is converted into “Thanks!” or a corresponding stamp image based on a conversion table defined in advance and stored in the storage unit 150. , Contact information is determined. Finally, in step S55a, the determined contact information is transmitted to the server system for transmission to the three-dimensional virtual space as shown in FIGS. 3 and 4 and notifying the shared user. At this time, it is preferable to send the above-mentioned voice-related information related to voice input together.

As described above, the computer program supporting the user input according to the embodiment of the present invention can very efficiently input desired contact information from a large number of candidates through voice input without hindering the progress of the game. You can In addition, the association between the text (“Thank you”) and the corresponding information (“Thanks!” and the text information including symbols (“♪” “★”, etc.) and the corresponding stamp image) to be converted is It is possible to adopt any mode, whether each user individually implements and stores the association information or downloads and stores the association information from the server side.

FIG. 8 is a detailed flow chart of the contact output process of superimposing the contact information based on the voice input on the visual field image and displaying it on the display in step S6a of FIG. 6, and FIG. This corresponds to the output processing of the screen image. 9 to 11 are some exemplary schematic images related to the contact output process.

In step S61a of FIG. 8, the character placement determination unit 83 determines placement information in the three-dimensional virtual space of the character that transmitted the contact information. In the example of FIG. 4, since the user himself/herself has input the contact information, the position coordinate of the corresponding own character is determined. Note that, as in the example of FIG. 9A, it is preferable that the position of the player character is basically the center of the view image. Succeedingly, in a step S62a, the contact information arrangement area determination unit 911 determines a contact information arrangement area for superimposing the contact information in the visual field image according to the determined arrangement information and the voice related information in the step S55a. More specifically, the reference point in the view image and the position and size of the contact information arrangement area are determined. The reference point is necessary for generating the balloon image, and as an example, the reference point is preferably associated with the arrangement position of the character, but is not limited to this. For example, as shown in FIG. 9B, it is preferable to adopt the position coordinates of the head of the own character as the reference point. Further, the contact information arrangement area is an area for accommodating the balloon image, and similarly, as shown in FIG. 9B, the position of the contact information arrangement area is changed according to the relative position of the reference point in the entire visual field image. At least according to the volume included in the voice-related information, it is preferable to determine the loudness.

Here, as can be seen by referring to the example of FIG. 11, the contact information is displayed on the display together with the balloon image (so as to be contained in the balloon image) in the contact information arrangement area. The contact information placement area is preferably hidden on the display. As shown in the figure, the balloon information is stored in the contact information arrangement area, and the contact information (that is, the stamp image (a) and the text information (b)) is stored in the balloon image. Further, as shown in the figure, the balloon image includes a tip portion aligned with the reference point of the contact information arrangement area and a main body portion containing the stamp image and text information, and is formed by combining these. ..

Returning to FIG. 8, in step S63a, the tip portion of the balloon image is aligned with the reference point in the view image determined in step S62a. Next, in step S64a, the size of the main body portion is adjusted so that the main body portion of the balloon image is accommodated in the visual field image, and then the main body portion is joined to the tip portion. The shape of the main body is not limited to the rectangular shape shown in FIGS. 11A and 11B, and may be, for example, a rounded shape, a polygonal shape, or any other shape. In particular, the shape may be determined according to the sound quality information included in the voice related information. Specifically, when the voice quality is poor, the balloon image may be formed so as to have a polygonal (ragged) main body portion, and when the voice quality is good, a square main body portion.

Next, in step S65a, the size of the contact information displayed (that is, the size of the stamp or the font size of the text information) is adjusted based on the size of the body part adjusted in step S64a, and the contact information is stored in the body part. Then, the contact image information is generated. In particular, when the contact information is text information, the font type may be further determined according to the sound quality information included in the voice related information. These steps S63a and S64a are performed by the contact image generation unit 913. Finally, in step S66a, the contact information superimposing unit 915 superimposes the contact image information on the field-of-view image together with the balloon image and displays it on the screen as a game image as shown in FIGS. 3 and 4B and 4C. ..

In this way, by adopting the voice-related information such as the volume and sound quality at the time of voice input as the parameter at the output process of the contact information, it is possible to generate the contact image information more dynamically for the users, and The realism of real-time communication can be enhanced.

In FIG. 9C, the stamp image is arranged at the center of the contact information arrangement area as the contact image information, but the present invention is not limited to this, and the stamp image may be arranged at any place as long as it is accommodated in the view image. You may. In the example of FIG. 9, the user sends a stamp, and a balloon is displayed on the character. On the other hand, the example of FIG. 10 is an example in the case where contact information is selected and transmitted by another partner user who shares the three-dimensional virtual space. Also in this case, first, as shown in FIG. 10A, at least the placement information of the opponent character in the three-dimensional virtual space is determined (step S61a), and according to the placement information and the received voice-related information, FIG. As described above, the reference point and the contact information arrangement area for displaying the contact information in the visual field image based on the arrangement of the own character of the own user are determined (step S62a), and as shown in FIG. The contact image information is superimposed on the balloon image in the contact information arrangement area and displayed on the display (steps S63a to S66a).

The computer program for supporting user input according to the embodiments of the present invention has been described above with various examples. The embodiments described above are merely examples for facilitating the understanding of the present invention, and are not for limiting the interpretation of the present invention. It goes without saying that the present invention can be modified and improved without departing from the spirit thereof and that the present invention includes equivalents thereof.

Claims (6)

A field-of-view image generation unit that generates a field-of-view image based on the arrangement of the character associated with one user in the virtual space and displays the field-of-view image on a display included in the user terminal of the user.
An input unit for receiving voice input through a microphone included in the user terminal;
An output unit that superimposes contact information based on the voice input on the visual field image and displays it on the display, wherein a contact information arrangement area for superimposing the contact information is at least according to the volume of the voice input. A computer program for supporting user input, which is determined in the view image and causes the user terminal to function as an output unit. The computer program according to claim 1, wherein the contact information is displayed in the contact information arrangement area together with a balloon image in the output unit. The virtual space is shared with other characters associated with other users,
In the output unit, further, other contact information input by the other user is superimposed on the view image based on the arrangement of the character associated with the one user, and is displayed on the display. The computer program according to 1 or 2. In the output unit, another contact information arrangement area for superimposing the other contact information is determined in the view image at least according to the arrangement of the other character,
4. The computer program according to claim 3, wherein the other contact information is displayed in the other contact information arrangement area together with a balloon image. The computer program according to claim 1, wherein the contact information is text information based on text conversion of the voice input. The computer program according to any one of claims 1 to 5, wherein the contact information is a stamp image associated with text based on the text conversion of the voice input and stored in the user terminal.