JP2021174283A - Computer program, server device, terminal device, and method - Google Patents

Abstract

To provide a computer program, a server device, a terminal device and a method capable of expressing an avatar more appropriately.SOLUTION: The computer program is executed by one or more processors, acquires information relating to one or more selected from a predetermined action of an avatar played by a distributor, the avatar's expression, the avatar's complexion, the avatar's voice or a predetermined situation caused in relation to the avatar in a virtual space, determines whether or not the acquired information satisfies the predetermined conditions, and when determining that the predetermined conditions are satisfied, generates information for causing the avatar's expression or pause relating to the distributer generated based on an expression or pause relating to the distributer to be a predetermined expression or pause corresponding to the predetermined conditions, and displays an avatar to which the predetermined expression or pause is applied.SELECTED DRAWING: Figure 8

Description

The techniques disclosed in this application relate to computer programs, server devices, terminal devices and methods.

In recent years, technology using avatars played by distributors has been developed. In this kind of technology, the viewer can watch the avatar played by the distributor through the distribution service.

Further, in relation to the service using an avatar, a service called "custom cast" is known as a service using a technique of controlling the facial expression and movement of an avatar object based on the movement of a performer or the like ("custom cast" is known. Non-Patent Document 1). In this service, the performer assigns one of a large number of prepared facial expressions or movements in advance to each of the plurality of flick directions with respect to the screen of the smartphone, and obtains the desired facial expression or movement. By flicking the screen of the smartphone along the corresponding direction, the avatar object displayed in the moving image can express the facial expression or movement.

"Custom Cast", [online], Custom Cast Inc., [Search December 10, 2019], Internet (URL: https://customcast.jp/)

However, in the technique disclosed in Non-Patent Document 1, the performer must flick the screen of the smartphone while speaking, and it is difficult for the performer to operate the flick.

The entire non-patent document 1 is incorporated in the present specification by citation.

Some embodiments disclosed in this application provide computer programs, server devices, terminal devices, and methods that can better represent avatars.

The computer program according to one aspect is executed by one or more processors to perform a predetermined action of the avatar played by the distributor, the expression of the avatar, the complexion of the avatar, the voice of the avatar, and the like. Alternatively, the information relating to any one or more of the predetermined situations occurring with respect to the avatar is acquired, it is determined whether or not the acquired information satisfies the predetermined conditions, and the predetermined information relating to the acquired information is determined. When it is determined that the conditions are satisfied, the avatar's facial expression or pose related to the distributor, which was generated based on the facial expression or pose related to the distributor, is changed to the predetermined facial expression or pose corresponding to the predetermined condition. Information for making the avatar's facial expression is generated, and the avatar to which the predetermined facial expression or pose is applied is displayed.

The computer program according to one aspect is executed by one or more processors to perform a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, and the like. Alternatively, it acquires information relating to any one or more of the predetermined situations that occur with respect to the avatar, determines whether or not the acquired information satisfies the predetermined conditions, and determines that the predetermined conditions are satisfied. In this case, information is generated to make the facial expression or pose of the avatar related to the distributor, which was generated based on the facial expression or pose related to the distributor, into a predetermined facial expression or pose corresponding to the predetermined condition. Then, the information for making the predetermined facial expression or pose is transmitted.

The server device according to one aspect includes one or more processors, and the processor executes a computer-readable instruction to perform a predetermined operation of the avatar played by the distributor in the virtual space. Whether or not information relating to one or more of facial expressions, the complexion of the avatar, the voice of the avatar, or a predetermined situation occurring with respect to the avatar is acquired, and the acquired information satisfies the predetermined conditions. When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor, which has been generated based on the facial expression or pose related to the distributor, corresponds to the predetermined condition. It generates information for making a predetermined facial expression or pose, and transmits the information for making the predetermined facial expression or pose.

The method according to one aspect is a method executed by one or more processors that execute a command readable by a computer, and a predetermined action of an avatar played by a distributor in a virtual space, the expression of the avatar, the above-mentioned. Acquires information relating to any one or more of the complexion of the avatar, the voice of the avatar, or the predetermined situation that occurs with respect to the avatar, and determines whether or not the acquired information satisfies the predetermined conditions. , When it is determined that the predetermined condition related to the acquired information is satisfied, the facial expression or pose of the avatar related to the distributor, which was generated based on the facial expression or pose related to the distributor, is set to the predetermined condition. Information for making the corresponding predetermined expression or pose into the expression of the avatar is generated, and the avatar to which the predetermined expression or pose is applied is displayed.

The method according to one aspect is a method executed by one or more processors that execute a computer-readable instruction, such as a predetermined action of the avatar played by the distributor, the facial expression of the avatar, and the above. Acquires information relating to any one or more of the complexion of the avatar, the voice of the avatar, or the predetermined situation that occurs with respect to the avatar, and determines whether or not the acquired information satisfies the predetermined conditions. , When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor, which has been generated based on the facial expression or pose related to the distributor, is changed to the predetermined facial expression corresponding to the predetermined condition. Alternatively, the information for making a pose is generated, and the information for making the predetermined facial expression or pose is transmitted.

The viewer terminal device according to one aspect includes one or more processors, and the processor executes a computer-readable instruction to perform a predetermined operation of the avatar played by the distributor in the virtual space. Whether to acquire information relating to any one or more of the avatar's facial expression, the avatar's complexion, the avatar's voice, or the predetermined situation occurring with respect to the avatar, and whether the acquired information satisfies the predetermined conditions. When it is determined whether or not, and it is determined that the predetermined condition related to the acquired information is satisfied, the expression or pose of the avatar related to the distributor generated based on the expression or pose related to the distributor is displayed. Information for making a predetermined expression or pose corresponding to the predetermined condition into the expression of the avatar is generated, and the avatar to which the predetermined expression or pose is applied is displayed.

The distributor terminal device according to one aspect includes one or more processors, and the processor executes a computer-readable instruction to perform a predetermined operation of the avatar played by the distributor in the virtual space. Whether to acquire information relating to one or more of the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar, and whether the acquired information satisfies the predetermined conditions. When it is determined whether or not the condition is satisfied, the facial expression or pose of the avatar related to the distributor, which has been generated based on the facial expression or pose related to the distributor, is set to the predetermined condition. It generates information for making a corresponding predetermined facial expression or pose, and transmits the information for making the predetermined facial expression or pose.

FIG. 1 is a block diagram showing an example of a system configuration according to an embodiment. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the server device 20 (terminal device 30) shown in FIG. FIG. 3 is a block diagram schematically showing an example of the function of the system according to the embodiment. FIG. 4 is an example of data possessed by the system according to the embodiment. FIG. 5 is an example of data possessed by the system according to the embodiment. FIG. 6 is an example of a flow processed by the system according to the embodiment. FIG. 7 is an example of a flow processed by the system according to the embodiment. FIG. 8 is an example of a flow processed by the system according to the embodiment.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the components represented in one drawing may be omitted in another for convenience of explanation. Furthermore, it should be noted that although the attached drawings disclose one embodiment of the present invention, they are not necessarily described on an exact scale. Further, in the documents of the present application, the object indicated by the term application may be what is called software or a program, and may be a command to a computer, which may be combined so as to obtain a result.

1. 1. Example of a system FIG. 1 is a block diagram showing an example of a system configuration according to an embodiment. As shown in FIG. 1, the system 1 may include one or more server devices 20 connected to the communication network 10 and one or more terminal devices 30 connected to the communication network 10. In FIG. 1, three server devices 20A to 20C are exemplified as an example of the server device 20, and three terminal devices 30A to 30C are exemplified as an example of the terminal device 30, but the server device 20 is used. , One or more server devices 20 other than these can be connected to the communication network 10, and one or more terminal devices 30 other than these can be connected to the communication network 10 as the terminal device 30. In this application document, the term system may be used to indicate both a server and a terminal device, a server only, or a terminal device only. That is, the system may be in any mode of server only, terminal device only, and both server and terminal device.

Further, the system may be an information processing device on the cloud. Further, the system constitutes a virtual information processing device, and may be logically configured as one information processing device. Also, the owner and administrator of the system may be different.

The communication network 10 may be, and is not limited to, a mobile phone network, a wireless LAN, a fixed telephone network, the Internet, an intranet, an Ethernet (registered trademark), and / or a combination thereof. In the communication network 10, various data disclosed in the documents of the present application may be communicated.

By executing a specific installed application, the server device 20 executes a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the voice of the avatar in the virtual space. When information on any one or more of the predetermined situations that occur with respect to the avatar is acquired, it is determined whether or not the acquired information satisfies the predetermined conditions, and it is determined that the predetermined conditions are satisfied. , Generates information for making the facial expression or pose of the avatar related to the distributor, which was generated based on the facial expression or pose related to the distributor, into a predetermined facial expression or pose corresponding to the predetermined condition.
It may be possible to execute such an operation.

Alternatively, by executing the installed web browser or a specific application, the terminal device 30 executes a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, and the avatar in the virtual space. The information relating to any one or more of the voice of the avatar and the predetermined situation occurring with respect to the avatar is acquired, and it is determined whether or not the acquired information satisfies the predetermined condition, and the predetermined condition is satisfied. To make the avatar's facial expression or pose related to the distributor, which was generated based on the facial expression or pose related to the distributor, a predetermined facial expression or pose corresponding to the predetermined condition when it is determined that the condition is satisfied. It may be possible to execute an operation such as generating information.

The terminal device 30 is any terminal device capable of performing such an operation, and may be, but is not limited to, a smartphone, a tablet, a mobile phone (feature phone), and / or a personal computer.

2. Hardware Configuration of Each Device Next, an example of the hardware configuration of the server device 20 will be described.

2-1. Hardware Configuration of Server Device 20 A hardware configuration example of the server device 20 will be described with reference to FIG. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the server device 20 (terminal device 30) shown in FIG. 1. (Note that reference numerals in parentheses in FIG. 2 are as described later. It is described in relation to each terminal device 30.)

As shown in FIG. 2, the server device 20 can mainly include an arithmetic unit 21, a main storage device 22, and an input / output interface device 23. The server device 20 can further include an input device 24 and an auxiliary output device 26. These devices may be connected by a data bus and / or a control bus.

The arithmetic unit 21 performs an calculation using the instructions and data stored in the main storage device 22, and stores the result of the calculation in the main storage device 22. Further, the arithmetic unit 21 can control the input device 24, the auxiliary storage device 25, the output device 26, and the like via the input / output interface device 23. The server device 20 may include one or more arithmetic units 21. The arithmetic unit 21 may include one or more central processing units (CPUs), microprocessors, and / or graphics processing units (GPUs).

The main storage device 22 has a storage function, and commands and data received from the input device 24, the auxiliary storage device 25, the communication network 10 and the like (server device 20 and the like) via the input / output interface device 23, and It stores the calculation result of the calculation device 21. The main storage device 22 can include RAM (random access memory), ROM (read-only memory) and / or flash memory without limitation.

The auxiliary storage device 25 is a storage device. Instructions and data (computer programs) constituting the specific application, web browser, etc. may be stored, and these instructions and data (computer programs) can be stored in the input / output interface device 23 by being controlled by the arithmetic unit 21. It may be loaded into the main storage device 22 via. The auxiliary storage device 25 may be a magnetic disk device and / or an optical disk device, a file server, or the like, and is not limited thereto.

The input device 24 is a device that takes in data from the outside, and may be a touch panel, a button, a keyboard, a mouse and / or a sensor or the like.

The output device 26 may include, but is not limited to, a display device, a touch panel, and / or a printer device. Further, the input device 24 and the output device 26 may be integrated.

In such a hardware configuration, the arithmetic unit 21 sequentially loads the instructions and data (computer programs) that constitute a specific application stored in the auxiliary storage device 25 into the main storage device 22, and the loaded instructions. And by computing the data, the output device 26 is controlled via the input / output interface device 23, or another device (for example, the server device 20 and the server device 20 and) via the input / output interface device 23 and the communication network 10. Various information may be transmitted / received to / from other terminal devices (30, etc.).

The server device 20 has such a configuration, and by executing a specific installed application, a predetermined action of the avatar played by the distributor, the facial expression of the avatar, and the avatar of the avatar are defined below in the virtual space. Information on any one or more of the complexion, the voice of the avatar, or the predetermined situation that occurs with respect to the avatar is acquired, and it is determined whether or not the acquired information satisfies the predetermined conditions. When it is determined that the predetermined conditions are satisfied, the facial expressions or poses of the avatar related to the distributor, which are generated based on the facial expressions or poses related to the distributor, are changed to the predetermined facial expressions or poses corresponding to the predetermined conditions. It may be possible to execute a part or all of an operation (including various operations described in detail later) such as generating information for the above. Further, such an operation or the like may be performed by the user giving an instruction to the system of the example of the invention disclosed in the documents of the present application by using the input device 24 or the input device 34 according to the terminal device 30 described later. Further, when the program is executed on the arithmetic device 21, it may be displayed by the output device 26 of the server device 20 as the system used by the user, or the output device of the terminal device 30 as the system used by the user. It may be configured to be displayed on 36.

2-2. Hardware Configuration of Terminal Device 30 A hardware configuration example of the terminal device 30 will also be described with reference to FIG. As the hardware configuration of each terminal device 30, for example, the same hardware configuration as that of each server device 20 described above can be used. Therefore, reference numerals for the components of each terminal device 30 are shown in parentheses in FIG.

As shown in FIG. 2, each terminal device 30 mainly includes an arithmetic unit 31, a main storage device 32, an input / output interface device 33, an input device 34, an auxiliary storage device 35, and an output device 36. , Can be included. These devices are connected by a data bus and / or a control bus.

The arithmetic device 31, the main storage device 32, the input / output interface device 33, the input device 34, the auxiliary storage device 35, and the output device 36 are included in each of the server devices 20 described above, respectively. , The input / output interface device 23, the input device 24, the auxiliary storage device 25, and the output device 26 may be substantially the same as or different from each other. Further, the capacities and capacities of the arithmetic unit and the storage device may be different. In particular, the input device 34 and the output device 36 will be described in detail below.

In such a hardware configuration, the arithmetic unit 31 sequentially loads the instructions and data (computer programs) that constitute a specific application stored in the auxiliary storage device 35 into the main storage device 32, and the loaded instructions. And by calculating data, the output device 36 is controlled via the input / output interface device 33, or another device (for example, each server device 20) is controlled via the input / output interface device 33 and the communication network 10. Etc.), and various information can be sent and received.

The terminal device 30 is provided with such a configuration, and in a virtual space, a predetermined action of an avatar played by a distributor, a facial expression of the avatar, a complexion of the avatar, a voice of the avatar, or a predetermined situation occurring with respect to the avatar. When one or more of the information is acquired, it is determined whether or not the acquired information satisfies the predetermined conditions, and when it is determined that the predetermined conditions are satisfied, the facial expression or the facial expression relating to the distributor or the distributor is determined. An operation of generating information for changing the facial expression or pose of the avatar related to the distributor, which was generated based on the pose, into a predetermined facial expression or pose corresponding to the predetermined condition (various details to be described later). It may be possible to perform some or all of the actions). Further, by executing the installed web browser, a web page can be received and displayed from the server device 20 to execute the same operation. Further, such an operation or the like may be performed by the user using the input device 34 to give an instruction to the system of the example of the invention disclosed in the documents of the present application. Further, when the program is executed on the arithmetic unit 31, it may be configured to be displayed on the output device 36 of the terminal device 30 as the system used by the user.

As the terminal device, there may be two types of terminal devices, a "distributor terminal" and a "viewer terminal", in the documents of the present application. These may be names given to the role of the terminal, and one terminal device may be a viewer terminal or a distributor terminal, and may be a viewer terminal and simultaneously distributed. It may be a personal terminal. The distributor terminal may be a terminal used by a distributor who appears as a subject such as an avatar in what is distributed. On the other hand, the viewer terminal may be a terminal mainly used by a viewer who is a viewer of what is being distributed. In addition, the viewer also gives a certain influence to what the viewer delivers by giving a gift to the subject such as an avatar so that the gift appears in the delivered one. May be good. Similarly, the viewer may have a certain influence on what is delivered in the form of audio, comments, etc. What is delivered may be a moving image, a video, or an animation, and may be a person in which a subject such as an avatar played by the distributor appears in a part of these. .. The above description is merely an example in which one embodiment of the present invention is applied, and each embodiment of the present invention may be applied even in a virtual space in which a subject without such a premise appears.

As described above, the viewer terminal may be configured to be capable of voice input, comment input, gifting, and the like. For example, the user terminal may have a keyboard, a touch panel, or the like as the input device 34, which can input a comment and can acquire a comment which is text information. Further, the user terminal may have a function of generating a certain comment by the arithmetic unit 34. These acquired comments may be similarly transmitted to the communication network 10 via the input / output interface device 23.

The comment according to the present invention may be automatically generated by the system in addition to the comment input by the user terminal. Such a comment may be transmitted to the user terminal and displayed on the user terminal.

Further, the terminal may include a microphone capable of acquiring sound as the input device 34. The human voice may be acquired by the microphone as the input device 34 and treated as sound, or after being acquired by the microphone as the input device 34, it is converted into text by voice recognition by the arithmetic unit 31 and used as a comment. You may handle it. The user terminal may generate sound by the arithmetic unit 31. These acquired sounds or comments may be similarly transmitted to the communication network 10 via the input / output interface device 23.

On the other hand, the distributor terminal may include a motion sensor capable of detecting the movement of a person as the input device 34. The motion sensor may be attached to the body of the distributor and may have a function of detecting the movement of each part of the body. Each part of the body may include various parts such as the head, face, upper arm, forearm, hand, thigh, lower leg, leg, and trunk, but the movement of the body is not limited to a part or all of them. It may be mounted in a detectable position. Such a sensor may be able to track the facial expression or pose of the distributor and generate it as information. The motion sensor may include an acceleration sensor, a gyro sensor, a geomagnetic sensor, and the like. The acquired information may be similarly transmitted to the communication network 10 via the input / output interface device 23.

Further, the distributor terminal may include a camera capable of capturing a moving image as the input device 34. The camera may image the distributor's head, face, eyes, body part, whole body, and the like. When the camera images the head or face, it can detect the direction of the face, when it images the face, it can detect the facial expression, and when it images the eyes, it can detect the line of sight. Yes, when imaging a part or the whole body, it may be possible to detect the movement of the body together with or in place of the motion sensor described above. Information acquired about the face direction, the line of sight, the facial expression, and the movement of the body based on the captured information may be similarly transmitted to the communication network 10 via the input / output interface device 23.

Further, the output device 36 in the viewer terminal and the distributor terminal may be a display device or a sound generator. The display device may be various devices as long as it has a displayable function, and examples thereof include a liquid crystal display, a plasma display, an organic EL display, a micro LED display, and a head-mounted display, but the display device is not limited to these. It may be a device. The sound generator may be a speaker, headphones, earphones, or the like. The information output by the output device 36 may be the information generated by the arithmetic unit 31 or the information received from the communication network 10.

3. 3. Functions of Each Device Next, an example of the functions of each of the server device 20 and the terminal device 30 will be described with reference to FIG. FIG. 3 is a block diagram schematically showing an example of the function of the system shown in FIG. As shown in FIG. 3, an example system may have an acquisition unit that acquires information that can be used to generate an object, and a generation unit that generates an object using the acquired information.

2.1. Acquisition unit The acquisition unit has a function of acquiring information that can be used to determine whether or not a predetermined condition described later can be applied.

The information acquired by the acquisition unit is any of a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar in the virtual space. It may include information relating to one or more of them (in the documents of the present application, it may be a predetermined operation, etc.).

The specific contents of the information acquired by the acquisition unit will be described in the condition application unit. Note that FIG. 4 shows an example of a part of the information acquired by these acquisition units.

In addition, when the gift is provided to a specific avatar, the acquisition unit may acquire information for identifying the avatar to whom the gift is provided.

The information processing device from which the acquisition unit acquires information may be the same as or different from the information processing device having the function of the acquisition unit. Further, the term acquisition may be a superordinate concept of the meaning of receiving information from another information processing device, may be a superordinate concept of the meaning of reading information from a storage device, and may be another concept. It may be a superordinate concept of the meaning of receiving information from a program via a storage device.

2.2. Condition application unit The condition application unit determines whether or not the acquired information satisfies a predetermined condition, and when it is determined that the predetermined condition related to the acquired information is satisfied, the facial expression related to the distributor or the condition application unit It has a function of generating information for changing the facial expression or pose of the avatar related to the distributor, which was generated based on the pose, into a predetermined facial expression or pose corresponding to the predetermined condition.

Here, when the facial expression or pose of the avatar related to the distributor, which was generated based on the facial expression or pose related to the distributor, is generated to be the predetermined facial expression or pose corresponding to the predetermined condition. Is to make the facial expression of the avatar related to the distributor, which is generated based on the facial expression related to the distributor, a predetermined facial expression corresponding to the predetermined condition when the predetermined condition is satisfied. Only the information may be generated, or only the information for making the pose of the avatar related to the distributor, which was generated based on the pose related to the distributor, into a predetermined pose corresponding to the predetermined condition is used. It may be generated, or to make the facial expression and pose of the avatar related to the distributor, which are generated based on the facial expression and pose related to the distributor, into a predetermined facial expression and pose corresponding to the predetermined condition. Information may be generated. In the documents of the present application, a predetermined facial expression and / or pose specified in accordance with a predetermined condition may be referred to as a predetermined facial expression, and the facial expression and / or pose may be referred to as a facial expression or the like. ..

Further, the predetermined facial expression or the like is a facial expression displayed using a predetermined facial expression parameter or a facial expression parameter obtained by correcting a facial expression parameter based on the distributor's facial expression based on a predetermined rule. It may be a facial expression displayed by setting a predetermined shape or movement, or a predetermined pose parameter or a pose parameter based on the distributor's pose may be set to a predetermined rule. It may be a pose displayed using the pose parameters corrected based on it, or it may be a pose displayed by setting a predetermined shape or movement. Here, the predetermined facial expression parameters indicate a plurality of parameters that affect the movement of each part of the face, and by setting the plurality of parameters to predetermined values, one facial expression is indicated. May be. The one or more parameters may be parameters that affect the movement of each part of the face, and each parameter may be for a specific part of the face or for the entire face (or a part of the face). However, the shape of the entire face (or a part of the face) may be different for each parameter. The latter is a technique of preparing a plurality of products having the same area but different shapes, and expressing one facial expression by synthesizing a part or a plurality of them. An example of the latter is, for example, a blend shape. In such a technique, a plurality of face shapes having different shapes are prepared in advance, and one facial expression is generated by synthesizing the plurality of shapes. .. In the present technology, in addition to the usual facial elements, a predetermined shape may be prepared in advance to give a special facial expression. For example, when a shape indicating the vertical line of the face is prepared in advance, it is possible to produce the vertical line of the face, and when the element of the effect of the cross is prepared in advance, the eye is It is possible to produce a cross. In this case, since the parameters are set in advance, the facial expression or the like is reproduced regardless of the facial expression of the distributor. Therefore, when an appropriate parameter indicating the facial expression or the like is selected, the facial expression or the like that is easy to understand is always displayed. There is an advantage that it can be reproduced. Even in this case, the predetermined facial expressions and the like may be set differently depending on the avatar. That is, with respect to Avatar A and Avatar B, the predetermined facial expressions and the like applied when the same predetermined conditions are satisfied may differ between Avatar A and Avatar B. In this case, it may be set for each avatar, or it may be set according to the type of avatar.

On the other hand, when the predetermined facial expression or the like is a parameter such as a facial expression obtained by correcting a parameter such as a facial expression based on the distributor's facial expression or the like based on a predetermined rule, the predetermined facial expression or the like becomes the distributor's facial expression or the like. It may be a facial expression based on it. For example, suppose a distributor looks surprised at some gift. At this time, the facial expression of the avatar is set to the facial expression corresponding to the surprise by one or a plurality of parameters in response to the detection of the facial expression of the distributor, but a plurality of parameters related to the surprise as a predetermined facial expression corresponding to a predetermined condition. The case where the expression of surprise is emphasized by increasing or decreasing the value of is shown by a predetermined value is shown. Whereas the above technique is absolute in that one or more parameters are determined with the above technique as a predetermined facial expression, this technique is, so to speak, relative to the information obtained from the facial expression of the current distributor. Parameters may be used. Therefore, even if the same avatar played by the same distributor is applied with the same predetermined conditions, the parameters such as facial expressions based on the facial expressions that the distributor himself has at that time may be the same. If so, the facial expressions and the like according to the different parameters may be the predetermined facial expressions and the like because they may be different. Therefore, there is a possibility that more variations such as facial expressions can be given.

Further, the facial expression displayed by setting the predetermined shape or movement may indicate a facial expression in which the predetermined shape itself such as a mask is used as a predetermined facial expression, and may be such a facial expression. ..

In the above, the predetermined facial expressions have been described, but similarly, the corresponding techniques may be used for the predetermined poses.

Further, the predetermined facial expression or the like may be a facial expression or the like related to the predetermined movement or the like that occurs. In this case, the viewer has an advantage that the reason why the predetermined facial expression or the like is expressed can be easily understood by associating it with the predetermined motion or the like.

Further, a predetermined facial expression or the like may act on parameters for all the parts constituting the facial expression or the like, or may act on some parameters thereof. For example, a predetermined facial expression or the like acts only on the parameters for the mouth, and the parameters for the parts other than the mouth are parameters linked to the facial expression of the distributor and correspond to the movement of the facial expression of the distributor from the distributor terminal. It may be a parameter based on the information provided. Further, the predetermined facial expression and the like may include the appearance of the avatar. For example, a predetermined facial expression or the like may include an effect that the avatar is charred.

Further, the predetermined facial expression or the like may change in conjunction with the direction of the predetermined movement or the like. In the virtual space, the distributor may not know where the objects described below appear. At this time, the distributor may not notice the place where the object or the like appears, and as a result, the avatar related to the distributor may not be able to react to the object or the like. For example, when a ghost character appears or a tub falls from overhead, the distributor may not notice it. Therefore, there is an advantage that the viewer can be more interested in the behavior of the avatar by changing the predetermined facial expression or the like related to the avatar in conjunction with the direction in which the predetermined movement or the like is displayed. Here, there may be various modes that change in conjunction with the direction of a predetermined operation or the like. For example, a predetermined facial expression or the like to be set may be oriented with respect to the direction in which the ghost character is in contact or the direction in which the zombie character is approaching. When a predetermined facial expression or the like is suitable, a part of the avatar may be changed in conjunction with the change, or a plurality of parts of the avatar may be changed in conjunction with each other. For example, when a predetermined facial expression or the like is directed, the entire body may be oriented in a direction in which only a part of the face is applied, such as only the eyes or only a part of the face. You may.

The predetermined pose may be various poses. The pose may be only a part of the avatar's body or the entire avatar's body. For example, it may be a pose of only the head as a pose of bending the neck, a pose of only the hands including a production in which the hands are enlarged or the hands are swollen red, a pose of only the upper body such as a guts pose, or a gun. It may be a pose that holds the body or a whole pose that jumps with the whole body.

The predetermined condition is information relating to any one or more of a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar. , May be used.

The predetermined action of the avatar played by the distributor may be a predetermined action perceived by the avatar with all five senses if the avatar is a living thing. In addition, the predetermined action of the avatar may include an action of viewing a predetermined target. For example, when the avatar is surprised to see something, a surprised facial expression may be set as a predetermined facial expression or the like. In this case, an object that is natural for the avatar to make a surprised expression may be set in advance, and when the object is on an extension of the line of sight, it may be determined that the avatar has seen the object. That is, when the predetermined operation includes an operation of looking at the predetermined object, the predetermined condition is to move the line of sight of the avatar so that the predetermined target is in the line of sight of the avatar, or It may include the presence of the predetermined object in the line of sight of the avatar. In the former case, when the avatar independently moves the viewing direction to change the line of sight, if a surprised object is located on an extension of the line of sight, a surprised facial expression may be set as a predetermined facial expression or the like. The latter may be a case where a predetermined target exists, and there may be a case where a predetermined target is generated and displayed in that direction when the avatar is looking in a predetermined direction.

In the above description, the thing that brings a surprise feeling to the avatar has been described, but the thing that brings a surprise feeling to the avatar is not limited to the thing that brings other feelings and sensations. For example, things that bring about scary feelings such as ghosts, things that bring about feelings like steak, things that bring about feelings of dislike such as natto, etc. When a person looks at an object, certain feelings and sensations occur. It may be a thing. Further, as for a predetermined facial expression or the like when looking at such an object, a predetermined facial expression or the like indicating a face generally generated by a person when looking at such an object may be set. The above-mentioned things that bring about the feeling of scary, the things that bring about the feeling of like, and the things that bring about the feeling of dislike may be correspondingly horrifying facial expressions, smiles, disgusting facial expressions, and the like.

In the above, the object to be viewed has been described as an object, but the object to be viewed may be another character or another avatar. That is, when the predetermined target is another avatar or character, the predetermined operation of the avatar may include that the line of sight of the avatar and the line of sight of the predetermined target match. In this way, when the line of sight matches with another character or another avatar, a predetermined facial expression or the like may be set. When the lines of sight of the avatars match, a predetermined facial expression or the like may be set only for one avatar, or a predetermined facial expression or the like may be set for both avatars. In the latter case, for example, a throbbing facial expression such as a reddish face of both avatars when the eyes are aligned can be considered. Further, when a predetermined facial expression or the like is set for both of the latter avatars, the set facial expression or the like may be the same predetermined facial expression or the like, or may be a different predetermined facial expression or the like. .. The reason for the different predetermined facial expressions may be a predetermined facial expression or the like according to the type to which the avatar belongs, or a predetermined facial expression or the like according to the preference or property of the avatar. It may be a predetermined facial expression or the like that is stochastically selected. Further, as an example of the case where the avatar matches the line of sight of another character, the face of the avatar may be set to turn pale as a predetermined facial expression of the avatar when the line of sight of the ghost character and the avatar meet. Satisfiability of such a predetermined condition may be determined by determining the presence or absence of an intersection between the line-of-sight direction of the avatar and an object such as a ghost character.

In the above, the object to be viewed has been described as an object, but the object to be viewed may be some event. Events can vary in size and target, and are not limited. For example, it could be a scary event where a horde of crickets rushes, is washed away by flooded river water, or a gust of wind strikes, or a pain such as a fall or bloodshed of another character or avatar. That may be the situation. Even in the case of such an event, similarly, the avatar who saw the event may be set to a corresponding predetermined facial expression or the like.

In addition, the predetermined action of the avatar may include an action of contacting a predetermined target. When the predetermined operation includes an operation of contacting the predetermined target, the predetermined condition is that the distance between the position related to the avatar and the position related to the predetermined target is within a predetermined distance. It may include that there is. Here, the position related to the avatar is any one of the position of the avatar in the virtual space, the part that activates the predetermined facial expression, the predetermined part of the avatar, or the position of the collider of the avatar. good.

Here, the contacting action means a mode in which the avatar contacts from the avatar regardless of whether it is subjective or passive, but does not mean a mode in which the avatar is contacted by a third party. Aspects of being contacted by a third party, whether independent or passive, are included in the given circumstances that arise with respect to the avatar. In addition, the passive means, for example, a case where the avatar or the third party is contacted as a result of objective movement regardless of the intention of the avatar or the third party.

Examples of actions that the avatar touches include, for example, when the object touched by the avatar is hot, the avatar may have a surprising facial expression, or a predetermined facial expression such that the touched part is swollen by heat. May be. More specifically, for example, when a hot object is touched by a hand, the hand may have a predetermined facial expression such that the hand becomes large and swells red.

A predetermined action of the avatar includes a predetermined target eating and drinking action. Here, the predetermined eating and drinking action may be a predetermined eating and drinking action of the avatar, and may be detected by an ID or the like indicating such eating and drinking action. The ID indicating such eating and drinking movement may be an ID given to a specific movement predetermined as a eating and drinking movement, or an ID given to a predetermined movement based on one or a plurality of motion data. You may. In the present invention, the technical significance of incorporating the eating and drinking motion as a predetermined motion is to set a predetermined facial expression or the like by combining with other information described later. For example, even if the same eating and drinking action (for example, the action of eating meat) is performed, when a certain avatar A eats meat, a predetermined facial expression or the like expressing an elegant way of eating is set, while another avatar is set. When B eats meat, it is conceivable that a predetermined facial expression or the like expressing a wild way of eating is set. Here, as a factor that causes different effects in avatar A and avatar B, for example, even if avatar A and avatar B are different types of avatars, or even if they are the same type of avatar, the set taste is set. It is conceivable that a predetermined facial expression or the like expressing different eating styles is set depending on the taste and taste. The type of such an avatar may be the personality set at the time of setting the avatar, or may be determined from the parts and clothes that the avatar is equipped with at the time when a predetermined condition is determined.

Also, the predetermined action of the avatar may include a scent or a predetermined gesture for the odor. Here, as a predetermined gesture, a gesture such as moving the nose, a gesture of moving the air in front of the nose to the left or right by a hand, and the like can be mentioned. Such a gesture may be detected, for example, by using an optical sensor, an inertial sensor, or the like to detect the movement of the nose or the movement of a hand such as the right hand or the left hand. That is, the predetermined condition may use the detection of the predetermined gesture of the avatar. Then, as the corresponding predetermined facial expression and the like, a predetermined facial expression and the like that produce a feeling of ecstasy and a predetermined facial expression and the like that are in agony can be mentioned. This has the advantage that the action performed when the distributor feels some kind of odor or odor makes the viewer understand the meaning of the action more clearly. By sharing the odor and the specific gesture corresponding to the odor between the distributor and the system in advance, it is possible to more effectively produce a predetermined facial expression or the like corresponding to the gesture.

Also, the predetermined action of the avatar may include a predetermined gesture of listening / listening to a sound. As a predetermined gesture for listening / listening to a sound, for example, a gesture of moving a hand along the ear or a gesture of moving one ear in a certain direction can be considered. As a predetermined facial expression corresponding to such a gesture, it is considered that the hand is enlarged in the case of a gesture in which the hand is along the ear, and the ear is enlarged in the case of a gesture of moving one ear in a certain direction. Can be considered.

A predetermined condition including the facial expression of the avatar played by the distributor may be, for example, a predetermined facial expression when the facial expression of the avatar is a specific one or a plurality of parameters. Further, even if a predetermined facial expression or the like is not always obtained, it is conceivable to obtain a predetermined facial expression or the like when other predetermined conditions are satisfied. For example, as a face with a surprised expression of a distributor, normally, even if a predetermined facial expression or the like is not set, when a specific event occurs and the distributor shows a face with a surprised expression, it is predetermined. The facial expression and the like may be set.

The complexion of the avatar played by the distributor may include a change in complexion. For example, when the complexion of the avatar is different from the usual one, the facial expression of the avatar may be set to a different predetermined facial expression or the like according to the complexion.

The voice of the avatar played by the distributor may include that the sound quality of the voice of the avatar changes by a predetermined range or more, or that the volume of the voice of the avatar changes by a predetermined amount or more. For example, it is conceivable that the voice of the avatar has an unusual voice property due to tension or anger. In the case of such a voice, a predetermined facial expression or the like corresponding to the voice may be set.

The predetermined situation that arises with respect to the avatar may include the occurrence of a predetermined sound in the virtual space. The predetermined sound may be, for example, a loud sound. In response to such a loud sound, a surprised facial expression may be given as a predetermined facial expression, or a pose that expresses the surprise with the whole body, for example, jumping up, may be performed.

A predetermined situation that arises with respect to an avatar may include the distance between a position relating to a predetermined object and a position relating to the avatar being within a predetermined range. Here, the positions related to the predetermined object are, for example, the positions of the center of gravity of the predetermined object, the center of the predetermined object, the center of the circumscribed circle of the predetermined object, and the inscribed circle of the predetermined object. It may be the center, the center of the circumscribed circle on the display of the predetermined object, the center of the inscribed circle on the display of the predetermined object, and the like. Further, the position relating to the predetermined object may be an intersection of the circle or polygon relating to the predetermined object and the circle or polygon on the tangent line of the linear distance between the position relating to the avatar. Further, as for the position related to the predetermined object, a collider may be set for the predetermined object, and a collider may be set for the avatar, and a contact determination using the collider may be performed. The position of the avatar may be as described above. When the position related to the avatar is the position of the collider, it may be determined that the avatar is in contact with a predetermined object.

The predetermined object may be the various objects described above. For example, when the tub falls from above the head and comes into contact with the head, the eyes may be set to cross (x) as a predetermined facial expression or the like. Further, when lightning strikes (contacts) the avatar, the whole body may be charred as a predetermined facial expression or the like.

Further, instead of the predetermined object, another object may be used, for example, a character or another avatar. As an example in the case of a character, as a predetermined situation that occurs with respect to the avatar, the distance between the position related to the zombie character and the position related to the avatar may be within a predetermined range. In this case, a vertical line may be drawn on the face of the avatar when the distance is within a predetermined distance. In addition, a predetermined facial expression or the like may change depending on the degree of the distance. For example, when the distance is changed to a first distance and a second distance shorter than the first distance, a predetermined facial expression or the like at the first distance, a predetermined facial expression or the like at the second distance, or the like. And may be different. For example, as a predetermined facial expression at the first distance, there are 10 vertical lines in the facial expression, whereas as a predetermined facial expression at the second distance, there are 20 vertical lines in the facial expression. Moreover, the width of the vertical line may be doubled. Contrary to the above, it may be included that the position related to the avatar and the position related to the character or the avatar are outside the range of the predetermined distance under a predetermined condition. In this case, the situation where the avatar or the character moves relatively in the direction away from the avatar is shown, but for example, a facial expression such as tears appearing as a predetermined facial expression of the avatar may be set.

For example, a given situation that arises with respect to an avatar may include a case where a first avatar and a second avatar have a given relationship. For example, when the first avatar strokes the head of the second avatar, the eyes of the second avatar may be set as a heart as a predetermined facial expression or the like. In this case, a collider may be set for each of the first avatar and the second avatar, and the contact determination may be used for determination.

Further, the predetermined situation that occurs with respect to the avatar may include that the predetermined situation that occurs with respect to the avatar is a predetermined combination of the predetermined object and the predetermined pose of the avatar. Here, the predetermined target may be a thing, a predetermined situation, or a predetermined event. The item may also include a gift. For example, when a pistol gift is attached as an object and the avatar poses for shooting, a brave facial expression may be set as a predetermined facial expression or the like. Here, the shooting pose may be determined by setting a collider from the center position of the avatar and determining the collision at each position of the body such as the right hand, the left hand, the right foot, the left foot, and the head. Here, the positions of the right hand, left, right foot, left foot, head, and the like of each distributor in the distributor may be detected by an optical sensor or an inertial sensor. The predetermined facial expression or the like set in such a case may be suggested from the combination of the given gifts. For example, a frog shield, a frog case, or a frog cloak can look like a frog.

Further, among the plurality of conditions according to the present invention, a plurality of conditions may be satisfied. For example, when the avatar matches the line of sight with the ghost character, and at the same time, the distance between the position related to the avatar and the position related to the ghost character is within a predetermined distance range. In such a case, if the predetermined facial expressions and the like corresponding to the conditions that the line of sight is matched and the distance is within the range are different, the processing when a plurality of predetermined conditions are satisfied may be defined. For example, when the first predetermined condition is satisfied and the second predetermined condition is satisfied within a predetermined time, priority is given to the first predetermined condition or the second predetermined condition. When a predetermined condition set with a high degree is satisfied, a corresponding predetermined facial expression or pose may be applied. Here, the priority may be associated with each predetermined condition and stored, or may be set as a rule when a plurality of predetermined conditions are satisfied. For example, when there are A1, A2, A3, A4 and the like as predetermined conditions, it is sufficient that the predetermined conditions that are prioritized can be selected after comparing the predetermined conditions with each other. The function using such a priority has an advantage that even when a plurality of predetermined conditions are satisfied, particularly when a plurality of predetermined conditions are satisfied almost at the same time, processing can be performed appropriately. In addition, a probability may be used as the priority. For example, when the probability is determined by a pseudo-random number function or the like, and the first predetermined condition and the second predetermined condition are satisfied, the pseudo-random number function value is a predetermined value. In that case, a predetermined facial expression or the like corresponding to the first predetermined condition is applied, and in the case of another predetermined value, a predetermined facial expression or the like corresponding to the second predetermined condition is applied. It's okay. In this case, the variation of the production will increase, and there is a possibility that the viewer's interest can be further attracted.

In the determination of a plurality of conditions that can be satisfied, the determination is made after the lapse of a predetermined time. Therefore, when the predetermined time is set to a certain time or longer, the effect of the predetermined expression or the like is produced from the satisfaction of the predetermined conditions. There may be a time lag. Therefore, when the above-mentioned plurality of conditions are satisfied without providing such a priority, a predetermined facial expression or the like corresponding to the predetermined conditions satisfied in advance in time may be set. Here, "preceding in time" means that the processing unit first determines that the predetermined conditions are satisfied even when the predetermined conditions are satisfied substantially at the same time as a result of the network or information processing. good. In this case, there is an advantage that a predetermined facial expression or the like corresponding to a predetermined condition satisfied earlier can be set without waiting for the elapse of a predetermined time. In such a case, a predetermined facial expression or the like corresponding to a predetermined condition satisfied later may or may not be set. In the case of setting, the predetermined facial expression or the like corresponding to the predetermined condition satisfied earlier is overwritten, but there is an advantage that the predetermined facial expression or the like corresponding to the predetermined condition satisfied later can also be produced to the viewer. On the other hand, if it is not set, there is an advantage that the viewer can fully enjoy the preceding predetermined facial expression and the like. In this way, when both the first predetermined condition and the second predetermined condition are satisfied, the timing when the first predetermined condition is satisfied and the timing when the second predetermined condition is satisfied are satisfied. A predetermined facial expression or the like may be set accordingly. For example, when the time between the first timing when the first predetermined condition is satisfied and the second timing when the second predetermined condition is satisfied is shorter than the predetermined time, the first predetermined condition is satisfied. The process may be such that only the corresponding first predetermined facial expression or the like is produced, and the second predetermined facial expression or the like corresponding to the second predetermined condition is not produced. In this case, there is an advantage that the viewer can enjoy the first predetermined facial expression and the like without being changed on the way. On the other hand, when the time between the first timing and the second timing is longer than the predetermined time, the second predetermined condition is satisfied at the timing when the second predetermined condition is satisfied. A predetermined facial expression or the like may be set. In this case, the viewer has an advantage that the second predetermined facial expression and the like can enjoy both effects following the first predetermined facial expression and the like.

The above-mentioned predetermined time for determining the time between the first timing and the second timing may be set according to a set of predetermined conditions to be satisfied. For example, when the first predetermined condition is satisfied, a first predetermined facial expression or the like is produced, and when the second predetermined condition is satisfied, a second predetermined facial expression or the like is produced, and a third predetermined expression or the like is produced. It is assumed that a third predetermined facial expression or the like is produced when the above conditions are satisfied. Further, it is assumed that the first predetermined condition is satisfied at the first timing, the second predetermined condition is satisfied at the second timing, and the third predetermined condition is satisfied at the third timing. At this time, when the time between the first timing and the second timing is shorter than the twelfth predetermined time, the second predetermined facial expression or the like is not produced, and the time is equal to or longer than the twelfth predetermined time. It is assumed that a second predetermined facial expression or the like is produced. Further, when the time between the first timing and the third timing is shorter than the thirteenth predetermined time, the third predetermined facial expression or the like is not produced, and when it is equal to or longer than the thirteenth predetermined time. It is assumed that a third predetermined facial expression or the like is produced. At this time, the twelfth predetermined time and the thirteenth predetermined time may be the same or different. If they are the same, even if the second predetermined condition is satisfied or the third predetermined condition is satisfied after the first predetermined condition is satisfied, the first predetermined facial expression or the like is produced. It means that there is no change in time. On the other hand, if they are different, in the case where the second predetermined condition is satisfied after the satisfaction of the first predetermined condition and the case where the third predetermined condition is satisfied, the first predetermined expression, etc. The production time will change. In this case, the variation of the production will increase, and there is a possibility that the viewer's interest can be further attracted.

In addition, in the above, the example of the rule about the predetermined condition that the priority is associated with or is satisfied with the predetermined condition has been described, but in addition, the priority is an object or event within the predetermined condition. , Situation, etc. For example, when a gift is used under predetermined conditions, the gift may be associated with a priority.

The priority of objects, events, and situations (sometimes referred to as objects in the documents of the present application) related to predetermined conditions is the size of the objects displayed, the place where the objects appear, and the timing of the appearance of the objects. , Etc. may be used.

For example, regarding the displayed size of an object or the like, when the displayed size of the second object or the like is larger than the size of the first object or the like, it is applied to the second object or the like. A higher priority may be set than the first item or the like. In this case, the larger one displayed is more noticed by the viewer, and it is considered that giving priority is in line with the intention of the viewer. On the other hand, it may be set in reverse. If it is set in reverse, there is an advantage that it is unexpected.

In addition to the size of the item or the like, if the item or the like has a price, it may be the price, or if the item or the like has a consumption point, it may be a consumption point. For example, when the price of the second item or the like is higher than the price of the first item or the like, the second item or the like is given a higher priority than the first item or the like. good. In this case, the higher the price, the more attention the viewer will get, and it is considered that giving priority is in line with the viewer's intention. On the other hand, it may be set in reverse. If it is set in reverse, there is an advantage that it is unexpected. Similarly, with respect to the consumption points, for example, when the consumption points of the second item or the like are higher than the consumption points of the first item or the like, the first item is relative to the second item or the like. Etc., a higher priority may be set. In this case, the higher the consumption point, the more attention the viewer will get, and it is considered that giving priority is in line with the viewer's intention. On the other hand, it may be set in reverse. If it is set in reverse, there is an advantage that it is unexpected.

As the place of appearance in the virtual space such as an object, for example, an object appearing in the center of the virtual space may be set to have a higher priority than an object appearing at the left and right edges in the virtual space. .. When the priority of objects appearing in a conspicuous place in the virtual space is raised, the viewer can see the objects appearing in a conspicuous place, so that the viewer can see a predetermined facial expression or the like. It has the advantage of making it easier to understand the meaning.

Further, the priority related to the thing or the like may be static information preset for the thing or the like, or dynamic information set for the first time when the thing or the like is provided. good. The latter may be, for example, information set according to the position where an object or the like appears. For example, the priority may be set according to the relationship between the position where an object or the like appears in the virtual space and the position with the avatar. In this case, the distance itself may play the role of priority, or the distance may be used as one piece of information for setting the priority. For example, when the distance between the avatar and the position of the first object that appears is the first distance, and the distance between the avatar and the position of the second object that appears is the second distance, the first distance is the second. If it is longer than the distance, the priority may be set higher for the first object than for the second object. In addition, when the first distance between the center of the screen and the position related to the first object is shorter than the second distance between the center of the screen and the position related to the second object, the first object is used. Since it appears in the center of the screen, the priority of the first object may be set higher than that of the second object. When the priority related to a thing or the like is dynamically set, there is an advantage that a gift to which a predetermined facial expression or the like is set can be selected more appropriately and dynamically.

Further, as the information related to the avatar, the type to which the avatar belongs may be used. For example, the predetermined condition may use the type to which the avatar belongs, which is one of a plurality of types to which the avatar belongs. This may be such that when certain information is acquired, the first avatar type has a predetermined facial expression or the like, but the second avatar type does not have a predetermined facial expression or the like. For example, a certain type of avatar may have a bearish personality setting, and when the distance between the ghost character and the avatar is within the range of the first distance, a scared expression may easily appear. Further, it is assumed that a certain type of avatar has a cheerful personality setting, and the condition of a facial expression including a smile as a predetermined facial expression or the like may be set to be looser than that of other avatars. In this case, the avatar may be provided with personality characteristics such as bearish, cheerful, bullish, and unyielding, and the satisfaction of a predetermined condition may be determined using such personality characteristics. The personality may be set according to the type to which the avatar belongs, or may be set for each avatar separately from the type to which the avatar belongs.

The predetermined condition may include a probability. That is, the predetermined condition includes a pseudo-random number function or the like, and when the function value satisfies the predetermined condition, a predetermined facial expression or the like may be generated. When such a probability is included, a predetermined facial expression or the like is not always generated, so that the viewer's interest can be continuously attracted. Further, for example, when the probability value is made lower than a predetermined value and a rare facial expression is used, the viewer can be interested in the fact that the viewer can see a valuable facial expression.

In addition, as a predetermined condition, information on the display start of the object, etc., information on the display change of the object, etc., and / or information on the display end of the object, etc., are used to determine the timing of displaying the individual object, etc. Satisfaction of the condition may be determined. In this case, the facial expression and pose of the avatar change in response to the display of the object, such as the start, change, and end of the display of the object, so that the viewer can understand the meaning of the change in the facial expression and pose of the avatar. , There is an advantage that it becomes easier to understand in relation to the situation of things.

Further, as a predetermined condition, information possessed by an object or the like as an attribute may be used. The attributes of the thing or the like may or may not include the characteristics of the thing or the like such as the type of the thing or the like and the level of the thing or the like. Further, a predetermined condition may be set so that the predetermined condition is satisfied according to a specific feature of the object or the like, and a corresponding predetermined facial expression or the like may be set.

Further, the predetermined conditions may specify the order and timing of the acquired information.

For example, with respect to a predetermined facial expression when the predetermined conditions and satisfaction are satisfied, a predetermined facial expression A is set when the bat character appears on the screen within a predetermined time after the ghost character appears on the screen, and the bat character is set. When a ghost character appears on the screen within a predetermined time after appearing on the screen, a predetermined facial expression B may be set.

The condition application unit may use the facial expression or the like specified by satisfying the predetermined condition as the facial expression or the like of the avatar to which the gift is provided. More specifically, the information indicating the facial expression or the like specified by satisfying a predetermined condition may be an ID indicating the specified facial expression or the like or one or a plurality of parameters of the facial expression indicating the specified facial expression or the like. , The facial expression of the avatar or the like may be set by using the information indicating the specified facial expression or the like so that the specified facial expression or the like can be the facial expression of the avatar. The ID and parameter information may be specified or generated by the condition application unit, and then the information may be transmitted to a server or terminal for generating a video or animation and used for a predetermined period of time. Here, the condition application unit may store information indicating a specified facial expression or the like in association with each predetermined condition, and when each of the predetermined conditions is satisfied, the corresponding specified facial expression or the like is stored. It may be configured to identify the information to be shown. After a predetermined facial expression or the like applied by satisfying a predetermined condition is set on the avatar for a predetermined period, the operation of the original avatar may be restored. That is, since the avatar is played by the distributor, the facial expression and pose of the avatar may be based on the information of the facial expression and pose of the distributor after a predetermined period. Here, based on the information on the facial expression and pose of the distributor, the operation of the avatar may be defined by the information detected by the optical sensor and the inertial sensor on the facial expression and pose of the distributor.

In such processing, when the first information processing device on which the condition application unit is executed and the second information processing device that performs the processing including the setting of the facial expression of the avatar are the same, the condition application unit is the condition application unit. Using the facial expression specified by satisfying a predetermined condition, processing may be performed so as to set the facial expression of the avatar or the like.

Further, when the first information processing device on which the condition application unit is executed and the second information processing device that performs processing including setting of the facial expression of the avatar are different, the condition application unit specifies by satisfying a predetermined condition. The first information processing apparatus may transmit the facial expression or the like to the second information processing apparatus, and the second information processing apparatus may process the second information processing apparatus so as to set the facial expression or the like as the facial expression of the avatar using the specified facial expression or the like.

Here, when the first information processing device is a server and the second information processing device is a server, the specified facial expression or the like is transmitted from the server of the first information processing device to the server of the second information processing device. Information indicating that may be transmitted. When the first information processing device is a server and the second information processing device is a viewer terminal, the server of the first information processing device identifies the viewer terminal of the second information processing device. Information indicating the information processing and the like may be transmitted. When the first information processing device is a server and the second information processing device is a distributor terminal, the server of the first information processing device identifies the distributor terminal of the second information processing device. Information indicating the information processing and the like may be transmitted.

Similarly, when the first information processing device is a viewer terminal and the second information processing device is a server, the specific information processing device from the viewer terminal of the first information processing device to the server of the second information processing device. Information indicating the facial expression or the like may be transmitted. When the first information processing device is a viewer terminal and the second information processing device is a viewer terminal, the viewer terminal of the first information processing device is transferred to the viewer terminal of the second information processing device. , Information indicating such a identified facial expression or the like may be transmitted. When the first information processing device is a viewer terminal and the second information processing device is a distributor terminal, the viewer terminal of the first information processing device is transferred to the distributor terminal of the second information processing device. , Information indicating such a identified facial expression or the like may be transmitted.

Similarly, when the first information processing device is the distributor terminal and the second information processing device is the server, the specific information processing device from the distributor terminal of the first information processing device to the server of the second information processing device. Information indicating the facial expression or the like may be transmitted. When the first information processing device is a distributor terminal and the second information processing device is a distributor terminal, the distributor terminal of the first information processing device is transferred to the distributor terminal of the second information processing device. , Information indicating such a identified facial expression or the like may be transmitted. When the first information processing device is a distributor terminal and the second information processing device is a viewer terminal, the distributor terminal of the first information processing device is transferred to the viewer terminal of the second information processing device. , Information indicating such a identified facial expression or the like may be transmitted.

In the above, the condition application unit is executed in a single information processing device, but the condition application unit may be distributed and processed in a plurality of information processing devices.

In addition, the condition application unit may set a predetermined facial expression or the like by using the timing at which the predetermined facial expression or the like is set. The timing may be, for example, as described above, the timing at which the line of sight of the avatar and the avatar or the character match, the timing at which the avatar comes into contact with an object, and the like. In this case, information including information indicating such a predetermined facial expression or the like may be transmitted to the displayed information processing apparatus and displayed. The timing lag in this case may include a time lag in communication and processing.

On the other hand, when a predetermined condition is satisfied, a separately set timing may be used for setting a predetermined facial expression or the like. For example, a predetermined facial expression or the like may be obtained 2 seconds after the predetermined condition is set. As an example, a situation in which the avatar is surprised may occur, and a predetermined surprised facial expression may be set at a timing intentionally delayed 2 seconds later.

FIG. 5 is an example showing the relationship between a predetermined facial expression and the like with respect to a predetermined condition. By using the acquired information as a predetermined condition, a corresponding predetermined facial expression or the like can be specified.

As described above, the function of the condition application unit enables the corresponding predetermined facial expressions and the like to be realized when the predetermined conditions are satisfied, and has the advantage that the facial expressions and poses of the avatars in the virtual space can be varied. There is. In addition, even if the performer can specify the facial expression of the avatar by himself / herself using a tablet or the like, when the wearing gift is worn by the operator in the studio distribution, the performer may not be aware that the wearing gift has been worn. In such a case, there is an advantage that the facial expression or pose corresponding to the gift can be applied to the avatar without any operation by the performer. That is, the information for making a predetermined facial expression or pose may be generated without any operation other than providing a gift from the distributor.

Further, as described above, the function of the condition application unit can automatically realize the corresponding predetermined facial expression when the predetermined condition is satisfied, and the facial expression of the avatar can be changed without any operation from the viewer terminal. There is an advantage that you can enjoy the reaction that results in the result.

4. Embodiment
4-1. Embodiment 1
The first embodiment is an example in which the condition application unit operates in the viewer terminal. In this case, the acquisition unit may operate on the viewer terminal. This example will be described with reference to FIG. Since the condition application unit operates on the viewer terminal, it may be possible to change the expression of the avatar for each viewer terminal by including the information based on the viewer terminal as a predetermined condition. ..

Step 1
The acquisition unit acquires information such as a predetermined operation (step 001). The information such as the predetermined operation may be input in the viewer terminal in which the condition application unit operates, or the information input in the other viewer terminal or the information generated in the server as an effect is the server. The viewer terminal on which the condition application unit operates may acquire the information via the above.

Step 2
Next, the condition application unit determines a predetermined condition using at least information such as a predetermined operation, and when it is determined that the predetermined condition is satisfied, the facial expression or the like corresponding to the satisfied predetermined condition is specified ( Step 002). For this reason, the condition application unit may have information indicating at least a part of the predetermined conditions and a predetermined facial expression when the conditions are satisfied.

Step 3
The specified facial expression or the like is set to the facial expression or the like related to the avatar used to satisfy the predetermined condition on the viewer terminal (step 003). The viewer has the advantage of being able to view the reaction in which the facial expression of the avatar is changed in response to a predetermined operation or the like.

Step 4
After the predetermined facial expression or the like of the avatar is displayed for a predetermined period on each viewer terminal, the facial expression or the like related to the avatar returns to the facial expression based on the original facial expression of the distributor related to the avatar (step 004).

4-2. Embodiment 2
The second embodiment is an example in which the condition application unit operates in the server. In this case, the acquisition unit may operate on the server. In addition, this example will be described with reference to FIG. 7 on the premise that the animation is generated on the viewer terminal.

Step 1
The acquisition unit acquires information such as a predetermined operation (step 001).

Step 2
Next, the condition application unit determines a predetermined condition using at least information such as a predetermined operation, and when it is determined that the predetermined condition is satisfied, the facial expression or the like corresponding to the satisfied predetermined condition is specified ( Step 002).

Step 3
The server transmits information indicating the specified facial expression or the like to each viewer terminal viewing the distribution of the avatar (step 003).

Step 4
In each viewer terminal, the facial expression and the like of the avatar are set by using the information indicating the facial expression and the like acquired from the server (step 004). Here, in each viewer terminal, an animation may be generated using the facial expression of the set avatar or the like.

Step 5
On each viewer terminal, the facial expression of the avatar using the information indicating the facial expression acquired from the server is displayed for a predetermined period, and then the facial expression is set based on the facial expression of the distributor related to the original avatar. (Step 005). When an animation is generated, it is displayed in each animation using the generated facial expression for a predetermined period, and after that, it is obtained by tracking based on the facial expression of the distributor related to the avatar. The facial expression or the like may be used as the facial expression or the like of the avatar.

4-3. Embodiment 3
The third embodiment is an example in which the condition application unit operates in the server. In this case, the acquisition unit may operate on the server. Note that this example will be described with reference to FIG. 8 on the premise that a video including the facial expression of the avatar is generated on the server.

Step 1
The acquisition unit acquires information such as a predetermined operation (step 001).

Step 2
Next, the condition application unit determines a predetermined condition using at least information such as a predetermined operation, and when it is determined that the predetermined condition is satisfied, the facial expression or the like corresponding to the satisfied predetermined condition is specified ( Step 002).

Step 3
The server uses information or the like indicating the specified facial expression or the like to generate a video about the distribution of the avatar (step 003). Here, if the server that generates the video about the distribution of the avatar and the server that executes the condition application unit are the same server, the server that executes the condition application unit generates the video for the distribution of the avatar. You can. On the other hand, if the server that generates the video about the distribution of the avatar and the server that executes the condition application unit are different servers, the server that executes the condition application unit identifies the server that generates the video. Information indicating a facial expression or the like is transmitted, and the information indicating the specified facial expression or the like may be used in the server that generates such an image. Similarly, when generating an animation on such a server, an animation for distribution of the avatar may be generated together with the video or in place of the video. In this case, the animation is used together with the video or in place of the video. May be done.

Step 4
An image of an avatar generated using the specified facial expression based on the information indicating the specified facial expression or the like is transmitted to each viewer terminal (step 004).

Step 5
On each viewer terminal, an image using information indicating facial expressions acquired from the server is displayed for a predetermined period, and then an avatar image based on the facial expression of the distributor related to the original avatar is displayed. It is displayed (step 005).

4-4. Various Embodiments The computer program according to the first aspect is "a computer program, and by being executed by one or more processors, a predetermined operation of an avatar played by a distributor in a virtual space, said avatar. Whether or not information relating to any one or more of the facial expression, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar is acquired, and the acquired information satisfies the predetermined conditions. When it is determined that the predetermined condition related to the acquired information is satisfied, the expression or pose of the avatar related to the distributor generated based on the expression or pose related to the distributor is displayed. It generates information for making a predetermined expression or pose corresponding to a predetermined condition into the expression of the avatar, and displays the avatar to which the predetermined expression or pose is applied. "

The computer program according to the second aspect is the one in the first aspect, "a predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing". ..

The computer program according to the third aspect is the one in the first aspect or the second aspect, "the predetermined action of the avatar includes the action of looking at a predetermined object".

The computer program according to the fourth aspect is described in any one of the first to third aspects, "when the predetermined target is another avatar or character, the predetermined action of the avatar is the line of sight of the avatar. And the line of sight of the predetermined object are aligned with each other. "

In the computer program according to the fifth aspect, in any one of the first to fourth aspects, "when the predetermined operation includes an operation of viewing the predetermined object, the predetermined condition is the predetermined condition. It includes moving the line of sight of the avatar so that the target is in the direction of the line of sight of the avatar, or the presence of the predetermined target in the line of sight of the avatar. "

The computer program according to the sixth aspect is one in any one of the first to fifth aspects, "a predetermined action of the avatar includes an action of contacting a predetermined target".

In any one of the first to sixth aspects, the computer program according to the seventh aspect states that "when the predetermined operation includes an operation of contacting the predetermined object, the predetermined condition is the avatar. The distance between the position according to the above and the position according to the predetermined object is within a predetermined distance. "

In any one of the first to seventh aspects, the computer program according to the eighth aspect states that "the position of the avatar is the position of the avatar in the virtual space, the part that activates the predetermined facial expression, the said. It is either a predetermined part of the avatar or the position of the collider of the avatar. "

The computer program according to the ninth aspect is the one in any one of the first to eighth aspects, "the predetermined action of the avatar includes the eating and drinking action of a predetermined target".

The computer program according to the tenth aspect is the one in any one of the first to ninth aspects, "the predetermined action of the avatar includes a scent or a predetermined gesture for the odor".

The computer program according to the eleventh aspect is one in any one of the first to tenth aspects, "a predetermined action of the avatar includes a predetermined gesture for listening to or / listening to a sound". ..

The computer program according to the twelfth aspect is "the predetermined condition uses the detection of the predetermined gesture of the avatar" in any one of the first to eleventh aspects.

The computer program according to the thirteenth aspect is that in any one of the first to twelfth aspects, "a predetermined situation that occurs with respect to the avatar includes a predetermined sound that occurs in the virtual space".

The computer program according to the fourteenth aspect describes in any one of the first to thirteenth aspects, "The predetermined situation that occurs with respect to the avatar is the distance between the position relating to the predetermined object and the position relating to the avatar. Includes being within a predetermined range. "

In the computer program according to the fifteenth aspect, in any one of the first to the fourteenth aspects, "a predetermined situation that occurs with respect to the avatar is a combination of a predetermined object and a predetermined pose of the avatar. Including that. "

The computer program according to the sixteenth aspect is "the complexion of the avatar includes a change in complexion" in any one of the first to fifteenth aspects.

The computer program according to the seventeenth aspect is described in any one of the first to the sixth aspects, "The voice of the avatar changes the sound quality of the voice of the avatar by a predetermined range or more, or the voice of the avatar. Including that the volume of the voice changes by a predetermined amount or more. "

In the computer program according to the eighteenth aspect, in any one of the first to the seventeenth aspects, "the first predetermined condition is satisfied and the second predetermined condition is satisfied within a predetermined time". In that case, the predetermined facial expression or pose corresponding to the case where the predetermined condition set with a high priority among the first predetermined condition or the second predetermined condition is satisfied is applied. " be.

The computer program according to the nineteenth aspect acquires, in any one of the first to eighteenth aspects, "information for making the predetermined facial expression or pose obtains information for operating the avatar from the distributor terminal. It is generated without it. "

The computer program according to the twentieth aspect is "a computer program, which is executed by one or more processors to perform a predetermined action of an avatar played by a distributor, an expression of the avatar, and the avatar in a virtual space. Acquires information relating to any one or more of the complexion of the avatar, the voice of the avatar, or a predetermined situation that occurs with respect to the avatar, and determines whether or not the acquired information satisfies the predetermined conditions. When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor, which is generated based on the facial expression or pose related to the distributor, is changed to the predetermined facial expression or pose corresponding to the predetermined condition. The information for making a pose is generated, and the information for making the predetermined expression or pose is transmitted. "

In the twentieth aspect, the computer program according to the twenty-first aspect is "a predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing". ..

The server device according to the 22nd aspect is described as "a predetermined operation of an avatar played by a distributor in a virtual space by including one or a plurality of processors, and the processor executes a computer-readable instruction. Information relating to one or more of the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar is acquired, and the acquired information satisfies the predetermined condition. When it is determined whether or not the condition is satisfied, the facial expression or pose of the avatar related to the distributor, which has been generated based on the facial expression or pose related to the distributor, is set to the predetermined condition. The information for making the predetermined facial expression or pose corresponding to the above is generated, and the information for making the predetermined facial expression or pose is transmitted. "

In the 22nd aspect, the server device according to the 23rd aspect is "a predetermined operation of the avatar is a predetermined operation perceived by the avatar with all five senses if the avatar is a living thing". ..

The method according to the twenty-fourth aspect is "a method executed by one or more processors that execute a computer-readable instruction, a predetermined action of an avatar played by a distributor in virtual space, the avatar. Whether or not information relating to any one or more of the facial expression, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar is acquired, and the acquired information satisfies the predetermined conditions. When it is determined that the predetermined condition related to the acquired information is satisfied, the avatar's facial expression or pose related to the distributor, which was generated based on the facial expression or pose related to the distributor, is determined. Information for making a predetermined expression or pose corresponding to the condition of the above into the expression of the avatar is generated, and the avatar to which the predetermined expression or pose is applied is displayed. "

The method according to the 25th aspect is that in the 24th aspect, "a predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing".

The method according to the twenty-sixth aspect is "a method executed by one or more processors that execute a computer-readable instruction, and is a predetermined action of an avatar played by a distributor in a virtual space, that of the avatar. Whether or not information relating to one or more of facial expressions, the complexion of the avatar, the voice of the avatar, or a predetermined situation occurring with respect to the avatar is acquired, and the acquired information satisfies the predetermined conditions. When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor, which has been generated based on the facial expression or pose related to the distributor, corresponds to the predetermined condition. It generates information for making a predetermined facial expression or pose, and transmits the information for making the predetermined facial expression or pose. "

The method according to the 27th aspect is that in the 26th aspect, "a predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing".

The viewer terminal device according to the 28th aspect is described as "a predetermined avatar played by a distributor in a virtual space by including one or a plurality of processors, and the processor executes a computer-readable instruction. Information on any one or more of the operation, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar is acquired, and the acquired information satisfies a predetermined condition. When it is determined whether or not the information is satisfied and it is determined that the predetermined conditions related to the acquired information are satisfied, the facial expression or the avatar's facial expression related to the distributor, which was generated based on the facial expression or pose related to the distributor, or Information for making a pose a predetermined expression or pose corresponding to the predetermined condition as the expression of the avatar is generated, and the avatar to which the predetermined expression or pose is applied is displayed. " ..

In the 28th aspect, the viewer terminal device according to the 29th aspect is "a predetermined operation of the avatar is a predetermined operation perceived by the avatar with all five senses if the avatar is a living thing". Is.

The distributor terminal device according to the thirtieth aspect is described as "a predetermined avatar played by a distributor in a virtual space by including one or a plurality of processors, and the processor executes a computer-readable instruction. Information on any one or more of the operation, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar is acquired, and the acquired information satisfies a predetermined condition. When it is determined whether or not the condition is satisfied and it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor generated based on the facial expression or pose related to the distributor is set as the predetermined condition. The information for making a predetermined facial expression or pose corresponding to the condition of the above is generated, and the information for making the predetermined facial expression or pose is transmitted. "

In the thirtieth aspect, the distributor terminal device according to the thirty-first aspect is "a predetermined action of the avatar is a predetermined action perceived by the avatar with five senses if the avatar is a living thing". Is.

In addition, the system and information processing described in the documents of the present application may be carried out by software, hardware or a combination thereof, and a part or all of such a system and information processing implements processing / procedures as a computer program. However, it may be executed by various computers, and these computer programs may be stored in a storage medium. Also, these programs may be stored on a non-transient or temporary storage medium.

What has been described in the documents of the present application is not limited to that described in the documents of the present application, and is applied to various examples within the scope of various technical ideas having various technical advantages and configurations described in the documents of the present application. Needless to say, you can do it.

1 System 10 Communication network 20 (20A to 20C) Server device 30 (30A to 30C) Terminal device 21 (31) Computing device 22 (32) Main storage device 23 (33) Input / output interface 24 (34) Input device 25 ( 35) Auxiliary storage device 26 (36) Output device 41 Acquisition unit 42 Condition application unit

Claims (27)

It ’s a computer program,
By being run by one or more processors
Information relating to any one or more of a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar in the virtual space. To get
It is determined whether or not the acquired information satisfies the predetermined conditions, and the information is determined.
When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor generated based on the facial expression or pose related to the distributor is changed to the predetermined facial expression or pose corresponding to the predetermined condition. Generate information to pose and
Display the avatar to which the predetermined facial expression or pose is applied.
A computer program that activates the one or more processors as described above. The predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing.
The computer program according to claim 1. A predetermined action of the avatar includes an action of looking at a predetermined target.
The computer program according to claim 1. When the predetermined target is another avatar or character
The predetermined action of the avatar includes the line of sight of the avatar and the line of sight of the predetermined target.
The computer program according to claim 3. When the predetermined operation includes an operation of viewing the predetermined object,
The predetermined condition includes moving the line of sight of the avatar so that the predetermined target is in the line-of-sight direction of the avatar, or the predetermined target is present in the line of sight of the avatar.
The computer program according to claim 3. A predetermined action of the avatar includes an action of contacting a predetermined target.
The computer program according to claim 1. When the predetermined operation includes an operation of contacting the predetermined object,
The predetermined condition includes that the distance between the position related to the avatar and the position related to the predetermined target is within a predetermined distance.
The computer program according to claim 6. The position related to the avatar is either the position of the avatar in the virtual space, the part that activates the predetermined facial expression, the predetermined part of the avatar, or the position of the collider of the avatar.
The computer program according to claim 6. The predetermined action of the avatar includes a predetermined eating and drinking action of the target.
The computer program according to claim 1. A predetermined action of the avatar comprises a scent or a predetermined gesture to the odor.
The computer program according to claim 1. A predetermined action of the avatar includes a predetermined gesture of listening to or listening to a sound.
The computer program according to claim 1. The predetermined condition uses the detection of the predetermined gesture of the avatar.
The computer program according to claim 8 or 9. Predetermined situations that occur with respect to the avatar include producing a predetermined sound in the virtual space.
The computer program according to claim 1. A predetermined situation that occurs with respect to the avatar includes that the distance between the position relating to the predetermined object and the position relating to the avatar is within a predetermined range.
The computer program according to claim 1. A predetermined situation that occurs with respect to the avatar includes a predetermined combination of a predetermined object and a predetermined pose of the avatar.
The computer program according to claim 1. The complexion of the avatar includes a change in complexion.
The computer program according to claim 1. The voice of the avatar includes that the sound quality of the voice of the avatar changes by a predetermined range or more, or the volume of the voice of the avatar changes by a predetermined amount or more.
The computer program according to claim 1. When the first predetermined condition is satisfied and the second predetermined condition is satisfied within the predetermined time, the priority of the first predetermined condition or the second predetermined condition is set. Applying the corresponding facial expression or pose when a high set condition is met,
The computer program according to any one of claims 1 to 17. The information for making the predetermined facial expression or pose is generated without acquiring the information for operating the avatar from the distributor terminal.
The computer program according to any one of claims 1 to 18. It ’s a computer program,
By being run by one or more processors
Information relating to any one or more of a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar in the virtual space. To get
It is determined whether or not the acquired information satisfies the predetermined conditions, and the information is determined.
When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor generated based on the facial expression or pose related to the distributor is changed to the predetermined facial expression or pose corresponding to the predetermined condition. Generate information to pose and
Information for making the predetermined facial expression or pose is transmitted.
A computer program that activates the one or more processors as described above. The predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing.
The computer program according to claim 20. Equipped with one or more processors
When the processor executes a computer-readable instruction,
Information relating to any one or more of a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar in the virtual space. To get
It is determined whether or not the acquired information satisfies the predetermined conditions, and the information is determined.
When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor generated based on the facial expression or pose related to the distributor is changed to the predetermined facial expression or pose corresponding to the predetermined condition. Generate information to pose and
Information for making the predetermined facial expression or pose is transmitted.
A server device characterized by that. The predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing.
The server device according to claim 22. A method executed by one or more processors that execute computer-readable instructions.
Information relating to any one or more of a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar in the virtual space. To get
It is determined whether or not the acquired information satisfies the predetermined conditions, and the information is determined.
When it is determined that the predetermined condition related to the acquired information is satisfied, the facial expression or pose of the avatar related to the distributor, which is generated based on the facial expression or pose related to the distributor, corresponds to the predetermined condition. Generates information to make the predetermined facial expression or pose to be the facial expression of the avatar.
Display the avatar to which the predetermined facial expression or pose is applied.
A method characterized by that. The predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing.
24. The method of claim 24. A method executed by one or more processors that execute computer-readable instructions.
Information relating to any one or more of a predetermined action of the avatar played by the distributor, the facial expression of the avatar, the complexion of the avatar, the voice of the avatar, or the predetermined situation occurring with respect to the avatar in the virtual space. To get
It is determined whether or not the acquired information satisfies the predetermined conditions, and the information is determined.
When it is determined that the predetermined condition is satisfied, the facial expression or pose of the avatar related to the distributor generated based on the facial expression or pose related to the distributor is changed to the predetermined facial expression or pose corresponding to the predetermined condition. Generate information to pose and
Information for making the predetermined facial expression or pose is transmitted.
A method characterized by that. The predetermined action of the avatar is a predetermined action perceived by the avatar with all five senses if the avatar is a living thing.
The method of claim 26.

Images