JP7015597B1 - Avatar output device, terminal device, avatar output method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To output a large number of avatars in a conventional avatar output device, and it is not possible to perform appropriate processing according to the score of each avatar. SOLUTION: For each of two or more avatars, it corresponds to an avatar storage unit 112 that stores avatar information having a first model information for displaying an avatar and one or more attribute values, and each of two or more avatars. Score acquisition unit 131 that acquires the score of each of two or more avatars obtained by using one or more attribute values, and according to the score acquired by the score acquisition unit 131 using the avatar information of each of two or more avatars. The avatar output device 1 including the avatar processing unit 132 that outputs two or more avatars can perform appropriate processing according to the score of each avatar when outputting a large number of avatars. [Selection diagram] Fig. 2

Description

Application of Article 30, Paragraph 2 of the Patent Act March 26, 3rd year of Reiwa https: // www. youtube. com / watch? Announced through v = wRErhyoT70c

Application of Article 30, Paragraph 2 of the Patent Act March 28, 3rd year of Reiwa https: // www. youtube. com / watch? Announced through v = WyC76fzzZCA

Application of Article 30, Paragraph 2 of the Patent Act March 31, 3rd year of Reiwa https: // www. youtube. com / watch? v = YhX7xJ0MkxI, https: // spakerdec. Announced through com / clusterinc / cluster-rod

The present invention relates to an avatar output device or the like that performs processing related to avatar output.

Conventionally, there has been a content distribution system that realizes the provision of a suitable viewing experience while ensuring the presence of a large number of participants (see Patent Document 1). In such a system, when outputting the content of the main character and the content of the sub-character indicating the viewing user, the ratio of the sub-character that causes a predetermined behavior among the sub-characters is determined, and only the sub-character of the ratio operates. I was going to let you.

Japanese Patent No. 6688378

However, in the prior art setting, when outputting a large number of avatars, appropriate processing according to the score of each avatar could not be performed. The appropriate processing according to the avatar score is, for example, appropriate processing display processing and audio output processing according to the avatar score. An avatar is a character displayed as a user's alter ego. Also, the avatar may be simply considered as a character.

The avatar output device of the first invention has an avatar storage unit that stores avatar information having a first model information for displaying an avatar and one or more attribute values for each of two or more avatars, and two. The score acquisition unit that acquires the score of each of the two or more avatars obtained by using one or more attribute values corresponding to each of the above avatars, and the score acquisition unit that acquires the avatar information of each of the two or more avatars. It is an avatar output device including an avatar processing unit that outputs two or more avatars according to the score.

With such a configuration, when a large number of avatars are output, appropriate processing can be performed according to the score of each avatar.

Further, in the avatar output device of the second invention, in contrast to the first invention, the avatar processing unit uses an avatar whose score satisfies the score condition and an avatar whose score does not satisfy the score condition, and the avatar output method is different. It is an avatar output device that outputs avatars differently.

With such a configuration, when displaying a large number of avatars, the display control of each avatar can be appropriately controlled by the user according to the score of each avatar.

Further, in the avatar output device of the third invention, the avatar processing unit reduces the data size of the first model information for the avatar whose score satisfies the score condition for the second invention. It is an avatar output device that outputs an avatar using the second model information and outputs an avatar using the first model information for an avatar whose score does not satisfy the score condition.

With such a configuration, when displaying a large number of avatars, it is possible to appropriately display each avatar for the user while suppressing the processing load.

Further, in the avatar output device of the fourth invention, with respect to the second invention, the avatar processing unit controls the operation of the avatar between the avatar whose score satisfies the score condition and the avatar whose score does not satisfy the score condition. It is an avatar output device that operates an avatar so that the method is different.

With such a configuration, when displaying a large number of avatars, it is possible to obtain the behavior of each avatar suitable for the user according to the score of each avatar.

Further, in the avatar output device of the fifth invention, the avatar information has voice information with respect to the first invention, and in the avatar processing unit, the avatar whose score satisfies the score condition and the score satisfy the score condition. It is an avatar output device that outputs the avatar's voice using voice information so that the avatar's voice output method is different from that of the non-avatar.

With such a configuration, when the voice output of a large number of avatars is performed, the voice output of each avatar suitable for the user can be obtained according to the score of each avatar.

Further, in the avatar output device of the sixth invention, for any one of the first to fifth inventions, one or more attribute values possessed by the avatar information are one or more dynamically changing avatars. The score acquisition unit has an attribute value and is an avatar output device that acquires the score of each of two or more avatars obtained by using one or more dynamic attribute values corresponding to each of two or more avatars.

With such a configuration, an appropriate score of the avatar can be obtained based on the dynamic attribute value of the avatar.

Further, in the avatar output device of the seventh invention, with respect to the sixth invention, one or more dynamic attribute values are the attribute value related to the user's field of view corresponding to the avatar, the attribute value related to the field of view of the camera, and the user. An avatar output device that includes either an attribute value related to the distance of the avatar or an attribute value related to the orientation with respect to the user.

With such a configuration, it is possible to obtain an appropriate score of the avatar based on the appropriate dynamic attribute value of the avatar.

Further, the avatar output device of the eighth invention is the terminal device and the terminal device in the process until an image including two or more avatars is output in the terminal device for any one of the first to seventh inventions. It is an avatar output device that shares the processing.

With such a configuration, processing can be shared between two or more terminal devices and an avatar output device.

Further, in the avatar output device of the ninth invention, the terminal device performs the process of acquiring the score or the determination result using one or more dynamic attribute values for the eighth invention, and obtains the first model information. The process of acquiring the second model information using the avatar output device is performed by the avatar output device.

With such a configuration, processing can be appropriately shared between two or more terminal devices and an avatar output device.

Further, in the avatar output device of the tenth invention, for any one of the first to ninth inventions, the avatar information of two or more avatars in the avatar storage unit does not change dynamically. The score acquisition unit is an avatar output device that acquires the score of each of two or more avatars obtained by using one or more static attribute values corresponding to each of two or more avatars.

With such a configuration, an appropriate score of the avatar can be obtained based on the static attribute value of the avatar.

Further, in the avatar output device of the eleventh invention, with respect to the tenth invention, one or more static attribute values include either an attribute value related to the role of the avatar or an attribute value related to the origin of the avatar. It is an avatar output device.

With such a configuration, it is possible to obtain an appropriate score of the avatar based on the appropriate static attribute value of the avatar.

Further, the avatar output device of the twelfth invention is an avatar output device in which one or more static attribute values include the attribute value of the terminal device corresponding to the avatar, with respect to the tenth invention.

With such a configuration, an appropriate score of the avatar can be obtained based on the appropriate static attribute value of the avatar.

Further, the avatar output device of the thirteenth invention obtains the second model information by using the mesh information of N (N is a natural number of 2 or more) possessed by the first model information with respect to the third invention. It is an avatar output device which is model information having mesh information of M (M is a natural number of 1 or more) less than N.

With this configuration, when displaying a large number of avatars by using at least a part of the avatars corresponding to each of the two or more terminal devices as the avatars of appropriately compressed data, the two or more terminals The output is different for each device, and each avatar can be displayed appropriately for the user while suppressing the processing load.

Further, the terminal device of the fourteenth invention is a terminal device that communicates with an avatar output device and displays an avatar, and stores one or more terminal attribute values including the position information of the avatar corresponding to the terminal device. Terminal storage unit, terminal transmitter unit that transmits position information to the avatar output device, terminal receiver unit that receives position information of one or more other avatars corresponding to one or more other terminal devices from the avatar output device, and one or more. It includes a terminal processing unit that acquires the score of one or more other avatars by using the position information and the position information of the other avatar, and the terminal transmission unit is associated with the terminal identifier of the terminal device and has one or more terminals. The score of another avatar or the judgment result based on the score is transmitted to the avatar output device, and the terminal receiver is the model information of the other avatar from the avatar output device according to the transmission of the score or the judgment result, and is used as the score or the judgment result. It is a terminal device further comprising a terminal output unit that receives different model information or different voice information according to the situation and outputs one or more other avatars by using the model information or voice information.

With this configuration, it is possible to acquire scores of avatars corresponding to each of two or more terminal devices and output avatars of different model information or different voice information according to the scores.

According to the avatar output device according to the present invention, when a large number of avatars are output, appropriate processing can be performed according to the score of each avatar.

Conceptual diagram of the information system A in the first embodiment Block diagram of the information system A A flowchart illustrating an operation example of the avatar output device 1. Flow chart explaining an example of the avatar information acquisition process A flowchart explaining an example of the voice information processing A flowchart illustrating an operation example of the terminal device 2. A flowchart illustrating an example of the score acquisition process. A flowchart illustrating an example of the display information configuration process. A flowchart illustrating an example of the audio output processing. The figure explaining the specific operation example of the information system A Diagram showing the same avatar management table The figure which shows the image of the judgment result Figure showing the same output example Overview of the computer system Block diagram of the computer system

Hereinafter, embodiments of the avatar output device and the like will be described with reference to the drawings. In addition, since the components with the same reference numerals perform the same operation in the embodiment, the description may be omitted again.

(Embodiment 1)
In the present embodiment, scores are acquired according to the attribute values of two or more avatars staying in a virtual three-dimensional space (hereinafter, appropriately simply referred to as "three-dimensional space"), and the score is obtained. An information system in which the processing related to the avatar is different based on the score will be described. The three-dimensional space is, for example, VR, but may be AR or the like.

Further, the different processes are, for example, different acquisition methods of data used for displaying each avatar, different behaviors of each avatar, different acquisition methods of output voice, and output voice. For example, the attribute value may be a different attribute value.

The information system in the present embodiment is, for example, a system that supports communication between users by gathering two or more avatars, which are the alter ego of each user, in a three-dimensional space. This information system can also be applied to games and the like. This information system only needs to have a function to output an avatar, and the range of application is not limited.

Hereinafter, the avatar corresponding to one of the two or more users is expressed as an own avatar, and the other users are expressed as other avatars.

Further, in the present embodiment, an information system in which the processing related to the avatar display in the three-dimensional space is appropriately shared between the avatar output device and the terminal device will be described.

FIG. 1 is a conceptual diagram of the information system A in the present embodiment. The information system A includes an avatar output device 1 and one or more terminal devices 2.

The avatar output device 1 is a device that performs processing for outputting an avatar. The avatar output device 1 is usually a so-called server here, but may be a device that operates standalone. The avatar output device 1 is, for example, a cloud server, an ASP server, or the like. The type of the avatar output device 1 does not matter. Further, when the avatar output device 1 is a stand-alone device, the terminal device 2 is unnecessary, and the avatar output device 1 executes some of the functions of the terminal device 2 described later.

The terminal device 2 is a terminal used by the user. The terminal device 2 is a terminal that outputs its own avatar corresponding to itself and one or more other avatars. One avatar corresponds to, for example, one terminal device 2. Also, one avatar corresponds to, for example, one user. The other avatar is an avatar corresponding to another user who uses the other terminal device 2. In addition, two or more avatars may be associated with one user. That is, one user may switch between two or more avatars and use one of the two or more avatars. The terminal device 2 is, for example, a so-called personal computer, a tablet terminal, a smartphone, or the like, and the type thereof does not matter. The output is usually a display, but may be transmitted to a display device.

FIG. 2 is a block diagram of the information system A according to the present embodiment. The avatar output device 1 constituting the information system A includes a storage unit 11, a reception unit 12, a processing unit 13, and an output unit 14. The storage unit 11 includes a world storage unit 111 and an avatar storage unit 112. The reception unit 12 includes an avatar receiving unit 121. The processing unit 13 includes a score acquisition unit 131 and an avatar processing unit 132. The output unit 14 includes a position information transmission unit 141 and an audio output unit 142.

The terminal device 2 includes a terminal storage unit 21, a terminal reception unit 22, a terminal processing unit 23, a terminal transmission unit 24, a terminal reception unit 25, and a terminal output unit 26.

Various types of information are stored in the storage unit 11 that constitutes the avatar output device 1. The various types of information are, for example, world information described later and avatar information described later.

World information is stored in the world storage unit 111. World information is information for forming a world. The structure of world information does not matter. The world is usually a virtual three-dimensional space. The world can be called a place.

One or two or more avatar information is stored in the avatar storage unit 112. The avatar information includes information for configuring the output avatar. Avatar information is information for each avatar. The avatar information corresponds to the avatar identifier. Having a correspondence with an avatar identifier may also have an avatar identifier. The avatar identifier is, for example, the ID of the avatar, but may be the ID of the user corresponding to the avatar, the ID of the terminal device 2, or the like.

The avatar information has model information. The model information is information for configuring the display of the avatar. The model information includes, for example, mesh information, bone information, and material information. The model information has, for example, a data structure of glTF? (GL Transmission Format) ?. However, the data structure of the model information may be VRM, OBJ, FBX, STL, GLB, COLLADA, etc., regardless of the type.

It is preferable that each avatar information here has two or more types of model information having different data sizes. The avatar information has, for example, first model information and second model information. Here, "data size of the first model information> data size of the second model information". The second model information is, for example, model information obtained by compressing the data size of the first model information. The compression algorithm does not matter. The second model information is, for example, model information in which one mesh information is configured (integrated mesh) from two or more mesh information among the mesh information possessed by the first model information, and the mesh information is reduced. Further, the second model information is model information in which the data size is reduced by, for example, reducing the gradation of the color information possessed by the first model information. The second model information is, for example, model information in which the data size is reduced by making the texture of the first model information into an atlas.

The first model information is, for example, information transmitted from the terminal device 2 in association with the avatar identifier. The avatar identifier may be a terminal identifier. Further, the first model information may be, for example, information acquired by using the original information transmitted from the terminal device 2. The original information may be model information or an identifier that identifies the model information.

Further, it is preferable that the avatar information has voice information and one or more attribute values in addition to the model information.

The voice information is voice information emitted by the avatar. The data structure and data format of audio information does not matter. It is preferable that the avatar information has two or more types of voice information having different data sizes or attribute values. The avatar information includes, for example, first voice information and second voice information. For example, "data size of the first voice information> data size of the second voice information". Further, for example, "volume which is the attribute value of the first voice information> volume which is the attribute value of the second voice information". Further, for example, "sampling frequency which is an attribute value of the first voice information> sampling frequency which is an attribute value of the second voice information". Further, for example, "height (frequency) which is an attribute value of the first voice information> height (frequency) which is an attribute value of the second voice information".

Each attribute value of 1 or more is an attribute value of the avatar. The attribute value is, for example, a dynamic attribute value or a static attribute value.

A dynamic attribute value is an attribute value that can change dynamically. The dynamic attribute value is, for example, position information and orientation information.

The position information is information that identifies the position of the avatar in the field. The position information is, for example, the position information input by the user. The position information input by the user is usually information determined by the operation of the user who operates the avatar. The position information is information that specifies an absolute position in a field (which may be called a world), and is, for example, three-dimensional coordinates (x, y, z) or two-dimensional coordinates (x, y). be.

The orientation information is information that identifies the orientation of the avatar in the field. The orientation information is, for example, an angle with respect to a reference direction. The reference direction is information that identifies the absolute direction in the field. The orientation information is, for example, information indicating whether or not the person is facing the front in the field.

A static attribute value is an attribute value that does not change dynamically. The static attribute value is, for example, a role attribute value, an origin attribute value, and a terminal attribute value.

The role attribute value is information about the role of the avatar. The role attribute values are, for example, "organizer", "moderator", and "audience". The "organizer" is an organizer when an event using an avatar is held in a virtual three-dimensional space. The "moderator" is a moderator when holding an event using an avatar in a virtual three-dimensional space. The "audience" is an audience when an event using an avatar is held in a virtual three-dimensional space.

The origin attribute value is information regarding the origin of the avatar. The origin attribute value is, for example, information indicating whether or not the avatar (UGC) is created by the user.

The terminal attribute value is information about the terminal device 2 corresponding to the avatar. The terminal attribute value is, for example, a terminal type identifier that specifies the type of the terminal device 2 (for example, "PC", "smartphone", "tablet"), information that specifies the ability of the processor of the terminal device 2 (for example, the level of the ability, etc.). Operating frequency (GHz)), screen size of the terminal device 2, and aspect ratio.

The reception unit 12 receives various information and instructions. The reception here is usually reception from the terminal device 2, but reception of information input from an input device such as a keyboard, mouse, or touch panel, and reading from a recording medium such as an optical disk, a magnetic disk, or a semiconductor memory. It may be possible to accept the information provided.

Further, various information and instructions are, for example, avatar information, voice information, and requests. The accepted avatar information does not have to have the same structure as the avatar information of the avatar storage unit 112. The accepted avatar information includes, for example, the first model information and the position information.

The request is a request to send an avatar. The request is, for example, a request for displaying another avatar, and has one or more sets of an avatar identifier indicating another avatar and model information. The request may have, for example, an instruction to send world information.

The avatar receiving unit 121 receives the first model information or the original information from each of the two or more terminal devices 2 used by the user. The original information is the information that is the source of the first model information. The original information is, for example, model information, but may be an identifier of the first model information.

It is preferable that the avatar receiving unit 121 also receives position information for specifying the position of the avatar corresponding to each terminal device 2 from two or more terminal devices 2. It is preferable that the avatar receiving unit 121 receives the first model information or the original information, the position information, and the avatar identifier from each of the two or more terminal devices 2 in association with each other. However, the first model information, the original information, and the position information may be associated with each other and may be received separately. The avatar identifier is information that identifies the avatar, and is, for example, an ID or a user name. Further, a unique avatar identifier may be acquired in response to the avatar receiving unit 121 receiving the first model information or the original information from the terminal device 2.

It is preferable that the avatar receiving unit 121 also receives voice information and position information. It is preferable that the avatar receiving unit 121 receives the voice information in association with the avatar identifier.

The avatar receiving unit 121 may receive avatar information having first model information and second model information from each of two or more terminal devices 2. In such a case, the terminal device 2 may perform a process of acquiring the second model information based on the first model information.

It is preferable that the avatar receiving unit 121 receives from two or more terminal devices 2 the scores or determination results of one or more other avatars acquired by each terminal device 2 in association with the avatar identifier. The avatar receiving unit 121 may also receive the score or determination result of its own avatar for each terminal device 2. The determination result is information for determining the type of model information of the avatar. The determination result is, for example, information determined based on the score. The determination result is, for example, a type identifier that specifies the type of model information. The determination result is, for example, "first" corresponding to the first model information and "second" corresponding to the second model information.

The other avatar is an avatar that is not the own avatar. The own avatar is an avatar corresponding to the terminal device 2. When the avatar receiving unit 121 does not receive the score of the own avatar, the score of the own avatar is usually a default value (for example, the highest score). The score of the other avatar for the terminal device 2 is information for specifying the importance of the other avatar for the terminal device 2. The score is, for example, 0 to 100, 10-grade evaluation, etc., but the range and the like are not limited. Further, since the determination result is information based on the score, it may be considered that it is a score.

The processing unit 13 performs various processes. The various processes are, for example, processes performed by the score acquisition unit 131 and the avatar processing unit 132.

The score acquisition unit 131 acquires the score of each of two or more avatars. The score is information obtained by using one or more attribute values corresponding to the avatar. The score acquisition unit 131 usually acquires the score of each avatar of 2 or more for each terminal device 2 of 2 or more. That is, it is preferable that the score for the same other avatar differs depending on the terminal device 2.

The score acquisition unit 131 acquires the score of each of two or more avatars by using, for example, one or more attribute values corresponding to each of two or more avatars.

The score acquisition unit 131 acquires a score by, for example, an arithmetic expression, a correspondence table, or machine learning. That is, the score acquisition unit 131, for example, substitutes each attribute value of 1 or more into the calculation formula, executes the calculation formula, and acquires the score. The score acquisition unit 131 detects, for example, a vector or scalar whose element is one or more attribute values and a vector or scalar that most closely resembles the vector or scalar from the correspondence table, and corresponds a score that is paired with the vector or scalar that most closely resembles the vector or scalar. Get from the table. The correspondence table is a table having two or more correspondence information which is a set of a vector or a scalar and a score. The score acquisition unit 131, for example, gives a learner and each attribute value of 1 or more to a module of prediction processing of machine learning, executes the module, and acquires a score. It should be noted that the learner is information acquired by giving two or more teacher data having one or more attribute values and scores to a module of learning processing of machine learning and executing the module. The machine learning algorithm may be deep learning, random forest, SVR, SVM, decision tree, or the like. As a machine learning module, TensorFlow library, TinySVM, R language random forest library, etc. can be used.

When the score acquisition unit 131 does not calculate or read the score by itself, the score acquisition unit 131 receives, for example, the score of each of the two or more avatars acquired by the terminal device 2 from the terminal device 2. That is, the score acquisition unit 131 may acquire the score by itself, or may receive the score acquired by the terminal device 2. It is preferable that the attribute value of 1 or more used when acquiring the score of the avatar includes the dynamic attribute value of 1 or more. The one or more attribute values used to obtain the avatar score may include one or more static attribute values. It is preferable that the attribute value of 1 or more used when acquiring the score of the avatar includes a dynamic attribute value of 1 or more and a static attribute value of 1 or more.

The score acquisition unit 131 performs the following score acquisition processing, for example. That is, the score acquisition unit 131 uses one or more attribute values received from each of the two or more terminal devices 2 and the position information of each avatar, and one or more for each of the two or more terminal devices 2. Get the avatar score. The one or more attribute values received from each terminal device 2 have, for example, the position information of the own avatar and the orientation information of the own avatar.

Specifically, the score acquisition unit 131 is, for example, the position information of the own avatar received from the terminal device 2, the orientation information of the own avatar received from the terminal device 2, the camera attribute value, and each of the other avatars having a value of 1 or more. Acquire the dynamic attribute value of one or more other avatars by using two or more of the position information. The camera attribute value is, for example, camera position information for specifying the position of the camera, camera orientation information for specifying the direction of the camera, and angle of view information for specifying the angle of view of the camera. The camera attribute value is stored in, for example, the storage unit 11. Further, the angle of view information is usually a range of the horizontal angle of the camera and a range of the vertical angle of the camera. The camera here is a camera installed in a virtual three-dimensional space.

The score acquisition unit 131 acquires the distance between the own avatar and the other avatar by using, for example, the position information of the own avatar and the position information of the other avatar. Further, the score acquisition unit 131 uses, for example, the position information of the own avatar, the orientation information of the own avatar, and the position information of the other avatar to indicate whether or not the other avatar is in the field of view of the own avatar. Acquires the target attribute value (which may be called the in-field attribute value). Further, the score acquisition unit 131 dynamically indicates whether or not the other avatar is within the range of shooting by the camera by using, for example, the camera position information, the camera orientation information, the angle of view information, and the position information of the other avatar. Acquires an attribute value (which may be called a shooting range attribute value).

Then, the score acquisition unit 131 acquires, for example, a score having a larger value as the distance from the other avatar is shorter. Further, the score acquisition unit 131 acquires a score having a larger value when it is in the visual field, for example, as compared with the case where it is not in the visual field. Further, the score acquisition unit 131 acquires a score having a larger value when it is within the range of shooting by the camera, for example, as compared with the case where it is not within the range of shooting.

More specifically, the score acquisition unit 131 acquires a score for another avatar, for example, by a decreasing function with a distance as a parameter. The score acquisition unit 131 acquires, for example, an arithmetic expression corresponding to the in-field attribute value and the shooting range attribute value from the storage unit 11, substitutes the distance into the arithmetic expression, executes the arithmetic expression, and acquires the score. .. The arithmetic expression is, for example, a decreasing function with a distance as a parameter.

The score acquisition unit 131 acquires, for example, the score corresponding to the distance, the in-field attribute value, and the shooting range attribute value from the correspondence table. In such a case, the correspondence table is, for example, a table having two or more correspondence information indicating the correspondence between the set of the distance range, the in-field attribute value, and the shooting range attribute value and the score.

Further, the score acquisition unit 131 may perform the following score acquisition processing using, for example, one or more static attribute values. The static attribute value of 1 or more includes, for example, either an attribute value related to the role of the avatar or an attribute value related to the origin of the avatar.

For example, when the role of the other avatar is "organizer" or "moderator", the score acquisition unit 131 acquires a higher score as compared with the case where the role of the other avatar is "audience". For example, when the other avatar is UGC, the score acquisition unit 131 acquires a higher score as compared with the case where the other avatar is not UGC.

The score acquisition unit 131 may acquire a score based only on, for example, the in-field attribute value or the shooting range attribute value. When the score acquisition unit 131 acquires a score, the algorithm for acquiring the score does not matter.

The avatar processing unit 132 uses the avatar information of each of the two or more avatars to output each of the two or more avatars according to the score acquired by the score acquisition unit 131. Here, the output is usually transmission to the terminal device 2, but display on a display, projection using a projector, sound output, storage in a recording medium, other processing devices, other programs, and the like. It may be a concept including delivery of processing results. Further, the output of the avatar may be the transmission of model information or the transmission of a model identifier. It suffices if the avatar is output by the terminal device 2.

To output the avatar according to the score is, for example, to control the display of the avatar according to the score and to control the voice output of the avatar according to the score.

The display control is a process related to the display of the avatar. The display control according to the score is, for example, a process including a model selection process, a process including an avatar deformation process, and a process including a behavior selection process.

The model selection process is a process of selecting different types of model information according to the score as model information used for displaying one avatar. The different types of model information are, for example, two or more types of model information. The different types of model information are, for example, model information having different data sizes. The different types of model information are, for example, first model information, second model information, ..., Nth second model information (N is a natural number of 2 or 3 or more). "Data size of the first model information> Data size of the second model information> ...> Data size of the Nth model information". The second model information is, for example, model information in which data is reduced with respect to the first model information. The different types of model information are, for example, model information having different data structures (eg, glTF, VRM, OBJ, etc.). The different types of model information are, for example, model information having different colors and model information using different numbers of colors.

The second model information is, for example, a mesh of M (M is a natural number of 1 or more) less than N, which is acquired by using the mesh information of N (N is a natural number of 2 or more) possessed by the first model information. It is model information having information.

The avatar transformation process is, for example, a process of transforming the shape of the avatar (for example, an enlargement process, a reduction process, a thinning process (horizontal reduction process), a fattening process (horizontal enlargement process), etc.). be. The transformation process of the avatar according to the score may or may not be performed depending on the score. The transformation processing of the avatar according to the score may be performed different transformation processing according to the score.

The behavior selection process is a process in which the behavior of one avatar is different depending on the score. The different behavior is, for example, either "with movement" or "without movement". The different behavior is, for example, the difference in the rewriting frequency of the avatar. It should be noted that the avatar with a low rewriting frequency does not move smoothly as compared with the avatar with a high rewriting frequency. The different behaviors are, for example, "operate according to the user's instruction" and "operate only for a part of the user's instruction". The different behaviors are, for example, "behave as a standard operation" and "behave as a standard operation excluding some operations".

The voice output control according to the score is, for example, to output the voice according to the score or not to output the voice when the voice of one avatar is output. The voice output control according to the score is, for example, to output the voice of one avatar as different attribute values according to the score. The different attribute values are, for example, volume, sampling frequency, frequency.

The avatar processing unit 132 outputs an avatar so that the avatar output method differs between an avatar whose score satisfies the score condition and an avatar whose score does not satisfy the score condition, for example. The output here is usually transmission to the terminal device 2, but may be display or the like. Further, the avatar output method usually relates to display and voice output of the avatar on the terminal device 2.

The score condition is a condition related to the score. The score condition is, for example, a condition for reducing the data size of the model information of the avatar. The score conditions are, for example, "the score is equal to or higher than the threshold value", "the score is larger than the threshold value", "the score is within the upper N (N is a natural number)", and "the score is higher than the upper N (N is a natural number)". The score conditions are, for example, "score is below the threshold value", "score is smaller than the threshold value", "score is other than the top N (N is a natural number)", and "score is lower than the top N (N is a natural number)".

The avatar processing unit 132 outputs an avatar using the second model information obtained by reducing the data size of the first model information for the avatar whose score satisfies the score condition, and the score satisfies the score condition. For non-avatars, the avatar is output using the first model information. The avatar processing unit 132 acquires the second model information by using, for example, the first model information or the original information. The original information is the information that is the source of the first model information. The original information is, for example, model information, but may be an identifier of the first model information.

The avatar processing unit 132 operates the avatar so that the control method of the operation of the avatar differs between the avatar whose score satisfies the score condition and the avatar whose score does not satisfy the score condition, for example. The difference in the operation control method is the above-mentioned different behavior.

The avatar processing unit 132 outputs the voice of the avatar by using the voice information so that the voice output method of the avatar differs between the avatar whose score satisfies the score condition and the avatar whose score does not satisfy the score condition. The difference in the audio output method is the audio output control according to the score described above.

When the avatar processing unit 132 outputs an avatar, for example, two or more avatars are transmitted to each of two or more terminal devices 2 for each of two or more terminal devices 2.

The avatar of the avatar processing unit 132 does not have to be completely the same as the avatar information displayed on the terminal device 2. The avatar output by the avatar processing unit 132 may be information for configuring the avatar displayed on the terminal device 2. To output the avatar, it may be possible to output an image including the avatar.

The avatar processing unit 132 acquires the second model information by using, for example, the first model information or the original information. Such processing is called compression processing. For example, the avatar processing unit 132 constitutes one mesh information from two or more mesh information possessed by the first model information or the original information, and acquires the second model information in which the number of mesh information is reduced.

Further, the avatar processing unit 132 acquires the second model information with the data size reduced, for example, by reducing the gradation of the color information of the first model information or the original information. The avatar processing unit 132 acquires the second model information with the data size reduced, for example, by atlasing the texture of the first model information or the original information.

It is preferable that the avatar processing unit 132 compresses only the information of a part of the avatar (for example, the part other than the body part and the face part) of the first model information and acquires the second model information.

The output unit 14 outputs various information. The various types of information are, for example, location information and voice information. Further, here, the output is usually transmission to the terminal device 2, but display on a display, projection using a projector, printing by a printer, sound output, storage on a recording medium, and other processing devices. It may be a concept including delivery of the processing result to or other programs.

The output unit 14 transmits, for example, the world information of the world storage unit 111 to each of two or more terminal devices 2.

When the received request includes the transmission instruction of the world information, the output unit 14 transmits the world information to the terminal device 2 that has transmitted the request.

The avatar processing unit 132 may perform the above processing performed by the output unit 14.

The position information transmission unit 141 associates the position information of one or more other avatars with the position information of one or more other avatars among the position information of each of the two or more avatars corresponding to each of the two or more terminal devices 2, and associates the position information with the avatar identifier that identifies the avatar. It is transmitted to each of the above terminal devices. The position information of one or more other avatars is, for example, information transmitted by the terminal device 2 corresponding to each other avatar. The position information of one or more other avatars may not include the position information of the own avatar in each terminal device 2. The position information transmission unit 141 does not have to transmit the position information of the own avatar corresponding to the terminal device 2 to each of the two or more terminal devices 2, and may also transmit the position information of the own avatar.

The voice output unit 142 transmits different voice information according to the score of the avatar corresponding to one terminal device 2 to one or more terminal devices 2 other than at least one terminal device 2.

The voice output unit 142 outputs, for example, the first voice information and the second voice information. The output of the first voice information and the second voice information may be the output of an identifier for identifying the first voice information and an identifier for identifying the second voice information.

It is preferable that the voice output unit 142 outputs the type of voice information according to the score of the avatar. Here, the output is usually a transmission to the terminal device 2, but is a concept including sound output, storage in a recording medium, delivery of processing results to other processing devices, other programs, and the like. Is also good.

The first voice information and the second voice information output by the voice output unit 142 do not have to be the same information as the voice output by the terminal device 2.

One or more terminal attribute values are stored in the terminal storage unit 21 constituting the terminal device 2. The terminal attribute value is an attribute value of the terminal device 2. The attribute values of the terminal device 2 are, for example, the terminal type identifier of the terminal device 2, the screen size of the terminal device 2, and the aspect ratio. The terminal storage unit 21 may store position information, first model information, or original information.

Normally, one or more terminal attribute values including the position information of the avatar corresponding to the terminal device 2 are stored in the terminal storage unit 21.

The terminal reception unit 22 receives various instructions and information. The various instructions and information are, for example, position information, first model information, an identifier for identifying the first model information, an avatar identifier, one or more attribute values, and initial input. The attribute value of 1 or more is, for example, a role attribute value, a derived attribute value, and a terminal attribute value.

The initial input is an input before outputting the three-dimensional space including two or more avatars to the terminal device 2, and includes the position information of the avatars. The initial input includes 1 or 2 or more score acquisition source attribute values. It is preferable that the initial input includes the model information or the original information of the avatar. The initial input may include an avatar identifier. It is preferable that the model information included in the initial input is the first model information. The score acquisition source attribute value is an attribute value that is the basis for acquiring the score, and includes position information. The score acquisition source attribute value usually includes orientation information.

Here, acceptance means acceptance of information input from an input device such as a keyboard, mouse, or touch panel, reception of information transmitted via a wired or wireless communication line, recording of an optical disk, magnetic disk, semiconductor memory, or the like. It is a concept including acceptance of information read from a medium.

The terminal processing unit 23 performs various processes. The various processes are, for example, a score acquisition process described later and an avatar composition process described later. When the avatar output device 1 acquires the score, the terminal processing unit 23 does not perform the score acquisition process.

The terminal processing unit 23 acquires, for example, the score of one or more other avatars by using the position information of one or more other avatars and the terminal attribute value of one or more.

The terminal processing unit 23 acquires the score of one or more other avatars by using, for example, the position information of one or more other avatars in one or more other terminal devices 2 and the position information of the own avatar. The score acquisition process performed by the terminal processing unit 23 may be the same as the score acquisition process performed by the score acquisition unit 131 described above.

Specifically, the terminal processing unit 23 has, for example, among the position information of the own avatar, the orientation information of the own avatar, the camera position information, the camera orientation information, the camera angle information, and the position information of one or more other avatars. Acquire the dynamic attribute value of 1 or more other avatars by using 2 or more information of.

The terminal processing unit 23 acquires the distance between the own avatar and the other avatar by using, for example, the position information of the own avatar and the position information of the other avatar. Further, the terminal processing unit 23 uses, for example, the position information of the own avatar, the orientation information of the own avatar, and the position information of the other avatar to indicate whether or not the other avatar is in the field of view of the own avatar. Acquires the target attribute value (which may be called the in-field attribute value).

The terminal processing unit 23 uses the position information of the other avatar whose attribute value is to be acquired, the position information of the other avatar which is not the target to acquire the attribute value, the position information of the own avatar, and the orientation information of the own avatar. , You may acquire a dynamic attribute value indicating whether or not another avatar of the target for which the attribute value is acquired is in the field of view of the own avatar. That is, for example, even if the position information of the other avatar whose attribute value is to be acquired by using the position information of the own avatar and the orientation information of the own avatar is the information indicating the position within the field of view of the own avatar. When the position information of another avatar that is not the target for acquiring the attribute value is the information indicating the position between the own avatar and the other avatar for which the attribute value is acquired (the own avatar and the attribute value are acquired). If there is another avatar that is not the target for acquiring the attribute value with the other target avatar and the other avatar for which the attribute value is acquired from the own avatar cannot be seen), the attribute value in the field of view is ". Information indicating that another avatar is not in the field of the own avatar. "

In addition, the terminal processing unit 23 uses the size information of the other avatar for which the attribute value is acquired and the other avatar which is not the target for acquiring the attribute value, and the viewing angle information of the own avatar to obtain the attribute value. You may acquire a dynamic attribute value indicating whether or not another avatar to be acquired is in the field of view of your avatar.

The terminal processing unit 23 acquires the attribute value by using the position information of the other avatar that is the target for acquiring the attribute value, the position information of the objects constituting the world, the position information of the own avatar, and the orientation information of the own avatar. You may acquire a dynamic attribute value indicating whether or not the other target avatar is in the field of the own avatar. That is, for example, even if the position information of another avatar whose attribute value is to be acquired by using the position information of the own avatar and the orientation information of the own avatar is the information indicating the position within the field of view of the own avatar. , When the position information of the objects constituting the world is the information indicating the position between the own avatar and the other avatar for which the attribute value is acquired (the own avatar and the other avatar for which the attribute value is acquired). If there are objects that make up the world between them and you cannot see the other avatar for which you want to get the attribute value from your avatar), the attribute value in the field is "The other avatar is not in the field of your avatar." Information indicating that. "

In addition, the terminal processing unit 23 uses the size information of the other avatar of the target for acquiring the attribute value and the object constituting the world, and the information of the viewing angle of the own avatar, and the other avatar of the target for acquiring the attribute value is You may acquire a dynamic attribute value indicating whether or not you are in the field of view of your avatar.

In addition, the terminal processing unit 23 uses the size information of the other avatar of the target for acquiring the attribute value and the object constituting the world, and the information of the viewing angle of the own avatar to obtain the other avatar of the target for acquiring the attribute value. Specify the in-field attribute value corresponding to the percentage of your avatar in the field of view, or whether all are in the field, only part of it is in the field, or not at all. You may acquire the attribute value in the field of view. That is, the in-field attribute value may be one of two values of whether or not the user is in the field of view, or one of three or more.

Further, the terminal processing unit 23 uses, for example, camera position information, camera orientation information, angle of view information, and position information of other avatars to indicate whether or not the other avatar is within the range of shooting by the camera. Acquires a value (which may be called a shooting range attribute value).

Then, the terminal processing unit 23 acquires, for example, a score with a larger value as the distance from the own avatar in the three-dimensional space is closer to the other avatar. Further, the terminal processing unit 23 obtains a large score when, for example, another avatar is in the field of view of the own avatar, as compared with the case where the other avatar is not in the field of view. Further, for example, when the terminal processing unit 23 is within the range of shooting by the camera, the terminal processing unit 23 obtains a score having a large value as compared with the case where it is not within the range of shooting.

For example, the terminal processing unit 23 acquires a score of a larger value as the distance from the camera is closer to the other avatar.

More specifically, the terminal processing unit 23 acquires a score for another avatar, for example, by a decreasing function with a distance as a parameter. The score acquisition unit 131 acquires, for example, an arithmetic expression corresponding to the in-field attribute value and the shooting range attribute value from the storage unit 11, substitutes the distance into the arithmetic expression, executes the arithmetic expression, and acquires the score. .. The arithmetic expression is, for example, a decreasing function with a distance as a parameter.

The terminal processing unit 23 acquires, for example, a score corresponding to the distance, the in-field attribute value, and the shooting range attribute value from the correspondence table. In such a case, the correspondence table is, for example, a table having two or more correspondence information indicating the correspondence between the set of the distance range, the in-field attribute value, and the shooting range attribute value and the score.

In addition, the terminal processing unit 23 usually obtains a score higher than the score of the other avatar in the visual field in which the attribute value in the visual field is in the visual field of the own avatar. Further, the terminal processing unit 23 usually obtains a larger score as the ratio in the visual field indicated by the attribute value in the visual field is larger.

Further, the terminal processing unit 23 may perform the following score acquisition processing of the other avatar by using, for example, one or more static attribute values of the other avatar.

The static attribute value of 1 or more includes, for example, one of an attribute value relating to the role of another avatar and an attribute value relating to the origin of the other avatar. For example, when the role of the other avatar is "organizer" or "moderator", the terminal processing unit 23 obtains a higher score than the case where the role of the other avatar is "audience". For example, when the other avatar is UGC, the terminal processing unit 23 obtains a higher score as compared with the case where the other avatar is not UGC.

Further, the terminal processing unit 23 may acquire the determination result corresponding to each other avatar by using, for example, the score of each other avatar of 1 or more. The terminal processing unit 23 refers to a correspondence table having two or more correspondence information indicating the correspondence between the score width and the determination result, and acquires the determination result paired with the score for each other avatar. The terminal processing unit 23, for example, substitutes a score into an arithmetic expression having a score as a parameter, executes the arithmetic expression, and acquires a determination result. The determination result is the result of determination as to which of the two or more avatars (for example, the first avatar and the second avatar) is used as the avatar used when outputting another avatar.

Further, the terminal processing unit 23 acquires model information for one or more other avatars from, for example, the avatar output device 1, and uses the model information to perform avatar configuration processing for forming the displayed avatar. The avatar composition process is a known technique.

Further, the terminal processing unit 23 constitutes a world using the received world information, arranges two or more avatars in the world, and constitutes a three-dimensional space in which the avatars are arranged. The terminal processing unit 23 arranges each of the two or more avatars at a position specified by the corresponding position information.

The terminal transmission unit 24 transmits various information to the avatar output device 1. The terminal transmission unit 24 transmits, for example, the position information of the own avatar corresponding to the terminal device 2 to the avatar output device 1. The terminal transmission unit 24 transmits, for example, one or more attribute values of the terminal storage unit 21 to the avatar output device 1. The attribute value of 1 or more is, for example, the position information of the own avatar, the orientation information of the own avatar, and the terminal attribute value.

The terminal transmission unit 24 transmits the score or determination result of one or more other avatars to the avatar output device 1 in association with the terminal identifier of the terminal device 2. The score or determination result transmitted here is information acquired by the terminal processing unit 23. In addition, the score or the determination result corresponds to the avatar identifier of another avatar. When the avatar output device 1 acquires the score, the terminal transmission unit 24 does not transmit the score to the avatar output device 1. When the avatar output device 1 acquires the determination result, the terminal transmission unit 24 does not transmit the determination result to the avatar output device 1.

The terminal receiving unit 25 receives the position information of another avatar corresponding to one or more other terminal devices 2 from the avatar output device 1. The terminal receiving unit 25 receives, for example, one or more attribute values of another avatar from the avatar output device 1.

The terminal receiving unit 25 receives model information of another avatar from the avatar output device 1 and different model information according to the score or the determination result.

The terminal receiving unit 25 may receive two or more types of model information for each avatar. In such a case, the terminal processing unit 23 determines the model information to be used when displaying the other avatar according to the score or the determination result of the other avatar.

It is preferable that the terminal receiving unit 25 also receives world information from the avatar output device 1.

The terminal output unit 26 displays one or more other avatars configured by using one or more model information. The display may be transmitted to another display medium. Further, the model information is model information of one of two or more types of model information.

It is preferable that the terminal output unit 26 also displays its own avatar.

It is preferable that the terminal output unit 26 also uses world information to display the world.

It is preferable that the terminal output unit 26 outputs the voice information corresponding to the avatar. It is preferable that the voice information to be output is a kind of voice information (for example, first or second voice information) according to the score of the avatar or the determination result.

The storage unit 11, the world storage unit 111, the avatar storage unit 112, and the terminal storage unit 21 are preferably non-volatile recording media, but can also be realized by a volatile recording medium.

The process of storing information in the storage unit 11 or the like does not matter. For example, the information may be stored in the storage unit 11 or the like via the recording medium, or the information transmitted via the communication line or the like may be stored in the storage unit 11 or the like. Alternatively, the information input via the input device may be stored in the storage unit 11 or the like.

The reception unit 12, the avatar receiving unit 121, the score acquisition unit 131, and the terminal receiving unit 25 can be usually realized by wireless or wired communication means.

The processing unit 13, the score acquisition unit 131, the avatar processing unit 132, and the terminal processing unit 23 can usually be realized from a processor, a memory, or the like. The processing procedure of the processing unit 13 and the like is usually realized by software, and the software is recorded in a recording medium such as ROM. However, it may be realized by hardware (dedicated circuit). The processor is an MPU, a CPU, a GPU, or the like, and the type thereof does not matter.

The output unit 14, the position information transmission unit 141, the avatar processing unit 132, and the voice output unit 142 can be realized by a wireless or wired communication means.

The terminal reception unit 22 can be realized by a device driver for input means such as a touch panel or a keyboard, control software for a menu screen, or the like.

The terminal output unit 26 may or may not include an output device such as a display or a speaker. The terminal output unit 26 can be realized by the driver software of the output device, the driver software of the output device, the output device, or the like.

Next, an operation example of the information system A will be described. First, an operation example of the avatar output device 1 will be described with reference to the flowchart of FIG.

(Step S301) The avatar receiving unit 121 determines whether or not model information or the like has been received from the terminal device 2. If the model information or the like is received, the process goes to step S302, and if the model information or the like is not received, the process goes to step S303. The model information and the like are information including the first model information or the original information of the avatar corresponding to the terminal device 2. It is preferable that the model information and the like include, for example, the position information of the avatar corresponding to the terminal device 2. The model information and the like may include an avatar identifier. As for the avatar identifier, the processing unit 13 may acquire a unique avatar identifier in response to the reception of model information or the like. It doesn't matter how you get a unique avatar identifier. Further, in step S301, model information and the like are received from each of the two or more terminal devices 2.

(Step S302) The processing unit 13 stores the received model information and the like in association with the avatar identifier. Return to step S301.

(Step S303) The avatar processing unit 132 determines whether or not to start the compression process or the like. If the compression process or the like is started, the process goes to step S304, and if the compression process or the like is not started, the process goes to step S312. The compression process and the like are the processes of steps S304 to S311. Further, the conditions for starting the compression process or the like are not limited. Such a condition is, for example, that the time has reached a predetermined time and that the processing unit 13 has determined that the model information or the like has been received from all the terminal devices 2 scheduled to participate. Further, such a condition is that, for example, the reception unit 12 receives a request for compression processing or the like from the terminal device 2.

(Step S304) The avatar processing unit 132 substitutes 1 for the counter i.

(Step S305) The avatar processing unit 132 determines whether or not the avatar identifier of the i-th avatar to be compressed or the like exists. If the i-th avatar identifier exists, the process goes to step S306, and if it does not exist, the process goes to step S310.

(Step S306) The avatar processing unit 132 acquires the first model information of the i-th avatar identifier.

The avatar processing unit 132 may acquire the received first model information, or may acquire the first model information corresponding to the received original information. That is, the avatar processing unit 132 acquires, for example, the first model information paired with the i-th avatar identifier from the avatar storage unit 112. The avatar processing unit 132 acquires, for example, the original information paired with the i-th avatar identifier from the avatar storage unit 112, and acquires the first model information using the original information. In such a case, the original information is, for example, an identifier of the first model information or the original model information constituting the first model information.

(Step S307) The avatar processing unit 132 acquires one or more types of model information having a data size smaller than the first model information acquired in step S306. The one or more types of model information includes the second model information.

(Step S308) The avatar processing unit 132 stores avatar information including the first model information and the second model information in the avatar storage unit 112 in association with the i-th avatar identifier. It should be noted that accumulating the avatar information means that the avatar information is accumulated, and the information originally stored in the avatar storage unit 112 does not need to be accumulated here.

(Step S309) The avatar processing unit 132 increments the counter i by 1. Return to step S305.

(Step S310) The avatar processing unit 132 acquires one or more score acquisition source attribute values of all avatars in association with the avatar identifier. The score acquisition source attribute value is an attribute value that is the source for acquiring the score, and includes position information. The score acquisition source attribute value usually includes orientation information.

(Step S311) The position information transmission unit 141 associates one or more score acquisition source attribute values of each avatar acquired in step S310 with the avatar identifier and transmits the score acquisition source attribute value to two or more all terminal devices 2. Return to step S301.

(Step S312) The score acquisition unit 131 determines whether or not a request has been received from the terminal device 2. If the request is received, the process goes to step S313, and if the request is not received, the process goes to step S315. In step S312, requests are received from all two or more terminal devices 2. The request includes the determination result or score of one or more other avatars associated with the avatar identifier.

(Step S313) The avatar processing unit 132 performs an avatar information acquisition process. The avatar information acquisition process is a process of acquiring model information or the like for displaying an avatar. Further, the avatar information acquisition process may acquire world information. An example of the avatar information acquisition process will be described with reference to the flowchart of FIG.

(Step S314) The avatar processing unit 132 transmits the information acquired in step S313 to the terminal device 2 that has transmitted the request. Return to step S301. The information to be transmitted usually includes the model information of the avatar.

(Step S315) The reception unit 12 determines whether or not the voice information corresponding to the avatar identifier has been received. If the voice information is received, the process goes to step S316, and if the voice information is not received, the process returns to step S301. The voice information corresponding to the avatar identifier is usually voice information input by the user of the terminal device 2 corresponding to the avatar identifier.

(Step S316) The avatar processing unit 132 processes the voice information received in step S315. An example of such voice information processing will be described with reference to the flowchart of FIG.

In the flowchart of FIG. 3, the process is terminated by turning off the power or interrupting the end of the process.

Next, an example of the avatar information acquisition process in step S313 will be described with reference to the flowchart of FIG.

(Step S401) The avatar processing unit 132 substitutes 1 for the counter i.

(Step S402) The avatar processing unit 132 determines whether or not the i-th avatar identifier corresponding to the avatar information acquisition process exists. If the i-th avatar identifier exists, the process goes to step S403, and if the i-th avatar identifier does not exist, the process goes to step S406. The i-th avatar identifier is usually the i-th avatar identifier included in the received request.

(Step S403) The avatar processing unit 132 acquires the determination result or score corresponding to the i-th avatar identifier. Further, when the score is acquired, the avatar processing unit 132 acquires the determination result corresponding to the score. The determination result is usually a type identifier that specifies the type of model information to be acquired. The type identifier is, for example, "first" corresponding to the first model information and "second" corresponding to the second model information. Further, the avatar processing unit 132 temporarily stores the determination result or score corresponding to the i-th avatar identifier in a buffer (not shown) in association with the terminal device 2 that has transmitted the request.

(Step S404) The avatar processing unit 132 acquires the i-th avatar identifier and the model information corresponding to the determination result in association with the i-th avatar identifier. It can be said that the model information corresponding to the determination result is the model information corresponding to the score.

The avatar processing unit 132 acquires the model information from the avatar storage unit 112, for example. The avatar processing unit 132 generates, for example, the model information from the first model information.

(Step S405) The avatar processing unit 132 increments the counter i by 1. Return to step S402.

(Step S406) The avatar processing unit 132 determines whether or not to transmit the world information. If the world information is transmitted, the process goes to step S407, and if the world information is not transmitted, the process goes to step S408. In addition, when the world information is transmitted, it is usually the case that the world information is not transmitted to the terminal device 2 even once from the start of operation.

(Step S407) The avatar processing unit 132 acquires world information from the world storage unit 111.

(Step S408) The avatar processing unit 132 constitutes information including model information associated with each one or more avatar identifiers. Return to higher-level processing. The information may include world information. Such information is information transmitted to the terminal device 2.

Next, an example of voice information processing in step S316 will be described with reference to the flowchart of FIG.

(Step S501) The avatar processing unit 132 acquires an avatar identifier corresponding to the received voice information.

(Step S502) The avatar processing unit 132 acquires the received voice information.

(Step S503) The avatar processing unit 132 substitutes 1 for the counter i.

(Step S504) The avatar processing unit 132 determines whether or not the i-th other terminal device 2 exists. The other terminal device 2 is a terminal device 2 other than the terminal device 2 that has transmitted voice information.

(Step S505) The avatar processing unit 132 is a score or determination result corresponding to the i-th other terminal device 2, and the avatar score or determination result identified by the avatar identifier acquired in step S501 is from a buffer (not shown). get.

(Step S506) Whether the avatar processing unit 132 transmits the voice information of the avatar identified by the avatar identifier acquired in step S501 to the i-th other terminal device 2 from the score or the determination result acquired in step S505. Judge whether or not. If the voice information is transmitted, the process goes to step S507, and if the voice information is not transmitted, the process goes to step S509.

When it is determined that the voice information is transmitted, the voice of the avatar identified by the avatar identifier acquired in step S501 is output by the i-th other terminal device 2, and it is determined that the voice information is not transmitted. In this case, the voice of the avatar identified by the avatar identifier acquired in step S501 is not output by the i-th other terminal device 2.

(Step S507) The avatar processing unit 132 acquires voice information to be transmitted to the i-th other terminal device 2 by using the voice information acquired in step S502 according to the score or the determination result acquired in step S505. The acquired voice information may be the voice information acquired in step S502 or the voice information acquired from the voice information acquired in step S502.

(Step S508) The avatar processing unit 132 transmits the voice information acquired in step S507 to the i-th other terminal device 2.

(Step S509) The avatar processing unit 132 increments the counter i by 1. Return to step S504.

Next, an operation example of the terminal device 2 will be described with reference to the flowchart of FIG.

(Step S601) The terminal reception unit 22 determines whether or not the initial input, which is the input before the start of operation, has been accepted. If the initial input is accepted, the process goes to step S602, and if the initial input is not accepted, the process goes to step S612. The initial input includes one or more score acquisition source attribute values.

(Step S602) The terminal processing unit 23 configures the information to be transmitted by using the initial input received in step S601. The terminal transmission unit 24 transmits the information to the avatar output device 1. The information includes, for example, model information, position information, orientation information, and the like.

(Step S603) The terminal receiving unit 25 determines whether or not the score acquisition source attribute values of all the avatars have been received in response to the transmission in step S602. If the score acquisition source attribute value is received, the process proceeds to step S604, and if the score acquisition source attribute value is not received, the process returns to step S603. The terminal receiving unit 25 receives one or more score acquisition source attribute values for each avatar in association with the avatar identifier of each avatar.

(Step S604) The terminal processing unit 23 acquires the score of each avatar by using one or more score acquisition source attribute values of each avatar. An example of such a score acquisition process will be described with reference to the flowchart of FIG. In the score acquisition process, the terminal processing unit 23 may acquire the score and acquire the determination result by using the score. In the score acquisition process, the terminal processing unit 23 does not have to acquire the score and acquire the determination result. In such a case, the avatar output device 1 acquires the determination result.

(Step S605) The terminal processing unit 23 configures a request by using the score or the determination result acquired in step S604. The request has a score or a determination result corresponding to the avatar identifier of each avatar.

(Step S606) The terminal transmission unit 24 transmits the request configured in step S605 to the avatar output device 1. For example, the request may include an avatar identifier corresponding to the score acquired for each other avatar, and when the terminal processing unit 23 acquires the determination result, the request includes the determination result for each other avatar and the corresponding avatar identifier. You may.

(Step S607) The terminal receiving unit 25 determines whether or not the information has been received in response to the transmission of the request in step S606. If the information is received, the process goes to step S608, and if the information is not received, the process returns to step S607. The information usually includes model information of one or more avatars output by the avatar output device 1 in response to a request. Further, it is preferable that the information includes world information. Further, the information may include voice information corresponding to one or more avatar identifiers. Further, the received information is stored at least temporarily in the terminal storage unit 21.

(Step S608) The terminal processing unit 23 performs display information configuration processing using the information received in step S607. The display information configuration process is a process for configuring information to be displayed on the terminal device 2. An example of the display information configuration process will be described with reference to the flowchart of FIG. 7.

(Step S609) The terminal output unit 26 outputs the information configured in step S608. The output information usually includes a world and one or more avatars.

(Step S610) The terminal processing unit 23 determines whether or not the information received in step S607 has voice information. If it has voice information, it goes to step S611, and if it does not have voice information, it returns to step S601.

(Step S611) The processing unit 13 and the like perform audio output processing. Return to step S601. An example of audio output processing will be described with reference to the flowchart of FIG.

(Step S612) The terminal reception unit 22 determines whether or not the input from the user has been accepted. If the input is accepted, the process goes to step S613, and if the input is not accepted, the process goes to step S619. The input from the user is, for example, an input for changing the position information of the own avatar, an input for changing the orientation information of the own avatar, and voice information of the own avatar.

(Step S613) The terminal processing unit 23 acquires attribute values (for example, changed position information of the own avatar, changed orientation information of the own avatar, etc.) based on the input in step S612. The terminal processing unit 23 acquires the score to be changed based on the input. Further, when the information is received in step S619, the terminal processing unit 23 acquires the score to be changed based on the received information. The score acquisition process will be described with reference to the flowchart of FIG.

(Step S614) The terminal processing unit 23 configures a request by using the score or the determination result acquired in step S604. The request has a score or a determination result corresponding to the avatar identifier of each avatar.

Further, in the case of sending the request for the second time or later, it is preferable that the terminal processing unit 23 configures the request regarding the avatar for which the score or the determination result is different from the previous score or the determination result. Such a request does not include the score or judgment result of the avatar whose score or judgment result does not change. Such a request includes the avatar identifier of the avatar for which a different score or determination result was obtained, and the score or determination result.

Further, if there is no change in the score or the determination result of each avatar, the request may not be configured in step S614.

(Step S615) The terminal processing unit 23 determines in step S614 whether or not the request has been configured. If the request is configured, the process goes to step S606, and if the request is not configured, the process goes to step S616.

(Step S616) The terminal processing unit 23 determines whether or not to transmit the information corresponding to the input in step S612. If the information is transmitted, the process goes to step S617, and if the information is not transmitted, the process goes to step S608. The information corresponding to the input is, for example, voice information input by the user and information regarding the position and orientation of the new own avatar after the input.

(Step S617) The terminal processing unit 23 configures transmission information corresponding to the input in step S612.

(Step S618) The terminal transmission unit 24 transmits the transmission information configured in step S617 to the avatar output device 1 by pairing it with its own avatar identifier. Go to step S608.

(Step S619) The terminal receiving unit determines whether or not information has been received from the avatar output device 1. If the information is received, the process goes to step S613, and if the information is not received, the process returns to step S601. The information is, for example, voice information, changed position information of another avatar, and changed orientation information of another avatar. When the voice information is received, the terminal output unit 26 usually outputs the voice information.

In the flowchart of FIG. 5, the process ends when the power is turned off or an interrupt for the end of the process is interrupted.

Next, an example of the score acquisition process in step S604 will be described with reference to the flowchart of FIG. 7.

(Step S701) The terminal processing unit 23 acquires one or more attribute values for acquiring a score. The attribute value of 1 or more here includes the position information of the own avatar. The one or more attribute values here include, for example, the orientation information of the own avatar, the camera position information, the camera orientation information, and the angle of view information of the camera.

(Step S702) The terminal processing unit 23 substitutes 1 for the counter i.

(Step S703) The terminal processing unit 23 determines whether or not the avatar identifier of the i-th avatar whose score is to be acquired exists. If the i-th avatar identifier exists, the process proceeds to step S704, and if it does not exist, the process returns to higher processing.

(Step S704) The terminal processing unit 23 acquires one or more score acquisition source attribute values paired with the i-th avatar identifier. The score acquisition source attribute value of 1 or more is, for example, the position information, orientation information, role attribute value, and origin attribute value of the i-th avatar.

(Step S705) The terminal processing unit 23 acquires the user visual field attribute value by using the position information of the own avatar, the orientation information of the own avatar, and the position information of the i-th avatar. The user visual field attribute value is information indicating whether or not the i-th avatar exists in the visual field of the own avatar.

(Step S706) The terminal processing unit 23 acquires the camera field of view attribute value by using the camera position information, the camera orientation information, the angle of view information of the camera, and the position information of the i-th avatar. The camera field of view attribute value is information indicating whether or not the i-th avatar is within the shooting range of the camera.

(Step S707) The terminal processing unit 23 acquires the user distance attribute value by using the position information of the own avatar and the position information of the i-th avatar. The user distance attribute value is information for specifying the distance between the own avatar and the i-th avatar.

(Step S708) The terminal processing unit 23 acquires the user orientation attribute value by using the orientation information of the own avatar and the orientation information of the i-th avatar. The user orientation attribute value is information on the relative orientation between the own avatar and the i-th avatar, for example, information on the angle between the own avatar and the i-th avatar, and the own avatar and the i-th avatar. It is information indicating whether or not they are facing each other.

(Step S709) The terminal processing unit 23 acquires the camera distance attribute value by using the camera position information and the position information of the i-th avatar. The camera distance attribute value is information that specifies the distance between the camera and the i-th avatar.

(Step S710) The terminal processing unit 23 acquires the score of the i-th avatar by using one or two or more dynamic attribute values among the dynamic attribute values acquired in steps S709 from step S705.

(Step S711) The terminal processing unit 23 acquires the determination result of the i-th avatar by using the score of the i-th avatar. The determination result is, for example, a type identifier here. The terminal processing unit 23 usually acquires a determination result corresponding to a larger data size as the score is higher.

(Step S712) The terminal processing unit 23 temporarily stores the determination result in association with the i-th avatar identifier. The terminal processing unit 23 may temporarily accumulate the score in association with the i-th avatar identifier.

(Step S713) The terminal processing unit 23 increments the counter i by 1. Return to step S703.

In the flowchart of FIG. 6, the terminal processing unit 23 does not have to acquire the determination result. In such a case, the terminal processing unit 23 temporarily accumulates the score in association with the i-th avatar identifier.

Next, an example of the display information configuration process in step S608 will be described with reference to the flowchart of FIG.

(Step S801) The terminal processing unit 23 acquires world information. The world information is information received from the avatar output device 1 or information stored in the terminal storage unit 21.

(Step S802) The terminal processing unit 23 substitutes 1 for the counter i.

(Step S803) The terminal processing unit 23 determines whether or not the avatar identifier of the i-th avatar to be configured exists. If the i-th avatar identifier exists, the process proceeds to step S804, and if the i-th avatar identifier does not exist, the process returns to higher processing.

(Step S804) The terminal processing unit 23 acquires one or more attribute values or the like paired with the i-th avatar identifier from the terminal storage unit 21. It should be noted that one or more attribute values and the like may be considered to include a score or a determination result.

(Step S805) The terminal processing unit 23 determines whether or not to output the i-th avatar by using one or more attribute values acquired in step S804. To output the i-th avatar, go to step S806, and to not output the i-th avatar, go to step S80. The terminal processing unit 23 determines that, for example, another avatar that is not in the field of view of the camera or another avatar that is not in the field of view of the user's own avatar is not output. The terminal processing unit 23 may determine, for example, to output only an avatar whose score is equal to or higher than the threshold value or larger than the threshold value.

(Step S806) The terminal processing unit 23 acquires model information paired with the i-th avatar identifier. The model information is, for example, first model information or second model information determined based on the determination result of each avatar.

(Step S807) The terminal processing unit 23 constitutes an avatar to be displayed using the model information acquired in step S806.

(Step S808) The terminal processing unit 23 arranges the avatar configured in step S807 in the world composed of the world information acquired in step S801 by using the position information paired with the i-th avatar identifier. ..

(Step S809) The terminal processing unit 23 increments the counter i by 1. Return to step S803.

Next, an example of the audio output processing in step S611 will be described with reference to the flowchart of FIG.

(Step S901) The terminal processing unit 23 substitutes 1 for the counter i.

(Step S902) The terminal processing unit 23 determines whether or not the avatar identifier of the i-th avatar exists. If the i-th avatar identifier exists, the process proceeds to step S903, and if the i-th avatar identifier does not exist, the process returns to higher processing.

(Step S903) The terminal processing unit 23 determines whether or not there is voice information paired with the i-th avatar identifier. If the voice information exists, the process goes to step S904, and if the voice information does not exist, the process goes to step S907. The voice information paired with the i-th avatar identifier is, for example, information received from the avatar output device 1.

(Step S904) The terminal processing unit 23 acquires a score or a determination result paired with the i-th avatar identifier.

(Step S905) The terminal processing unit 23 acquires the type of voice information according to the score or the determination result in step S904.

Here, when two or more types of voice information are stored as a pair with the i-th avatar identifier, for example, the terminal processing unit 23 has a voice information paired with the i-th avatar identifier (for example, the first voice information). Of the voice information (voice information, second voice information), the type of voice information according to the score or the determination result is acquired. When one voice information is stored as a pair with the i-th avatar identifier, for example, the terminal processing unit 23 has an attribute value (for example, volume, frequency) of the one voice information according to a score or a determination result. ) To get the audio information to be output.

(Step S906) The terminal output unit 26 outputs the voice information acquired in step S905.

(Step S907) The terminal processing unit 23 increments the counter i by 1. Return to step S902.

In the flowchart of FIG. 9, the terminal output unit 26 may only output voice information paired with one or more avatar identifiers. In such a case, the avatar output device 1 usually acquires voice information according to the score paired with the avatar identifier.

Hereinafter, a specific operation example of the information system A in the present embodiment will be described with reference to FIG. The information system A has an avatar output device 1 and two or more terminal devices 2. Here, the two or more terminal devices 2 are referred to as terminal devices 2 (1), ..., Terminal device 2 (N).

It is assumed that the terminal reception unit 22 of the terminal device 2 (1) has received model information or the like from the user. Then, the terminal processing unit 23 configures the model information or the like to be transmitted by using the received model information or the like. The terminal transmission unit 24 transmits the model information to the avatar output device 1 (see 1001). The model information and the like have the first model information and one or more attribute values here. Here, it is assumed that the attribute value of 1 or more includes the position information, the role attribute value, the origin attribute value, and the terminal attribute value.

Similarly, the terminal device 2 (N) also transmits the model information and the like received from the user to the avatar output device 1 (see 1002).

Next, the avatar receiving unit 121 of the avatar output device 1 receives model information and the like from the terminal device 2 (1), the terminal device 2 (N), and the like (see 1001 and 1002). Then, the processing unit 13 generates a unique avatar identifier for each model information and the like. Next, it is assumed that the processing unit 13 associates the received model information or the like with the avatar identifier and stores it in the avatar management table having the structure of FIG. 11 of the avatar storage unit 112.

The avatar management table has "ID", "avatar identifier", "first model information", "second model information", and "attribute value". Further, the "attribute value" has "position information", "role attribute value", "origin attribute value", and "terminal attribute value". The "terminal attribute value" has a "screen size" and an "operating frequency" here. The "ID" is information for identifying a record. "First model information" is a file name of the first model information. "Second model information" is a file name of the second model information. Each file is also stored in the avatar storage unit 112. "Position information" is information that identifies the position of the avatar in the three-dimensional space. Further, here, the "role attribute value" may be any of "organizer", "moderator", and "audience". The "origin attribute value" can be either "UGC" or "default". "UGC" indicates that the avatar is created by the user. "Default" indicates that it is the default avatar. The default avatar is, for example, an avatar prepared in advance by the administrator of the avatar output device 1. At this stage, there is no information in the "second model information" in the table.

Next, the avatar processing unit 132 of the avatar output device 1 detects that the predetermined conditions are satisfied (for example, the predetermined time has come), and the terminal device 2 (1) or the terminal device 2 (for example) The above-mentioned compression processing is performed on the first model information such as N), and the second model information is acquired (see 1003). Next, the avatar processing unit 132 stores two or more second model information in the avatar storage unit 112, pairs the file names of the two or more second model information with the avatar identifier, and puts them in the avatar management table. accumulate. By the above processing, the avatar management table of FIG. 11 was constructed. In the avatar management table of FIG. 11, "D1 .json" is the _first model information of the default avatar, and "D2 .json" is the _second model information of the default avatar.

Next, the processing unit 13 acquires the score acquisition source attribute values of all the avatars from the avatar management table of FIG. 11 or the storage unit 11 in association with the avatar identifier. Here, it is assumed that the score acquisition source attribute values are the five attribute values shown in FIG. 11 and the camera attribute values (camera position information, camera orientation information, and angle of view information). It is assumed that the camera attribute value is stored in the storage unit 11.

Next, the position information transmission unit 141 associates the score acquisition source attribute values of all avatars with the avatar identifiers and transmits them to all the terminal devices 2 including the terminal device 2 (1) and the terminal device 2 (N). (See 1004, 1005).

Next, the terminal receiving unit 25 of the terminal device 2 (1) receives the score acquisition source attribute values of all avatars (see 1004). Further, the terminal receiving unit 25 such as the terminal device 2 (N) also receives the score acquisition source attribute values of all avatars (see 1004).

Next, the terminal processing unit 23 of the terminal device 2 (1) or the like uses the position information of each other avatar possessed by the received score acquisition source attribute value, the camera position information, the camera orientation information, and the angle of view information. , Acquires the shooting range attribute value of each other avatar and the distance from the camera for each other avatar. Further, all the terminal processing units 23 such as the terminal device 2 (1) use the position information of each own avatar and the position information of each other avatar to set the distance between the own avatar and the other avatar for each other avatar. To get to.

Next, the terminal processing unit 23 such as the terminal device 2 (1) has a shooting range attribute value corresponding to the other avatar, a distance from the camera, a distance between the own avatar and the other avatar, and a role attribute value for each other avatar. , Derived attribute value, etc. are used to obtain the score. Next, the terminal processing unit 23 such as the terminal device 2 (1) acquires the determination result "first" or "second" for each other avatar. Here, the terminal processing unit 23 acquires the determination result of "first" for other avatars whose score is equal to or higher than the threshold value, and "second" for other avatars whose score is less than the threshold value. (See 1006 and 1007).

Further, the concept of the determination result here is, for example, FIG. 12. In FIG. 12, when the area 1201 shown in gray is the shooting range of the camera, the determination result of the nine avatars included in the shooting range of the camera and close to the camera is "first", and the other The determination result of the avatar is "second". In FIG. 11, the avatar with the determination result “first” is painted black, and the avatar with the determination result “second” is not painted black. Further, it is preferable that the determination result differs depending on each terminal device 2 of the terminal devices 2 (1), ..., And the terminal device 2 (N). The nine avatars corresponding to the determination result "first" are A01, A02, A03, A04, A05, A06, A07, A08, and A09 in FIG.

Similarly, in FIG. 12, if the region 1201 shown in gray is the field of view seen from the specific terminal device (N), the determination can be made in consideration of the field of view of the own avatar.

Next, all the terminal processing units 23 such as the terminal device 2 (1) constitute a request having a set of an avatar identifier of another avatar and a determination result as many as the number of other avatars. Next, each terminal transmission unit 24 of the terminal devices 2 (1), ..., And the terminal device 2 (N) transmits a request to the avatar output device 1 (see 1008 and 1009).

Next, the score acquisition unit 131 of the avatar output device 1 receives a request from each of two or more terminal devices 2 (see 1008 and 1009).

Next, the score acquisition unit 131 of the avatar output device 1 acquires the determination result corresponding to each avatar identifier included in the request from each terminal device 2. The determination result may be considered as an example of the score. Next, the avatar processing unit 132 acquires the file name of the attribute value "first model information" or the attribute value "second model information" from the avatar management table (FIG. 11) for each avatar identifier according to the determination result. Then, the first model information or the second model information identified by the file name is associated with the avatar identifier and acquired from the avatar storage unit 112. The first model information is acquired for the avatar identifier corresponding to the determination result "first", and the second model information is acquired for the avatar identifier corresponding to the determination result "second".

Next, the avatar processing unit 132 detects that the flag world information sending flag indicating whether or not the world information has been sent is OFF (not sent), and determines that the world information is transmitted. Then, the avatar processing unit 132 acquires the world information from the world storage unit 111. The avatar processing unit 132 performs the above processing for each terminal device 2 and acquires the first model information or the second model information and the world information associated with the avatar identifier (see 1010 and 1011).

Next, the avatar processing unit 132 transmits the acquired information to each of the two or more terminal devices 2 that have transmitted the request (see 1012 and 1013). The avatar processing unit 132 turns on (sent) the world information sending flag by sending the world information.

Next, the terminal receiving unit 25 of each of the two or more terminal devices 2 receives information in response to the transmission of the request (see 1012 and 1013). The information here includes two or more sets of world information and avatar identifiers and model information.

Next, the terminal processing unit 23 of each of the two or more terminal devices 2 performs the above-mentioned display information configuration processing using the received information (see 1014 and 1015). The terminal output unit 26 outputs the information configured by the display information configuration process (see 1016, 1017). The output information has a large number of avatars in a virtual three-dimensional space. An example of such output is shown in FIG. In FIG. 13, avatars corresponding to each user of two or more terminal devices 2 are displayed together with the world. Further, it is preferable that the first model information or the second model information is used even with the same avatar by the terminal device 2.

Further, it is preferable that the image acquired by the camera in the world is displayed on the virtual screen of 1301 of FIG. In such a case, for example, the avatar output device 1 constitutes an image acquired by a camera in the world and transmits it to each terminal device 2. Then, the terminal receiving unit 25 of each terminal device 2 receives the image acquired by the camera. Then, the terminal processing unit 23 pastes the received video on a virtual screen in the world, and then the terminal output unit 26 corresponds to each user in the world including the screen on which the video is pasted. Output with the avatar to do.

Further, it is assumed that the time has passed and the user has input to the terminal device 2 (1) to change the position information of the own avatar (see 1018).

Next, the terminal processing unit 23 of the terminal device 2 (1) calculates the score of each of the other avatars of 1 or more again according to the change of the position information of the own avatar. The terminal processing unit 23 has already received information other than the position information of its own avatar (information of other avatars, camera attribute values, etc.), and uses the accumulated information to score one or more of each other avatar. Is calculated.

Next, the terminal processing unit 23 of the terminal device 2 (1) acquires a determination result according to the score of each of the other avatars of 1 or more (see 1019).

Next, the terminal processing unit 23 has one or more sets of avatar identifiers and determination results of other avatars whose determination results have changed as compared with the previous determination result, and the changed position information of the own avatar. Configure a request with.

Next, the terminal transmission unit 24 of the terminal device 2 (1) transmits the request to the avatar output device 1 (see 1020).

Next, the score acquisition unit 131 of the avatar output device 1 receives a request from the terminal device 2 (1) (see 1020).

Next, the avatar processing unit 132 of the avatar output device 1 acquires the determination result corresponding to each one or more avatar identifiers included in the request from the terminal device 2 (1). Next, the avatar processing unit 132 acquires the file name of the attribute value "first model information" or the attribute value "second model information" from the avatar management table (FIG. 11) for each avatar identifier according to the determination result. Then, the first model information or the second model information identified by the file name is associated with the avatar identifier and acquired from the avatar storage unit 112.

Next, since the world information has already been transmitted to the terminal device 2 (1), the avatar processing unit 132 determines that the world information is not transmitted.

Next, the avatar processing unit 132 transmits the acquired information to the terminal device 2 (1) that has transmitted the request (see 1021).

Further, the terminal processing unit 23 of the terminal device 2 (1) configures the display information to be changed by using the model information of the other avatar received in response to the update of the position information of the own avatar (see 1022). ). Next, the terminal output unit 26 of the terminal device 2 (1) outputs the newly configured display information (see 1023). The terminal processing unit 23 also changes the position information (relative position information) of the other avatar according to the update of the position information of the own avatar.

Further, the avatar processing unit 132 transfers information on other avatars including the changed position information of the avatar of the terminal device 2 (1) and the avatar identifier of the avatar of the terminal device 2 (1) to the terminal device 2 (N). Transmit to one or more terminal devices 2 including (see 1024).

Next, the terminal receiving unit 25 such as the terminal device 2 (N) receives the information of the other avatar of the terminal device 2 (1).

Next, the terminal processing unit 23 of the terminal device 2 (N) or the like acquires a new score for the avatar of the terminal device 2 (1) by changing the position information of the avatar of the terminal device 2 (1). Next, the terminal processing unit 23 such as the terminal device 2 (N) acquires the determination result for the avatar of the terminal device 2 (1) (see 1025).

Then, it is assumed that the determination result of the avatar of the terminal device 2 (1) in the terminal device 2 (N) is different from the previous determination result.

Next, the terminal transmission unit 24 of the terminal device 2 (N) transmits a request including the avatar identifier of the other avatar of the terminal device 2 (1) and the new determination result to the avatar output device 1 (see 1026). It is assumed that the terminal device (2) whose avatar determination result of the terminal device 2 (1) is the same as the previous determination result does not transmit the request to the avatar output device 1.

Next, the score acquisition unit 131 of the avatar output device 1 receives a request from the terminal device 2 (N) (see 1026).

Next, the avatar processing unit 132 of the avatar output device 1 acquires the determination result corresponding to the avatar identifier included in the request from the terminal device 2 (N). Next, the avatar processing unit 132 is a file name of the attribute value "first model information" or the attribute value "second model information" according to the determination result of the avatar identifier, and is a file paired with the avatar identifier. The name is acquired from the avatar management table (FIG. 11), and the first model information or the second model information identified by the file name is associated with the avatar identifier and acquired from the avatar storage unit 112.

Next, the avatar processing unit 132 transmits the acquired information to the terminal device 2 (N) that has transmitted the request (see 1027).

Next, the terminal receiving unit 25 of the terminal device 2 (N) receives information in response to the transmission of the request (see 1027).

Next, the terminal processing unit 23 of the terminal device 2 (N) performs display information configuration processing using the received information (see 1028). The terminal output unit 26 of the terminal device 2 (N) outputs the information configured by the display information configuration process (see 1029). In the terminal device 2 (N), for example, the position of the avatar of the terminal device 2 (1) is moved by the display information configuration process, and the model information used for displaying the avatar is the second model information. Is changed to the first model information.

By changing the position information of the avatar of the terminal device 2 (1), the terminal device 2 other than the terminal device 2 (N) also sends a request to the avatar output device 1 and similarly to the terminal device 2 (N). The changed information may be output.

As described above, according to the present embodiment, when a large number of avatars are output, appropriate processing can be performed according to the score of each avatar.

Further, according to the present embodiment, when displaying a large number of avatars, the display control of each avatar can be appropriately controlled by the user according to the score of each avatar.

Further, according to the present embodiment, when displaying a large number of avatars, each avatar can be appropriately displayed for the user while suppressing the processing load.

Further, according to the present embodiment, when displaying a large number of avatars, it is possible to obtain the behavior of each avatar suitable for the user according to the score of each avatar.

Further, according to the present embodiment, when the voice output of a large number of avatars is performed, the voice output of each avatar suitable for the user can be obtained according to the score of each avatar.

Further, according to the present embodiment, an appropriate score of the avatar can be obtained based on the dynamic attribute value or the static attribute value of the avatar.

Further, according to the present embodiment, the processing can be shared between the two or more terminal devices 2 and the avatar output device 1.

In the present embodiment, in the process until the avatar is displayed on the terminal device 2, the process may be shared between the two or more terminal devices 2 and the avatar output device 1. In the above specific example, for example, the terminal device 2 performs the acquisition and determination of the score of each avatar, but for example, the terminal device 2 acquires the score of each avatar, and the determination using the score is performed by the avatar output device. 1 may go. Further, the avatar output device 1 may perform acquisition and determination of the score of each avatar.

Further, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded on a recording medium such as a CD-ROM and disseminated. It should be noted that this also applies to other embodiments herein. The software that realizes the avatar output device 1 in this embodiment is the following program. That is, this program uses a computer that can access an avatar storage unit that stores avatar information having a first model information for displaying an avatar and one or more attribute values for each of two or more avatars. The score is obtained by using the score acquisition unit for acquiring the score of each of the two or more avatars using the attribute value of one or more corresponding to each of the two or more avatars, and the avatar information of each of the two or more avatars. This is a program for functioning as an avatar processing unit that outputs each of the two or more avatars according to the score acquired by the acquisition unit.

Further, the software that realizes the terminal device 2 in the present embodiment is the following program. That is, this program has a computer that can access a terminal storage unit that stores one or more terminal attribute values including the position information of the avatar, a terminal transmission unit that transmits the position information to the avatar output device, and the avatar output. Using the terminal receiving unit that receives the position information of the other avatar corresponding to one or more other terminal devices from the device, and the position information and the position information of the one or more other avatars, the one or more other avatars It is a program for functioning as a terminal processing unit for acquiring a score, and the terminal transmitting unit associates the terminal identifier of the terminal device with the score of one or more other avatars or a determination result based on the score. It is transmitted to the avatar output device, and the terminal receiving unit is model information of the other avatar from the avatar output device according to the transmission of the score or the determination result, and differs depending on the score or the determination result. A program for operating the computer to receive model information or different voice information, and further as a terminal output unit that outputs the one or more other avatars using the model information or the voice information. It is a program for making the computer function.

Further, FIG. 14 shows the appearance of a computer that executes the program described in the present specification to realize the avatar output device 1 and the like in various embodiments described above. The above-described embodiment can be realized by computer hardware and a computer program executed on the computer hardware. FIG. 14 is an overview view of the computer system 300, and FIG. 15 is a block diagram of the system 300.

In FIG. 14, the computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.

In FIG. 15, in addition to the CD-ROM drive 3012, the computer 301 includes an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012, the ROM 3015 for storing a program such as a boot-up program, and the MPU 3013. It includes a RAM 3016 that is connected and for temporarily storing instructions of an application program and providing a temporary storage space, and a hard disk 3017 for storing an application program, a system program, and data. Although not shown here, the computer 301 may further include a network card that provides a connection to the LAN.

The program for causing the computer system 300 to execute the functions of the avatar output device 1 and the like according to the above-described embodiment may be stored in the CD-ROM 3101, inserted into the CD-ROM drive 3012, and further transferred to the hard disk 3017. .. Alternatively, the program may be transmitted to the computer 301 via a network (not shown) and stored in the hard disk 3017. The program is loaded into RAM 3016 at run time. The program may be loaded directly from the CD-ROM3101 or the network.

The program does not necessarily have to include an operating system (OS) or a third-party program that causes the computer 301 to execute the functions of the avatar output device 1 and the like according to the above-described embodiment. The program need only include a portion of the instruction that calls the appropriate function (module) in a controlled manner to obtain the desired result. It is well known how the computer system 300 works, and detailed description thereof will be omitted.

In the above program, in the step of transmitting information and the step of receiving information, the processing performed by the hardware, for example, the processing performed by the modem or the interface card in the transmission step (only performed by the hardware). Processing) is not included.

Further, the number of computers that execute the above program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

Further, it goes without saying that in each of the above embodiments, the two or more communication means existing in one device may be physically realized by one medium.

Further, in each of the above embodiments, each process may be realized by centralized processing by a single device, or may be realized by distributed processing by a plurality of devices.

It goes without saying that the present invention is not limited to the above embodiments, and various modifications can be made, and these are also included in the scope of the present invention.

As described above, the avatar output device according to the present invention has the effect of being able to perform appropriate processing according to the score of each avatar when outputting a large number of avatars, and is useful as an avatar output device or the like.

1 Avatar output device 2 Terminal device 11 Storage unit 12 Reception unit 13 Processing unit 14 Output unit 21 Terminal storage unit 22 Terminal reception unit 23 Terminal processing unit 24 Terminal transmission unit 24 Each terminal transmission unit 25 Terminal reception unit 26 Terminal output unit 111 World Storage unit 112 Avatar storage unit 121 Avatar reception unit 131 Score acquisition unit 132 Avatar processing unit 141 Location information transmission unit 142 Audio output unit

Claims (14)

For each of the two or more avatars, an avatar storage unit that stores the first model information for displaying the avatar and the avatar information having one or more attribute values, and
A score acquisition unit for acquiring the score of each of the two or more avatars, which is obtained by using the attribute value of the one or more corresponding to each of the two or more avatars.
It is provided with an avatar processing unit that outputs each of the two or more avatars according to the score acquired by the score acquisition unit using the avatar information of each of the two or more avatars.
The one or more attribute values possessed by the avatar information include any one of an attribute value relating to the field of view of the user corresponding to the avatar, an attribute value relating to the field of view of the camera, an attribute value relating to the distance from the user, and an attribute value relating to the orientation with respect to the user. One or more dynamic attribute values of an avatar that can change dynamically,
The score acquisition unit
An avatar output device for acquiring the score of each of the two or more avatars, which is obtained by using the one or more dynamic attribute values corresponding to the two or more avatars. The avatar information of each of the two or more avatars in the avatar storage unit also has one or more static attribute values that do not change dynamically.
The score acquisition unit
The avatar output device according to claim 1, wherein a score of each of the two or more avatars is acquired, which is obtained by using the static attribute value of the one or more corresponding to each of the two or more avatars. The avatar processing unit
The avatar output device according to claim 1 or 2, wherein the avatar is output so that the output method of the avatar differs between the avatar whose score satisfies the score condition and the avatar whose score does not satisfy the score condition. .. The avatar processing unit
For an avatar whose score satisfies the score condition, the avatar is output using the second model information obtained by reducing the data size of the first model information, and the score satisfies the score condition. The avatar output device according to claim 3, wherein the avatar is output to a non-avatar using the first model information. The avatar processing unit
The avatar output device according to claim 3, wherein the avatar is operated so that the control method of the operation of the avatar differs between the avatar whose score satisfies the score condition and the avatar whose score does not satisfy the score condition. The avatar information has voice information and has voice information.
The avatar processing unit
Claimed to output the voice of the avatar using the voice information so that the voice output method of the avatar differs between the avatar whose score satisfies the score condition and the avatar whose score does not satisfy the score condition. The avatar output device according to any one of claims 1 to 5. The terminal device performs the process of acquiring the score or the determination result using the above-mentioned one or more dynamic attribute values.
The avatar output device according to any one of claims 1 to 6 , wherein the avatar output device performs a process of acquiring the second model information using the first model information. The one or more static attribute values include any of a role attribute value related to the role of the avatar, a derived attribute value indicating whether or not the avatar is created by the user, and an attribute value of the terminal device corresponding to the avatar. Item 2 The avatar output device. The second model information is M (M is a natural number of 1 or more) mesh information less than N, which is acquired by using the mesh information of N (N is a natural number of 2 or more) possessed by the first model information. The avatar output device according to claim 4, which is model information to have. A terminal storage unit that stores one or more terminal attribute values including the position information of the avatar corresponding to the terminal device, and
A terminal transmitter that transmits the position information of the avatar corresponding to the terminal device to the avatar output device, and
A terminal receiving unit that receives position information of another avatar corresponding to one or more other terminal devices from the avatar output device.
A terminal processing unit for acquiring the score of the one or more other avatars by using the position information of the one or more other avatars and the position information of the avatar corresponding to the terminal device is provided.
The terminal transmitter is
The score of the other avatar of 1 or more or the determination result based on the score is transmitted to the avatar output device in association with the terminal identifier of the terminal device.
The terminal receiver is
In response to the transmission of the score or the determination result, the model information or voice information of the other avatar is received from the avatar output device, and different model information or different voice information according to the score or the determination result is received.
A terminal device further comprising a terminal output unit that outputs one or more other avatars using the model information or the voice information. For each of two or more avatars, it is realized by an avatar storage unit that stores the first model information for displaying the avatar and avatar information having one or more attribute values, a score acquisition unit, and an avatar processing unit. Avatar output method
A score acquisition step of acquiring a score of each of the two or more avatars, which is obtained by the score acquisition unit using the one or more attribute values corresponding to the two or more avatars.
The avatar processing unit includes an avatar processing step that outputs each of the two or more avatars according to the score acquired by the score acquisition unit by using the avatar information of each of the two or more avatars.
The one or more attribute values possessed by the avatar information include any one of an attribute value relating to the field of view of the user corresponding to the avatar, an attribute value relating to the field of view of the camera, an attribute value relating to the distance from the user, and an attribute value relating to the orientation with respect to the user. One or more dynamic attribute values of an avatar that can change dynamically,
In the score acquisition step
An avatar output method for acquiring the score of each of the two or more avatars, which is obtained by using the one or more dynamic attribute values corresponding to the two or more avatars. An avatar realized by a terminal storage unit, a terminal transmission unit, a terminal reception unit, a terminal processing unit, and a terminal output unit in which one or more terminal attribute values including the position information of the avatar corresponding to the terminal device are stored. It ’s an output method,
A terminal transmission step in which the terminal transmission unit transmits the position information of the avatar corresponding to the terminal device to the avatar output device.
A terminal receiving step in which the terminal receiving unit receives the position information of another avatar corresponding to one or more other terminal devices from the avatar output device.
The terminal processing unit includes a terminal processing step for acquiring a score of the one or more other avatars by using the position information of the one or more other avatars and the position information of the avatar corresponding to the terminal device.
The terminal transmitter is
The score of the other avatar of 1 or more or the determination result based on the score is transmitted to the avatar output device in association with the terminal identifier of the terminal device.
The terminal receiver is
In response to the transmission of the score or the determination result, the model information or voice information of the other avatar is received from the avatar output device, and different model information or different voice information according to the score or the determination result is received.
An avatar output method in which the terminal output unit further comprises a terminal output step of outputting one or more other avatars using the model information or the voice information. For each of the two or more avatars, a computer that can access the avatar storage unit that stores the first model information for displaying the avatar and the avatar information having one or more attribute values.
A score acquisition unit for acquiring the score of each of the two or more avatars, which is obtained by using the attribute value of the one or more corresponding to each of the two or more avatars.
It is a program for functioning as an avatar processing unit that outputs each of the two or more avatars according to the score acquired by the score acquisition unit by using the avatar information of each of the two or more avatars.
The one or more attribute values possessed by the avatar information include any one of an attribute value relating to the field of view of the user corresponding to the avatar, an attribute value relating to the field of view of the camera, an attribute value relating to the distance from the user, and an attribute value relating to the orientation with respect to the user. One or more dynamic attribute values of an avatar that can change dynamically,
The score acquisition unit
A program for operating the computer as a device for acquiring the score of each of the two or more avatars, which is obtained by using the one or more dynamic attribute values corresponding to the two or more avatars. A computer that can access the terminal storage unit that stores one or more terminal attribute values including the location information of the avatar.
A terminal transmission unit that transmits the position information of the avatar to the avatar output device, and
A terminal receiving unit that receives position information of another avatar corresponding to one or more other terminal devices from the avatar output device.
It is a program for functioning as a terminal processing unit for acquiring the score of the other avatar of 1 or more by using the position information of the other avatar of 1 or more and the position information of the avatar.
The terminal transmitter is
The score of the other avatar of 1 or more or the determination result based on the score is transmitted to the avatar output device in association with the terminal identifier of the terminal device.
The terminal receiver is
Assuming that the model information or voice information of the other avatar is received from the avatar output device in response to the transmission of the score or the determination result, and different model information or different voice information according to the score or the determination result is received. , A program for operating the computer,
A program for further functioning the computer as a terminal output unit that outputs one or more other avatars using the model information or the voice information.

Images