WO2021261188A1

WO2021261188A1 - Avatar generation method, program, avatar generation system, and avatar display method

Info

Publication number: WO2021261188A1
Application number: PCT/JP2021/020993
Authority: WO
Inventors: 浩齋藤
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2020-06-23
Filing date: 2021-06-02
Publication date: 2021-12-30
Also published as: JP2023110113A

Abstract

This avatar generation method comprises a generation step and a modification step. The generation step is a step for generating avatar-purpose data for displaying, in a virtual space, an avatar that reflects at least physical information of a target person. The modification step is a step for modifying, among the avatar-purpose data generated in the generation step, the avatar and/or an accessory that will be displayed in the virtual space, according to a display form of the avatar and/or an attribute of the accessory.

Description

Avatar generation method, program, avatar generation system, and avatar display method

This disclosure generally relates to avatar generation methods, programs, and avatar generation systems. More specifically, the present disclosure relates to an avatar generation method for generating an avatar displayed in a virtual space, a program for executing the avatar generation method, and an avatar generation system for generating an avatar displayed in the virtual space.

Patent Document 1 describes a virtual space providing system in which a user-customized avatar image can be operated in the virtual space provided by the virtual space providing server, and the avatar image can be moved in the virtual space. Is disclosed.

Japanese Unexamined Patent Publication No. 2009-21528

It is an object of the present disclosure to provide an avatar generation method, a program, and an avatar generation system that can easily generate avatar data suitable for an application.

The avatar generation method according to one aspect of the present disclosure includes a generation step and a modification step. The generation step is a step of generating avatar data for displaying an avatar that reflects at least the physical information of the subject in the virtual space. In the modification step, at least one of the avatar and the accessory displayed in the virtual space among the data for the avatar generated in the generation step is at least one of the display mode of the avatar and the attribute of the accessory. It is a step to modify according to.

The program according to one aspect of the present disclosure causes one or more processors to execute the above-mentioned avatar generation method.

The avatar generation system according to one aspect of the present disclosure includes a generation unit and a modification unit. The generation unit generates avatar data for displaying at least an avatar that reflects the physical information of the subject in a virtual space. The modification unit uses at least one of the avatar and the accessory displayed in the virtual space among the avatar data generated by the generation unit, and at least one of the display mode of the avatar and the attribute of the accessory. Modify according to.

This disclosure has the advantage that it is easy to generate avatar data suitable for the application.

FIG. 1 is a block diagram of an overall configuration including an avatar generation system which is an execution subject of the avatar generation method according to the embodiment of the present disclosure. FIG. 2 is a flowchart showing an example of the operation of the above-mentioned avatar generation system. FIG. 3 is a schematic diagram showing an example of an avatar generated by the above-mentioned avatar generation system. FIG. 4 is a schematic diagram showing an example of an avatar modified by the same avatar generation system. FIG. 5 is a schematic diagram showing another example of the avatar modified by the same avatar generation system. FIG. 6 is a schematic diagram showing a first operation example of the above-mentioned avatar generation system. FIG. 7 is a schematic diagram showing a second operation example of the above-mentioned avatar generation system. FIG. 8 is a schematic diagram showing a second operation example of the above-mentioned avatar generation system. FIG. 9 is a schematic diagram showing a third operation example of the above-mentioned avatar generation system.

(1) Outline Hereinafter, the avatar generation method of the present embodiment and the avatar generation system 100 (see FIG. 1), which is the execution subject of the avatar generation method, will be described with reference to the drawings. However, the following embodiments are only part of the various embodiments of the present disclosure. The following embodiments can be variously modified according to the design and the like as long as the object of the present disclosure can be achieved. Further, each figure described in the following embodiment is a schematic view, and the ratio of the size and the thickness of each component in the figure does not necessarily reflect the actual dimensional ratio. ..

The avatar generation method (avatar generation system 100) of the present embodiment is a method (system) for generating the avatar A1 of the target person T1. The "avatar" referred to in the present disclosure is a character displayed in the virtual space V1 as an alter ego of the target person T1 in the real space R1. The avatar A1 is displayed in the virtual space V1 as, for example, a three-dimensional model imitating the target person T1.

Further, in the present embodiment, the virtual space V1 is a three-dimensional space displayed on the display unit 51 of the information terminal 5 described later. The virtual space V1 may be a space expressed by VR (Virtual Reality) technology or a space expressed by AR (Augmented Reality). Further, the virtual space V1 may be a space represented by MR (Mixed Reality) technology or a space represented by SR (Substitutional Reality) technology. That is, the virtual space V1 is a space expressed by xR (Cross Reality) technology.

As shown in FIG. 1, the avatar generation system 100 includes a generation unit 11 and a modification unit 12. The generation unit 11 is the execution subject of the generation step ST1 (see FIG. 2) in the avatar generation method of the present embodiment. The modification unit 12 is the execution subject of the modification step ST2 (see FIG. 2) in the avatar generation method of the present embodiment.

As the generation step ST1, the generation unit 11 generates avatar data for displaying at least the avatar A1 reflecting the physical information of the target person T1 in the virtual space V1. The avatar data is used, for example, in an application executed by the information terminal 5. In this case, the application can superimpose and display the avatar A1 on the virtual space V1 by using the avatar data provided by the avatar generation system 100. The avatar A1 includes a three-dimensional model of the subject T1, a texture, a material, a skeleton, a skin weight, and the like.

Here, the avatar A1 included in the avatar data is not a model completely different from the target person T1 in the real space R1 such as a stuffed bear, but the physical information of the target person T1, that is, the degree to which the target person T1 can be identified. It is a model that reflects the information of. In the present embodiment, the avatar A1 included in the avatar data is a model that realistically imitates the subject T1, that is, a photorealistic model. Further, the avatar data may include not only the data of the avatar A1 but also the data of the accessory B1 described later. Further, the avatar data may include motion data relating to the movement of the avatar A1.

The modification unit 12 modifies at least one of the avatar data generated by the generation unit 11 (generation step ST1) of the avatar A1 and the accessory B1 displayed in the virtual space V1 as the modification step ST2. Hereinafter, unless otherwise specified, the avatar A1 and the accessory B1 before being modified by the modification unit 12 are simply referred to as "avatar A1" and "incidental B1", respectively. Further, in the following, unless otherwise specified, the avatar A1 and the accessory B1 after being modified by the modification unit 12 are referred to as "the modified avatar A1" and "the modified accessory B1", respectively.

The "incidental object" referred to in the present disclosure is an object displayed together with the avatar A1 in the virtual space V1 and refers to an object related to the avatar A1 in some way. As an example, the accessory B1 may include an object that can be worn by the avatar A1 such as clothes, and an object used by the avatar A1 such as a car or a house. In the present embodiment, the clothes T11 worn by the subject T1 when the avatar A1 is generated are included in the avatar A1 instead of the accessory B1.

The modification unit 12 modifies at least one of the avatar A1 and the accessory B1 according to at least one of the display mode of the avatar A1 and the attribute of the accessory B1 in the virtual space V1. For example, the modification unit 12 modifies at least one of the avatar A1 and the accessory B1 according to the partner who discloses the avatar A1 (that is, the display mode of the avatar A1) as described later. Further, for example, the modification unit 12 modifies at least one of the avatar A1 and the accessory B1 according to the type and / or size of the garment (that is, the attribute of the accessory B1) as described later.

Then, by using the avatar data provided by the avatar generation system 100, the application can superimpose and display the modified avatar A1 and / or the modified accessory B1 on the virtual space V1. ..

As described above, in the present embodiment, of the avatar data generated by the generation unit 11, at least one of the avatar A1 and the accessory B1 is according to the display mode of the avatar A1 and at least one of the attributes of the accessory B1. Modify. Therefore, this embodiment has an advantage that it is easy to generate avatar data suitable for the application.

(2) Details Hereinafter, the avatar generation system 100 of the present embodiment will be described in detail with reference to FIG. In this embodiment, it is assumed that the company that operates the avatar generation system 100 and the company that provides the application are different from each other.

In this embodiment, the avatar generation system 100 is a server. The avatar generation system 100 is configured to be able to communicate with each of the scanner 4 and the information terminal 5 via a network N1 such as the Internet. In FIG. 1, one scanner 4 and one information terminal 5 are shown, but each of them may be plural.

The scanner 4 is a 3D scanner, and is installed in a remote place away from the place where the avatar generation system 100 is installed, for example. The scanner 4 includes a plurality of image pickup devices 41 that image the subject T1 in the real space R1. In FIG. 1, four image pickup devices 41 are installed, but in reality, it is preferable that several tens of image pickup devices 41 are installed. It should be noted that the plurality of image pickup devices 41 and their arrangement in FIG. 1 are merely conceptually expressed and do not represent an actual mode.

Each image pickup device 41 has a solid-state image pickup element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor. The plurality of image pickup devices 41 are installed at different positions so as to surround the subject T1 and image the subject T1 from different angles. As a result, the scanner 4 scans the whole body of the subject T1 by acquiring a plurality of still images of the subject T1 captured from various angles. The plurality of still images acquired by the scanner 4 are transmitted to the avatar generation system 100 via the network N1.

The information terminal 5 is, for example, a smartphone. Further, the information terminal 5 may include a desktop personal computer (including a display), a laptop personal computer, a tablet terminal, or the like. That is, the information terminal 5 is a device for communicating with a server to perform information processing and information display, and may be a device including a processor, a memory, a transmitter, a receiver, and a display. In addition, the information terminal 5 may include a head-mounted display. The user of the information terminal 5 is basically the target person T1.

The information terminal 5 receives the input from the user and executes the application pre-installed in the information terminal 5. Alternatively, the information terminal 5 receives an input from the user and acquires the execution result of the application on the web server via the browser installed in the information terminal 5 in advance. In either case, the virtual space V1 based on the execution result of the application is displayed on the display unit 51 of the information terminal 5.

Here, the avatar A1 based on the avatar data provided by the avatar generation system 100 or the modified avatar A1 is superimposed and displayed in the virtual space V1. Further, when the data for the avatar includes the data of the accessory B1, the accessory B1 or the modified accessory B1 is superimposed on the virtual space V1 in addition to the avatar A1 (or the modified avatar A1). Is displayed. Further, when the motion data is included in the avatar data, the avatar A1 (or the modified avatar A1) that moves according to the motion data is drawn in the virtual space V1.

As shown in FIG. 1, the avatar generation system 100 includes a processing unit 1, a communication unit 2, and a storage unit 3.

The processing unit 1 is configured to control the entire avatar generation system 100. The processing unit 1 can be realized by, for example, a computer system including one or more processors (microprocessors) and one or more memories. That is, one or more processors execute one or more programs (applications) stored in one or more memories, thereby functioning as the processing unit 1. Although the program is recorded in advance in the memory of the processing unit 1 here, it may be recorded and provided through a telecommunication line such as the Internet or on a non-temporary recording medium such as a memory card.

The processing unit 1 has a generation unit 11, a modification unit 12, a presentation unit 13, and a reception unit 14. In FIG. 1, none of these functional units shows a substantive configuration, but shows the functions realized by the processing unit 1.

The generation unit 11 generates avatar data for displaying the avatar A1 in the virtual space V1 for each target person T1 as the generation step ST1. In the present embodiment, the generation unit 11 generates avatar data based on a plurality of still images of the whole body of the subject T1 acquired from the scanner 4. In the example shown in FIG. 1, since the subject T1 wears the clothes T11, the generation unit 11 generates avatar data including the avatar A1 of the subject T1 wearing the clothes T11.

Hereinafter, an example of a method of generating the avatar A1 of the target person T1 by the generation unit 11 will be described. First, the generation unit 11 generates a three-dimensional model of the subject T1 based on a plurality of still images acquired from the scanner 4. Specifically, the generation unit 11 calculates the coordinates of the target points in the basic space, which is a three-dimensional space, for each of all the target points of all the still images. Here, the generation unit 11 acquires the image pickup result of each image pickup apparatus 41 to acquire the distance from the image pickup apparatus 41 to the target point when projected onto the basic space. Further, the generation unit 11 acquires the position information of each image pickup device 41 to acquire the distance between the adjacent image pickup devices 41 when projected onto the basic space. The generation unit 11 calculates the coordinates of the target point in the basic space based on these distances by the principle of triangulation. Then, the generation unit 11 generates a three-dimensional model of the target person T1 based on the coordinates of all the target points in the basic space.

Next, the generation unit 11 generates a texture to be attached to the three-dimensional model based on a plurality of still images acquired from the scanner 4. Here, the texture includes a texture corresponding to the skin of the subject T1 and a texture corresponding to the clothes T11 worn by the subject T1. Then, the generation unit 11 pastes the generated texture on the three-dimensional model.

Next, the generation unit 11 executes rigging on the three-dimensional model. In rigging, the generation unit 11 executes skeleton setting, IK (Inverse Kinematics) and / or FK (Forward Kinematics) setting, skinning including weight adjustment, and the like on the three-dimensional model. As a result, the avatar A1 of the subject T1 who can take various movements is generated.

As described above, in the present embodiment, the generation unit 11 can automatically generate the avatar A1 of the subject T1 based on a plurality of still images obtained by capturing the whole body of the subject T1 with the scanner 4. be. Further, when the motion data is included in the avatar data, or when the motion data is applied to the avatar A1 in the application, it is possible to make the avatar A1 move according to the motion data in the virtual space V1. Is.

Here, the motion data may be acquired as unique data for each target person T1 by performing motion capture for each target person T1, but may be general-purpose motion data. In this case, by applying general-purpose motion data, it is possible to basically make the same kind of movement for all avatars A1.

The modification unit 12 modifies at least one of the avatar A1 and the accessory B1 generated by the generation unit 11 mainly in response to a request from the application as the modification step ST2. In the present embodiment, the modification unit 12 may modify not only the avatar A1 but also both the avatar A1 and the accessory B1. Further, the modification unit 12 may modify not only one location in the avatar A1 but also a plurality of locations. That is, the process in the modification unit 12 (modification step ST2) may include a process of modifying a plurality of parts of the avatar data.

The following is a list of various processes that can be executed by the modification unit 12. The modification unit 12 may be in a mode in which at least one of the various processes listed below can be executed, and may not be in a mode in which all the processes can be executed.

The process in the modification unit 12 (modification step ST2) may include a process of abstracting a part or all of the avatar A1 (hereinafter, also referred to as “abstraction process”). The "abstraction of an avatar" as used in the present disclosure means to replace a part or all of the avatar A1 with an abstract expression based on the avatar A1 generated by the generation unit 11. The abstraction process may include, for example, a mosaic process or a blur process. Further, the abstraction process may include a process of deforming the avatar A1 and / or the accessory B1. The "deformation" as used in the present disclosure may include modifying a part or all of the avatar A1 and / or the accessory B1 so as to be consistent with the virtual space V1 provided by the application. Further, the "deformation" referred to in the present disclosure may include deforming a part or all of the avatar A1 and / or the accessory B1 to the extent that the person who sees the avatar A1 cannot recognize the target person T1.

Here, a specific example of the abstraction process for the avatar A1 will be described with reference to FIGS. 3 to 5. FIG. 3 shows the avatar A1 of the subject T1 that has not been modified by the modification unit 12, that is, the avatar A1 generated by the generation unit 11. Anyone who knows the target person T1 can understand that the avatar A1 represents the target person T1 by looking at the avatar A1.

FIG. 4 shows the modified avatar A11 in which a part of the avatar A1 of the target person T1 is subjected to an abstraction process. The modified avatar A11 is subjected to an abstraction process that deforms the region A100 corresponding to the head of the subject T1. As a result, the characteristics of each part (hair, eyes, nose, mouth, skin, etc.) included in the head of the subject T1 are not drawn on the modified avatar A11, so that the person who sees the modified avatar A11. However, it becomes difficult to grasp that the modified avatar A11 represents the target person T1.

In one example, in order to perform this abstraction process, the texture data (image data) of the target person T1 included in the avatar data can be used. For example, the modification unit 12 can recognize the face in the texture data and modify the recognized face. Here, an existing face recognition algorithm can be used for face recognition. The modified portion 12 can abstract the face by changing the size and shape of the recognized facial parts (hair, eyes, nose, mouth, skin, etc. as described above). Further, the modification unit 12 may abstract the face by modifying the resolution of the texture data of the recognized face portion. As an example, the modification unit 12 may abstract the face of the avatar by lowering the resolution of the texture data of the face portion. The modified avatar A11 can be generated by pasting the abstracted face texture on the three-dimensional model of the target person T1 included in the avatar data. As a result, abstraction processing can be performed without changing the shape of the three-dimensional model. Further, the abstraction process may be performed not only by modifying the texture data but also by modifying the shape of the three-dimensional model.

FIG. 5 shows the modified avatar A12 in which a part of the modified avatar A11 of the subject T1 is further abstracted. The modified avatar A12 is subjected to an abstraction process that deforms the region A101 corresponding to the clothes of the subject T1. As a result, the characteristics of the clothes T11 of the subject T1 are not drawn on the modified avatar A12, so that the person who sees the modified avatar A12 further indicates that the modified avatar A12 represents the subject T1. It becomes difficult to grasp. In this way, the degree of abstraction of only a part of the avatar A1 (for example, the head) may be increased, or the degree of abstraction of the entire avatar A1 may be increased. By abstracting only the head, the privacy of the subject T1 can be effectively protected by a relatively simple process.

Further, the process in the modification unit 12 (modification step ST2) may include a process of modifying the avatar A1 according to the person who discloses the avatar A1. For example, when the user of the information terminal 5 is the target person T1, the person who sees the avatar A1 of the target person T1 displayed on the display unit 51 of the information terminal 5 (that is, the person who discloses the avatar A1) is the target person T1. The person himself. On the other hand, when the user of the information terminal 5 is a person other than the target person T1, the person who sees the avatar A1 of the target person T1 displayed on the display unit 51 of the information terminal 5 (that is, the person who discloses the avatar A1) , Others.

Here, as already described, since the avatar A1 generated by the generation unit 11 is represented by a photorealistic three-dimensional model, information that can identify the target person T1, that is, personal information of the target person T1. Can correspond to. Therefore, depending on the target person T1, there may be a case where the avatar A1 (that is, personal information) is not desired to be disclosed to others. Therefore, by modifying the avatar A1 according to the person who discloses the avatar A1, for example, the modified avatar A1 abstracted to the extent that it cannot be identified as the target person T1 is disclosed to others. .. This makes it difficult for others to know that the modified avatar A1 is the target person T1.

In particular, in the present embodiment, the process in the modification unit 12 (modification step ST2) may include a process of modifying the avatar A1 according to the relationship between the partner who discloses the avatar A1 and the target person T1. The relationship referred to here may include at least whether or not the person who discloses the avatar A1 is the target person T1. For example, when the person who sees the avatar A1 of the target person T1 (the person who discloses the avatar A1) is the target person T1, the modification unit 12 does not modify the avatar A1 or is consistent with the virtual space V1. Modify avatar A1 up to. Further, for example, even when the person who sees the avatar A1 of the target person T1 (the person who discloses the avatar A1) is a relative or a friend of the target person T1, the modification unit 12 does not modify the avatar A1 or the virtual space V1. Modify avatar A1 to the extent that it is consistent with.

On the other hand, when the person who sees the avatar A1 of the target person T1 (the person who discloses the avatar A1) is a friend or acquaintance who is not so close to the target person T1, it is difficult for the modification unit 12 to grasp that the target person T1. Avatar A1 is abstracted to a certain extent. Further, when the person who sees the avatar A1 of the target person T1 (the person who discloses the avatar A1) is a third party who has nothing to do with the target person T1, the modification unit 12 cannot grasp that it is the target person T1. Avatar A1 is abstracted up to. The abstraction process here may include a process of not displaying the avatar A1 of the target person T1 on the display unit 51 of the information terminal 5 of another person. As described above, in the present embodiment, in the process (modification step ST2) in the modification unit 12, the lower the intimacy between the person who discloses the avatar A1 and the target person T1 (here, the user himself / herself), the lower the intimacy of the avatar A1. It may include processing that increases the degree of abstraction.

Further, the process in the modification unit 12 (modification step ST2) may include a process of modifying the avatar A1 according to the time change of the subject T1. The "time change of the subject" referred to in the present disclosure means a change in the appearance of the subject T1 with the passage of time from the time when the avatar A1 is generated by the generation unit 11 to a predetermined time. For example, when the application requests the avatar A1 20 years after the subject T1, the modification unit 12 estimates the 3D model of the subject T1 20 years later by an appropriate algorithm, and the avatar is based on the estimation result. Modify A1. In this case, the modified avatar A1 reflects the change in the appearance of the subject T1 with the passage of 20 years.

In particular, in the present embodiment, the time change of the subject T1 may include a change based on the behavioral information regarding the behavior of the subject T1. That is, the time change of the subject T1 is not only the change in the appearance of the subject T1 with the passage of time when the subject T1 does not take any action, but also the time when the subject T1 takes some action. It may include changes in the appearance of subject T1 over time. As an example, when the application requests an avatar A1 one year after the subject T1 who runs for 30 minutes every day, the modification unit 12 uses an appropriate algorithm to obtain a three-dimensional model of the subject T1 one year later. presume. Further, the modification unit 12 estimates the influence of running (behavior of the subject T1) on the appearance of the subject T1 by an appropriate algorithm. Then, the modification unit 12 modifies the avatar A1 based on these estimation results. In this case, the modified avatar A1 reflects the change in the appearance of the subject T1 with the passage of time for one year and the change in the appearance of the subject T1 due to running.

Further, the process in the modification unit 12 (modification step ST2) may include a process of modifying the motion of the avatar A1. For example, when the application requests that the garment T11 of the avatar A1 be changed to another garment as an accessory B1, the modification unit 12 changes the garment T11 in the avatar A1 to another garment so that the avatar A1 is changed to another garment. To modify. Then, the modification unit 12 modifies the motion of the modified avatar A1 according to the attributes of other clothes.

As an example, it is assumed that the motion of the avatar A1 takes an upright posture, and the other clothes are more elegant than the clothes T11. In this case, the modification unit 12 modifies the motion of the modified avatar A1 from taking an upright posture to taking an elegant gesture. Further, as an example, it is assumed that the motion of the avatar A1 is walking and the other clothes are heavier than the clothes T11. In this case, the modification unit 12 modifies the motion of the modified avatar A1 from a motion of walking relatively lightly to a motion of walking relatively slowly.

Further, the process in the modification unit 12 (modification step ST2) may include a process of modifying the avatar A1 according to the physical characteristics of the subject T1. For example, the modification unit 12 does not perform modification processing on the avatar A1 so as not to retain the prototype of the avatar A1, but a part or all of the avatar A1 has physical characteristics of the subject T1, that is, the subject T1. Modification processing is performed to the extent that the expression of the unique part remains.

Further, the process in the modification unit 12 (modification step ST2) may include a process of modifying the accessory B1. For example, as described above, when the application requests that the garment T11 of the avatar A1 be changed to another garment as an accessory B1, the modification unit 12 changes the garment T11 in the avatar A1 to another garment. As such, the avatar A1 is modified. As described above, the process of modifying the accessory B1 may include the process of imparting the accessory B1 to the avatar A1. Further, the process of modifying the accessory B1 may include a process of abstracting the accessory B1 to the extent that it cannot be specified, or a process of deforming the accessory B1 so as to be consistent with the virtual space V1.

Further, the process in the modification unit 12 (modification step ST2) may include a process of modifying the avatar A1 according to the accessory B1. For example, it is assumed that the application requests that the garment T11 of the avatar A1 be changed to another garment as ancillary B1 and that the size of the other garment is smaller or larger than the garment T11. In this case, the modification unit 12 modifies the size of the avatar A1 so as to be consistent with the size of other clothes. Further, in this case, the modification unit 12 may modify the motion of the avatar A1 so as to express the emotion of the subject T1 toward not being able to wear other clothes without modifying the size of the avatar A1.

The presentation unit 13 presents that the process in the modification unit 12 (modification step ST2) has been executed. The presentation unit 13 is the execution subject of the presentation step ST3. For example, when the presentation unit 13 causes the display unit 51 of the information terminal 5 to display the modified avatar A1, a character string or an image indicating that the avatar A1 has been modified is transmitted to the information terminal 5 via the network N1. Send it. As a result, the character string or the image is displayed on the display unit 51 of the information terminal 5 together with the modified avatar A1. Further, for example, when the presentation unit 13 displays the modified avatar A1 on the display unit 51 of the information terminal 5, a voice message indicating that the avatar A1 has been modified is sent to the information terminal 5 via the network N1. Send it. As a result, the information terminal 5 displays the modified avatar A1 on the display unit 51 and outputs the voice message from the speaker.

The reception unit 14 receives input from the user regarding the process (modification step ST2) in the modification unit 12. The reception unit 14 is the execution body of the reception step ST4. For example, when the reception unit 14 causes the display unit 51 of the information terminal 5 to display the modified avatar A1 and / or the modified accessory B1, the user (here, the target person T1) sends the modified avatar A1 to the information terminal 5. Information about the operation input is received via the network N1. As an example, the operation input may include an input requesting change of at least a part of the parameters of the modified avatar A1. The parameters may include, by way of example, aspects of each part of the face of Avatar A1 (eg, nose height, etc.).

When the reception unit 14 receives the input from the user, the modification unit 12 further modifies the modified avatar A1 and / or the modified accessory B1 according to the input from the user. For example, when an input requesting that the modified avatar A1 is narrowed is received, the modified unit 12 further modifies the modified avatar A1 so as to narrow the modified avatar A1.

The communication unit 2 has a communication interface that can be connected to the network N1. The communication unit 2 is configured to be able to communicate with the scanner 4 via the network N1. Further, the communication unit 2 is configured to be able to communicate with the information terminal 5 via the network N1. The communication protocol of the communication interface can be selected from various well-known wireless communication standards such as Wi-Fi (registered trademark).

The communication unit 2 receives a plurality of still images transmitted from the scanner 4 via the network N1. Further, the communication unit 2 transmits the avatar data to the information terminal 5 via the network N1. Further, the communication unit 2 receives the request information regarding the request from the information terminal 5 (that is, the request from the application) via the network N1.

The storage unit 3 includes, for example, an electrically rewritable non-volatile memory such as EEPROM (Electrically Erasable Programmable Read-Only Memory), and a volatile memory such as RAM (Random Access Memory). The storage unit 3 stores the avatar data generated by the generation unit 11 for each target person T1. Further, the storage unit 3 stores the avatar data modified by the modification unit 12 for each target person T1 and the application.

(3) Operation Hereinafter, an example of the basic operation of the avatar generation system 100 of the present embodiment will be described with reference to FIG. First, the subject T1 goes to the facility where the scanner 4 is installed and uses the scanner 4. Then, the scanner 4 scans the whole body of the subject T1 by acquiring a plurality of still images of the subject T1 captured from various angles. Then, the scanner 4 transmits the acquired plurality of still images to the avatar generation system 100 via the network N1. As a result, the avatar generation system 100 acquires a plurality of still images of the subject T1 captured by the scanner 4 (S1).

Next, the generation unit 11 generates avatar data including the avatar A1 of the target person T1 based on a plurality of still images of the whole body of the target person T1 acquired from the scanner 4 (S2). Process S2 corresponds to generation step ST1. Then, the generation unit 11 associates the generated avatar data with the target person T1 and stores it in the storage unit 3 (S3).

After that, the avatar generation system 100 does not execute anything in particular until it receives the request information regarding the request from the information terminal 5 (that is, the request from the application) (S4: No). Of course, when the other subject T1 uses the scanner 4 in this period, the above processes S1 to S3 are repeated for the other subject T1.

When the user of the information terminal 5 (here, the target person T1) executes the application by operating the information terminal 5, the information terminal 5 transmits the request information to the avatar generation system 100 via the network N1. Upon receiving the request information (S4: Yes), the modification unit 12 reads the avatar data from the storage unit 3 and modifies the avatar data according to the request information (that is, the request from the application) (S5). Process S5 corresponds to modification step ST2. Then, the modification unit 12 transmits (outputs) the avatar data including the modified avatar A1 and / or the modified accessory B1 to the information terminal 5 via the network N1 (S6).

Further, the presentation unit 13 transmits information (character string, image, voice message, etc.) indicating that the avatar A1 has been modified to the information terminal 5 via the network N1. As a result, the presentation unit 13 presents to the user of the information terminal 5 that the avatar A1 has been modified (S7). Process S7 corresponds to presentation step ST3.

After that, when the user of the information terminal 5 operates the information terminal 5 to request further modification of the modified avatar A1 and / or the modified accessory B1, the information terminal 5 receives the modified avatar A1 and / or the modified accessory B1 via the network N1. Information regarding the operation input to the information terminal 5 is transmitted to the avatar generation system 100. Upon receiving the information regarding the operation input (S8: Yes), the modification unit 12 reads the modified avatar data from the storage unit 3, and the modified unit 12 reads the modified avatar data according to the information regarding the operation input (that is, the input from the user). The avatar data is further modified (S9). The process S8 corresponds to the reception step ST4. Further, the process S9 corresponds to the modification step ST2. Then, the modification unit 12 transmits (outputs) the further modified avatar data to the information terminal 5 via the network N1 (S10).

(3.1) First Operation Example Hereinafter, a first operation example of the avatar generation system 100 of the present embodiment will be described. The first operation example is an example of the operation of the avatar generation system 100 at the time of executing an application in which a large number of users log in to the same server and share the same virtual space V1. Such an application may include, for example, an online game such as an MMO (Massively Multiplayer Online).

In the application in the first operation example, the user (target person T1) first creates an account. Further, the user requests the avatar A1 generated in advance by the avatar generation system 100 from the avatar generation system 100 through the application, and associates the avatar A1 with the account.

In addition, the user registers another person who uses the application as a friend at the stage of creating an account or while the application is running. The friend may be, for example, a friend already registered in SNS (Social Networking Service). In this case, the user may associate the SNS account with the account of this application.

Friends are registered in n stages (“n” is a natural number) according to the intimacy with the user. In the following, it is assumed that a friend who has a relatively high intimacy with a user is a "first friend" and a friend who has a relatively low intimacy with a user is a "second friend". The first friend is, for example, a relative or a close friend of the user. The second friend is, for example, an acquaintance of the user.

When using the application, the user operates the information terminal 5 to start the application and logs in with his / her own account. Then, the application displays the virtual space V1 on the display unit 51 of the information terminal 5, and superimposes and displays the avatars A1 of one or more users existing in the range of the display unit 51 on the virtual space V1. At this time, the application requests the avatar generation system 100 for the avatar data of one or more users to be displayed in the virtual space V1.

The modification unit 12 of the avatar generation system 100 modifies the avatar data of one or more users according to the world view of the virtual space V1 in response to the request from the application. In this way, by modifying the avatar data according to the world view of the virtual space V1, the user's immersive feeling is impaired as compared with the case where the photorealistic avatar A1 is superimposed and displayed on the virtual space V1. Hateful.

Further, the modification unit 12 modifies the avatar data of one or more users according to the relationship with the user (user himself / herself) of the requesting information terminal 5. Then, the avatar generation system 100 transmits the modified avatar data of one or more users to the information terminal 5. As a result, the modified avatar A1 of one or more users is displayed on the display unit 51 of the information terminal 5.

FIG. 6 shows an example of the display of the virtual space V1 and the avatar A1 of one or more users. In the example shown in FIG. 6, a closed space such as a room is displayed as a virtual space V1 on the display unit 51. Further, in the example shown in FIG. 6, the user's own avatar A10, the first friend's avatar A20, and the second friend's avatar A30 are displayed.

The user's own avatar A10 is displayed on the display unit 51 in a form modified according to the world view of the virtual space V1. Like the user's own avatar A10, the first friend's avatar A20 is displayed on the display unit 51 in a form modified according to the world view of the virtual space V1. The avatar A30 of the second friend is more abstract than the avatar A10 of the user himself and the avatar A20 of the first friend and is displayed on the display unit 51. However, the avatar A30 of the second friend may be abstracted and displayed on the display unit 51 according to the degree of abstraction set by the first friend.

The avatar A40 represented by the dotted line in FIG. 6 is a third party avatar A40 unrelated to the user, and is not actually displayed on the display unit 51. Of course, the third party avatar A40 may also be displayed on the display unit 51. In this case, the third party avatar A40 may be abstracted according to the degree of abstraction set by the third party, or may be further abstracted than the second friend avatar A30. As an example, the third party avatar A40 may be displayed on the display unit 51 as a silhouette.

Further, in FIG. 6, the first friend's avatar A20 is modified in the same manner as the user's own avatar A10, but may be more abstract than the user's own avatar A10. Further, the avatar A30 of the second friend may be further abstracted than the display mode shown in FIG.

Further, on the display unit 51 of the information terminal 5 of another person, the avatar A1 of the user himself / herself is displayed in a modified form according to the relationship between the other person and the user himself / herself. For example, on the display unit 51 of the information terminal 5 of a third party, the avatar A1 of the user himself / herself is not displayed in the same manner as the example shown in FIG. 6, or is abstracted to the extent that the user himself / herself cannot be identified. It is displayed in.

As described above, in the first operation example, the avatar A1 modified according to the relationship between each user is superimposed and displayed on the virtual space V1. Therefore, in the first operation example, there is an advantage that each user can use the application in a privacy-protected form. The relationship between each user may be determined in consideration of the degree of relevance determined by other factors in addition to the above-mentioned intimacy. For this degree of relevance, for example, the identity or closeness of information such as age, gender, place of origin, position on GPS (Global Positioning System), nationality, preference, or affiliation between users is used. Can be decided.

(3.2) Second Operation Example Hereinafter, a second operation example of the avatar generation system 100 of the present embodiment will be described. The second operation example is an example of the operation of the avatar generation system 100 at the time of executing an application in which the user's avatar A1 is tried on clothes as an accessory B1 in the virtual space V1.

In the second operation example, a large amount of clothing data (that is, data of the accessory B1) that can be tried on by the avatar A1 is accumulated in the dedicated server of the company that operates the application. Attribute information representing the clothing category is associated with each clothing data.

Similar to the first operation example, in the application in the second operation example, the user (target person T1) first creates an account. Further, the user requests the avatar A1 generated in advance by the avatar generation system 100 from the avatar generation system 100 through the application, and associates the avatar A1 with the account. In addition, the user registers another person who uses the application as a friend at the stage of creating an account or while the application is running. The friend may be, for example, a friend already registered on the SNS.

When using the application, the user operates the information terminal 5 to start the application and logs in with his / her own account. Then, the application displays the virtual space V1 on the display unit 51 of the information terminal 5, and superimposes and displays the user's avatar A1 on the virtual space V1. At this time, the application requests the avatar generation system 100 for the user's avatar data to be displayed in the virtual space V1.

The avatar generation system 100 transmits the avatar data of the user of the requesting information terminal 5 to the information terminal 5 in response to the request from the application. As a result, the user's avatar A1 is displayed on the display unit 51 of the information terminal 5. At this stage, the user's avatar A1 has not been modified by the modification unit 12.

Next, the user selects the clothes he / she wants to try on by operating the information terminal 5. The application requests the avatar generation system 100 for the avatar A1 of the user who has tried on the selected clothes.

The avatar generation system 100 requests the clothes data of the selected clothes from the dedicated server in response to the request from the application. Then, the modification unit 12 of the avatar generation system 100 modifies the user's avatar A1 based on the clothes data received from the dedicated server. For example, the modification unit 12 modifies the user's avatar A1 by pasting the texture of the clothing included in the clothing data on the user's avatar A1 (that is, adding the accessory B1). Further, the modification unit 12 modifies the user's avatar A1 by associating the motion data corresponding to the attribute information included in the clothing data with the user's avatar A1.

Then, the avatar generation system 100 transmits the modified user's avatar data to the information terminal 5. As a result, the user's modified avatar A1 is displayed on the display unit 51 of the information terminal 5. Specifically, the user's avatar A1 that tries on the clothes selected by the user and takes a motion according to the attributes of the clothes is superimposed on the virtual space V1 and displayed on the display unit 51.

FIGS. 7 and 8 show an example of displaying the avatar A1 of the user who tried on the clothes selected by the user. In the example shown in FIG. 7, a closed space such as a fitting room is displayed as a virtual space V1 on the display unit 51. Further, in the example shown in FIG. 7, the avatar A13 of the user who has tried on the sports clothing B11 (incidental B1) is displayed on the display unit 51. The user's avatar A13 is drawn on the display unit 51 so as to take a motion (here, a running motion) according to the attribute information of the sports clothing B11. In the example shown in FIG. 7, the user's avatar A13 is stationary, but is moving on the actual display unit 51.

In the example shown in FIG. 8, a closed space such as a fitting room is displayed as a virtual space V1 on the display unit 51. Further, in the example shown in FIG. 8, the avatar A14 of the user who has tried on the clothes B12 (incidental object B1) having a size smaller than the size suitable for the user is displayed on the display unit 51. Then, the user's avatar A14 is drawn on the display unit 51 so as to take a motion (here, a confused motion) according to the attribute information of the clothes B12 (here, the information that the size is small). In the example shown in FIG. 8, the user's avatar A14 is stationary, but is actually moving. Further, in the example shown in FIG. 8, the clothes B12 may be partially torn.

Here, if the user likes the selected clothes, the user can publish the avatar A1 of the user who tried on the clothes on SNS or the like. In this case, the user's avatar A1 is displayed on the display unit 51 of the information terminal 5 of the other person in a form corresponding to the relationship between the other person and the user. For example, if the other person is the user's best friend, the avatar A1 of the user who has tried on the clothes is displayed as it is on the display unit 51 of the other person's information terminal 5. Further, for example, if the other person is a third party, the user's avatar A1 is not displayed on the display unit 51 of the other person's information terminal 5, or is abstracted to the extent that the user cannot be identified. The user's avatar A1 is displayed with.

As described above, in the second operation example, the user can try on clothes online by using the avatar A1. Therefore, in the second operation example, the manufacturer who provides the clothes does not have to provide the clothes to the actual store, so that there is an advantage that the manufacturer does not have to hold the inventory. Further, in the second operation example, there is an advantage that the user can objectively view the user himself / herself by looking at the display unit 51 as compared with the case of trying on clothes in the fitting room of the actual store.

The virtual space V1 displayed on the display unit 51 may be appropriately changed by the user operating the information terminal 5. For example, by operating the information terminal 5 to select an urban area, the user can superimpose and display the user's own avatar A1 on the virtual space V1 simulating the urban area. In this case, the user has an advantage that it is easier to grasp whether or not the selected garment is suitable for a predetermined situation, as compared with the case where the garment is tried on in the fitting room.

Further, the avatar A1 in a state of not wearing clothes (that is, wearing only naked or underwear) is displayed on the display unit 51 in an appropriately abstracted form, or is not displayed on the display unit 51. Is preferable.

(3.3) Third Operation Example Hereinafter, a third operation example of the avatar generation system 100 of the present embodiment will be described. The third operation example is an example of the operation of the avatar generation system 100 at the time of executing an application for fitness or health care, for example.

In the third operation example, the dedicated server of the company that operates the application executes a simulation that estimates the change in the user's body shape when the predetermined exercise is continued and / or when the predetermined meal is continuously eaten. Here, since the effect of exercise and / or diet on the body shape varies from person to person depending on the constitution of the user, information on the constitution of the user is referred to in the simulation.

Similar to the first operation example, in the application in the third operation example, the user (target person T1) first creates an account. Further, the user requests the avatar A1 generated in advance by the avatar generation system 100 from the avatar generation system 100 through the application, and associates the avatar A1 with the account. In addition, the user registers another person who uses the application as a friend at the stage of creating an account or while the application is running. The friend may be, for example, a friend already registered on the SNS. In addition, the user also associates information about his / her constitution with the account.

Next, the user selects the exercise he / she wants to continue and / or the meal he / she wants to continue eating by operating the information terminal 5. The application requests the avatar generation system 100 for the user's avatar A1 corresponding to the selected exercise / and meal.

The avatar generation system 100 requests a simulation result corresponding to the selected exercise / and meal from the dedicated server in response to a request from the application. Then, the modification unit 12 of the avatar generation system 100 modifies the user's avatar A1 based on the simulation result received from the dedicated server. For example, the modification unit 12 modifies the user's avatar A1 so that the muscle corresponding to the selected exercise is enlarged, the whole body is thinned, or the corresponding portion is slimmed.

Then, the avatar generation system 100 transmits the modified user's avatar data to the information terminal 5. As a result, the user's modified avatar A1 is displayed on the display unit 51 of the information terminal 5. Specifically, the user's avatar A1 in which the muscle corresponding to the selected exercise is enlarged, the whole body is thinned, or the corresponding part is slimmed is superimposed on the virtual space V1 and displayed on the display unit 51. Will be done.

FIG. 9 shows an example of the display of the user's avatar A1 when the user's selected exercise is continuously executed. In the example shown in FIG. 9, a closed space such as a gym is displayed as a virtual space V1 on the display unit 51. Further, in the example shown in FIG. 9, the display unit 51 starts a predetermined exercise with the current user's avatar A1 and the user's avatar A15 taking a motion of a predetermined exercise (here, abdominal muscle exercise). The user's avatar A16 after a lapse of a certain period of time is displayed on the display unit 51. The current avatar A1 is the avatar A1 generated by the generation unit 11. The arrows between the avatars A1 in FIG. 9 indicate the passage of time. The user's avatar A15 located in the center of FIG. 9 wears exercise clothes B13 as an accessory B1. Further, the user's avatar A16 located on the right side of FIG. 9 wears sports-type underwear B14 as an accessory B1.

Here, if the user likes his / her future avatar A1, he / she can publish the future user's avatar A1 on SNS or the like. In this case, the user's avatar A1 is displayed on the display unit 51 of the information terminal 5 of the other person in a form corresponding to the relationship between the other person and the user. For example, if the other person is the user's best friend, the future user's avatar A1 is displayed as it is on the display unit 51 of the other person's information terminal 5. Further, for example, if the other person is a third party, the user's avatar A1 is not displayed on the display unit 51 of the other person's information terminal 5, or is abstracted to the extent that the user cannot be identified. The user's avatar A1 is displayed with.

As described above, in the third operation example, the avatar A1 that estimates the future user's body shape by exercise / and meal is superimposed and displayed on the virtual space V1. Therefore, in the third operation example, there is an advantage that the user can easily feel the effect of exercise / and meal. That is, for example, in fitness, the effect of training does not appear in a short period of time, and it is difficult for the user to experience it. On the other hand, in the third operation example, the user can easily realize the effect of the training by seeing the avatar A1. As a result, the third operation example has an advantage that it is easy to maintain the motivation for the user's training. In addition, even if training is not performed at this time, by presenting the avatar A1 that estimates the body shape of the future user to the user, it is easy to motivate the user to go to the gym or the like in order to approach the body shape. There is an advantage.

Note that the application may acquire exercise information regarding the exercise performed by the user from a wearable terminal such as an activity meter worn by the user. The exercise information may include, for example, the type of exercise, the execution time of the exercise, the exercise intensity, and the like. In this case, the avatar generation system 100 can modify the user's avatar A1 so as to reflect the simulation result on the dedicated server based on the motion information.

(4.1) Modifications The above embodiment is only one of the various embodiments of the present disclosure. The above-described embodiment can be variously modified depending on the design and the like as long as the object of the present disclosure can be achieved. Further, the same function as the avatar generation method (avatar generation system 100) may be embodied in a (computer) program, a non-temporary recording medium on which the program is recorded, or the like. The program according to one aspect of the present disclosure causes one or more processors to execute the above-mentioned avatar generation method.

Hereinafter, modified examples of the above-described embodiment are listed. The modifications described below can be applied in combination as appropriate.

In the avatar generation system 100 in the present disclosure, for example, the processing unit 1 and the like include a computer system. The computer system mainly consists of a processor and a memory as hardware. When the processor executes the program recorded in the memory of the computer system, the function as the avatar generation system 100 in the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, may be provided through a telecommunications line, and may be recorded on a non-temporary recording medium such as a memory card, optical disk, hard disk drive, etc. that can be read by the computer system. May be provided. The processor of a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The integrated circuit such as IC or LSI referred to here has a different name depending on the degree of integration, and includes an integrated circuit called a system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Further, an FPGA (Field-Programmable Gate Array) programmed after the LSI is manufactured, or a logical device capable of reconstructing the junction relationship inside the LSI or reconfiguring the circuit partition inside the LSI should also be adopted as a processor. Can be done. A plurality of electronic circuits may be integrated on one chip, or may be distributed on a plurality of chips. A plurality of chips may be integrated in one device, or may be distributed in a plurality of devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microprocessor is also composed of one or a plurality of electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

Further, it is not an essential configuration for the avatar generation system 100 that a plurality of functions in the avatar generation system 100 are integrated in one housing. The components of the avatar generation system 100 may be distributed in a plurality of housings. Further, at least a part of the functions of the avatar generation system 100 may be realized by, for example, a server and a cloud (cloud computing).

In the above-described embodiment, it is not an essential configuration that the scanner 4 is configured by using a plurality of image pickup devices 41. For example, the scanner 4 may be composed of one image pickup device 41, and one image pickup device 41 may be moved to acquire a plurality of images. That is, in the present disclosure, a plurality of images for generating the avatar A1 may be obtained by photographing the subject T1 from a plurality of different angles, and the number of image pickup devices 41 is not limited to a plurality of units. Further, the scanner 4 may be configured by using a distance sensor. Further, the scanner 4 may be configured by combining a distance sensor and an image pickup device. Examples of the distance sensor include a lidar sensor. Specifically, a ToF type LIDAR sensor may be used. By using the distance sensor, a more realistic avatar can be generated.

In the above-described embodiment, the modified unit 12 is included in the processing unit 1, but the present invention is not limited to this embodiment. For example, the modification unit 12 may be included in the information terminal 5, or may be included in both the processing unit 1 and the information terminal 5. In the latter case, the processing of the modification unit 12 may be shared between the processing unit 1 and the information terminal 5. Further, the modification unit 12 may be included in the dedicated server of the company that operates the application, or may be included in both the processing unit 1 and the dedicated server. In the latter case, the processing of the modification unit 12 may be shared between the processing unit 1 and the dedicated server.

In the above-described embodiment, the modification unit 12 may be modified to the avatar A1 in a state of wearing clothes, for example, when the avatar A1 generated by the generation unit 11 is in underwear. On the contrary, the modification unit 12 may modify the avatar A1 generated by the generation unit 11 into a naked avatar A1 when the avatar A1 is in a state of wearing clothes. In the latter case, the modification unit 12 can modify the avatar A1 by using a trained model machine-learned by, for example, deep learning. That is, the modification unit 12 estimates the body shape hidden by the clothes by using the trained model, and modifies the avatar A1 so as to reflect the estimated body shape.

In the above-described embodiment, the application installed in the information terminal 5 may have contents such as a moving image, a still image, or an audio in advance. Further, the application may acquire contents such as moving images, still images, and sounds from the outside via a network. Further, the application may display the avatar A1 generated by the avatar generation system 100 on the display unit 51 in combination with the above content.

In each of the above-mentioned first operation example to third operation example, the user does not have to log in with his / her own account when executing the application. In this case, the display unit 51 of the information terminal 5 may display a general-purpose avatar prepared by the avatar generation system 100 or the dedicated server of the application superimposed on the virtual space V1 as the user's avatar A1.

In the above-mentioned second operation example, for example, when the clothes selected by the user are smaller than the size suitable for the user, the user's avatar A1 is displayed as a silhouette, and the user's avatar A1 is displayed superimposed on the virtual space V1 in an abstract form. You may let me. Further, the size of the user's avatar A1 may be changed to match the size of the selected clothes. In the latter case, the presentation unit 13 may present that the current user's body shape cannot wear the selected clothing.

In the above-described embodiment, the presentation unit 13 not only presents that the processing in the modification unit 12 (modification step ST2) has been executed, but also presents the comparison results before and after the processing in the modification unit 12. You may.

(4.2) Other Modifications As described in the above modification, the modification of the avatar may be performed on the information terminal 5. In this modification, an example in which the avatar is modified and displayed on the information terminal 5 will be described with reference to FIG. Although the example in which the user who uses the information terminal 5 is a person different from the target person T1 is described here, the user and the target person T1 may be the same person.

The user uses the information terminal 5 to execute an application for displaying the avatar of the target person T1. This application may be executed on the information terminal 5 or may be executed on a server (not shown) according to the instruction of the information terminal 5. Next, the user logs in to the user's account in this application using the information terminal 5. To log in to the account, password authentication, fingerprint authentication, face authentication, etc. can be used. Here, the application is, for example, an online game or an SNS installed in the information terminal 5.

In order to display the avatar of the target person T1 in this application, the information terminal 5 acquires the avatar data of the target person T1 from the avatar generation system 100 (an example of the first server). Specifically, the information terminal 5 sends an instruction to the avatar generation system 100, and in response, the communication unit 2 of the avatar generation system 100 stores the data for the avatar of the target person T1 stored in the storage unit 3 in the information terminal. Send to 5.

Further, the information terminal 5 communicates with an application server (an example of a second server, not shown) that stores data necessary for the operation of the application, and the user and the target person T1 stored in the application server. Get information that shows the intimacy with. The information indicating this intimacy is information indicating that the user is a relative, a close friend, or an acquaintance of the user in an online game or SNS, as described in the first operation example.

The information terminal 5 modifies the avatar of the target person T1 according to the information indicating the intimacy. The modification method is as described above, and the lower the intimacy, the greater the degree of abstraction of the avatar. The modified avatar is displayed on the display unit 51 of the information terminal 5.

By the above processing, the avatar of the target person T1 can be modified according to the intimacy between the user of the information terminal 5 and the target person T1. As a result, the privacy of the target person T1 can be automatically protected from the user of the information terminal 5. In the above description, the avatar generation system 100 may be a server different from the application server that stores information indicating intimacy, or may be the same server.

(summary)
As described above, the avatar generation method according to the first aspect includes a generation step (ST1) and a modification step (ST2). The generation step (ST1) is a step of generating avatar data for displaying at least the avatar (A1) reflecting the physical information of the target person (T1) in the virtual space (V1). The modification step (ST2) is performed on the avatar (A1) for at least one of the avatar (A1) and the accessory (B1) displayed in the virtual space (V1) among the avatar data generated in the generation step (ST1). It is a step of modifying according to at least one of the display mode of the above and the attribute of the accessory (B1).

According to this aspect, there is an advantage that it is easy to generate avatar data suitable for the application.

In the avatar generation method according to the second aspect, in the first aspect, the modification step (ST2) includes a process of abstracting a part or all of the avatar (A1).

According to this aspect, there is an advantage that the avatar (A1) modified to the extent that the target person (T1) cannot be identified can be displayed in the virtual space (V1).

In the avatar generation method according to the third aspect, in the first or second aspect, the modification step (ST2) includes a process of modifying the avatar (A1) according to the person who discloses the avatar (A1).

According to this aspect, there is an advantage that it is not necessary to give information about the target person (T1) more than necessary to the person who discloses the avatar (A1).

In the avatar generation method according to the fourth aspect, in the third aspect, the modification step (ST2) obtains the avatar (A1) according to the relationship between the person who discloses the avatar (A1) and the target person (T1). Includes processing to modify.

According to this aspect, the method of giving information about the target person (T1) can be changed between a person who is relatively close to the target person (T1) and a person who has a relatively weak relationship with the target person (T1). There is an advantage.

In the avatar generation method according to the fifth aspect, in the fourth aspect, in the modification step (ST2), the lower the intimacy between the person who discloses the avatar (A1) and the target person (T1), the lower the intimacy of the avatar (A1). Includes processing to increase the degree of abstraction of.

According to this aspect, there is an advantage that the privacy of the target person (T1) can be easily protected.

In the avatar generation method according to the sixth aspect, in the fourth or fifth aspect, the relationship includes at least whether or not the person who discloses the avatar (A1) is the target person (T1).

According to this aspect, there is an advantage that the method of giving information about the target person (T1) can be changed depending on whether or not the person who discloses the avatar (A1) is the target person (T1).

In the avatar generation method according to the seventh aspect, in any one of the first to sixth aspects, the modification step (ST2) is a process of modifying the avatar (A1) according to the time change of the target person (T1). include.

According to this aspect, for example, when the physical information of the subject (T1) changes with the passage of time, there is an advantage that the change in the physical information can be reflected in the avatar (A1).

In the avatar generation method according to the eighth aspect, in the seventh aspect, the time change of the target person (T1) is a change based on the behavior information regarding the behavior of the target person (T1).

According to this aspect, for example, when the physical information of the subject (T1) changes with the behavior of the subject (T1), the change of the physical information can be reflected in the avatar (A1). There is.

In the avatar generation method according to the ninth aspect, in any one of the first to eighth aspects, the modification step (ST2) includes a process of modifying the motion of the avatar (A1).

According to this aspect, there is an advantage that it is easy for the avatar (A1) to take a movement suitable for the application.

In the avatar generation method according to the tenth aspect, in any one of the first to ninth aspects, the modification step (ST2) is a process of modifying the avatar (A1) according to the physical characteristics of the subject (T1). including.

According to this aspect, there is an advantage that it is easy to generate data for an avatar suitable for an application while retaining the physical characteristics of the target person (T1).

In the avatar generation method according to the eleventh aspect, in any one of the first to tenth aspects, the modification step (ST2) includes a process of modifying the accessory (B1).

According to this aspect, there is an advantage that it is easy to generate an accessory (B1) suitable for the application.

In the avatar generation method according to the twelfth aspect, in any one of the first to eleventh aspects, the modification step (ST2) includes a process of modifying the avatar (A1) according to the accessory (B1).

According to this aspect, there is an advantage that it is easy to generate data for an avatar suitable for an accessory (B1).

The avatar generation method according to the thirteenth aspect further includes a presentation step (ST3) indicating that the modification step (ST2) has been executed in any one of the first to twelfth aspects.

According to this aspect, there is an advantage that the viewer of the avatar (A1) can grasp that the avatar (A1) has been modified.

The avatar generation method according to the fourteenth aspect further includes a reception step (ST4) for receiving input from the user regarding the modification step (ST2) in any one of the first to thirteenth aspects.

According to this aspect, there is an advantage that the user's request can be easily reflected in the modification of the avatar (A1).

In the avatar generation method according to the fifteenth aspect, in any one of the first to the fourteenth aspects, the modification step (ST2) includes a process of modifying a plurality of parts of the avatar data.

According to this aspect, there is an advantage that the variety of modification of the avatar data is improved as compared with the case of modifying only one place of the avatar data.

The program according to the sixteenth aspect causes one or more processors to execute the avatar generation method of any one of the first to fifteenth aspects.

The avatar generation system (100) according to the seventeenth aspect includes a generation unit (11) and a modification unit (12). The generation unit (11) generates avatar data for displaying at least the avatar (A1) reflecting the physical information of the target person (T1) in the virtual space (V1). The modification unit (12) has the avatar (A1) for at least one of the avatar (A1) and the accessory (B1) displayed in the virtual space (V1) among the avatar data generated by the generation unit (11). Is modified according to at least one of the display mode of the above and the attribute of the accessory (B1).

The method according to the second to fifteenth aspects is not an essential method for the avatar generation method, and can be omitted as appropriate.

100 Avatar generation system 11 Generation part 12 Modification part A1 Avatar B1 Ancillary items ST1 Generation step ST2 Modification step ST3 Presentation step ST4 Reception step T1 Target person V1 Virtual space

Claims

At least the generation step to generate the avatar data to display the avatar that reflects the physical information of the target person in the virtual space,
Of the avatar data generated in the generation step, at least one of the avatar and the accessory displayed in the virtual space is modified according to at least one of the display mode of the avatar and the attribute of the accessory. Has a modification step,
How to generate an avatar.
The modification step includes a process of abstracting a part or all of the avatar.
The avatar generation method according to claim 1.
The modification step includes a process of modifying the avatar according to the person who discloses the avatar.
The avatar generation method according to claim 1 or 2.
The modification step includes a process of modifying the avatar according to the relationship between the person who discloses the avatar and the target person.
The avatar generation method according to claim 3.
The modification step includes a process of increasing the degree of abstraction of the avatar as the intimacy between the person disclosing the avatar and the target person is lower.
The avatar generation method according to claim 4.
The avatar data includes a three-dimensional model of the avatar and texture data of the three-dimensional model.
The modification step includes a process of modifying the texture data to increase the degree of abstraction of the avatar.
The avatar generation method according to claim 5.
The avatar data includes a three-dimensional model of the avatar and texture data of the three-dimensional model.
The modification step
The process of recognizing the face in the texture data and
A process of modifying the recognized face to increase the degree of abstraction of the face of the avatar, and the like.
The avatar generation method according to claim 5.
The relationship includes at least whether or not the person disclosing the avatar is the target person.
The avatar generation method according to any one of claims 4 to 7.
The modification step includes a process of modifying the avatar according to the time change of the subject.
The avatar generation method according to any one of claims 1 to 8.
The time change of the subject is a change based on the behavioral information regarding the behavior of the subject.
The avatar generation method according to claim 9.
The modification step includes a process of modifying the motion of the avatar.
The avatar generation method according to any one of claims 1 to 10.
The modification step comprises the process of modifying the avatar according to the physical characteristics of the subject.
The avatar generation method according to any one of claims 1 to 11.
The modification step comprises a process of modifying the accessory.
The avatar generation method according to any one of claims 1 to 12.
The modification step includes a process of modifying the avatar according to the attributes of the accessory.
The avatar generation method according to any one of claims 1 to 13.
Further comprising a presentation step indicating that the modification step has been performed.
The avatar generation method according to any one of claims 1 to 14.
Further having a reception step for accepting input from the user regarding the modification step.
The avatar generation method according to any one of claims 1 to 15.
The modification step includes a process of modifying a plurality of parts of the avatar data.
The avatar generation method according to any one of claims 1 to 16.
For one or more processors
The avatar generation method according to any one of claims 1 to 17 is executed.
program.
At least a generator that generates avatar data that displays the avatar that reflects the physical information of the target person in the virtual space,
Of the avatar data generated by the generation unit, at least one of the avatar and the accessory displayed in the virtual space is modified according to at least one of the display mode of the avatar and the attribute of the accessory. With a modified part,
Avatar generation system.
It is a method of displaying the target person's avatar using an information terminal.
The steps to run the application and
The steps to log in to the user's account in the application,
A step of acquiring avatar data including an avatar that reflects the physical information of the target person from the first server, and
A step of acquiring information indicating the intimacy of the user and the target person in the application from the second server, and
The step of modifying the avatar according to the information indicating the intimacy, and
The information terminal has a step of displaying the modified avatar.
Avatar display method.