JP2024030610A - Avatar control device, avatar control method, and avatar control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an avatar control device that can perform control so as to generate avatars corresponding to users while preventing drawing load or communication load from becoming excessive.

SOLUTION: An avatar control device 103 includes an avatar motion setting unit 4 and an avatar generation unit 7. The avatar generation unit 7 generates individual avatars by drawing avatars corresponding to individual users. The avatar motion setting unit 4 sets the motion of each avatar based on a motion detection signal generated by a motion sensor 21 that acquires the motion of each user. The avatar motion setting unit 4 sets an avatar whose motion is equal to or less than a predetermined magnitude to a stationary state, irrespective of the motion detection signal generated by the motion sensor 21.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2024,JPO&INPIT

Description

The present invention relates to an avatar control device, an avatar control method, and an avatar control program.

In recent years, as processor processing speeds have increased, it has become possible for each user to move an avatar generated for each user and to interact with each other in virtual reality (VR) space. (See Patent Document 1). Typically, an avatar corresponding to each user is generated by a server that controls the avatar and a user terminal owned by each user communicating with each other via a network.

Japanese Patent Application Publication No. 2009-172239

Although the processing speed of processors has become faster, the drawing load for drawing avatars corresponding to each user may become excessive, or the communication load between the server and the user terminal may become excessive. This causes the avatar to stop unexpectedly or not follow the user's movements, making the avatar's movements unnatural and making the user feel uncomfortable.

An object of the present invention is to provide an avatar control device, an avatar control method, and an avatar control program that can control the generation of an avatar corresponding to a user while preventing an excessive drawing load or communication load. shall be.

The present invention calculates the movement of each avatar based on a motion detection signal generated by an avatar generation unit that generates each avatar by drawing an avatar corresponding to each user, and a motion sensor that acquires the movement of each user. and an avatar movement setting unit for setting an avatar whose movement is less than or equal to a predetermined size, to a stationary state or a specific movement regardless of a movement detection signal generated by the movement sensor. avatar control device.

The present invention generates each avatar by drawing an avatar corresponding to each user, sets the movement of each avatar based on a motion detection signal generated by a motion sensor that acquires the movement of each user, and The present invention provides an avatar control method for setting an avatar whose size is less than or equal to a predetermined size to a stationary state or a specific movement regardless of a motion detection signal generated by the motion sensor.

The present invention includes the steps of generating each avatar by drawing an avatar corresponding to each user on a computer, and determining the movement of each avatar based on a motion detection signal generated by a motion sensor that acquires the movement of each user. and setting an avatar whose movement is less than a predetermined size to a stationary state or a specific movement regardless of a movement detection signal generated by the movement sensor. do.

According to the avatar control device, avatar control method, and avatar control program of the present invention, it is possible to perform control to generate an avatar corresponding to a user while preventing excessive drawing load or communication load.

FIG. 1 is a block diagram showing an avatar control device according to a first embodiment. FIG. 2 is a diagram showing an example of a user's movement. FIG. 3 is a diagram showing skeletal movements when the user moves as shown in FIG. FIG. 4 is a conceptual diagram showing a skeletal movement signal indicating skeletal movement when the user moves as shown in FIG. FIG. 5 is a diagram showing the movement of the avatar when the user moves as shown in FIG. FIG. 6 is a conceptual diagram showing changes in the skeletal motion signal when tracking loss occurs. FIG. 7A is a diagram showing a state in which only one other avatar is looking at one's own avatar. FIG. 7B is a diagram showing a state in which there are four other avatars looking at the user's own avatar. FIG. 8 is a flowchart showing the operation of the avatar control device according to the first embodiment, the avatar control method according to the first embodiment, and the processing that the avatar control program according to the first embodiment causes a computer to execute. FIG. 9 is a block diagram showing an avatar control device according to the second embodiment. FIG. 10 is a flowchart showing the operation of the avatar control device according to the second embodiment, the avatar control method according to the second embodiment, and the processing that the avatar control program according to the second embodiment causes a computer to execute. FIG. 11 is a flowchart showing the operation of the avatar control device according to the third embodiment, the avatar control method according to the third embodiment, and the processing that the avatar control program according to the third embodiment causes a computer to execute.

Hereinafter, an avatar control device, an avatar control method, and an avatar control program according to each embodiment will be described with reference to the accompanying drawings.

<First embodiment>
As shown in FIG. 1, an avatar control server 10a and user terminals 20a to 20c are connected via a network 50. A user terminal that does not specify any of the user terminals 20a to 20c and any other user terminal not shown will be referred to as a user terminal 20. The number of user terminals 20 connected to the avatar control server 10a via the network 50 is one or more. Typically, network 50 is the Internet.

The avatar control server 10a includes an avatar control device 101. The avatar control device 101 includes a communication unit 1, a movement detection unit 2, a tracking deviation detection unit 3, an avatar movement setting unit 4, a specific posture data storage unit 5, an avatar control signal generation unit 6, an avatar generation unit 7, a rendering unit 8, It includes a control section 9, an avatar position control section 11, and an avatar/background setting section 12. Each user terminal 20 includes a motion sensor 21 , a control section 22 , an operation section 23 , a communication section 24 , and an image display section 25 . The avatar generation section 7 includes a calculation section 71.

The communication unit 1 can be configured with a communication circuit that communicates with the user terminal 20 by employing a communication protocol such as the Internet protocol. The avatar control device 101 other than the communication unit 1 can be configured with a computer including a processor and a memory. The specific posture data holding section 5 and the avatar/background setting section 12 can be configured with a computer memory. Portions of the avatar control device 101 other than the communication section 1, specific posture data holding section 5, and avatar/background setting section 12 can be configured by a computer processor.

It is assumed that the user who owns the user terminal 20a is the user U1 shown in FIG. 2. The motion sensor 21 is a TOF (Time Of Flight) sensor or a camera. When the motion sensor 21 is a TOF sensor, the motion sensor 21 measures the time it takes from irradiating light or ultrasound to the user U1 until the light or ultrasound returns, and determines the posture of the user U1. A motion detection signal corresponding to the movement (including posture) of the user U1 is generated, indicating how the user U1 is moving.

The motion sensor 21 may be a sensor such as an acceleration sensor or a gyro sensor attached to multiple locations on the body of the user U1. The motion sensor 21 may be any sensor as long as it can detect the movement or posture of the user U1's body.

When the motion sensor 21 is a camera, the motion sensor 21 photographs the user U1 and generates a motion detection signal corresponding to the motion (including posture) of the user U1. When a camera is used as the motion sensor 21, the camera is a camera that photographs the user U1 two-dimensionally or a stereo camera that photographs the user U1 three-dimensionally. It is preferable to use a stereo camera as the motion sensor 21 because the user U1 can be photographed three-dimensionally. The motion detection signal output from the motion sensor 21 is transmitted to the avatar control server 10a via the control section 22, communication section 24, and network 50.

The communication section 1 receives the motion detection signal and supplies it to the motion detection section 2 . The motion detection unit 2 detects the positions of a plurality of joints and specific body parts of the user U1 based on the input motion detection signal, and determines the posture of the user U1. A skeletal motion signal indicating the skeletal motion of the user U1 is generated, indicating how the user U1 is moving. The skeletal motion signal is an example of a body motion signal indicating the motion of the user U1's body. As shown in FIG. 2, it is assumed that the user U1 transitions from a pose P1 in which he is standing with his hands down to a pose P2 in which he bends his right arm and pushes his left arm upward. As shown in FIG. 3, the motion detection unit 2 generates a skeletal motion signal including a skeletal posture Q1 corresponding to the pose P1 and a skeletal posture Q2 corresponding to the pose P2.

Although not shown in FIG. 3, the motion detection unit 2 generates a skeletal motion signal midway from pose P1 to pose P2. The skeletal motion signal that changes from the skeletal posture Q1 to the skeletal posture Q2 shown in FIG. 4 is supplied to the tracking loss detection section 3 and the avatar movement setting section 4.

The user terminal 20 may have a configuration corresponding to the motion detection section 2. In this case, the communication unit 24 of the user terminal 20 transmits each user's skeletal movement signal to the avatar control server 10a, and the communication unit 1 of the avatar control server 10a receives the skeletal movement signal. The received skeletal motion signal is supplied to an out-of-tracking detection section 3 and an avatar motion setting section 4.

When the skeletal motion signal is no longer input, the tracking loss detection unit 3 detects that tracking loss has occurred, which is a state in which the motion sensor 21 no longer generates a motion detection signal corresponding to the movement of the user U1. When detecting that tracking loss has occurred, tracking loss detection section 3 notifies avatar movement setting section 4 that tracking loss has occurred. The tracking loss detection unit 3 may also detect that tracking loss has occurred when the skeletal motion signal indicates an abnormal movement that cannot normally occur. For example, if a part of user U1's body comes off the TOF sensor or camera, the skeletal motion signal may indicate abnormal movement.

If the avatar movement setting unit 4 has not been notified that tracking loss has occurred, it instructs the avatar control signal generation unit 6 to cause the avatar to move in accordance with the skeletal movement signal. The avatar control signal generation section 6 generates an avatar control signal that controls the avatar Av to move in accordance with the skeletal motion signal, and supplies it to the avatar generation section 7 .

The calculation unit 71 of the avatar generation unit 7 generates an avatar by drawing an avatar that moves according to the skeletal motion signal. In the avatar/background setting section 12, the type of avatar to be generated by the avatar generation section 7 is set. It is assumed that the form of the avatar set in the avatar/background setting section 12 is a form imitating a human body as shown in FIG. The avatar/background setting section 12 also sets the correspondence between the parts of the human body and which parts of the avatar correspond.

Therefore, as shown in FIG. 5, the avatar generation unit 7 generates an avatar Av1 that changes from pose Pav1 to pose Pav2 in response to the change from skeletal posture Q1 to skeletal posture Q2 shown in FIG. . Any avatar including avatar Av1 will be referred to as avatar Av.

The configuration may be such that the user uploads the form of the avatar Av to the avatar/background setting section 12 using the user terminal 20. A plurality of forms of the avatar Av may be set in the avatar/background setting section 12, and the user may be configured to be able to select any of the forms.

The avatar/background setting section 12 is set with background data that determines a three-dimensional virtual space in which the avatar Av is located and moves. If the avatar Av is a two-dimensional image, the background data may be two-dimensional image data. The rendering unit 8 acquires background data from the avatar/background setting unit 12 and performs rendering to position the avatar Av in a virtual space based on the background data.

The user can operate the operation unit 23 in the user terminal 20 to move the avatar Av within the virtual space. The control unit 22 of the user terminal 20 generates a movement control signal for moving the avatar Av in accordance with the operation of the operation unit 23. The movement control signal is transmitted to the avatar control server 10a via the communication unit 24 and the network 50. The communication unit 1 of the avatar control server 10a receives the movement control signal, and the control unit 9 supplies the movement control signal to the avatar position control unit 11. The avatar position control unit 11 controls the rendering unit 8 to move the avatar Av in the virtual space according to the movement control signal.

As described above, the avatar control server 10a generates an avatar Av corresponding to the user of each user terminal 20, and generates a rendered image positioned in the virtual space. The communication unit 1 transmits the rendered image to each user terminal 20. The communication unit 24 receives the rendered image, and the control unit 22 controls the rendered image to be displayed on the image display unit 25. While viewing the rendered image displayed on the image display unit 25, the user can change his or her own posture to change the posture of the avatar Av, or move the avatar Av within the virtual space.

Here, the operation of the avatar control server 10a when the tracking loss detection unit 3 detects tracking loss will be explained. The specific posture data holding unit 5 holds specific posture data for making the avatar Av stand still or move in a specific manner. As an example, the specific posture data holding unit 5 holds posture data corresponding to the skeletal posture Q0 in the resting state shown in FIG. 6 as the specific posture data. Here, the skeletal posture Q0 in the resting state is the same skeletal posture as the skeletal posture Q1 shown in FIG. 4. The specific posture data that makes the avatar Av have a specific movement may be, for example, posture data of a skeletal posture in which a part of the skeletal posture Q0 changes periodically.

As shown in FIG. 6, it is assumed that tracking loss occurs at the time when the motion detection unit 2 generates a skeletal motion signal corresponding to the skeletal posture Q11. When the avatar movement setting unit 4 is notified of the occurrence of tracking loss from the tracking loss detection unit 3, the avatar movement setting unit 4 changes the avatar Av to the skeletal posture Q0 in a stationary state (or a specific The avatar control signal generation unit 6 is instructed to take a posture according to the skeletal posture of the movement of the avatar. At this time, the motion detection unit 2 does not immediately transition from the skeletal posture Q11 to the skeletal posture Q0, but moves the skeletal posture Q12 and the skeletal posture Q12, which is a skeletal posture between the skeletal posture Q11 and the skeletal posture Q0. It is preferable to change the posture to Q13 in order and shift to the skeletal posture Q0.

The avatar movement setting unit 4 may include a user terminal 20 that controls the skeletal posture Q0 in a stationary state, and a user terminal 20 that controls the skeletal posture of a specific movement. The avatar movement setting unit 4 selects whether to set the skeletal posture Q0 in a stationary state or the skeletal posture in a specific movement depending on whether the ID assigned to the user terminal 20 is an odd number or an even number. It's okay. The avatar movement setting unit 4 selects a skeletal posture of a specific movement when there are many other avatars Av looking at the own avatar Av, and selects a skeletal posture Q0 of a stationary state when there are few avatars Av. You may.

The avatar motion setting unit 4 may select a skeletal posture of a specific motion if the motion of the avatar Av immediately before the tracking loss occurs is large, and may select a skeletal posture Q0 of a stationary state if the motion of the avatar Av is small. The specific posture data holding unit 5 may hold specific posture data for a plurality of specific movements. The avatar movement setting unit 4 may select any skeletal posture of a specific movement from among the skeletal postures of a plurality of specific movements, depending on the movement of the avatar Av immediately before tracking loss occurs. . The user may select the skeletal posture Q0 in a resting state and the skeletal posture in a specific movement.

By the way, when the number of user terminals 20 connected to the avatar control server 10a via the network 50 increases excessively, the drawing load for the avatar generation unit 7 to draw the avatar Av corresponding to each user becomes excessive. Or, the communication load between the avatar control server 10a and the user terminal 20 may become excessive. Therefore, in the first embodiment, in order to reduce the drawing load and the communication load, the avatar control device 101 is configured as follows.

The control unit 9 acquires the number of user terminals 20 with which the communication unit 1 communicates. When the number of user terminals 20 connected to the avatar control server 10a exceeds a predetermined number, the control unit 9 transmits a motion detection signal (or skeletal motion signal) to at least some of the user terminals 20 to the avatar control server 10a. Sends an instruction signal not to send. The user terminal 20 that has acquired the instruction signal and has been instructed not to transmit the motion detection signal to the avatar control server 10a stops transmitting the motion detection signal to the avatar control server 10a. Therefore, the communication load between the avatar control server 10a and the user terminal 20 is reduced.

Further, the user terminal 20 that has stopped sending the motion detection signal to the avatar control server 10a enters the above-mentioned untracked state in the avatar control device 101. The avatar Av corresponding to the user of the user terminal 20 that has stopped transmitting the motion detection signal to the avatar control server 10a will be in a stationary state or will only make specific movements. Therefore, the drawing load on the avatar generation section 7 is reduced.

The control unit 9 may select the user terminal 20 to be instructed not to transmit the motion detection signal to the avatar control server 10a in the following manner. As a first example, the control unit 9 selects a user terminal 20 to be instructed not to transmit a motion detection signal to the avatar control server 10a, based on the ID assigned to the user terminal 20. For example, the control unit 9 divides the user terminals 20 into two groups depending on whether the ID is an odd number or an even number, and instructs the user terminals 20 of one group not to send a motion detection signal to the avatar control server 10a. Instruct.

As a second example, the control unit 9 does not transmit a motion detection signal to the avatar control server 10a from the user terminal 20 of the user corresponding to the avatar Av whose number of other avatars Av viewing the own avatar Av is small. Select this as the user terminal 20 to be instructed to do so. The control unit 9 knows the position of each avatar Av in the virtual space and the direction in which each avatar Av is facing. The visual field of each avatar Av is set in advance.

FIG. 7A shows a state in which the only other avatar Av looking at one's own avatar Av10 is avatar Av11. FIG. 7B shows a state in which there are four other avatars Av, avatars Av11 to Av14, looking at the user's avatar Av10. Comparing FIGS. 7A and 7B, when one's own avatar Av10 that is moving suddenly becomes stationary, the extent to which the user corresponding to the other avatar Av feels strange is that the other avatar Av This is the case of FIG. 7B, where there are many numbers.

Therefore, the control unit 9 prevents the user terminal 20 of the user corresponding to the avatar Av for which there is no other avatar Av looking at the own avatar Av10 from transmitting a motion detection signal to the avatar control server 10a. It is selected as the user terminal 20 to be given the highest priority. When the number of user terminals 20 connected to the avatar control server 10a exceeds the above-mentioned predetermined number even after excluding the selected user terminal 20, the control unit 9 controls other avatars Av viewing the own avatar Av10. The user terminal 20 of the user corresponding to the avatar Av with fewer values is selected.

The control unit 9 prevents the motion detection signal from being transmitted to the avatar control server 10a until the number of user terminals 20 connected to the avatar control server 10a, excluding the selected user terminal 20, becomes equal to or less than the predetermined number described above. All you have to do is select the user terminal 20 you want to instruct.

The operation of the avatar control device 101 according to the first embodiment, the avatar control method according to the first embodiment, and the process that the avatar control program according to the first embodiment causes a computer to execute will be explained using the flowchart shown in FIG. do. In FIG. 8, when the process of the avatar control device 101 is started, the control unit 9 determines in step S1 whether the number of connected user terminals 20 exceeds a predetermined number. If the number of user terminals 20 exceeds the predetermined number (YES), the control unit 9 instructs at least some of the user terminals 20 to stop transmitting user motion detection signals, and performs processing. is moved to step S10. If the number of user terminals 20 does not exceed the predetermined number (NO), the control unit 9 moves the process to step S10.

In parallel with step S1, the tracking loss detection unit 3 determines in step S3 whether or not there is a user terminal that has lost tracking. If there is a user terminal 20 that is out of tracking (YES), the out-of-tracking detection unit 3 instructs the avatar movement setting unit 4 to make the avatar corresponding to the user of the corresponding user terminal 20 in a stationary state in step S4. Notice. Continuing to step S4, if there is no user terminal 20 that is out of tracking in step S3 (NO), the avatar movement setting unit 4 generates an avatar control signal for the movement of each avatar Av in step S5. Instruct section 6.

Avatar control signal generation section 6 generates an avatar control signal in step S6. Avatar generation section 7 generates avatar Av in step S7. In step S8, the rendering unit 8 performs rendering to position the avatar Av within the virtual space. The communication unit 1 transmits the rendered image to each user terminal 20 in step S9.

Avatar control device 101 determines whether to end the avatar control operation in step S10. If the avatar control operation is not completed (NO), the avatar control device 101 returns the process to steps S1 and S3, and repeats the subsequent process. If the avatar control operation is completed (YES), the avatar control device 101 ends the process.

As described above, the avatar control device 101 according to the first embodiment includes the avatar generation unit 7 that draws an avatar Av corresponding to each user to generate each avatar, and the number of avatars Av generated by the avatar generation unit 7. The avatar movement setting unit 4 is provided to set whether or not to reflect at least some of the user's movements on the avatar Av in accordance with the avatar Av. The avatar control method and avatar control program according to the first embodiment generate each avatar by drawing an avatar Av corresponding to each user, and control the movements of at least some of the users according to the number of avatars Av to be generated. Set whether or not to reflect on avatar Av.

Therefore, according to the avatar control device 101, avatar control method, and avatar control program according to the first embodiment, control is performed to generate an avatar Av corresponding to the user while preventing excessive drawing load or communication load. can do.

The avatar movement setting unit 4 preferably sets the avatar Av, which does not reflect the user's movement, to a stationary state or a specific movement.

An avatar control device 101 according to the first embodiment is provided in an avatar control server 10a connected to each user terminal 20 via a network 50. Each user terminal 20 transmits a motion detection signal generated by a motion sensor 21 that detects the motion of each user or a skeletal motion signal of each user generated based on the motion detection signal to the avatar control server 10a.

The avatar control device 101 acquires the number of user terminals 20 connected to the avatar control server 10a. When the number of user terminals 20 connected to the avatar control server 10a exceeds a predetermined number, the avatar control device 101 transmits a motion detection signal or a skeletal motion signal to at least some of the user terminals 20 to the avatar control server 10a. It includes a control unit 9 that instructs not to transmit. Therefore, it is possible to realize the avatar control device 101 that prevents the drawing load or the communication load from becoming excessive.

<Second embodiment>
In the second embodiment shown in FIG. 9, the same parts as in the first embodiment are given the same reference numerals, and the explanation thereof may be omitted. As shown in FIG. 9, the avatar control server 10b and user terminals 20d to 20f are connected via a network 50. A user terminal that does not specify any of the user terminals 20d to 20f and any other user terminal not shown will be referred to as a user terminal 20. The number of user terminals 20 connected to the avatar control server 10b via the network 50 is one or more.

Each user terminal 20 includes an avatar control device 222 . Each user terminal 20 has a different configuration from the user terminal 20 of the first embodiment, including a movement detection section 202, a tracking deviation detection section 203, an avatar movement setting section 204, a specific posture data holding section 205, an avatar control signal generation section 206, It includes an avatar generation section 207, a rendering section 208, and a storage section 209. Avatar generation section 207 includes a calculation section 2071. The avatar control server 10b includes a communication section 1, a control section 9, an avatar/background setting section 12, and an avatar position management section 110.

Avatar control device 222 can be configured with a computer including a processor and memory. The specific posture data holding unit 205 and the storage unit 209 can be configured with a computer memory. The parts of the avatar control device 222 other than the motion sensor 21, the operation section 23, the communication section 24, the image display section 25, the specific posture data holding section 205, and the storage section 209 can be configured by a computer processor.

Similar to the motion detection unit 2, the motion detection unit 202 generates a skeletal motion signal for each user. The skeletal motion signal is supplied to the tracking-off detection section 203, the avatar motion setting section 204, and the communication section 24. The communication unit 24 transmits the skeletal motion signal to the avatar control server 10b. The communication unit 1 of the avatar control server 10b receives skeleton movement signals transmitted from each user terminal 20. The communication unit 1 transmits the skeletal motion signals transmitted from all other user terminals 20 to each user terminal 20 under the control of the control unit 9.

In the example shown in FIG. 9, the communication unit 1 transmits the skeletal motion signals received from the user terminals 20e and 20f to the user terminal 20d. The communication unit 1 transmits the skeletal motion signals received from the user terminals 20d and 20f to the user terminal 20e. The communication unit 1 transmits the skeletal motion signals received from the user terminals 20d and 20e to the user terminal 20f.

The tracking loss detection unit 203 detects each user terminal 20 based on the skeletal motion signal supplied from the motion detection unit 202 in its own user terminal 20 and the skeletal motion signal generated by the motion detection unit 202 in other user terminals 20. Detect the presence or absence of tracking loss. When tracking loss detection section 203 detects that tracking loss has occurred in any of the user terminals 20, it notifies avatar movement setting section 204 that tracking loss has occurred.

If the avatar movement setting unit 204 has not been notified that tracking loss has occurred, it instructs the avatar control signal generation unit 206 to cause the avatar Av to move in accordance with the skeletal movement signal. The avatar control signal generation section 206 generates an avatar control signal that controls the avatar Av to move in accordance with the skeletal motion signal, and supplies it to the avatar generation section 207 . The calculation unit 2071 of the avatar generation unit 207 generates an avatar Av by drawing an avatar Av that moves according to the skeletal motion signal.

Information indicating the form of the avatar Av, information indicating the correspondence between parts of the human body and which parts of the avatar Av correspond, and background data set in the avatar/background setting section 12 of the avatar control server 10b are as follows: It is transmitted to each user terminal 20 and stored in the storage unit 209. The rendering unit 8 acquires background data from the storage unit 209 and performs rendering to position the avatar Av in a virtual space based on the background data.

The control unit 22 of each user terminal 20 generates a movement control signal to move the avatar Av in accordance with the operation of the operation unit 23. The control unit 22 controls the rendering unit 208 to move the avatar Av corresponding to the user of the own user terminal 20 within the virtual space according to the movement control signal. The movement control signal is sent to the avatar control server 10b. The avatar position management unit 110 acquires movement control signals from all user terminals 20 and manages the position of each avatar Av in the virtual space.

The communication unit 1 transmits the movement control signals transmitted from all other user terminals 20 to each user terminal 20 under the control of the control unit 9. In the example shown in FIG. 9, the communication unit 1 transmits the movement control signals received from the user terminals 20e and 20f to the user terminal 20d. The communication unit 1 transmits the movement control signals received from the user terminals 20d and 20f to the user terminal 20e. The communication unit 1 transmits the movement control signals received from the user terminals 20d and 20e to the user terminal 20f. The control unit 22 controls the rendering unit 208 to move the avatar Av corresponding to the user of the other user terminal 20 within the virtual space according to the movement control signal.

The image display unit 25 displays the rendered image generated by the rendering unit 208. While viewing the rendered image displayed on the image display unit 25, the user can change his or her own posture to change the posture of the avatar Av, or move the avatar Av within the virtual space.

The specific posture data holding unit 205 holds specific posture data for making the avatar Av stand still or move in a specific manner. The operation of the avatar movement setting unit 204 when the tracking deviation detection unit 203 detects tracking deviation is the same as that of the avatar movement setting unit 4.

In the second embodiment, the avatar control server 10b is configured as follows in order to reduce the drawing load and communication load. The control unit 9 is connected to the avatar control server 10b and acquires the number of user terminals 20 with which the communication unit 1 communicates. When the number of user terminals 20 connected to the avatar control server 10b exceeds a predetermined number, the control unit 9 instructs at least some of the user terminals 20 not to transmit skeletal movement signals to the avatar control server 10b. send an instruction signal to The user terminal 20 that has acquired the instruction signal and has been instructed not to transmit the skeletal motion signal to the avatar control server 10b stops transmitting the skeletal motion signal to the avatar control server 10b. Therefore, the communication load between the avatar control server 10b and the user terminal 20 is reduced.

In addition, the avatar Av corresponding to the user of the user terminal 20 that has stopped sending skeletal motion signals to the avatar control server 10b is out of tracking in other user terminals 20. The avatar Av corresponding to the user of the user terminal 20 that has stopped transmitting skeletal motion signals to the avatar control server 10b will remain in a stationary state or only make specific movements. Therefore, the drawing load on the avatar generation unit 207 is reduced.

The control unit 9 selects the user terminal 20 that instructs not to transmit the skeletal motion signal to the avatar control server 10b. The selection method for the terminal 20 may be the same.

The operation of the avatar control device 222 according to the second embodiment, the avatar control method according to the second embodiment, and the process that the avatar control program according to the second embodiment causes a computer to execute will be explained using the flowchart shown in FIG. do. In FIG. 10, when the process of the avatar control device 222 is started, the control unit 22 determines in step S21 whether or not it has been instructed to stop transmitting the skeletal motion signal. If the instruction to stop transmitting the skeletal motion signal is given (YES), the communication unit 24 stops transmitting the skeletal motion signal in step S22, and the control unit 22 moves the process to step S210. If there is no instruction to stop transmitting the skeletal motion signal (NO), the control unit 22 moves the process to step S210.

In parallel with step S21, the tracking loss detection unit 203 determines in step S23 whether or not there is a user terminal that has lost tracking. If there is a user terminal 20 that is out of tracking (YES), the out-of-tracking detection unit 203 instructs the avatar movement setting unit 204 to make the avatar corresponding to the user of the corresponding user terminal 20 in a stationary state in step S24. Notice. Continuing to step S24, if there is no user terminal 20 that is out of tracking in step S23 (NO), the avatar movement setting unit 204 generates an avatar control signal for the movement of each avatar Av in step S25. 206.

Avatar control signal generation section 206 generates an avatar control signal in step S26. Avatar generation unit 207 generates avatar Av in step S27. In step S28, the rendering unit 208 performs rendering to position the avatar Av within the virtual space. The image display unit 25 displays the rendered image in step S29.

Avatar control device 222 determines whether to end the avatar control operation in step S210. If the avatar control operation is not completed (NO), the avatar control device 222 returns the process to steps S21 and S23, and repeats the subsequent process. If the avatar control operation is completed (YES), the avatar control device 222 ends the process.

As described above, the avatar control device 222 according to the second embodiment includes the avatar generation unit 207 that generates each avatar by drawing the avatar Av corresponding to each user, and the number of avatars Av that the avatar generation unit 207 generates. and an avatar movement setting unit 204 that sets whether or not to reflect at least some of the user's movements on the avatar Av. The avatar control method and avatar control program according to the second embodiment generate each avatar by drawing an avatar Av corresponding to each user, and control the movements of at least some of the users according to the number of avatars Av to be generated. Set whether or not to reflect on avatar Av.

Therefore, according to the avatar control device 222, avatar control method, and avatar control program according to the second embodiment, control is performed to generate an avatar Av corresponding to the user while preventing excessive drawing load or communication load. can do.

The avatar movement setting unit 204 preferably sets the avatar Av, which does not reflect the user's movement, to a stationary state or a specific movement.

The avatar control device 222 according to the second embodiment is provided in each user terminal 20. Each user terminal 20 transmits each user's skeletal motion signal generated based on a motion detection signal generated by a motion sensor 21 that acquires each user's motion to the avatar control server 10b. The avatar control device 222 of each user terminal 20 acquires, from the avatar control server 10b, skeletal motion signals generated by user terminals 20 other than its own user terminal 20.

The avatar control server 10b prevents at least some of the user terminals 20 from transmitting skeletal motion signals to the avatar control server 10b when the number of user terminals 20 connected to the avatar control server 10b exceeds a predetermined number. Send an instruction signal to instruct. Therefore, the avatar control devices 222 of at least some of the user terminals 20 acquire the instruction signal transmitted from the avatar control server 10b.

The avatar control device 222 includes a control unit 22 that controls not to transmit the skeletal motion signal to the avatar control server 10b upon acquiring the instruction signal. Therefore, according to the second embodiment, it is possible to realize the avatar control device 222 that prevents the drawing load or the communication load from becoming excessive.

<Third embodiment>
As shown in FIG. 1, the avatar control server 10a includes an avatar control device 103 according to the third embodiment, which has the same configuration as the avatar control device 101. The operation of the avatar control device 103 according to the third embodiment, the avatar control method according to the third embodiment, and the process that the avatar control program according to the third embodiment causes a computer to execute will be explained using the flowchart shown in FIG. 11. do.

In FIG. 11, when the process of the avatar control device 103 is started, the control unit 9 determines in step S31 whether the number of connected user terminals 20 exceeds a predetermined number. If the number of user terminals 20 exceeds the predetermined number (YES), the control unit 9 sends a motion detection signal to the user terminal 20 of the user corresponding to the avatar whose movement is less than or equal to the predetermined size in step S32. , and the process moves to step S310. If the number of user terminals 20 does not exceed the predetermined number (NO), the control unit 9 moves the process to step S310. Steps S33 to S310 are the same as steps S3 to S10 in FIG.

The avatar control device 103 according to the third embodiment includes an avatar generation unit 7 that draws an avatar Av corresponding to each user to generate each avatar, and a motion detection signal generated by a motion sensor 21 that acquires the motion of each user. The avatar movement setting section 4 sets the movement of each avatar based on the avatar movement setting section 4. When the number of avatars generated by the avatar generation unit 7 exceeds a predetermined number, the avatar movement setting unit 4 selects avatars whose movement is less than or equal to a predetermined size, regardless of the motion detection signal generated by the motion sensor 21. Set to rest or specific movement. The specific movement here is preferably a movement less than the above-mentioned predetermined magnitude.

The avatar control method and avatar control program according to the third embodiment generate each avatar by drawing an avatar corresponding to each user, and based on a motion detection signal generated by a motion sensor 21 that acquires the motion of each user. , set the movement of each avatar. In the avatar control method and avatar control program according to the third embodiment, when the number of avatars to be generated exceeds a predetermined number, the motion sensor 21 generates an avatar corresponding to a user whose movement is less than or equal to a predetermined size. Set to stationary state or specific motion regardless of motion detection signal.

Therefore, according to the avatar control device 103, avatar control method, and avatar control program according to the third embodiment, control is performed to generate an avatar Av corresponding to the user while preventing excessive drawing load or communication load. can do. Avatars whose movements are less than a predetermined size are considered not to make significant movements, so even if the avatar is set to a static state, other users other than the user corresponding to the avatar set to a static state may feel strange. I don't remember much.

The avatar control device 103, the avatar control method, and the avatar control program according to the third embodiment can be applied to a user whose movement is less than or equal to a predetermined size, regardless of whether the number of avatars to be generated exceeds a predetermined number. The corresponding avatar may be set to a stationary state or to a specific motion independently of the motion detection signal generated by the motion sensor 21.

<Fourth embodiment>
As shown in FIG. 9, each user terminal 20 includes an avatar control device 224 according to the fourth embodiment, which has the same configuration as the avatar control device 222. When the number of user terminals 20 connected to the avatar control server 10b exceeds a predetermined number, the control unit 9 of the avatar control server 10b controls the motion to a predetermined level based on the skeletal motion signal transmitted from each user terminal 20. The user terminal 20 of the user corresponding to the avatar whose size is smaller than or equal to is instructed not to transmit a skeletal motion signal to the avatar control server 10b. The user terminal 20 that has been instructed not to transmit the skeletal motion signal to the avatar control server 10b stops transmitting the skeletal motion signal to the avatar control server 10b.

The operation of the avatar control device 224 according to the fourth embodiment, the avatar control method according to the fourth embodiment, and the avatar control program according to the fourth embodiment are the same as those in FIG. 10.

The avatar control device 224 according to the fourth embodiment includes an avatar generation unit 207 that draws an avatar Av corresponding to each user to generate each avatar, and a motion detection signal generated by a motion sensor 21 that acquires the motion of each user. , and an avatar movement setting section 204 that sets the movement of each avatar based on the following. When the number of avatars generated by the avatar generation unit 207 exceeds a predetermined number, the avatar movement setting unit 204 selects avatars whose movement is less than or equal to a predetermined size, regardless of the motion detection signal generated by the motion sensor 21. Set to quiescent state.

The avatar control method and avatar control program according to the fourth embodiment generate each avatar by drawing an avatar corresponding to each user, and based on a motion detection signal generated by a motion sensor 21 that acquires the motion of each user. , set the movement of each avatar. In the avatar control method and avatar control program according to the fourth embodiment, when the number of avatars to be generated exceeds a predetermined number, the movement sensor 21 generates an avatar corresponding to a user whose movement is less than or equal to a predetermined size. Set to a stationary state regardless of the motion detection signal.

Therefore, according to the avatar control device 224, the avatar control method, and the avatar control program according to the fourth embodiment, the avatar Av corresponding to the user is controlled to be generated while preventing the drawing load or the communication load from becoming excessive. can do. Avatars whose movements are less than a predetermined size are considered not to make significant movements, so even if the avatar is set to a static state, other users other than the user corresponding to the avatar set to a static state may feel strange. I don't remember much.

The avatar control device 224, the avatar control method, and the avatar control program according to the fourth embodiment can be applied to a user whose movement is less than or equal to a predetermined size, regardless of whether the number of avatars to be generated exceeds a predetermined number. The corresponding avatar may be set to a stationary state or to a specific movement independently of the motion detection signal generated by the motion sensor 21.

The present invention is not limited to the first to fourth embodiments described above, and various modifications can be made without departing from the gist of the present invention.

1, 24 Communication unit 2, 202 Motion detection unit 3, 203 Tracking deviation detection unit 4, 204 Avatar movement setting unit 5, 205 Specific posture data storage unit 6, 206 Avatar control signal generation unit 7, 207 Avatar generation unit 8, 208 Rendering unit 9, 22 Control unit 10a, 10b Avatar control server 11 Avatar position control unit 12 Avatar/background setting unit 20a, 20b, 20c, 20d, 20e, 20f User terminal 21 Motion sensor 23 Operation unit 25 Image display unit 50 Network 101 , 103, 222, 224 Avatar control device 110 Avatar position management section 209 Storage section

Claims (4)

an avatar generation unit that generates each avatar by drawing an avatar corresponding to each user;
an avatar movement setting unit that sets the movement of each avatar based on a movement detection signal generated by a movement sensor that acquires the movement of each user;
Equipped with
The avatar motion setting unit sets an avatar whose motion is less than a predetermined magnitude to a stationary state or a specific motion regardless of a motion detection signal generated by the motion sensor. When the number of avatars generated by the avatar generation unit exceeds a predetermined number, the avatar movement setting unit selects an avatar whose movement is less than or equal to a predetermined size, regardless of the motion detection signal generated by the movement sensor. The avatar control device according to claim 1, wherein the avatar control device is set to a stationary state or a specific movement. Generate each avatar by drawing an avatar corresponding to each user,
setting the movement of each avatar based on a movement detection signal generated by a movement sensor that acquires the movement of each user;
An avatar control method that sets an avatar whose motion is less than a predetermined magnitude to a stationary state or a specific motion regardless of a motion detection signal generated by the motion sensor. to the computer,
generating each avatar by drawing an avatar corresponding to each user;
setting the movement of each avatar based on a movement detection signal generated by a movement sensor that acquires the movement of each user;
setting an avatar whose movement is less than or equal to a predetermined magnitude to a stationary state or a specific movement regardless of a movement detection signal generated by the movement sensor;
An avatar control program that runs.

Images