JP2024041749A - Moving image distribution system, moving image distribution method, and moving image distribution program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving image distribution system, a moving image distribution method, and a moving image distribution program that can distribute a coacting moving image with an improved sense of unity.

SOLUTION: A moving image distribution system including one or more computer processors distributes a coacting moving image including a first character generated on the basis of the movement of a first user and a second character generated on the basis of the movement of a second user, displays a first object in association with the first character, determines whether a matching object identical to the first object is displayed in association with the second character, and displays the same matching object as the first object in association with the second character in the coacting moving image when it is determined that the matching object is not displayed in association with the second character.

SELECTED DRAWING: Figure 16

COPYRIGHT: (C)2024,JPO&INPIT

Description

The disclosure herein relates to a video distribution system, a video distribution method, and a video distribution program. More specifically, the disclosure herein relates to a video distribution system, a video distribution method, and a video distribution program that live-distributes a video including a character generated based on a user's movement.

Various video distribution services have been known for a long time. In recent years, a video distribution system that generates character animation based on the movement of a distribution user and live-distributes a video including the character animation has been attracting attention. Such video distribution systems are disclosed, for example, in Japanese Patent Application Publication No. 2015-184689 (Patent Document 1) and “Yusuke Hasegawa, The Beginning of a New Era of Virtual Idols” PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 2017 10th, Vol. 231, pp. 74-79" (Non-Patent Document 1).

"Virtual Cast" provided by Dwango Co., Ltd. is known as a video distribution service that distributes videos that include characters generated based on the movements of distribution users. In virtual cast, characters of other users participate in a video being distributed by a distribution user, allowing two distribution users to virtually co-star in the video through their respective characters.

A video distribution system is also known that displays a gift object corresponding to a gift purchased by the viewing user on a display screen in response to a request from the viewing user who views the video. For example, in the video distribution system disclosed in Japanese Unexamined Patent Publication No. 2012-120098 (Patent Document 2), a viewing user purchases a gift item and provides the purchased gift item to the distribution user as a gift. I can do it. Gifts are displayed on videos being distributed in response to display requests from viewing users. A gift display request may be automatically generated in response to the gift being purchased by a viewing user. The specification of Japanese Patent No. 6543403 (Patent Document 3) describes displaying a gifted object in association with a moving character based on the movement of a distribution user.

Japanese Patent Application Publication No. 2015-184689 JP 2012-120098 A Patent No. 6543403

Yusuke Hasegawa, The Beginning of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Volume 231, pp. 74-79 Dwango Co., Ltd., "[Virtual Cast] About Convex", [online], [searched on July 1, 2019], Internet <URL: https://qa.nicovideo.jp/faq/show/10740?category#id =718&site#domain=default〉

When a host user's character and a guest user's character co-star in a co-starring video, the appearance of the host user's character is determined by the settings of the host user, and the appearance of the guest user's character is determined by the settings of the guest user. It will be done. In other words, the image of the character included in the co-starring video is uniquely determined by each co-star. For this reason, there is a problem in that it is difficult to express a sense of unity in conventional co-starring videos.

It is an object of the present invention to provide technical improvements that solve or alleviate at least some of the problems of the prior art mentioned above. One of the more specific objects of the present invention is to provide a video distribution system, a video distribution method, and a video distribution program that can distribute co-starring videos with an improved sense of unity.

One aspect of the present invention relates to a video distribution system that includes one or more computer processors. In one aspect, the one or more computer processors execute computer-readable instructions to generate a first character based on a first user's movement and a first character generated based on a second user's movement. Distribute a co-starring video including a second character, display a first object in association with the first character, and determine whether a matching object identical to the first object is displayed in association with the second character. , when it is determined that the matching object is not displayed in association with the second character, the same matching object as the first object is displayed in association with the second character in the co-starring video.

In one aspect of the present invention, the matching object displayed in association with the second character is displayed only in the co-starring video.

The video distribution system according to one aspect of the present invention provides a display request for displaying the matching object in association with the second character when it is determined that the matching object is not displayed in association with the second character. The matching object is displayed in association with the second character in the co-starring video based on the display request.

When it is determined that the matching object is not displayed in association with the second character, the video distribution system according to one aspect of the present invention prompts one or more viewing users who are watching the co-starring video to make a display request to display the matching object in association with the second character.

In the video distribution system according to one aspect of the present invention, when it is determined that the matching object is not displayed in association with the second character, the video distribution system matches the first user with the matching object in association with the second character. Prompts you to make a display request to display the object.

In the video distribution system according to one aspect of the present invention, when it is determined that the matching object is not displayed in association with the second character, the video distribution system matches the second user with the matching object in association with the second character. Prompts you to make a display request to display the object.

The video distribution system according to one aspect of the present invention provides a benefit to the first user when the matching object is displayed in association with the second character in the co-starring video. The video distribution system according to one aspect of the present invention provides a benefit to the second user when the matching object is displayed in association with the second character in the co-starring video. In the video distribution system according to one aspect of the present invention, a display request to display the matching object in association with the second character is received from a first viewing user among one or more viewing users who are viewing the co-starring video. A privilege is given to the first viewing user when the matching object is displayed in response to the matching object. In the video distribution system according to one aspect of the present invention, when the matching object is displayed in association with the second character in the co-starring video, the first user, the second user, and the co-starring video are viewed. A privilege is given to each of the one or more viewing users who are watching the video.

In one aspect of the present invention, the co-starring video is generated in response to receiving a co-starring request from the second user for co-starring with the first user.

In one aspect of the present invention, the first object is displayed in association with the attachment part of the first character, and the matching object is displayed in association with the attachment part of the second character.

One aspect of the present invention relates to a video distribution method performed by one or more computer processors executing computer-readable instructions. The video distribution method includes a first character generated based on a first user's movement, a second character generated based on a second user's movement, and a first character displayed in association with the first character. a step of distributing a co-starring video including the object; a step of determining whether a matching object identical to the first object is displayed in association with the second character; and a step of determining whether the matching object is displayed in association with the second character. The method further includes the step of displaying a matching object that is the same as the first object in association with the second character in the co-starring video when it is determined that the object is not displayed.

One aspect of the present invention relates to a video distribution program. The video distribution program causes one or more computer processors to generate a first character generated based on a first user's movement, a second character generated based on a second user's movement, and the first character. a step of distributing a co-starring video including a first object displayed in association with the second character; a step of determining whether a matching object identical to the first object is displayed in association with the second character; If it is determined that the matching object is not displayed in association with the character, the step of displaying the same matching object as the first object in association with the second character in the co-starring video is executed.

According to the embodiments of the present invention, it is possible to provide a video distribution system, a video distribution method, and a video distribution program that can distribute co-starring videos with an improved sense of unity.

FIG. 1 is a block diagram illustrating a video distribution system according to an embodiment. FIG. 2 is a schematic diagram schematically showing a distribution user who distributes a video distributed by the video distribution system of FIG. 1 and a distribution user device used by the distribution user. 2 is a diagram illustrating gift object information stored in the video distribution system of FIG. 1. FIG. 2 is a diagram illustrating retained object information stored in the video distribution system of FIG. 1. FIG. 2 is a diagram illustrating object display information stored in the video distribution system of FIG. 1. FIG. FIG. 2 is a diagram illustrating an example of a moving image image displayed on the viewing user device 10 in one embodiment. FIG. 3 is a diagram illustrating an example of a moving image image displayed on a distribution user device 20a in an embodiment. It is a figure which shows the example of the image of the moving image displayed on the distribution user device 20b in one embodiment. 8 is a diagram showing an example of an image of a moving image displayed on an audience user device 10 in one embodiment. FIG. 3 is a diagram illustrating an example of a video image displayed on the viewing user device 10 in one embodiment. In the image of FIG. 9, a mounted object is displayed. It is a figure which shows the example of the image of the moving image displayed on the distribution user device 20a in one embodiment. It is a figure which shows the example of the image of the moving image displayed on the distribution user device 20b in one embodiment. FIG. 3 is a diagram illustrating an example of an image of a co-starring video displayed on the viewing user device 10 in one embodiment. It is a figure which shows the example of the image of the co-starring video displayed on the distribution user device 20a in one embodiment. It is a figure which shows the example of the image of the co-starring video displayed on the distribution user device 20b in one embodiment. FIG. 2 is a diagram showing an example of an image of a co-starring video displayed on a viewing user device 10 in one It is a flow diagram showing the flow of video distribution processing in one embodiment. FIG. 2 is a flow diagram showing the flow of processing for distributing co-starring videos in one embodiment. FIG. 3 is a flow diagram illustrating a process for displaying matching objects in one embodiment.

Hereinafter, various embodiments of the present invention will be described with appropriate reference to the drawings. Identical or similar components in multiple drawings are provided with the same reference numerals.

A video distribution system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram showing a video distribution system 1 according to an embodiment, and FIG. 2 shows users Ua and Ub who distribute videos in the video distribution system 1 and distribution user devices used by the users Ua and Ub. FIG. 2 is a schematic diagram schematically showing 20a and 20b. In the video distribution system 1, the distribution user device 20a has a function for distributing a video including a character object generated based on the movement of the user Ua. It has a function for distributing a video containing a character object generated based on the movement of Ub.

As will be described in detail later, the video distribution system 1 can generate a video including character objects of two or more distribution users and distribute the video. In other words, in the video distribution system 1, two or more distribution users can virtually perform together in a video via their respective character objects. In this way, when two or more distribution users virtually co-star in a video via their respective character objects, the video is called a "co-star video." In this specification, a character object of a distribution user included in a video may be simply referred to as a "character."

User Ua and user Ub are both distribution users who distribute videos including characters generated based on movement, and viewing users who view videos of other distribution users. In this specification, a user who views a video using the viewing user device 10, the distribution user devices 20a, 20b, or a device other than these is referred to as a viewing user. Therefore, the distribution user devices 20a and 20b may have a function of viewing videos distributed by the video distribution system 1.

User Ua can apply for co-starring with user Ub. When this co-starring request is approved, a co-starring video including the user Ub's character and the user Ua's character is generated, and the co-starring video is distributed. When user Ua participates in a video that user Ub is distributing, and user Ub and user Ua co-star, user Ua who has applied for co-starring and co-stars with user Ub is called a "guest user", and the guest user participates. The user Ub who is distributing the video may be called a "host user". The concepts of host user and guest user are relative. For example, contrary to the above example, if user Ub sends a co-starring request to user Ua, and based on this co-starring request, user Ub co-stars in user Ua's video, user Ua becomes the host user and the user Ub becomes a guest user. In this specification, for convenience of explanation, it is assumed that an invitation is sent from user Ub to user Ua. That is, it is assumed that user Ub is a host user and user Ua is a guest user. However, the description regarding the user Ua in this specification may be extended to the general guest users as much as possible. Similarly, the description herein regarding the user Ub may be extended to the extent possible to the description regarding host users in general. For example, even when a description is given regarding distribution user Ua in this specification, the explanation can be understood as an explanation regarding guest users in general, and a description regarding distribution user Ub can be understood as an explanation regarding host users in general.

The video distribution system 1 includes a viewing user device 10, distribution user devices 20a and 20b, a server device 60, and a storage 70. The viewing user device 10, the distribution user device 20, the server device 60, and the storage 70 are connected to each other via a network 50 so as to be able to communicate with each other. The server device 60 is configured to distribute videos including animations of characters of distribution users Ua and distribution users Ub, as will be described later.

This video is distributed from the server device 60 to the viewing user device 10 and the broadcasting user devices 20a and 20b. The distributed video is displayed on the display of the viewing user device 10. A viewing user, who is a user of the viewing user device 10, can view the distributed video using the viewing user device 10. Although only one viewing user device 10 is shown in FIG. 1 for the sake of simplicity, the video distribution system 1 may include multiple viewing user devices. By viewing the distributed video, the broadcasting users Ua and Ub can perform while checking the video within the video.

In the illustrated embodiment, the distribution user device 20a includes a computer processor 21a, a communication I/F 22a, a display 23a, a camera 24a, and a microphone 25a. Similarly, the distribution user device 20b includes a computer processor 21b, a communication I/F 22b, a display 23b, a camera 24b, and a microphone 25b. Since the distribution user device 20a and the distribution user device 20b have similar configurations and functions, if there is no particular need to distinguish between the two, they may be collectively referred to as the distribution user device 20. A component may also be called a computer processor 21 or the like.

The computer processor 21 is an arithmetic device that loads an operating system and various programs that implement various functions from storage into memory, and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various other arithmetic devices, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. Although computer processor 21 is illustrated as a single component in FIG. 1, computer processor 21 may be a collection of multiple physically separate computer processors.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver or a PPP driver, or a combination thereof. The distribution user device 20 can send and receive data to and from other devices via the communication I/F 22.

Display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect a touch operation (contact operation) by a player. The touch panel can detect various touch operations such as tap, double tap, and drag by the player. The touch panel may include a capacitive proximity sensor and be configured to be able to detect a non-contact operation by the player.

The camera 24 continuously images the faces of the distribution users Ua and Ub, and obtains image data of the distribution users Ua and Ub's faces. Image data of the faces of the distribution users Ua and Ub captured by the camera 24 is transmitted to the server device 60 via the communication I/F 22 . The camera 24 may be a 3D camera that can detect the depth of a person's face. The camera 24 may acquire imaging data by capturing images of distribution users Ua, Ub's parts other than their faces, for example, their hands, legs, fingers, or other parts.

The microphone 25 is a sound collection device configured to convert input audio into audio data. The microphone 25 is configured to be able to acquire audio input from distribution users Ua and Ub. The voice input of the distribution users Ua and Ub acquired by the microphone 25 is converted into voice data, and this voice data is transmitted to the server device 60 via the communication I/F 22.

The viewing user device 10 may include the same components as the distribution user device 20. For example, viewing user device 10 may include a computer processor, a communication I/F, a display, and a camera. The viewing user device 10 may perform the same functions as the distribution user device 20 by downloading and installing predetermined application software.

The viewing user device 10 and the distribution user device 20 are information processing devices such as smartphones. The viewing user device 10 and the distribution user device 20 include, in addition to smartphones, mobile phones, tablet terminals, personal computers, e-book readers, wearable computers, game consoles, and various other information processing devices capable of playing back videos. It's okay. In addition to the above-described components, each of the viewing user device 10 and the distribution user device 20 may include a sensor unit including various sensors such as a gyro sensor, and a storage that stores various information.

Next, the server device 60 will be explained. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I/F 62, and a storage 63.

The computer processor 61 is an arithmetic device that loads an operating system and various programs that implement various functions into memory from the storage 63 or other storage, and executes instructions included in the loaded programs. The computer processor 61 is, for example, a CPU, MPU, DSP, GPU, various other arithmetic devices, or a combination thereof. The computer processor 61 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. Although computer processor 21 is illustrated as a single component in FIG. 1, computer processor 61 may be a collection of multiple physically separate computer processors.

The communication I/F 62 is implemented as hardware, firmware, or communication software such as a TCP/IP driver or a PPP driver, or a combination of these. The server device 60 can send and receive data to and from other devices via the communication I/F 62.

Storage 63 is a storage device accessed by computer processor 61. Storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other storage device capable of storing data. Various programs may be stored in storage 63. At least a portion of the programs and various data that may be stored in storage 63 may be stored in a storage device (e.g., storage 70) that is physically separate from server device 60.

Each program described herein as being executed by computer processor 21 or computer processor 61, or the instructions contained therein, may be executed by a single computer processor or distributed by multiple computer processors. It may also be executed as follows. Furthermore, each program executed by the computer processor 21 or the computer processor 61 or the instructions included in the program may be executed by a plurality of virtual computer processors.

Next, data stored in the storage 63 will be explained. In the illustrated embodiment, the storage 63 includes model data 63a, object data 63b, gift object information 63c, possessed object information 63d, object display information 63e, and various other items necessary for generating and distributing distribution videos. Data is stored.

The model data 63a is model data for generating character animation. The model data 63a may be three-dimensional model data for generating three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (sometimes referred to as "skeleton data") indicating the skeleton of the character's face and parts other than the face, and surface data indicating the shape and texture of the character's surface. The model data 63a can include a plurality of different model data. This plurality of model data may have mutually different rig data, or may have the same rig data. This plurality of model data may have different surface data from each other, or may have the same surface data.

The object data 63b includes asset data for constructing a virtual space that constitutes a moving image. The object data 63b includes data for drawing the background of the virtual space constituting the video, data for drawing various objects displayed in the video, and data for drawing various objects displayed in the video other than these. Contains data. The object data 63b may include object position information indicating the position of the object in the virtual space.

The gift object information 63c is information for managing gift objects. An example of gift object information 63c is shown in FIG. As illustrated, in the gift object 63c, object information indicating the characteristics of the object is stored in association with object identification information for identifying the object. Object information for an object includes image data indicating an image of the object, type data indicating the type of the object, mounting position data indicating the mounting position on the character if the object is a mounting object (described later), and the object. , and various other data characterizing the object.

In one embodiment, gift objects are displayed in a video based on a request to display a gift from a viewing user who is viewing the video. There are various types of gift objects. The gift objects may include, for example, an effect object corresponding to an effect gift, a normal object corresponding to a normal gift, a wearing object corresponding to a wearing gift, and a message object corresponding to a message gift. Viewing users can purchase desired gifts. The distinction between viewing users and distribution users (for example, distribution users Ua, Ub) is a distinction that focuses on the actions of the users. For example, in the video distribution system 1, when a certain user views a video, the user is called a viewing user, but when the user distributes the video, the user is called a distribution user.

An effect object indicating an effect gift is an object that affects the impression of the entire viewing screen of the distributed video, and is, for example, an object imitating confetti. The object imitating confetti may be displayed over the entire viewing screen, thereby changing the impression of the entire viewing screen before and after the object is displayed. Although effect objects may be displayed overlapping the character, they differ from attachment objects in that they are displayed without being associated with a specific part of the character.

A normal object indicating a normal gift is an object indicating a gift from a viewing user to a distribution user (for example, distribution users Ua, Ub), and includes, for example, a stuffed animal, a bouquet of flowers, an accessory, or other items suitable for a gift or present. It is a modeled object. In one aspect, the normal object is displayed on the video display screen so as not to come into contact with the character. In one embodiment, the normal object is displayed on the video display screen so as not to overlap with the character. The normal object may be displayed so as to overlap objects other than the character in the virtual space. Normal objects are sometimes displayed so as to overlap with the character, but are different from attached objects in that they are not displayed in association with a specific part of the character. In one aspect, when displaying a normal object overlapping with a character, the normal object is displayed so as to overlap with parts other than the head including the face of the character and not overlap with the head of the character. be done. In one embodiment, when a normal object is displayed overlapping with a character, the normal object is displayed so as to overlap with parts other than the upper body of the character including the face, and not overlap with the upper body of the character. .

A wearable object indicating a wearable gift is an object displayed on the display screen in association with a specific part (wearing part) of the character. In one embodiment, a mounting object displayed on the display screen in association with a specific part of the character is displayed on the display screen so as to be in contact with the specific part of the character. In one embodiment, a mounting object displayed on the display screen in association with a specific part of the character is displayed on the display screen so as to cover part or all of the specific part of the character. A specific part may be specified by three-dimensional position information indicating a position in a three-dimensional coordinate space, or may be associated with position information in a three-dimensional coordinate space. For example, in a character's head, specific parts include the front left side, front right side, back left side, back right side, center front side, center rear side, left eye, right eye, left ear, right ear, and the entire hair. It may be determined.

The wearable objects include, for example, accessories (headbands, necklaces, earrings, etc.) that are worn on the character, clothes (T-shirts, etc.), costumes, and other objects that can be worn on the character. The gift object information 63c corresponding to the wearing object may include wearing part information indicating which part of the character the wearing object is associated with. The attachment part information of a certain attachment object can indicate which part of the character the attachment object is attached to. For example, when the wearing object is a headband, the wearing part information of the wearing object may indicate that the wearing object is worn on the "head" of the character. When the wearing part information on which the wearing object is worn is specified as a position in a three-dimensional coordinate space, the wearing part information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, wearing part information indicating a position where a wearing object indicating a "headband" is worn may be associated with two parts of the character: "back left side of head" and "back right side of head". In other words, the wearing object indicating a "headband" may be worn on both the "back left side of the head" and the "back right side of the head." When the wearing object is a T-shirt, the wearing part information of the wearing object may indicate that the wearing object is worn on the "torso" of the character.

Two types of attachment objects that have a common attachment location are displayed in the video at different times. In other words, two types of attachment objects having a common attachment site are attached to the character at different times. In other words, two types of attachment objects that have a common attachment site are not attached to the character at the same time. For example, when a wearing object representing a headband and a wearing object representing a hat are both set to the "head" as the wearing part, the wearing object representing a headband and the wearing object representing a hat are not displayed at the same time.

Each gift object may have a display time set according to its type. In one embodiment, the display time of the attachment object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the attachment object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

The held object information 63d is a list showing objects held by users (viewing users and distribution users) of the video distribution system. An example of the held object information 63c is shown in FIG. As shown in the figure, in the held object information 63c, an object ID that specifies an object held by the viewing user is stored in association with the viewing user's account information. The viewing user's account information is, for example, a user ID that identifies the viewing user. The object held by the viewing user is, for example, the gift object described above. A distribution user can attach an object held to a character included in the video while distributing the video.

The object display information 63e is information for managing the attached object displayed in association with the distribution user's character in the video. An example of the object display information 63d is shown in FIG. As shown in the figure, in the object display information 63d, an object ID that identifies an object displayed in the video is stored in association with account information of a distribution user who is distributing the video. In the object display information 63d, an object ID is stored that identifies the attached object displayed in the video in association with the character of the distribution user, in association with the account information of the distribution user who is distributing the video. It's okay. The distribution user's account information is, for example, a user ID that identifies the distribution user.

Next, the functions realized by the computer processors 21a and 21b will be explained in more detail. The computer processor 21a functions as a face motion data generation section 21a1 by executing computer-readable instructions included in the distribution program. Similarly, the computer processor 21b functions as the face motion data generator 21b1 by executing computer-readable instructions included in the distribution program. At least some of the functions realized by the computer processors 21a and 21b may be realized by a computer processor other than the computer processors 21a and 21b of the video distribution system 1. At least some of the functions realized by the computer processors 21a and 21b may be realized by the computer processor 61 installed in the server device 60, for example.

The face motion data generation unit 21a1 generates face motion data that is a digital representation of the distribution user Ua's facial movement based on the image data of the camera 24a. Similarly, the face motion data generation unit 21b1 generates face motion data that is a digital representation of the distribution user Ub's facial movement based on the imaging data of the camera 24b. Face motion data is generated as time passes. Face motion data may be generated every predetermined sampling time interval. In this way, the face motion data generated by the face motion data generation unit 21a1 can digitally represent the facial movements (changes in facial expression) of the distribution user Ua in a time-series manner, and the face motion data generated by the face motion data generation unit 21b1 The face motion data generated in can digitally represent the facial movements (changes in facial expression) of the distribution user Ub in a time-series manner. The face motion data generated by the face motion data generation units 21a1 and 21b1 is transmitted to the server device 60 via the communication I/Fs 22a and 22b.

In the distribution user device 20, in addition to the face motion data generated by the face motion data generation unit 21a1, body motion data that is a digital representation of the position and orientation of each part of the distribution users Ua, Ub's body other than the face is generated. may be generated. Distribution user device 20 may transmit body motion data to server device 60 in addition to face motion data. In order to generate body motion data, distribution users Ua and Ub may wear motion sensors. The distribution user device 20 may be configured to be able to generate body motion data based on detection information of a motion sensor attached to the distribution users Ua, Ub. Body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data expresses the body movements of distribution users Ua and Ub in time series as digital data. The body motion data may be generated based on the detection information of the motion sensors attached to the distribution users Ua and Ub, for example, in a photography studio. The photography studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor attached to the distribution users Ua and Ub may be, for example, Vive Tracker provided by HTC CORPORATION. The base station provided in the photography studio may be, for example, a base station provided by HTC CORPORATION. Further, a supporter computer may be installed in a separate room from the photography studio. A display in the photography studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room where the supporter computer is installed. The room in which the supporter computer is installed and the photography studio may be separated by a glass window. In this case, the operator of the supporter computer (herein sometimes referred to as "supporter") can visually recognize the distribution users Ua and Ub. The supporter computer may be configured to be able to change the settings of various devices provided in the photography studio in accordance with operations by the supporter. The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various devices other than these. The supporter can enter a message into the supporter computer and display the entered message on a display in the photo studio.

The distribution user device 20 may implement functions other than the face motion data generation section 21a1 by executing the distribution program and/or other programs on a computer processor. For example, the distribution user device 20 may implement a function of playing the received video by executing a viewing program for video viewing. The distribution program and the viewing program may be packaged into one application software, or may be provided as separate application software.

Viewing user device 10 may be configured to provide similar functionality to distribution user device 20. For example, the viewing user device 10 may implement a function of playing the received video by executing a viewing program for video viewing, and may have a function similar to that of the face motion data generation unit 21a1 by executing a distribution program. The function may be realized.

Next, the functions realized by the computer processor 61 will be explained in more detail. By executing computer-readable instructions included in the distribution program, the computer processor 61 generates an animation generation section 61a, a video generation section 61b, a video distribution section 61c, a gift request processing section 61d, a gift purchase processing section 61e, and a co-starring application. It functions as a processing section 61f, a determining section 61g, a matching processing section 61h, and a privilege granting section 61i.

The animation generation unit 61a generates character animation by applying the face motion data generated by the face motion data generation unit 21a1 of the distribution user device 20 to predetermined model data included in the model data 63a. configured. The animation generation unit 61a can generate an animation of the character so that the facial expression of the character changes based on the face motion data. Specifically, the animation generation unit 61a can generate an animation of a character that moves in synchronization with the movement of the facial expression of the distribution user Ua, based on face motion data regarding the distribution user Ua. Similarly, the animation generation unit 61a can generate an animation of a character that moves in synchronization with the facial movements of the distribution user Ub, based on the face motion data regarding the distribution user Ub.

When the distribution user device 20 provides body motion data regarding the distribution users Ua, Ub, the animation generation unit 61a generates the distribution users Ua, Ub based on the body motion data and face motion data regarding the distribution users Ua, Ub. It is possible to generate character animation that moves in synchronization with the body and facial movements of the character.

When distributing the video of the distribution user Ua, the video generation unit 61b generates a background image indicating the background using the object data 63b, and combines this background image and the animation of the character corresponding to the distribution user Ua. You can generate videos that include The video generation unit 61b can synthesize the generated video with the audio of the distribution user Ua, which is generated based on the audio data received from the distribution user device 20a. Similarly, when distributing a video of a distribution user Ub, the video generation unit 61b generates a background image indicating the background using the object data 63b, and combines this background image with an animation of a character corresponding to the distribution user Ub. It is possible to generate a video containing . The video generation unit 61b can attach the object it owns to its own character in response to a request from the distribution user Ua or the distribution user Ub. The object that can be attached is, for example, the attachment object described above. By operating the distribution user device 20a or the distribution user device 20b, the distribution user Ua or the distribution user Ub sends a display request to the server device for equipping their own character with an attachment object before or after the start of video distribution. 60. Based on this display request, the video generation unit 61b can attach the attachment object to the character of the distribution user device 20a or the distribution user device 20b. The video generation unit 61b can synthesize the generated video with the audio of the distribution user Ub, which is generated based on the audio data received from the distribution user device 20b. In the video generated by the video generation unit 61b, the characters corresponding to the distribution users Ua and Ub are displayed superimposed on the background image. As described above, the video generation unit 61b generates an animation of a character that moves in synchronization with the facial movements of the distribution user Ua or distribution user Ub, and the voice of the distribution user Ua or distribution user Ub is synthesized with this animation. It is possible to generate videos for distribution. A co-starring video including both distribution user Ua's character and distribution user Ub's character will be described later.

The video distribution unit 61c distributes the video generated by the video generation unit 61b. This video is distributed via the network 50 to the viewing user device 10 and other viewing user devices. The generated video is also distributed to the distribution user devices 20a and 20b. The received video is played back on the viewing user device 10 and the distribution user devices 20a and 20b.

Display examples of videos distributed from the video distribution unit 61c are shown in FIGS. 6, 7a, and 7b. In these figures, it is assumed that the distribution user Ub uses the distribution user device 20b to distribute a video including his or her own character, and that the video is being played on the viewing user device 10 and the distribution user devices 20a and 20b. There is. In FIG. 7a, it is assumed that distribution user Ua is not distributing a video, but is viewing a video distributed by distribution user Ub, who is another distribution user. Therefore, in the explanations regarding FIGS. 6 and 7a to 7b, the distribution user Ua may also be referred to as a viewing user. FIG. 6 shows a display example of a video being played on the viewing user device 10, FIG. 7a shows a display example of a video being played on the distribution user device 20a, and FIG. 7b shows a display example of a video being played on the distribution user device 20b. An example of how a video is displayed is shown below.

As shown in FIG. 6, the video image 30 distributed from the server device 60 is displayed on the display of the viewing user device 10. The image 30 displayed on the viewing user device 10 includes a character 31 of the distribution user Ub generated by the animation generation unit 61a, a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35. and are included.

As shown in FIG. 7a, an image 40a of a moving image distributed from the server device 60 is displayed on the display of the distribution user device 20a. Similar to the image 30, this image 40a includes a character 31 of distribution user Ub, a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35. In addition, the image 40a includes a co-starring request button 36 for requesting co-starring with the distribution user Ub in the video that the distribution user Ub is distributing. The distribution user device 20a can display the image 40a of the distributed moving image, for example, by executing application software including a viewing program.

As shown in FIG. 6, in one embodiment, the image 30 of the viewing user device 10 does not include the co-starring request button 36. For example, if the application software including the distribution program is not downloaded or installed on the viewing user device 10, or if the application software including the distribution program is not activated on the viewing user device 10, the co-starring request button 36 is not included. The image 30 of the viewing user device 10 is generated such that the viewing user device 10 does not appear. In other embodiments, the co-starring request button 36 may also be displayed on the image 30 of the viewing user device 10. For example, when application software including a distribution program is downloaded or installed on the viewing user device 10, or when application software including a distribution program is activated on the viewing user device 10, the co-starring request button 36 is included. An image 30 of the viewing user device 10 is generated as follows.

As described above, the character 31 is generated by applying the facial motion data of the distribution user Ub to the model data included in the model data 63a, so that the character 31 is generated by applying the facial motion data of the distribution user Ub to the model data included in the model data 63a. The expression changes. When body motion data is provided from the distribution user device 20, the character 31 can be controlled so that parts other than its face also change in synchronization with the body movements of the distribution user Ub.

The gift button 32 is displayed on the image 30 so as to be selectable by operating the viewing user device 10. The gift button 32 can be selected, for example, by tapping an area of the touch panel of the viewing user device 10 in which the gift button 32 is displayed. In one embodiment, when the gift button 32 is selected, a window 30 for selecting a gift to gift to the distribution user (here, distribution user Ub) who is distributing the video being viewed is displayed. will be displayed. The viewing user can purchase a gift to be gifted from among the gifts displayed in the window. In other embodiments, in response to selection of gift button 32, image 30 displays a window containing a list of purchased gifts. In this case, the viewing user can select a gift to be gifted from among the gifts displayed in the window. Gifting or purchasable gifts may include effect gifts, regular gifts, wearable gifts, and other gifts.

The evaluation button 33 is displayed on the image 30 so as to be selectable by the viewing user using the viewing user device 10. The evaluation button 33 can be selected, for example, by a tap operation on a region of the touch panel of the viewing user device 10 in which the evaluation button 33 is displayed. When the evaluation button 33 is selected by the viewing user who is viewing the video, evaluation information indicating that the video has been positively evaluated may be transmitted to the server device 60. The server device 60 can aggregate evaluation information from the viewing user device 10 and other viewing user devices. By selecting the evaluation button 33, evaluation information indicating that the video has been negatively evaluated may be transmitted to the server device 60. Evaluation information indicating a positive evaluation of the video may be referred to as positive evaluation information, and evaluation information indicating that the video has been negatively evaluated may be referred to as negative evaluation information.

The comment button 34 is displayed on the image 30 so that it can be selected by the user. When the comment button 34 is selected, for example, by a tap operation, a comment input window for inputting a comment is displayed on the image 30. The viewing user can input comments via the input mechanism of the viewing user device 10 or the distribution user device 20a. The input comment is transmitted to the server device 60 from the viewing user device 10 and the distribution user device 20a. The server device 60 receives comments from the viewing user device 10, the distribution user device 20a, and other user devices, and displays the comments in the comment display area 35 within the image 30. In the comment display area 35, comments posted by each user are displayed, for example, in chronological order. The comment display area 35 occupies a part of the image 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When a comment exceeding the upper limit set in the comment display area 35 is posted, the comments are deleted from the comment display area 35 in the order of posting time. Therefore, the display time of each comment in the comment area 35 becomes shorter as the frequency of received comments increases. In one embodiment, a scroll bar is provided on the image 30, and comments deleted from the comment display area 35 can be viewed by operating the scroll bar to scroll the comments.

As shown in FIG. 7b, the video image 40b distributed from the server device 60 is displayed on the display of the distribution user device 20b. The image 40b displayed on the distribution user device 20b includes a character 31 corresponding to the distribution user Ub, display instruction buttons 42a to 42c for displaying the equipped gift requested to be displayed by the viewing user, and a comment display area. 35 is included. The image 40b displayed on the distribution user device 20b includes the same background image, character image, and comment as the images 30 and 40a. On the other hand, image 40b differs from images 30 and 40a in that it does not include gift button 32, evaluation button 33, comment button 34, and co-starring request button 36, but includes display instruction buttons 42a to 42c. .

The display instruction buttons 42a to 42c are displayed on the display screen 40 in response to receiving a display request from a viewing user to display a wearable gift, which will be described later. In the illustrated embodiment, three display instruction buttons 42a to 42c are displayed on image 40b. Each of the display instruction buttons 42a to 42c is displayed on the display screen 40 so as to be selectable by the distribution user. When one of the display instruction buttons 42a to 42c is selected, for example, by a tap operation, an operation is performed to display the fitted gift corresponding to the selected display instruction button. In this way, the display instruction buttons 42a to 42c are display instruction objects for instructing to display the wearing gift in the video being distributed. Therefore, in this specification, the display instruction buttons 42a to 42c are sometimes referred to as display instruction objects 42a to 42c. Furthermore, when there is no need to distinguish the display instruction objects 42a to 42c from each other, they may be simply referred to as display instruction objects 42. A specific example of the display of the fitted gift will be described later. Image 40b may be displayed on the supporter computer described above. The display instruction objects 42a to 42c may be selected according to the supporter's operation of the supporter computer.

Each time a display request for displaying an attached gift is received, a display instruction object 42 corresponding to that display request is added to the image 40b. There is an upper limit to the number of display instruction objects 42 that can be displayed on the image 40b. In the illustrated embodiment, the upper limit number of display instruction objects 42 that can be displayed on the image 40b is three. In this case, the image 40b has a display area that can display three display instruction objects. If four or more display requests for attached gifts are received, the display instruction objects 42 corresponding to the fourth and subsequent display requests are not displayed on the image 40b. The display instruction object 42 corresponding to the fourth-received display request for an attached gift is displayed on the image 40b when one of the three display instruction objects 42 already displayed is selected and a space is created in the display area.

The gift request processing unit 61d receives a gift display request from a viewing user, and performs processing for displaying a gift object according to the display request. Each viewing user can transmit a gift display request to the server device 60 by operating his or her own viewing user device. A gift display request includes the user ID of the viewing user, gift identification information (gift ID) that specifies the gift that is requested to be displayed, and/or object identification information (object ID) that specifies the gift object that corresponds to the gift that is requested to be displayed. ID) and may be included.

As described above, gift objects representing gifts may include an effect object corresponding to an effect gift, a normal object corresponding to a normal gift, and a fitted object corresponding to a fitted gift.

In one aspect, upon receiving a display request for a specific normal gift from a viewing user, the gift request processing unit 61d executes a process for displaying a normal object indicating the requested normal gift in a video based on the display request. Perform processing. For example, when a request is made to display a regular gift representing a bag, the gift request processing unit 61d displays a regular object 37a representing a bag on the image 30 based on the display request, as shown in FIG. Similarly, when a request to display a normal gift representing a stuffed bear is made, the gift request processing unit 61d displays a normal object 37b representing a stuffed bear in the image 30 based on the display request, as shown in FIG. will be displayed. Although not shown, normal objects 37a and 37b are also displayed on the image 40a on the distribution user device 20a and the image 40b on the distribution user device 20b, similar to the image 30.

In one embodiment, upon receiving a request to display a specific effect gift from a viewing user, the gift request processing unit 61d converts an effect object corresponding to the effect gift requested to be displayed into a display image of a video based on the display request. Perform processing for display. For example, when a request is made to display an effect gift showing confetti or fireworks, the gift request processing unit 61d generates an effect object (not shown) corresponding to the effect gift showing confetti or fireworks based on the display request. ) are displayed in images 30, 40a, and 40b.

The display request for a normal gift may include a display position designation parameter that designates the display position of a normal object representing the normal gift. In this case, the gift request processing unit 61d can display the normal object at the position designated by the display position designation parameter. When the display position and display range of the character 31 are determined, the display position designation parameter can designate a position relative to the character 31 as the display position of the normal object.

In one aspect, the normal object may be displayed as moving within the video image 30. For example, the normal objects 37a and 37b may be displayed so as to fall from the top to the bottom of the screen. In this case, the normal objects 37a and 37b may be displayed in the image 30 from the start of the fall until they fall to the bottom edge of the image 30, and may disappear from the image 30 after falling to the bottom edge of the image 30. The moving direction of the normal objects 37a and 37b within the screen can be set arbitrarily. For example, the normal objects 37a and 37b may move in the image 30 from left to right, from right to left, from upper left to lower left, or in any other direction. Normal objects 37a and 37b can move on various trajectories. For example, the normal objects 37a and 37b can move on a linear trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or other trajectory. In response to a normal object display request, in addition to or in place of the display position specification parameter, the viewing user requests a movement direction parameter that specifies the moving direction of the normal objects 37a, 37b, and the movement of the normal objects 37a, 37b. At least one of the trajectory parameters specifying the trajectory can be included. In one embodiment, among the effect objects and normal objects, those whose size in the virtual space is smaller than the reference size may be displayed on the character 31 so as to partially or entirely overlap. In one embodiment, among effect objects and normal objects, objects whose size in the image 30 is larger than a reference size are displayed at positions that do not overlap with the character 31. In another embodiment, among the effect objects and normal objects, those whose size in the virtual space is larger than a reference size may be displayed behind the character 31. The normal objects 37a and 37b may also be displayed moving in the image 40a and the image 40b as described above.

In one aspect, when the gift request processing unit 61d receives a request to display a specific wearable object from a viewing user, the gift request processing unit 61d displays a display instruction object on the image 40b on the distribution user device 20 based on the display request, as shown in FIG. 7b. 42a to 42c are displayed. Each of the display instruction objects 42a to 42c is associated with a fitted gift for which a display request has been made. When one of the display instruction objects 42a to 42c is selected, the wearing gift associated with the selected display instruction object is displayed in the video being distributed. For example, when the display instruction object 42b is associated with a headband imitating cat ears, when the display instruction object 42b is selected, the gift request processing unit 61d sends a headband that corresponds to the selected display instruction object 42b. A mounted object 38 indicating the following is displayed on the video being distributed. A display example of a moving image including a wearable object 38 representing a headband is shown in FIGS. 9 and 10a-10b. Also, as shown in FIG. 10b, the selected display instruction object 42b is deleted from the image 40b.

The attachment object is displayed in the video in association with a specific part (attachment part) of the character. For example, the wearing object may be displayed in the video so as to be in contact with the wearing part of the character. The attachment object 38 may be displayed in the video so as to be attached to the corresponding attachment site of the character. In one embodiment, a wearable object 38 representing a headband is associated with the character's head. Therefore, in the display examples shown in FIGS. 9 and 10a to 10b, the mounting object 38 is mounted on the character 31's head. The wearing object may be displayed on the video display screen so as to move along with the movement of the wearing part of the character. For example, when the head of the character 31 wearing the wearing object 38 representing a headband moves, the wearing object 38 representing the headband also attaches to the head of the character 31, as if the headband is attached to the head of the character 31. and move.

As described above, the gift object information 63c may include attachment part information indicating which part of the character the attachment object is associated with. In one aspect, when a wearable object is attached to the character, the gift request processing unit 61d is configured to display a part that is the same as or overlaps the part indicated by the wearing part information of the wearable object until the display time of the wearable object has elapsed. Prohibits display of other attached objects attached to the body part. For example, a headband that is associated with both "back left side of the head" and "back right side of the head" and a hair accessory associated with "back left side of the head" overlaps with "back left side of the head". Therefore, when a headband is displayed, display of a hair accessory whose wearing location information is set to "back left side of the head" is prohibited. On the other hand, headbands associated with the "back left side of the head" and "back right side of the head" and earrings associated with the "left ear (of the head)" and "right ear (of the head)" are Since the attachment parts on the character do not overlap, they can be attached at the same time.

In one embodiment, in order to prohibit the display of multiple wearing objects with the same or overlapping wearing parts, the display instruction object 42 for displaying the wearing object that is prohibited from being displayed may be deactivated. In the embodiment shown in FIG. 7b, it is assumed that the display instruction object 42a is an object (button) for instructing the display of a hair accessory with "left rear of head" set as the wearing part information. In this case, since the character 31 is wearing the wearing object 38 representing a headband, the wearing object representing this hair accessory is prohibited from being displayed in the video while the wearing object 38 is worn by the character 31. In one embodiment, in order to prohibit the wearing object representing this hair accessory from being displayed in the video, the display instruction object 42a associated with the wearing object representing the hair accessory is deactivated. For example, the display instruction object 42a is made unselectable even if it is operated while the wearing object 38 is worn by the character 31. In another embodiment, the display instruction object 42a is erased from the image 40b while the wearing object 38 is worn by the character 31. The deactivated display instruction object 42a is activated again when the display time of the headband has elapsed. To reactivate the display instruction object 42a, for example, the display instruction object 42a that was made unselectable may be made selectable again, or the display instruction object 42a that was hidden may be displayed again in the image 40b.

The gift request processing unit 61d performs processing for displaying a gift object in response to a gift display request from a viewing user, as well as processing for updating object display information 63e. For example, when the wearable object 38 is displayed in the video being distributed by the distribution user Ub, the object ID that identifies the attachment object 38a is associated with the user ID that identifies the distribution user Ub in the object display information 63e. be remembered. Similarly, when another wearable object is displayed, the object ID for identifying the displayed wearable object is stored in association with the user ID of the distribution user Ub. When the wearable object displayed in the video disappears from the screen (when the wearable object is no longer worn), the gift request processing unit 61d sends an object ID that identifies the wearable object that has disappeared from the screen to the object display information 63e. You can delete it from

In one embodiment, the gift purchase processing unit 61e, in response to a request from a video viewing user, transmits purchase information for each of a plurality of gift objects that can be purchased in relation to the video to the viewing user device of the viewing user (e.g. , to the viewing user device 10 and the distribution user device 20a). The purchase information for each gift object includes the type of gift object (effect object, normal object, or attached object), the image of the gift object, the price of the gift object, and information necessary for purchasing other gift objects. may be included. The viewing user can select a gift object to purchase based on the gift object purchase information displayed on the viewing user device 10 or the distribution user device 20a. The selection of the gift object to be purchased may be performed by operating the viewing user device 10 or the distribution user device 20a. When a gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 60. The gift purchase processing unit 61e performs payment processing based on the purchase request. When this payment process is completed, the purchased gift object is held by the viewing user. The gift ID of the purchased gift (or the gift object ID of the gift object indicating the gift) may be stored in the storage 23 in association with the user ID of the viewing user who purchased the gift. Purchasing gift objects may be performed using a lottery, a loot box, or a roulette wheel. That is, the viewing user may acquire a gift item through lottery, loot box, or roulette purchase without specifying the gift object to be purchased. In this specification, "purchasing" a gift item may also include obtaining a gift item without specifying the gift object to be purchased.

Purchasable gift objects may be different for each video. A purchasable gift object may be purchasable in multiple videos. That is, the purchasable gift objects may include a unique gift object unique to each video and a common gift object purchasable for multiple videos. For example, an effect object representing confetti may be a common gift object that can be purchased in multiple videos.

In one aspect, when an effect object is purchased while viewing a predetermined video, the effect object to be purchased is changed to the video being viewed in response to completion of payment processing for purchasing the effect object. It may be displayed automatically. If you purchase a normal object while watching a certain video, the normal gift object for the purchase will be transferred to the video being viewed in the same manner as above, upon completion of the payment process for purchasing the normal object. may be displayed automatically.

In another aspect, in response to completion of payment processing in the gift purchase processing unit 61e for the effect object to be purchased, a payment completion notification is sent to the viewing user device 10, and the purchase is completed in the viewing user device 10. A confirmation screen may be displayed to ask the viewing user whether or not to request the display of the effect object. When the viewing user selects to make a display request for the purchased effect object, a display request requesting the display of the purchased effect object is sent from the client device of the viewing user to the gift request processing unit 61d. The gift request processing unit 61d may perform a process of displaying the effect object to be purchased on the video 70. Even when the purchase target is a normal object, a confirmation screen may be displayed on the viewing user device 10 to ask the viewing user whether or not to make a display request for the purchased regular object, in the same manner as described above.

When there is a co-starring request from another distribution user to one distribution user, the co-starring request processing unit 61f allows the one distribution user and the other distribution user to virtually collaborate based on the co-starring request. Generate a co-starring video. In the following, a case will be described assuming that a distribution user Ua who is viewing a video including a character 31 of distribution user Ub requests to co-star with distribution user Ub. The co-starring application processing unit 61f can generate a co-starring video based not only on the co-starring request from the distribution user Ua but also on the co-starring requests from various distribution users.

In one embodiment, the co-starring application processing unit 61f receives a co-starring request from the distribution user Ua, and generates a co-starring video according to the co-starring request. Distribution user Ua can transmit a co-starring request to server device 60 by operating distribution user device 20a. Specifically, when the co-starring request button 36 displayed on the distribution user device 20a is selected, a co-starring request is transmitted from the distribution user device 20a to the server device 60. The co-starring request button 36 can be selected, for example, by tapping an area of the touch panel of the distribution user device 20a in which the co-starring request button 36 is displayed. In response to selection of the co-starring request button 36, application software including a distribution program may be activated on the distribution user device 20a. The co-starring request transmitted from the distribution user device 20a may include a user ID that identifies the distribution user Ua. The co-starring request button 36 may be displayed from the time the video is distributed, or may be displayed in response to distribution user Ub inviting distribution user Ua. Distribution user Ub may send an invitation from distribution user device 20b to distribution user device 20a to invite distribution user Ua to perform together, either through server device 60 or not through server device 60.

The co-starring application processing unit 61f may determine whether to permit the co-starring application in response to receiving the co-starring application from the distribution user device 20a. The co-starring application processing unit 61f can determine whether co-starring is possible based on various information regarding the distribution user Ua who has applied for co-starring. For example, if the evaluation of distribution user Ua from other users is higher than a predetermined standard, a request for co-starring from distribution user Ua can be permitted; conversely, if the evaluation of distribution user Ua from other users is higher than a predetermined standard If it is lower than the standard, the co-starring request from distribution user Ua can be rejected. Alternatively, the distribution user Ub may be inquired as to whether or not to permit a co-starring request from the distribution user Ua, and it may be determined whether co-starring is possible or not based on the answer.

In one embodiment, when a co-starring request from the distribution user Ua is permitted, the co-starring application processing unit 61f generates a co-starring video in which the distribution user Ua and the distribution user Ub co-star. In order to generate a co-starring video, the co-starring application processing unit 61f acquires face motion data and audio data of the distribution user Ua from the distribution user Ua. The face motion data of the distribution user Ua may be transmitted from the distribution user device 20a to the server device 60 together with the co-starring request, or may be sent from the distribution user device 20a to the server device 60 in response to a request from the server device 60 after the co-starring request is approved. The information may be sent to device 60. If distribution user Ua's body movements are also expressed as animation, body motion data may be provided to server device 60 along with distribution user Ua's face motion data. If face motion data cannot be acquired from distribution user Ua, co-starring application processing unit 61f may acquire only audio data from distribution user Ua. For example, if the distribution user device 20a used by the distribution user Ua does not have the function of the face motion data generation unit 21a1 or any other function for video distribution, if the function is disabled, or if In this case, the co-starring application processing unit 61f may obtain voice data without obtaining face motion data (and body motion data) from distribution user Ua.

In one embodiment, the co-starring application processing unit 61f generates a co-starring image by adding animation of the character of broadcast user Ua to a video including character 31 of broadcast user Ub based on the facial motion data of broadcast user Ua. The animation of the character of broadcast user Ua may be generated by animation generation unit 61a based on the facial motion data of broadcast user Ua. The animation of the character of broadcast user Ua may be generated by applying the facial motion data of broadcast user Ua to model data for broadcast user Ua included in model data 63a. For example, the co-starring application processing unit 61f can generate a co-starring video including the character of broadcast user Ua and character 31 of broadcast user Ub by generating a layer including animation of the character of broadcast user Ua and superimposing this layer on a video including character 31 of broadcast user Ub. When the co-starring application processing unit 61f acquires voice data but not face motion data (and body motion data) from the broadcast user Ua, it can generate a co-starring video including the character 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing a voice generated based on the voice data acquired from the broadcast user Ua onto a video including the character 31 of the broadcast user Ub. Even when model data for the broadcast user Ua is not set as the model data 63a, the co-starring application processing unit 61f can generate a co-starring video including the character 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing a voice generated based on the voice data acquired from the broadcast user Ua onto a video including the character 31 of the broadcast user Ub. In this way, the broadcast user Ua can co-star with the broadcast user Ub using his or her own voice.

When the face motion data cannot be acquired from the distribution user Ua, the co-starring application processing unit 61f distributes the co-starring video including the voice of the distribution user Ua and the character 31 of the distribution user Ub, and then acquires the face motion data from the distribution user Ua. By generating the character of the distribution user Ua based on the face motion data of the distribution user Ua at the appropriate timing, it is possible to generate a co-starring video including the character of the distribution user Ua and the character 31 of the distribution user Ub. In this way, the co-starring application processing unit 61f can switch the co-starring video including the voice of the distribution user Ua and the character 31 of the distribution user Ub to the co-starring video including the character of the distribution user Ua and the character 31 of the distribution user Ub. . On the contrary, the co-starring application processing unit 61f switches the co-starring video including the character of the distribution user Ua and the character 31 of the distribution user Ub to the co-starring video including the voice of the distribution user Ua and the character 31 of the distribution user Ub. I can do it. In this way, co-starring videos in which co-starring voices are performed (sometimes referred to as "audio co-starring videos") and co-starring videos in which co-starring characters are performed (sometimes referred to as "character co-starring videos"). ) may be alternately switchable.

The generated co-starring video is distributed by the video distribution unit 61c. The co-starring video may be created by the distribution user device 20a or the distribution user device 20b. When the co-starring video is generated by the distribution user device 20a, the co-starring video is transmitted from the distribution user device 20a to the server device 60, and distributed by the video distribution unit 61c of the server device 60. When the co-starring video is generated by the distribution user device 20b, the co-starring video is transmitted from the distribution user device 20b to the server device 60, and distributed by the video distribution unit 61c of the server device 60.

Display examples of co-starring videos distributed from the video distribution unit 61c are shown in FIGS. 11 and 12a to 12b. In these figures, distribution user Ua requests co-starring for a video distributed by distribution user Ub, and as a result, a co-starring video including the distribution user Ua's character and the distribution user's character is distributed. It is assumed that the distribution user Ua selected the co-starring request button 36 while viewing the image shown in FIG. 10a.

As shown in FIG. 11, an image 130 of the co-starring video distributed from the server device 60 is displayed on the display of the viewing user device 10. The image 130 of the co-starring video displayed on the viewing user device 10 includes a character 131 of the distribution user Ua in addition to the character 31 of the distribution user Ub. As described above, the character 131 of the distribution user Ua is generated by the animation generation unit 61a or the co-starring application processing unit 61f. The co-starring video image 130 includes a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35, similar to the original distribution image shown in FIG.

The co-starring video image 130 is displayed in a horizontally long manner as shown. When the co-starring image is distributed, the co-starring application processing unit 61f or the video distribution unit 61c distributes the co-starring image as a horizontally long image. Thereby, the co-starring video is displayed as a horizontally long image 130 on the viewing user device 10. In one embodiment, as shown in FIG. 6, even if the original video (image) is vertically oriented, the co-starring image is converted into horizontally oriented image and distributed. Since the co-starring image includes the characters of two distribution users, by making the image horizontally long, it becomes easier to display the characters of the two users without overlapping. For example, in a co-starring image, the left half from the viewing user's perspective is allocated to the character of the original distribution user (host user), and the right half is allocated to the character of the distribution user (guest user) who requested co-starring. It may also be an allocated area. The allocation of areas to each distribution user may be arbitrarily determined so that characters do not overlap.

12a and 12b, image 140a of the co-starring video distributed from the server device 60 is displayed on the broadcast user device 20a, and image 140b of the co-starring video is displayed on the display of the broadcast user device 20b. These images 140a and 140b contain the same background image, character image, and comment as image 130. On the other hand, images 140a and 140b differ from image 130 in that they do not contain the gift button 32, the rating button 33, and the comment button 34, but contain the display instruction buttons 42a, 42c, and 42d. Since broadcast user Ua and broadcast user Ub appear together in the same co-starring image, image 140a displayed on broadcast user device 20a of broadcast user Ua and image 140b displayed on broadcast user device 20b of broadcast user Ub may be the same. Images 140a and 140b are also displayed horizontally in the same way as image 130, from the viewpoint of arranging multiple characters without overlapping. In the example shown in FIG. 11 and FIG. 12a-FIG. 12b, it is assumed that a viewing user viewing the co-starring image shown in FIG. 11 makes a display request for a wearing gift showing earrings, and as a result, a display instruction object 42d is added to the display image of the broadcast user device 20a and the broadcast user device 20b in response to the display request. The display instruction object 42d is an object (button) for instructing the display of earrings with "ear" set as the wearing body part information.

The determination unit 61g determines, when an object is displayed in association with one of the characters of the host user and the guest user in the co-starring video, whether the same object is displayed in association with the other character. do. Therefore, when one of the characters of the host user and the guest user is wearing a wearable object, the determination unit 61g can determine whether the other character is wearing the same wearable object. The determination by the determination unit 61g may be performed with reference to the object display information 63e. As described above, in the object display information 63e, an object ID is stored that specifies the attached object that is displayed in association with the distribution user's character in the video in association with the distribution user's account information. Therefore, based on the object display information 63e, it is possible to specify the mounted object mounted on the host user's character 31 and the mounted object mounted on the guest user's character 131. The determining unit 61g can determine whether the host user and the guest user are wearing the same wearing object based on the object display information 63e.

A specific example of the determination by the determination unit 61g will be described using the co-starring video displayed in FIG. 11 as an example. In the image 130 of the co-starring video shown in FIG. 11, the wearable object 38 is displayed in association with the host user's character 31, while the wearable object displayed in association with the guest user's character 131 is not exist. Therefore, based on the object display information 63e, the determination unit 61g determines that the mounted object 38 displayed in association with the host user's character 31 is not displayed in association with the guest user's character 131 (the character 131 is not displayed in association with the guest user's character 131). It is determined that the attached object 38 is not attached. If at least one of the host user's character 31 and the guest user's character 131 is wearing a plurality of wearable objects, the determination unit 61g can make the above determination for each of the plurality of wearable objects.

The matching processing unit 61h displays a matching object in the co-starring video according to the determination result of the determination unit 61g. Specifically, the determination unit 61g determines that when a wearable object is displayed for one of the characters of the host user and the guest user, an object identical to the wearable object is not displayed in association with the other character. When a matching object is displayed in association with the other character, a matching object that is the same as the object displayed in association with the one character is displayed.

A specific example of processing in the matching processing section 61h will be described with reference to FIGS. 11 and 13. When the co-starring video illustrated in FIG. 11 is distributed, the determination unit 61g determines that the wearable object 38 displayed in association with the character 31 of the distribution user Ub (host user) is ) is not displayed in association with the character 131. Based on the determination by the determining unit 61g, the matching processing unit 61h displays the matching object 138 in association with the guest user's character 131 who is not wearing the wearing object 38. In other words, the matching object 138 is attached to the character 131. Matching object 138 is the same object as attachment object 38. In the illustrated example, the wearing object 38 and the matching object 138 are both objects representing headbands imitating cat ears. Since the attached object 38 and the matching object 138 are the same attached object, they may be identified by the same object ID.

The matching processing unit 61h may perform a process of displaying the matching object based on a display request requesting display of the matching object. In one embodiment, the matching processing unit 61h determines that the wearable object 38 that is displayed in association with the host user's character 31 in the co-starring video is not displayed in association with the guest user's character 131. , processing can be performed to prompt the viewing user of the co-starring video to send a request to display a matching object. For example, the gift button 32 may be highlighted in the image 130 of the viewing user device 10 that is playing the co-starring video. The gift button 32 can be highlighted, for example, by blinking the gift button 32, changing the color of the gift button 32, changing the size of the gift button 32, or in other ways than described above. Various aspects can be considered for the process of prompting the viewing user to request display of the matching object. The process of prompting the viewing user to request the display of matching objects includes, for example, a process of highlighting the wearable object 38 attached to the character 31 in the image 130, a process of highlighting the wearable object 38 attached to the character 31 in the image 130, a process of displaying the attachable object 38 attached to only one character in the image 130, etc. This may include a process of displaying a message indicating that the matching object has been matched, a process of displaying a message prompting to request display of another matching object, and other processes other than the above.

The viewing user can operate the viewing user device 10 to transmit a matching object display request to the server device 60 when the viewing user is prompted to request the display of the matching object. For example, the viewing user may select the same object as the attached object 38 as the object to be gifted by operating the gift button 32, and may transmit a request to display the selected object (matching object) to the server device 60. I can do it. The matching object display request may include an object ID that identifies the matching object to be displayed. When the server device 60 receives a matching object display request from the viewing user device 10, the gift request processing unit 61d displays the matching object 138 in association with the character 131 based on the display request. Since the matching object 138 is a type of attached object, the matching object is included in at least one of the image 140a displayed on the distribution user device 20a and the image 140b displayed on the distribution user device 20b when a request to display the matching object is made. A display instruction object associated with 138 may be displayed. In this case, the matching object 138 may be displayed in the co-starring video in response to the selection of the display instruction object associated with the matching object 138. The matching object 138 may be displayed in the co-starring video in response to a request to display the matching object 138 being accepted by the server device 60, regardless of the selection of the display instruction object.

A display example of the matching object 138 is shown in FIG. FIG. 13 shows a display example of an image of a co-starring video in which a matching object 138 is displayed in association with a character 131. As shown in FIG. 13, in the co-starring video 130 displayed on the viewing user device 10, a matching object 138 is displayed in association with the character 131. A matching object 138 is similarly displayed in association with the character 131 in an image 140a displayed on the distribution user device 20a and an image 140b displayed on the distribution user device 20b. As illustrated, the attachment object 38 and the matching object 138 are attached to the same attachment site of the character 31 and the character 131. Specifically, the mounting object 38 and the matching object 138 are displayed in association with the head of the character 31 and the head of the character 131, respectively.

In another embodiment, the matching processing unit 61h determines that the wearable object 38 displayed in association with the host user's character 31 in the co-starring video is not displayed in association with the guest user's character 131. Additionally, processing can be performed to prompt the user (distribution user Ua) of the character 131 who is not wearing the wearing object 38 to send a request to display the matching object. Various aspects can be considered for the process of prompting the distribution user Ua, who is the user of the character 131 who is not wearing the wearing object 38, to request the display of the matching object. The process of prompting the distribution user Ua to request the display of matching objects includes, for example, a process of highlighting the wearable object 38 worn by the character 31 in the image 140a, a process of highlighting the wearable object 38 worn by the character 31 in the image 140a, and a process of highlighting the wearable object 38 worn by only one character in the image 140a. This may include a process of displaying a message indicating that the object is attached, a process of displaying a message prompting a request to display a matching object other than this, and other processes other than the above. When the process of prompting the distribution user Ua to request the display of a matching object is performed, the distribution user Ua can operate the distribution user device 20a to transmit a request to display the matching object to the server device 60. The video generation unit 61b displays the matching object 138 in association with the character 131 based on the display request.

In another embodiment, the matching processing unit 61h determines that the wearable object 38 displayed in association with the host user's character 31 in the co-starring video is not displayed in association with the guest user's character 131. In addition, processing can be performed to prompt the user (distribution user Ub) of the character 31 wearing the wearing object 38 to send a request to display the matching object. Various aspects can be considered for the process of prompting the distribution user Ub, who is the user of the character 31 wearing the wearing object 38, to request the display of the matching object. The process of prompting the distribution user Ub to request the display of matching objects includes, for example, a process of highlighting the wearable object 38 attached to the character 31 in the image 140b, a process of highlighting the wearable object 38 attached to the character 31 in the image 140b, and a process of highlighting the attached object 38 attached to the character 31 in the image 140b. This may include a process of displaying a message indicating that the object is attached, a process of displaying a message prompting a request to display a matching object other than this, and other processes other than the above. When the process of prompting the distribution user Ub to request the display of a matching object is performed, the distribution user Ub can operate the distribution user device 20b to transmit a request to display the matching object to the server device 60. The video generation unit 61b displays the matching object 138 in association with the character 131 based on the display request.

By displaying the matching object 138 in the co-starring video, both the character 31 and the character 131 wear the same wearing object. This improves the consistency of co-starring videos. More specifically, in the co-starring video, the consistency of appearance between the host user's character and the guest user's character is improved.

The matching object 138 is displayed in the co-starring video based on a request to display the matching object 138 by the viewing user, a display request by the distribution user Ua, or a display request by the distribution user Ub. The matching object 138 may be attached to the character 131 only in the co-starring video. In other words, a matching object (e.g., matching object 138) displayed in a specific co-starring video based on a display request for the matching object 138 by the viewing user, a display request by the distribution user Ua, or a display request by the distribution user Ub, Cannot be used by other videos.

When a matching object is displayed in association with the character of one of the users co-starring in the co-starring video, the privilege granting unit 61i provides a privilege to the other user. For example, in the examples shown in FIGS. 11 and 13, when the matching object 138 is displayed in association with the character 131, the privilege granting unit 61i provides a privilege to the distribution user Ub who is the user of the character 31. Grant. The benefit granting unit 61i may grant a benefit to the distribution user Ua who is the user of the character 131 when the matching object 138 is displayed in association with the character 131. The benefit granting unit 61i may grant a benefit when the matching object 138 is displayed in association with the character 131 and to the viewing user who is viewing the co-starring video. The benefit granting unit 61i may grant benefits to all of the viewing users who are viewing the co-starring video, or may grant benefits to only some of the viewing users who are viewing the co-starring video. Also good. The benefit granting unit 61i may grant a benefit to each of the distribution user Ua, the distribution user Ub, and the viewing user. The benefit granting unit 61i may grant a benefit only to the viewing users who have gifted the matching object 138 among the viewing users who are viewing the co-starring video. The benefits given by the benefit granting unit 61i include points that can be used in the video distribution service provided by the video distribution system 1, points that can be used on a specific platform other than the video distribution system 1, crypto assets such as Bitcoin, It may include gifts to be given to other distribution users (for example, distribution user Ub), objects that can be displayed in distributed videos, and various other benefits.

Next, a video distribution process according to one aspect will be described with reference to FIGS. 14 to 16. FIG. 14 is a flowchart showing the flow of video distribution processing in one embodiment, FIG. 15 is a flowchart showing the flow of processing for distributing co-starring videos in one embodiment, and FIG. FIG. 3 is a flowchart showing the flow of processing for displaying matching objects in FIG. In the video distribution process described with reference to these figures, a video generated based on face motion data obtained by a distribution user Ub using the distribution user device 20b is distributed, and the video is viewed and viewed by the distribution user Ub. It is assumed that a request for co-starring will be made from distribution user Ua.

First, in step S11, face motion data that is a digital representation of facial movements (expressions) of distribution user Ub is generated. Generation of the face motion data is performed, for example, by the face motion data generation unit 121b of the distribution user device 20b. In the distribution user device 20b, audio data may be generated based on voice input from distribution users Ua and Ub. The generated face motion data and audio data are transmitted to the server device 60.

Next, in step S12, the face motion data from the distribution user device 20b is applied to the model data for the distribution user Ub, thereby generating an animation of the character object 31 that moves in synchronization with the facial movements of the distribution user Ub. be done. This animation is generated, for example, by the animation generation section 61a described above.

Next, in step S13, a video including the animation of the character object 31 of the distribution user Ub is generated. The voice of distribution user Ub may be synthesized with this video. The animation of the character object 31 is displayed superimposed on the background image. The generation of this moving image is performed, for example, by the above-mentioned moving image generation unit 61b.

Next, the process moves to step S14, and the video generated in step S13 is distributed. This moving image is distributed via the network 50 to the viewing user device 10, other viewing user devices, and distribution user devices. When the distributed video is played back on the viewing user device 10, an image of the video as shown in FIG. 5, for example, is displayed on the viewing user device 10. The video is continuously distributed over a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, or any other time. Distribution of this moving image is performed, for example, by the above-mentioned moving image distribution unit 61c.

Next, the process advances to step S15, and it is determined whether the termination condition for terminating the distribution of the moving image is fulfilled. The termination condition is, for example, that the distribution termination time has been reached, that distribution user Ub has performed an operation to terminate distribution on distribution user device 20b, or other conditions. If the termination condition is not met, the processes of steps S11 to S14 are repeatedly executed, and a video containing animation synchronized with the movements of the distribution user Ub, or a co-starring video if the co-starring with the distribution user Ua continues. distribution will continue. If it is determined that the termination condition is fulfilled for the video, the distribution process for the video is ended.

Next, with reference to FIG. 15, a co-star video distribution process in one embodiment will be described. FIG. 15 is a flow diagram showing the flow of processing for distributing a co-starring video in one embodiment. In the co-starring video distribution process described with reference to FIG. 15, it is assumed that a co-starring request is made to the distribution user Ub from the distribution user Ua who is viewing a video including the character object of the distribution user Ub. ing. The co-star video distribution process is performed in parallel with the video distribution process shown in FIG. 14.

First, during distribution of a video including a character object of distribution user Ub, in step S21, it is determined whether a co-starring request has been made by a user other than distribution user Ub. A co-starring request is made by distribution user Ua, for example. If the request for co-starring is made by distribution user Ua, the process proceeds to step S22.

In step S22, one or more guest users are selected from the distribution user Ua who has applied for co-starring and other users. In this embodiment, it is assumed that distribution user Ua is selected as a guest user. The determination as to whether or not to permit this co-starring request is made, for example, by the co-starring application processing unit 61f.

If the co-starring request from broadcast user Ua is approved in step S22, processing proceeds to step S23. In step S23, animation of broadcast user Ua's character object 131 is generated based on the face motion data of broadcast user Ua. Then, a co-starring video is generated by adding animation of broadcast user Ua's character object 131 to the video being distributed (video including broadcast user Ub's character object 31). The processing in step S22 is performed, for example, by the co-starring request processing unit 61f described above.

Next, the process moves to step S24. In step S24, the co-starring video generated in step S23 is distributed. This co-starring video is distributed to the viewing user device 10, other viewing user devices, and distribution user devices via the network 50. The co-starring video includes, for example, the animation of the character object 131 of the distribution user Ua and the animation of the character object 31 of the distribution user Ub, as shown in FIGS. 11 and 12a to 12b.

Next, the process moves to step S25. In step S25, it is determined whether the co-starring end condition is satisfied. For example, when the character object 131 of distribution user Ua who is a guest user is in a non-active state, when the co-starring user evaluation point falls below a predetermined threshold, or when an instruction to end co-starring is received from distribution user Ub who is a host user. , or that a predetermined time or more has elapsed since the start of distribution of the co-starring video, it is determined that the co-starring end condition is satisfied. If the co-starring end condition is satisfied, the process proceeds to step S26.

In step S26, processing is performed to end the distribution of the co-starring video. For example, the character object 131 of distribution user Ua, who is a guest user, is removed from the co-starring video, thereby ending the co-starring performance between distribution user Ua and distribution user Ub. Even if the co-starring ends, the video may continue to be distributed. The video distributed after the co-starring ends does not include the character object 131 of the distribution user Ua.

Next, with further reference to FIG. 16, the flow of processing for displaying a matching object in one embodiment will be described. In the display processing for a matching object described with reference to FIG. 16, as shown in FIG. 11, a co-starring video is distributed in which a character 31 of a broadcast user Ub and a character 131 of a broadcast user Ua appear together, and it is assumed that the character 131 is not wearing the wearing object 38 that the character 31 is wearing. The display processing for a matching object may be performed in parallel with the distribution processing for the co-starring video shown in FIG. 15.

First, in step S31, a co-starring video in which the character 31 of the distribution user Ub and the character 131 of the distribution user Ua co-star is distributed. The co-starring video is generated and distributed by, for example, the co-starring application processing section 61f and the video distribution section 61c.

Next, in step S32, it is determined whether the characters co-starring in the co-starring video are wearing the same wearing object. The determination process in step S32 is performed by, for example, the determination unit 61g described above. In the co-starring video, one of the co-starring characters, the character 31, is wearing the wearable object 38, so it is difficult to determine whether the other co-starring character, the character 131, is wearing the wearable object 38. It will be judged. If the character 131 is wearing the same object as the wearing object 38, the matching object display process ends. If the character 131 is not wearing the same object as the wearing object 38 as in the example shown in FIG. 11, the process proceeds to step S33.

In step S33, it is determined whether a request to display a matching object has been made. A request to display a matching object is made by, for example, a co-starring video viewing user, a distribution user Ua, or a distribution user Ub. In step S33, a process may be performed to prompt at least one of the viewing user of the co-starring video, the distribution user Ua, and the distribution user Ub to transmit a matching object display request. The viewing user of the co-starring video, the distribution user Ua, or the distribution user Ub operates the viewing user device 10, the distribution user device 20a, or the distribution user device 20b in response to the process of prompting the transmission of the matching object display request. A matching object display request can be sent to the server device 60. A determination as to whether a request to display a matching object has been made is made, for example, in the matching processing unit 61h. If a request to display a matching object is made, the process advances to step S34.

In step S34, display processing for displaying matching objects is performed. For example, a matching object 138 is displayed in association with a character 131 in a co-starring video. As described above, the character 31 of the distribution user Ub and the character 131 of the distribution user Ua can wear the same attachment object in the co-starring video.

The matching object display process shown in FIG. 16 may be repeatedly performed during distribution of the co-starring video. In the matching object display process, the matching object may be automatically displayed in response to a determination that the characters co-starring are not wearing the same wearing object. Therefore, step S33 can be omitted.

Next, examples of the effects of the above embodiment will be described. According to the above embodiment, it is possible to attach the same attachment object to each of the characters co-starring in the co-starring video. For example, when the character 31 is wearing the wearing object 38 in the co-starring video, it is possible to make the character 131 wear the same matching object 138 as the wearing object. Thereby, the uniformity of co-starring videos can be improved.

According to the above embodiment, the matching object is made available only in the co-starring video in which the matching object is displayed. In one embodiment, a distribution user purchases an object (for example, a wearable object) that is displayed in association with a character in a video, and displays the object in the video. For this reason, if an object that the user has purchased for a fee is given to another user as a co-acting partner in a manner that allows the user to freely use it free of charge, there will be a lack of fairness between the users. In the above embodiment, the matching object displayed in the co-starring video is available only in the co-starring video and cannot be used in other videos. In this way, by limiting the scope of use of matching objects, it is possible to improve the uniformity of co-starring videos and maintain fairness among users of the video distribution system.

According to the above embodiment, a matching object can be displayed in a co-starring video based on a display request from a viewing user. Therefore, according to the above embodiment, it is possible to encourage gifting of matching objects by viewing users. If the viewing user does not own the matching object, the viewing user may purchase the matching object and then gift it. In this case, the purchase of matching objects is also promoted.

According to the above embodiment, a matching object can be displayed in a co-starring video based on a display request from a user of a character wearing the attachment object (e.g., broadcast user Ub). Therefore, according to the above embodiment, a user who does not own an attachment object or owns a small number of attachment objects can be given an incentive to appear in a co-starring video.

According to the above embodiment, a matching object can be displayed in a co-starring video based on a display request from a user of a character who is not wearing an attachment object (for example, distribution user Ua). If the user of the character who does not have the matching object equipped does not have the matching object at the time he or she is prompted to request the display of the matching object, the user purchases the matching object and then requests the display. . Therefore, according to the embodiment described above, it is possible to promote the purchase of a matching object by a user whose character is not wearing an attachment object.

According to the above embodiment, the matching object 138 is displayed in association with the character of distribution user Ua among distribution user Ua (guest user) and distribution user Ub (host user) co-starring in the co-starring video. In this case, a privilege is given to the distribution user Ub who is the host user. Therefore, when distributing co-starring videos, wearing the wearable object provides an opportunity to receive benefits. Therefore, it is possible to provide incentives for participants (host users and guest users) to wear as many wearable objects as possible in the co-starring video. This facilitates the acquisition and purchase of wearable objects.

According to the above embodiment, when the matching object 138 is displayed in association with the character of the distribution user Ua among the distribution users Ua and distribution users Ub who co-star in the co-starring video, the distribution user Ua who is the guest user A privilege is granted to user Ua. Therefore, by becoming a guest user in a co-starring video, benefits can be obtained, and viewing users can be encouraged to apply for co-starring.

According to the above-mentioned embodiment, a privilege is given to the viewing user who has gifted the matching object 138 among the viewing users who are viewing the co-starring video. Thereby, it is possible to provide an incentive for gifting the matching object 138 to the viewing user.

According to the above embodiment, when the matching object 138 is displayed in association with the character of the distribution user Ua among the distribution users Ua and distribution users Ub who co-star in the co-starring video, the distribution user Ua, the distribution Benefits may be provided to each of the user Ub and the viewing user. As a result, benefits will be given to all users who are involved in the co-starring video, so gifting and message sending will become more active after the benefits are given, and it will be possible to create excitement in the co-starring video. can.

According to the above embodiment, the matching object is attached to the same attachment site as the matching object worn by the co-starring partner. For example, the matching object 138 is attached to the same attachment site (ie, the head) as the attachment object 38. This can further improve the sense of unity in co-starring videos.

In the video distribution system 1 according to the embodiment described above, distribution users Ua and Ub can distribute videos including characters that move according to their facial expressions using distribution user devices 20 equipped with cameras such as smartphones. In this way, in the video distribution system 1, the equipment for distribution users Ua and Ub to distribute videos is simplified, so a platform in which distribution users Ua and Ub can easily participate is realized.

In the processing procedures described in this specification, particularly those explained using flowcharts, some of the steps constituting the processing procedure may be omitted, and some of the steps constituting the processing procedure may be omitted. It is possible to add steps that are not specified and/or change the order of the steps, and such omissions, additions, or changes in the order of processing procedures are also included in the present invention as long as they do not depart from the spirit of the present invention. within the scope of the invention.

At least some of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the video distribution system 1. At least part of the functions realized by the computer processor 61 may be realized by the computer processor 21 of the distribution user device 20 or the computer processor of the viewing user device 10, for example. Specifically, part or all of the functions of the animation generation unit 61a and the video generation unit 61b may be executed in the distribution user device 20. For example, a video generated by the distribution user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

When a distribution user Ua who is viewing a video including the character 31 of the distribution user Ub requests to co-star with the distribution user Ub, the animation of the character 131 of the distribution user Ua who has made the co-starring request is transferred to the server device 60. , the distribution user device 20a of the distribution user Ua, the distribution user device 20b of the distribution user Ub, the viewing user device 10, or a device other than these. In one example, when the animation of the character 131 of the distribution user Ua is generated by the distribution user device 20b of the distribution user Ub, the animation of the distribution user Ua's character 131 is generated from the distribution user device 20a of the distribution user Ua to the distribution user device 20b of the distribution user Ub. , face motion data and audio data of distribution user Ua are transmitted. The distribution user device 20b generates the animation of the character 131 by applying the face motion data and audio data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua. This model data for distribution user Ua may be transmitted from server device 60 to distribution user device 20a. In another example, when the animation of the character 131 of the distribution user Ua is generated by the viewing user device 10, the distribution user Ua's face motion data and The audio data is transmitted, and the distribution user Ub's face motion data and audio data are transmitted from the distribution user device 20b of the distribution user Ub to the viewing user device 10. In the viewing user device 10, the animation of the character 131 is generated by applying the face motion data and audio data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua, and the animation of the character 131 is generated by applying the face motion data and audio data of the distribution user Ua received from the distribution user device 20a. The animation of the character 31 may be generated by applying the face motion data and voice data of the distribution user Ub to the model data for the distribution user Ub. The model data for the distribution user Ua and the model data for the distribution user Ub may be transmitted from the server device 60 to the viewing user device 10. In this way, the co-star video including the animation of the distribution user's character and/or the animation of the character object can be generated by any device included in the video distribution system 1. Animation of the character may be generated with equipment not explicitly shown in FIG. The distribution user Ua's face motion data and audio data are transmitted from the distribution user device 20a of the distribution user Ua to the device that generates character animation, and the distribution user Ub's face motion data and voice data are transmitted from the distribution user device 20b of the distribution user Ub. Audio data is transmitted. Body motions may be transmitted in addition to face motions.

Further, generation of a co-starring video including the generated character 131 of the distribution user Ua, the distribution video of the distribution user Ub, and the character 31 is performed by the server device 60, the distribution user device 20a of the distribution user Ua, and the distribution user device of the distribution user Ub. 20b or the viewing user device 10. The co-starring video may be generated in a shared manner by the server device 60, the distribution user device 20a, the distribution user device 20b, the viewing user device 10, and devices other than these. When a gift object is included in the co-starring video, data for displaying the gift object may be transmitted from the server device 60 or another device to the device that generates the co-starring video.

The co-starring video may include characters of three or more distribution users. That is, three or more distribution users may virtually co-star in a video using their respective characters.

Below, the invention described in the claims of the original application of this application at the time of filing will be added.
[1]
comprising one or more computer processors;
The one or more computer processors may execute computer readable instructions to:
Distributing a co-starring video including a first character generated based on the movement of the first user and a second character generated based on the movement of the second user,
displaying a matching object that is the same as a first object displayed in association with the first character and that can only be used in the co-starring video in association with the second character in the co-star video;
Video distribution system.
[2]
the matching object is an object purchased by the first user;
The video distribution system described in [1].
[3]
determining whether a matching object identical to the first object is displayed in association with the second character;
If it is determined that the matching object is not displayed in association with the second character, prompting to make a display request to display the matching object in association with the second character;
displaying the matching object in association with the second character in the co-starring video based on the display request;
The video distribution system according to [1] or [2].
[4]
If it is determined that the matching object is not displayed in association with the second character, the matching object is displayed in association with the second character for one or more viewing users who are viewing the co-starring video. prompting you to make a display request to display the
The video distribution system described in [3].
[5]
If it is determined that the matching object is not displayed in association with the second character, prompting the first user to make a display request to display the matching object in association with the second character. ,
The video distribution system described in [3] or [4].
[6]
If it is determined that the matching object is not displayed in association with the second character, prompting the second user to make a display request to display the matching object in association with the second character. ,
The video distribution system according to any one of [3] to [5].
[7]
giving a benefit to the first user when the matching object is displayed in association with the second character in the co-starring video;
The video distribution system according to any one of [1] to [6].
[8]
giving a benefit to the second user when the matching object is displayed in association with the second character in the co-starring video;
The video distribution system according to any one of [1] to [6].
[9]
When the matching object is displayed in association with the second character in the co-starring video, a benefit is given to one or more viewing users who are viewing the co-starring video.
The video distribution system according to any one of [1] to [6].
[10]
The matching object is displayed in response to a display request made by a first viewing user among one or more viewing users viewing the co-starring video to display the matching object in association with the second character. giving a benefit to the first viewing user if
The video distribution system according to any one of [1] to [6].
[11]
When the matching object is displayed in association with the second character in the co-starring video, each of the first user, the second user, and one or more viewing users viewing the co-starring video give benefits to
The video distribution system according to any one of [1] to [6].
[12]
The co-starring video is generated in response to receiving a co-starring request from the second user for co-starring with the first user.
The video distribution system according to any one of [1] to [11].
[13]
The first object is displayed in association with the attachment part of the first character,
The matching object is displayed in association with the attachment part of the second character.
The video distribution system according to any one of [1] to [12].
[14]
A video distribution method performed by one or more computer processors executing computer-readable instructions, the method comprising:
A co-starring video including a first character generated based on a first user's movement, a second character generated based on a second user's movement, and a first object displayed in association with the first character. The process of distributing
displaying a matching object that is the same as the first object and can only be used in the co-starring video in association with the second character in the co-starring video;
A video distribution method that includes
[15]
one or more computer processors;
A co-starring video including a first character generated based on a first user's movement, a second character generated based on a second user's movement, and a first object displayed in association with the first character. The process of distributing
displaying a matching object that is the same as the first object and can only be used in the co-starring video in association with the second character in the co-starring video;
A video distribution program that runs

1 Video distribution system 10 Viewing user device 20a, 20b Distribution user device 61a Animation generation section 61b Video generation section 61c Video distribution section 61d Gift request processing section 61e Gift purchase processing section 61f Co-starring application processing section 61g Judgment section 61h Matching processing section 61i Benefits Granting part

Claims (17)

comprising one or more computer processors;
The one or more computer processors may execute computer readable instructions to:
A first character generated based on a first user's movement, a second character generated based on a second user's movement, and a second character generated based on a first display request are displayed in association with the first character. Deliver a co-starring video including the first object,
In the co-starring video, displaying a matching object that is the same as the first object in association with the second character based on a second display request;
Video distribution system. determining whether a matching object identical to the first object is displayed in association with the second character;
If it is determined that the matching object is not displayed in association with the second character, prompting one or more viewing users who are viewing the co-starring video to make the second display request;
The video distribution system according to claim 1. determining whether a matching object identical to the first object is displayed in association with the second character;
If it is determined that the matching object is not displayed in association with the second character, prompting the first user to make the second display request;
The video distribution system according to claim 1. determining whether a matching object identical to the first object is displayed in association with the second character;
If it is determined that the matching object is not displayed in association with the second character, prompting the second user to make the second display request;
The video distribution system according to claim 1. the matching object is an object purchased by the first user;
The video distribution system according to any one of claims 1 to 4. the matching object is an object purchased by the second user;
The video distribution system according to any one of claims 1 to 4. The matching object is an object purchased by the one or more viewing users,
The video distribution system according to claim 2. The second display request is different from the first display request,
The video distribution system according to claims 1 to 7. giving a benefit to the first user when the matching object is displayed in association with the second character in the co-starring video;
The video distribution system according to any one of claims 1 to 8. giving a benefit to the second user when the matching object is displayed in association with the second character in the co-starring video;
The video distribution system according to any one of claims 1 to 8. When the matching object is displayed in association with the second character in the co-starring video, a benefit is given to one or more viewing users who are viewing the co-starring video.
The video distribution system according to any one of claims 1 to 7. The matching object is displayed in response to a display request made by a first viewing user among one or more viewing users viewing the co-starring video to display the matching object in association with the second character. giving a benefit to the first viewing user if
The video distribution system according to any one of claims 1 to 8. When the matching object is displayed in association with the second character in the co-starring video, each of the first user, the second user, and one or more viewing users viewing the co-starring video give benefits to
The video distribution system according to any one of claims 1 to 8. The co-starring video is generated in response to receiving a co-starring request from the second user for co-starring with the first user.
The video distribution system according to any one of claims 1 to 13. The first object is displayed in association with the attachment part of the first character,
The matching object is displayed in association with the attachment part of the second character.
The video distribution system according to any one of claims 1 to 14. 1. A method for streaming video that is executed by one or more computer processors executing computer readable instructions, comprising:
a step of distributing a co-starring video including a first character generated based on a movement of a first user, a second character generated based on a movement of a second user, and a first object displayed in association with the first character based on a first display request;
displaying a matching object identical to the first object in the co-starring video in association with the second character based on a second display request;
A video distribution method comprising: one or more computer processors;
A first character generated based on the movement of the first user, a second character generated based on the movement of the second user, and a second character displayed in association with the first character based on the first display request. A step of distributing a co-starring video including one object;
In the co-starring video, displaying a matching object that is the same as the first object in association with the second character in the co-starring video based on a second display request;
A video distribution program that runs