JP7462912B2 - Video distribution system, video distribution method, and video distribution program - Google Patents

Description

The disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program. More specifically, the disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program that live-distributes videos that include character objects generated based on the movements of a user.

There has been known a video distribution system that generates animation of a character object based on the movement of a distribution user and live-distributes a video including the animation of the character object. Such a video distribution system is disclosed, for example, in JP2015-184689A (Patent Document 1) and "Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79" (Non-Patent Document 1).

Video distribution services are provided that distribute videos that include character objects generated based on the movements of broadcasting users. One such service is "Virtual Cast," provided by Dwango Co., Ltd. In Virtual Cast, a character object of a broadcasting user is inserted into a video broadcast by another broadcasting user, allowing the two broadcasting users to virtually appear together in the video through their respective character objects.

There is also known a content distribution system that displays a gift object corresponding to a gift purchased by a viewing user on a display screen in response to a request from the viewing user who is viewing content. For example, in the video distribution system disclosed in JP 2012-120098 A (Patent Document 2), the viewing user can purchase a gift item and provide the purchased gift item to the distribution user as a gift. The gift is displayed in the video being distributed in response to a display request from the viewing user. The gift display request may also be generated automatically in response to the purchase of the gift by the viewing user.

JP 2015-184689 A JP 2012-120098 A

Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79 Dwango Co., Ltd., About [Virtual Cast], [online], [searched on November 25, 2018], Internet <URL: https://qa.nicovideo.jp/faq/show/10740?back=front%2Fcategory%3Ashow&category_id=718&page=1&site_domain=default&sort=sort_access&sort_order=desc>

In conventional video distribution systems, gifts are provided from viewing users to broadcasting users. When gifts are accepted from viewing users to each broadcasting user in a co-starring video in which two or more broadcasting users appear together, the number of gifts accepted is greater than when each broadcasting user broadcasts a video individually. For this reason, when gifts accepted in a co-starring video are displayed, the broadcasting video becomes cluttered with gifts provided to each broadcasting user, and there is a problem in that the quality of the broadcasting video cannot be maintained.

The objective of the present disclosure is to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above. One of the more specific objectives of the present disclosure is to provide a video distribution system, a video distribution method, and a video distribution program that can display gifts from viewing users in co-starring videos in an orderly manner.

A video distribution system according to one aspect of the present invention includes one or more computer processors, and the one or more computer processors execute computer-readable instructions to distribute a first video including a first character object generated based on the movement of a first user, and in response to receiving a first display request for a first gift from a viewing user who views the first video, display a display instruction object on a first user device of the first user who displays the first video, while not displaying the display instruction object on a viewing user device used by the viewing user and a second user device used by a second user who displays the first video, and distribute a co-starring video including the first character object and a second character object generated based on the movement of the second user based on a co-starring request from the second user, display the display instruction object on the first user device that displays the co-starring video and the second user device that displays the co-starring video, and display the first gift in the co-starring video in association with at least one of the first character object and the second character object in response to an operation on the display instruction object.

In one aspect of the present invention, when the display instruction object is operated on the first user device, the display instruction object is made unselectable from the second user device, and when the display instruction object is operated on the second user device, the display instruction object is made unselectable from the first user device.

In one aspect of the present invention, the display instruction object is made selectable on the first user device, while the display instruction object is made unselectable on the second user device.

In one aspect of the present invention, the first gift is displayed in the co-starring video in association with the second character object by operating the display instruction object on the first user device.

In one aspect of the present invention, the first gift is a wearable gift associated with the wearable parts of the first character object and the second character object, and the wearable gift is displayed in the co-starring video at a position corresponding to the wearable parts in response to an operation on the display instruction object.

In one aspect of the present invention, in response to receiving a second display request from the viewing user regarding a second gift that is not associated with a specific part of the first character object or the second character object, the second gift is displayed in the co-starring video.

In one aspect of the present invention, the first gift is displayed in the co-starring video in association with only one of the first character object and the second character object in response to an operation on the display instruction object.

One aspect of the present invention relates to a video distribution method executed by one or more computer processors executing computer-readable instructions. The video distribution method includes the steps of: distributing a first video including a first character object generated based on a movement of a first user; displaying a display instruction object on a first user device of the first user that displays the first video in response to receiving a first display request for a first gift from a viewing user who views the first video, while not displaying the display instruction object on a viewing user device used by the viewing user and a second user device used by a second user that displays the first video; distributing a co-starring video including the first character object and a second character object generated based on the movement of the second user based on a co-starring request from the second user; displaying a display instruction object on the first user device that displays the co-starring video and the second user device that displays the co-starring video; and displaying the first gift in the co-starring video in association with at least one of the first character object and the second character object in response to an operation on the display instruction object.

A video distribution program according to one aspect of the present invention executes, to one or more computer processors, the steps of distributing a first video including a first character object generated based on the movement of a first user, displaying a display instruction object on a first user device of the first user displaying the first video in response to receiving a first display request for a first gift from a viewing user viewing the first video, while not displaying the display instruction object on a viewing user device used by the viewing user and a second user device used by a second user displaying the first video, distributing a co-starring video including the first character object and a second character object generated based on the movement of the second user based on a co-starring request from the second user, displaying a display instruction object on the first user device displaying the co-starring video and the second user device displaying the co-starring video, and displaying the first gift in the co-starring video in association with at least one of the first character object and the second character object in response to an operation on the display instruction object.

According to an embodiment of the present invention, gifts from viewing users can be displayed in an orderly manner in co-starring videos.

1 is a block diagram showing a video distribution system according to an embodiment. 2 is a schematic diagram showing a broadcaster user who broadcasts a video distributed in the video distribution system of FIG. 1 and a broadcaster user device used by the broadcaster user. FIG. FIG. 2 is a diagram showing an example of a display screen displayed on the viewer user device 10 in one embodiment. FIG. 13 is a diagram showing an example of a display screen displayed on a broadcast user device 20a in one embodiment. FIG. 13 is a diagram showing an example of a display screen displayed on a broadcast user device 20b in an embodiment. Fig. 5 is a diagram showing an example of a display screen displayed on an audience user device 10 in one embodiment.The display screen in Fig. 5 shows an example of a normal object. Fig. 6 is a diagram showing an example of a display screen displayed on an audience user device 10 in one embodiment. An example of a wearable object is displayed on the display screen of Fig. 6. 7A and 7B are diagrams showing examples of display screens displayed on broadcast user devices 20a in accordance with an embodiment of the present invention, in which an example of an attachment object is displayed on the display screen of Fig. 7A. 7A and 7B are diagrams showing examples of display screens displayed on broadcast user devices 20b in accordance with an embodiment of the present invention, in which an example of an attachment object is displayed on the display screen of Fig. 7b. FIG. 11 is a diagram showing an example of a display screen of a co-starring video displayed on a viewing user device 10 FIG. 13 is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20a in one embodiment. FIG. 13 is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20b in an embodiment. 10 is a diagram showing an example of a display screen of a co-starring video displayed on a viewing user device 10 in an embodiment. In the display screen of FIG. 10, an attachment object 138 is attached to a character object 31. 11A is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20a in an embodiment. In the display screen of FIG. 11A, an attachment object 138 is attached to a character object 31. 11B is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20b in an embodiment. In the display screen of FIG. 12 is a diagram showing an example of a display screen of a co-starring video displayed on a viewing user device 10 in an embodiment. In the display screen of FIG. 12, an attachment object 138 is attached to a character object 131. 13A is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20a in an embodiment. In the display screen of FIG. 13A, an attachment object 138 is attached to a character object 131. 13B is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20b in an embodiment. In the display screen of FIG. 13B, an attachment object 138 is attached to a character object 131. FIG. 11 is a flow diagram showing a flow of a video distribution process in one embodiment. FIG. 11 is a flow chart showing a process for displaying a normal gift in one embodiment. FIG. 11 is a flow chart showing a process for displaying a wearing gift in one embodiment.

Various embodiments of the present invention will now be described with reference to the drawings. The same reference numerals are used to designate the same or similar components in the drawings.

A video distribution system according to one embodiment will be described with reference to Figures 1 and 2. Figure 1 is a block diagram showing a video distribution system 1 according to one embodiment, and Figure 2 is a schematic diagram showing users Ua and Ub who distribute videos on the video distribution system 1 and distribution user devices 20a and 20b used by the users Ua and Ub. Distribution device 20a and distribution device 20b may have a function to view videos distributed on the video distribution system 1.

The video distribution system 1 includes a viewing user device 10, broadcasting user devices 20a and 20b, a server device 60, and a storage 70. The viewing user device 10, the broadcasting user device 20, the server device 60, and the storage 70 are connected to each other via a network 50 so as to be able to communicate with each other. The server device 60 is configured to distribute videos including animations of the characters of the broadcasting user Ua and the broadcasting user Ub, as described below.

This video is distributed from the server device 60 to the viewing user device 10 and the broadcasting user devices 20a and 20b. The distributed video is displayed on the display of the viewing user device 10. A viewing user, who is a user of the viewing user device 10, can view the distributed video using the viewing user device 10. Although only one viewing user device 10 is shown in FIG. 1 for the sake of simplicity, the video distribution system 1 may include multiple viewing user devices. By viewing the distributed video, the broadcasting users Ua and Ub can perform while checking the video within the video.

In the illustrated embodiment, the broadcast user device 20a includes a computer processor 21a, a communication I/F 22a, a display 23a, a camera 24a, and a microphone 25a. Similarly, the broadcast user device 20b includes a computer processor 21b, a communication I/F 22b, a display 23b, a camera 24b, and a microphone 25b. Since the broadcast user device 20a and the broadcast user device 20b have similar configurations and functions, when there is no need to particularly distinguish between the two, they may be collectively referred to as the broadcast user device 20, and their components may also be referred to as the computer processor 21, etc.

The computer processor 21 is an arithmetic device that loads an operating system and various programs that realize various functions from storage into memory and executes instructions contained in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 21 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. Although the computer processor 21 is illustrated in FIG. 1 as a single component, the computer processor 21 may be a collection of multiple physically separate computer processors.

The communication I/F 22 is implemented as hardware, firmware, or communication software such as a TCP/IP driver or a PPP driver, or a combination of these. The broadcast user device 20 can send and receive data to and from other devices via the communication I/F 22.

The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect touch operations (contact operations) by the player. The touch panel can detect various touch operations by the player, such as tapping, double tapping, and dragging. The touch panel may be equipped with a capacitance-type proximity sensor and configured to be able to detect non-contact operations by the player.

The camera 24 continuously captures images of the faces of the broadcast users Ua and Ub, and acquires image data of the faces of the broadcast users Ua and Ub. The image data of the faces of the broadcast users Ua and Ub captured by the camera 24 is transmitted to the server device 60 via the communication I/F 22. The camera 24 may be a 3D camera capable of detecting the depth of a person's face.

The microphone 25 is a sound collection device configured to convert input voice into voice data. The microphone 25 is configured to acquire voice input from the broadcast users Ua and Ub. The voice input from the broadcast users Ua and Ub acquired by the microphone 25 is converted into voice data, and this voice data is transmitted to the server device 60 via the communication I/F 22.

The viewing user device 10 may have components similar to those of the broadcasting user device 20. For example, the viewing user device 10 may have a computer processor, a communication I/F, a display, and a camera. The viewing user device 10 may perform functions similar to those of the broadcasting user device 20 by downloading and installing specific application software.

The viewing user device 10 and the broadcasting user device 20 are information processing devices such as smartphones. In addition to smartphones, the viewing user device 10 and the broadcasting user device 20 may be mobile phones, tablet terminals, personal computers, e-book readers, wearable computers, game consoles, and various other information processing devices capable of playing videos. In addition to the above components, each of the viewing user device 10 and the broadcasting user device 20 may also be equipped with a sensor unit equipped with various sensors such as a gyro sensor, and storage for storing various information.

Next, the server device 60 will be described. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I/F 62, and storage 63.

The computer processor 61 is an arithmetic device that loads an operating system and various programs that realize various functions from the storage 63 or other storage into memory, and executes instructions contained in the loaded programs. The computer processor 61 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 61 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. In FIG. 1, the computer processor 21 is illustrated as a single component, but the computer processor 61 may be a collection of multiple physically separate computer processors.

The communication I/F 62 is implemented as hardware, firmware, or communication software such as a TCP/IP driver or a PPP driver, or a combination of these. The server device 60 can send and receive data to and from other devices via the communication I/F 62.

Storage 63 is a storage device accessed by computer processor 61. Storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other storage device capable of storing data. Various programs may be stored in storage 63. At least a portion of the programs and various data that may be stored in storage 63 may be stored in a storage device (e.g., storage 70) that is physically separate from server device 60.

In this specification, a program or instructions included in the program described as being executed by computer processor 21 or computer processor 61 may each be executed by a single computer processor, or may be distributed and executed by multiple computer processors. In addition, a program or instructions included in the program executed by computer processor 21 or computer processor 61 may each be executed by multiple virtual computer processors.

Next, the data stored in storage 63 will be described. In the illustrated embodiment, storage 63 stores model data 63a, object data 63b, and various other data required for generating and distributing videos to be distributed.

The model data 63a is model data for generating character animation. The model data 63a may be three-dimensional model data for generating three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (sometimes called "skeleton data") that indicates the skeleton of the character's face and other parts of the body, and surface data that indicates the shape and texture of the character's surface. The model data 63a may include multiple model data that are different from each other. The multiple model data may have different rig data from each other, or may have the same rig data. The multiple model data may have different surface data from each other, or may have the same surface data.

Object data 63b includes asset data for constructing a virtual space that constitutes the video. Object data 63b includes data for drawing the background of the virtual space that constitutes the video, data for drawing various objects that are displayed in the video, and data for drawing various other objects that are displayed in the video. Object data 63b may also include object position information that indicates the position of an object in the virtual space.

In addition to the above, the object data 63b may also include gift objects. The gift objects are displayed in the video based on a gift display request from a viewing user who is viewing the video. The gift objects may include an effect object corresponding to an effect gift, a normal object corresponding to a normal gift, an attachment object corresponding to an attachment gift, and a message object corresponding to a message gift. The viewing user can purchase the gift he or she desires. The distinction between viewing users and broadcasting users (e.g., broadcasting users Ua and Ub) is based on the actions of the users. For example, in the video broadcasting system 1, when a user watches a video, the user is called a viewing user, but when the user broadcasts a video, the user is called a broadcasting user.

An effect object that indicates an effect gift is an object that affects the overall impression of the viewing screen of the distributed video, for example an object that resembles confetti. The object that resembles confetti may be displayed across the entire viewing screen, thereby changing the overall impression of the viewing screen before and after it is displayed. Effect objects may be displayed so as to overlap with character objects, but they differ from wearable objects in that they are displayed without being associated with any particular part of the character object.

A normal object indicating a normal gift is an object indicating a gift from a viewing user to a broadcasting user (e.g., broadcasting users Ua and Ub), and is, for example, an object imitating a stuffed animal, a bouquet of flowers, an accessory, or an object that imitates an item suitable for a gift or present other than the above. In one aspect, the normal object is displayed on the video display screen so as not to come into contact with the character object. In one aspect, the normal object is displayed on the video display screen so as not to overlap with the character object. The normal object may be displayed so as to overlap with an object other than the character object in the virtual space. The normal object may be displayed so as to overlap with a character object, but is different from an attached object in that it is not displayed in association with a specific part of the character object. In one aspect, when a normal object is displayed so as to overlap with a character object, the normal object is displayed so as to overlap with a part of the character object other than the head, including the face, and not to overlap with the head of the character object. In one aspect, when a normal object is displayed so as to overlap with a character object, the normal object is displayed so as to overlap with a part of the character object other than the upper body, including the face, and not to overlap with the upper body of the character object.

The wearable object indicating the wearable gift is an object displayed on the display screen in association with a specific part (wearable part) of the character object. In one aspect, the wearable object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the wearable object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object. The specific part may be specified by three-dimensional position information indicating a position in a three-dimensional coordinate space, or may be associated with position information in a three-dimensional coordinate space. For example, in the case of a character's head, the specific parts may be defined in units of the front left, front right, rear left, rear right, front center, rear center, left eye, right eye, left ear, right ear, and all of the hair.

The wearing object is, for example, an accessory (headband, necklace, earring, etc.) worn by a character object, clothing (T-shirt, etc.), costume, and other objects that can be worn by a character object. The object data 63b corresponding to the wearing object may include wearing part information indicating which part of the character object the wearing object is associated with. The wearing part information of a certain wearing object can indicate which part of the character object the wearing object is worn on. For example, if the wearing object is a headband, the wearing part information of the wearing object may indicate that the wearing object is worn on the "head" of the character object. If the wearing part information on the part where the wearing object is worn is specified as a position in a three-dimensional coordinate space, the wearing part information may be associated with multiple positions in the three-dimensional coordinate space. For example, the wearing part information indicating the position where the wearing object indicating a "headband" is worn may be associated with two parts of the character object, the "left rear of the head" and the "right rear of the head". In other words, the wearing object indicating a "headband" may be worn on both the "left rear of the head" and the "right rear of the head". If the wearing object is a T-shirt, the wearing part information of the wearing object may indicate that the wearing object is worn on the "torso" of the character object.

Two types of wearable objects that share the same wearing location are displayed in the video at different times. In other words, two types of wearable objects that share the same wearing location are worn by a character object at different times. In other words, two types of wearable objects that share the same wearing location are not worn by a character object at the same time. For example, if a wearing object showing a headband and a wearing object showing a hat are both set to "head" as the wearing location, the wearing object showing the headband and the wearing object showing the hat will not be displayed at the same time.

Each gift object may have a display time set according to its type. In one embodiment, the display time of the attachment object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the attachment object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

Next, the functions realized by computer processors 21a and 21b will be described in more detail. Computer processor 21a functions as face motion data generating unit 211a by executing computer readable instructions included in the distribution program. Similarly, computer processor 21b functions as face motion data generating unit 211b by executing computer readable instructions included in the distribution program. At least a part of the functions realized by computer processors 21a and 21b may be realized by a computer processor other than computer processors 21a and 21b of video distribution system 1. At least a part of the functions realized by computer processors 21a and 21b may be realized by, for example, computer processor 61 installed in server device 60.

The facial motion data generating unit 211a generates facial motion data that is a digital representation of the facial movement of the broadcast user Ua based on the imaging data of the camera 24a. Similarly, the facial motion data generating unit 211b generates facial motion data that is a digital representation of the facial movement of the broadcast user Ub based on the imaging data of the camera 24b. The facial motion data is generated at any time over time. The facial motion data may be generated at a predetermined sampling time interval. In this way, the facial motion data generated by the facial motion data generating unit 211a can digitally represent the facial movement (changes in facial expression) of the broadcast user Ua in a time series, and the facial motion data generated by the facial motion data generating unit 211b can digitally represent the facial movement (changes in facial expression) of the broadcast user Ub in a time series. The facial motion data generated by the facial motion data generating units 211a and 211b is transmitted to the server device 60 via the communication I/Fs 22a and 22b.

In the broadcast user device 20, in addition to the face motion data generated by the face motion data generating unit 211a, body motion data may be generated, which is a digital representation of the position and orientation of each part of the body of the broadcast users Ua and Ub other than the face. In addition to the face motion data, the broadcast user device 20 may transmit the body motion data to the server device 60. In order to generate the body motion data, the broadcast users Ua and Ub may wear a motion sensor. The broadcast user device 20 may be configured to be able to generate body motion data based on detection information of the motion sensor worn by the broadcast users Ua and Ub. The body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data represents the body movements of the broadcast users Ua and Ub in a time series as digital data. The generation of the body motion data based on the detection information of the motion sensor worn by the broadcast users Ua and Ub may be performed, for example, in a photography studio. The photography studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor attached to the broadcasting users Ua and Ub may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station provided in the photography studio may be, for example, a base station provided by HTC CORPORATION. A supporter computer may be installed in a room separate from the photography studio. The display of the photography studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room as the room in which the supporter computer is installed. The room in which the supporter computer is installed and the photography studio may be separated by a glass window. In this case, the operator of the supporter computer (sometimes referred to as a "supporter" in this specification) can visually recognize the broadcasting users Ua and Ub. The supporter computer may be configured to change the settings of various devices provided in the photography studio in response to the operation of the supporter. The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various other devices. Supporters can input messages into the supporter computer and have the input messages displayed on the display in the photography studio.

The broadcast user device 20 may realize functions other than the facial motion data generator 211a by executing the broadcast program and/or other programs on a computer processor. For example, the broadcast user device 20 may realize a function of playing received videos by executing a viewing program for video viewing. The broadcast program and the viewing program may be packaged in a single application software, or may be provided as separate application software.

The viewing user device 10 may be configured to provide functions similar to those of the broadcasting user device 20. For example, the viewing user device 10 may realize a function of playing received videos by executing a viewing program for video viewing, or may realize a function similar to that of the face motion data generating unit 211a by executing a broadcasting program.

Next, we will explain in more detail the functions realized by the computer processor 61. The computer processor 61 executes computer-readable instructions included in the distribution program to function as an animation generation unit 61a, a video generation unit 61b, a video distribution unit 61c, a gift request processing unit 61d, a gift purchase processing unit 61e, and a co-starring application processing unit 61f.

The animation generation unit 61a is configured to generate animation of a character object by applying facial motion data generated by the facial motion data generation unit 211a of the broadcast user device 20 to predetermined model data included in the model data 63a. The animation generation unit 61a can generate animation of the character object such that the facial expression of the character object changes based on the facial motion data. Specifically, the animation generation unit 61a can generate animation of a character object that moves in synchronization with the facial movement of broadcast user Ua based on facial motion data related to broadcast user Ua. Similarly, the animation generation unit 61a can generate animation of a character object that moves in synchronization with the facial movement of broadcast user Ub based on facial motion data related to broadcast user Ub.

When body motion data relating to broadcast users Ua and Ub is provided from the broadcast user device 20, the animation generation unit 61a can generate animation of a character object that moves in synchronization with the body and facial movement of broadcast users Ua and Ub based on the body motion data and facial motion data relating to broadcast users Ua and Ub.

When distributing a video of broadcast user Ua, the video generation unit 61b can generate a background image showing the background using object data 63b, and generate a video including this background image and an animation of a character object corresponding to broadcast user Ua. The video generation unit 61b can synthesize the generated video with the voice of broadcast user Ua, which is generated based on the voice data received from the broadcast user device 20a. Similarly, when distributing a video of broadcast user Ub, the video generation unit 61b can generate a background image showing the background using object data 63b, and generate a video including this background image and an animation of a character object corresponding to broadcast user Ub. The video generation unit 61b can synthesize the generated video with the voice of broadcast user Ub, which is generated based on the voice data received from the broadcast user device 20b. In the video generated by the video generation unit 61b, the character objects corresponding to broadcast users Ua and Ub are displayed superimposed on the background image. In this way, the video generator 61b can generate animation of a character object that moves in sync with the facial movements of broadcast user Ua or broadcast user Ub, and generate a video for distribution in which the animation is mixed with the voice of broadcast user Ua or broadcast user Ub. A co-starring video that includes both the character object of broadcast user Ua and the character object of broadcast user Ub will be described later.

The video distribution unit 61c distributes the video generated by the video generation unit 61b. This video is distributed to the viewing user device 10 and other viewing user devices via the network 50. The generated video is also distributed to the broadcasting user devices 20a and 20b. The received video is played back on the viewing user device 10 and the broadcasting user devices 20a and 20b.

Display examples of videos distributed from the video distribution unit 61c are shown in Fig. 3 and Fig. 4a to Fig. 4b. In these figures, it is assumed that the broadcast user Ub uses the broadcast user device 20b to distribute a video including his/her own character object, and that the video is being played on the viewing user device 10 and the broadcast user devices 20a and 20b. In Fig. 4a, it is assumed that the broadcast user Ua is not distributing videos, and is watching a video distributed by another broadcast user, broadcast user Ub. The same assumption is made for Fig. 6, Fig. 7a, and Fig. 7b described below. For this reason, in the explanations of Fig. 3, Fig. 4a to Fig. 4b, Fig. 6, and Fig. 7a to Fig. 7b, the broadcast user Ua may also be referred to as the viewing user. Fig. 3 shows a display example of a video being played on the viewing user device 10, Fig. 4a shows a display example of a video being played on the broadcast user device 20a, and Fig. 4b shows a display example of a video being played on the broadcast user device 20b.

As shown in FIG. 3, a display image 30 of the video distributed from the server device 60 is displayed on the display of the viewing user device 10. The display image 30 displayed on the viewing user device 10 includes a character object 31 of the broadcasting user Ub generated by the animation generation unit 61a, a gift button 32, a rating button 33, a comment button 34, and a comment display area 35.

As shown in FIG. 4a, a display image 130 of a video distributed from a server device 60 is displayed on the display of the broadcasting user device 20a. This display image 130 includes, like the display image 30, a character object 31 of broadcasting user Ub, a gift button 32, a rating button 33, a comment button 34, and a comment display area 35. In addition, the display image 130 includes a co-starring request button 36 for requesting to co-star with broadcasting user Ub in a video being distributed by broadcasting user Ub. The broadcasting user device 20a can display the display image 130 of a distributed video by, for example, executing application software including a viewing program.

As shown in FIG. 3, in one embodiment, the display image 30 of the viewing user device 10 does not include the request to perform together button 36. For example, when application software including a distribution program has not been downloaded or installed in the viewing user device 10, or when application software including a distribution program has not been started in the viewing user device 10, the display image 30 of the viewing user device 10 is generated so as not to include the request to perform together button 36. In another embodiment, the display image 30 of the viewing user device 10 may also display the request to perform together button 36. For example, when application software including a distribution program has been downloaded or installed in the viewing user device 10, or when application software including a distribution program has been started in the viewing user device 10, the display image 30 of the viewing user device 10 is generated so as to include the request to perform together button 36.

As described above, the character object 31 is generated by applying the facial motion data of the broadcast user Ub to the model data included in the model data 63a, so that its facial expression changes in synchronization with the facial movements of the broadcast user Ub. When body motion data is provided from the broadcast user device 20, the character object 31 can be controlled so that parts of the character object 31 other than its face also change in synchronization with the body movements of the broadcast user Ub.

The gift button 32 is displayed on the display screen 30 so as to be selectable by an operation on the viewing user device 10. The gift button 32 can be selected, for example, by a tap operation on an area of the touch panel of the viewing user device 10 where the gift button 32 is displayed. In one embodiment, when the gift button 32 is selected, a window is displayed on the display screen 30 for selecting a gift to be gifted to the broadcasting user (here, broadcasting user Ub) who is broadcasting the video being viewed. The viewing user can purchase a gift to be gifted from the gifts displayed in the window. In another embodiment, in response to the selection of the gift button 32, a window containing a list of purchased gifts is displayed on the display screen 30. In this case, the viewing user can select a gift to be gifted from the gifts displayed in the window. Gifts that can be gifted or purchased can include effect gifts, normal gifts, wearable gifts, and other gifts.

The rating button 33 is displayed on the display screen 30 so as to be selectable by a viewing user using the viewing user device 10. The rating button 33 can be selected, for example, by tapping on an area of the touch panel of the viewing user device 10 where the rating button 33 is displayed. When the rating button 33 is selected by a viewing user who is viewing a video, rating information indicating that the video has been positively rated may be transmitted to the server device 60. The server device 60 can aggregate rating information from the viewing user device 10 and other viewing user devices. When the rating button 33 is selected, rating information indicating that the video has been negatively rated may be transmitted to the server device 60. Rating information indicating that a video has been positively rated may be called positive rating information, and rating information indicating that a video has been negatively rated may be called negative rating information.

The comment button 34 is displayed on the display screen 30 so that it can be selected by the user. When the comment button 34 is selected, for example, by a tap operation, a comment input window for inputting a comment is displayed on the display screen 30. The viewing user can input a comment via the input mechanism of the viewing user device 10 or the broadcasting user device 20a. The input comment is transmitted from the viewing user device 10 and the broadcasting user device 20a to the server device 60. The server device 60 accepts comments from the viewing user device 10, the broadcasting user device 20a, and other user devices, and displays the comments in the comment display area 35 in the display image 30. In the comment display area 35, comments posted by each user are displayed, for example, in chronological order. The comment display area 35 occupies a part of the area of the display screen 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When comments are posted that exceed the upper limit set in the comment display area 35, the comments are deleted from the comment display area 35 in order of oldest posted comments. Therefore, the more frequently comments are received, the shorter the display time of each comment in the comment area 35.

As shown in FIG. 4b, a display image 40 of a video distributed from the server device 60 is displayed on the display of the broadcast user device 20b. The display image 40 displayed on the broadcast user device 20b includes a character object 31 corresponding to the broadcast user Ub, display instruction buttons 42a-42c for displaying the worn gifts requested to be displayed by the viewing user, and a comment display area 35. The display image 40 displayed on the broadcast user device 20b includes the same background image, character object image, and comments as the display image 30 and the display image 130. On the other hand, the display image 40 differs from the display image 30 and the display image 130 in that it does not include the gift button 32, the rating button 33, the comment button 34, or the co-star request button 36, but includes the display instruction buttons 42a-42c.

The display instruction buttons 42a to 42c are displayed on the display screen 40 in response to receiving a display request from a viewing user to display a wearing gift, which will be described later. In the illustrated embodiment, three display instruction buttons 42a to 42c are displayed on the display image 40. Each of the display instruction buttons 42a to 42c is displayed on the display screen 40 so as to be selectable by the broadcasting user. When any of the display instruction buttons 42a to 42c is selected, for example, by a tap operation, an operation is performed to display the wearing gift corresponding to the selected display instruction button. In this way, the display instruction buttons 42a to 42c are display instruction objects for issuing an instruction to display the wearing gift in the video being broadcast. For this reason, in this specification, the display instruction buttons 42a to 42c may be referred to as display instruction objects 42a to 42c. In addition, when it is not necessary to distinguish the display instruction objects 42a to 42c from each other, they may be simply referred to as display instruction objects 42. Specific examples of displaying the wearing gift will be described later. The display screen 40 may be displayed on the supporter computer described above. The display instruction objects 42a to 42c may be selected in response to the operation of the supporter computer by the supporter.

Each time a display request for displaying an attached gift is received, a display instruction object 42 corresponding to the display request is added to the display screen 40. There is an upper limit to the number of display instruction objects 42 that can be displayed on the display screen 40. In the illustrated embodiment, the upper limit number of display instruction objects 42 that can be displayed on the display screen 40 is three. In this case, the display screen 40 has a display area that can display three display instruction objects. If four or more display requests for attached gifts are received, the display instruction objects 42 corresponding to the fourth and subsequent display requests are not displayed on the display screen 40. The display instruction object 42 corresponding to the fourth-received display request for attached gifts is displayed on the display screen 40 when one of the three display instruction objects 42 already displayed is selected and a free space is created in the display area.

The gift request processing unit 61d receives a gift display request from a viewing user and performs processing to display a gift object corresponding to the display request. Each viewing user can transmit a gift display request to the server device 60 by operating their own viewing user device. The gift display request may include the viewing user's user ID, gift identification information (gift ID) that identifies the gift requested to be displayed, and/or gift object identification information (gift object ID) that identifies the gift corresponding to the gift requested to be displayed.

As described above, a gift object representing a gift may include an effect object corresponding to an effect gift, a normal object corresponding to a normal gift, and an attachment object corresponding to an attachment gift. An attachment gift is an example of a first gift. An attachment object may be referred to as a first gift object. A display request requesting the display of an attachment gift (or an attachment object) is an example of a first display request. Effect gifts and normal gifts are examples of second gifts. Effect objects and normal objects may be collectively referred to as second gift objects. A display request requesting the display of an effect gift (or effect object) or a normal gift (or normal object) is an example of a second display request.

In one aspect, when the gift request processing unit 61d receives a display request from a viewing user for a specific regular gift, it performs processing for displaying a regular object representing the regular gift requested to be displayed in the video based on the display request. For example, when a display request is made for a regular gift representing a bag, the gift request processing unit 61d displays a regular object 37a representing a bag in the display image 30 based on the display request, as shown in FIG. 5. Similarly, when a display request is made for a regular gift representing a stuffed bear, the gift request processing unit 61d displays a regular object 37b representing a stuffed bear in the display image 30 based on the display request, as shown in FIG. 5. Although not shown in the figure, the regular objects 37a and 37b are also displayed in the display image 130 on the broadcast user device 20a and the display image 40 on the broadcast user device 20b, similar to the display image 30.

In one aspect, when the gift request processing unit 61d receives a display request from a viewing user for a specific effect gift, it performs processing for displaying an effect object corresponding to the effect gift requested to be displayed in the display image of the video based on the display request. For example, when a display request is made for an effect gift showing confetti or fireworks, the gift request processing unit 61d displays an effect object (not shown) corresponding to the effect gift showing confetti or fireworks in the display image 30, the display image 130, and the display image 40 based on the display request.

The display request for a normal gift may include a display position designation parameter that designates the display position of a normal object representing the normal gift. In this case, the gift request processing unit 61d can display the normal object at the position designated by the display position designation parameter. When the display position and display range of the character object 31 are determined, the display position designation parameter can designate a position relative to the character object 31 as the display position of the normal object.

In one aspect, the normal object may be displayed to move within the display image 30 of the video. For example, the normal objects 37a and 37b may be displayed to fall from the top to the bottom of the screen. In this case, the normal objects 37a and 37b may be displayed within the display image 30 from the start of the fall until they fall to the bottom of the display image 30, and may disappear from the display image 30 after falling to the bottom of the display image 30. The movement direction of the normal objects 37a and 37b within the screen may be set arbitrarily. For example, the normal objects 37a and 37b may move from left to right, right to left, upper left to lower left, or in other directions in the display image 30. The normal objects 37a and 37b can move on various trajectories. For example, the normal objects 37a and 37b can move on a straight trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or other trajectories. In addition to or instead of the display position designation parameter, the viewing user can include at least one of a movement direction parameter that designates the movement direction of the normal objects 37a and 37b and a trajectory parameter that designates the trajectory along which the normal objects 37a and 37b move, in the display request for the normal objects. In one embodiment, the effect objects and normal objects whose size in the virtual space is smaller than the reference size may be displayed so as to overlap part or all of them with the character object 31. In one embodiment, the effect objects and normal objects whose size in the display image 30 is larger than the reference size are displayed at a position that does not overlap with the character object 31. In another embodiment, the effect objects and normal objects whose size in the virtual space is larger than the reference size may be displayed behind the character object 31. The normal objects 37a and 37b may also be displayed to move as described above in the display image 130 and the display image 40.

In one aspect, when the gift request processing unit 61d receives a display request from a viewing user for a specific wearing object, it displays display instruction objects 42a to 42c on the display screen 40 of the broadcasting user device 20 based on the display request, as shown in FIG. 4b. Each of the display instruction objects 42a to 42c is associated with the wearing gift for which the display request has been made. When any of the display instruction objects 42a to 42c is selected, the wearing gift associated with the selected display instruction object is displayed in the video being broadcast. For example, when a headband in the shape of cat ears is associated with the display instruction object 42b, when the display instruction object 42b is selected, the gift request processing unit 61d displays a wearing object 38 representing the headband corresponding to the selected display instruction object 42b in the video being broadcast. Display examples of a video including a wearing object 38 representing a headband are shown in FIG. 6 and FIG. 7a to FIG. 7b. Also, as shown in FIG. 7b, the selected display instruction object 42b is deleted from the display screen 40.

The attachment object is displayed in the video in association with a specific part (attachment part) of the character object. For example, the attachment object may be displayed in the video so as to be in contact with the attachment part of the character object. The attachment object 38 may be displayed in the video so as to be attached to the attachment part of the character object. In one embodiment, the attachment object 38 representing a headband is associated with the head of the character object. Therefore, in the display examples shown in Figures 6 and 7a to 7b, the attachment object 38 is attached to the head of the character object 31. The attachment object may be displayed in the display screen of the video so as to move in conjunction with the movement of the attachment part of the character object. For example, when the head of the character object 31 wearing the attachment object 38 representing a headband moves, the attachment object 38 representing the headband also moves in conjunction with the head of the character object 31 as if the headband was attached to the head of the character object 31.

As described above, the object data 63b may include wearing part information indicating which part of the character object the wearing object is associated with. In one aspect, when a wearing object is worn on a character object, the gift request processing unit 61d prohibits the display of other wearing objects worn on the same or overlapping parts indicated by the wearing part information of the wearing object until the display time of the wearing object has elapsed. For example, a headband associated with both the "left rear of the head" and the "right rear of the head" overlaps with a hair accessory associated with the "left rear of the head" in the "left rear of the head", so when a headband is displayed, the display of a hair accessory with "left rear of the head" set as the wearing part information is prohibited. On the other hand, a headband associated with the "left rear of the head" and the "right rear of the head" and an earring associated with the "left ear (of the head)" and the "right ear (of the head)" can be worn at the same time because their wearing parts on the character object do not overlap.

In one embodiment, in order to prohibit the display of multiple wearing objects with the same or overlapping wearing parts, the display instruction object 42 for displaying the wearing object that is prohibited from being displayed may be deactivated. In the embodiment shown in FIG. 4b, it is assumed that the display instruction object 42a is an object (button) for instructing the display of a hair accessory with "left rear of head" set as the wearing part information. In this case, since the character object 31 is wearing the wearing object 38 indicating a headband, the wearing object indicating this hair accessory is prohibited from being displayed in the video while the wearing object 38 is attached to the character object 31. In one embodiment, in order to prohibit the wearing object indicating this hair accessory from being displayed in the video, the display instruction object 42a associated with the wearing object indicating the hair accessory is deactivated. For example, the display instruction object 42a is made unselectable even if it is operated while the wearing object 38 is attached to the character object 31. In another embodiment, the display instruction object 42a is erased from the display screen 40 while the wearing object 38 is attached to the character object 31. The deactivated display instruction object 42a is reactivated when the display time of the headband has elapsed. To reactivate the display instruction object 42a, for example, a display instruction object 42a that was made unselectable may be made selectable again, or a display instruction object 42a that was hidden may be displayed again on the display screen 40.

In one aspect, the gift purchase processing unit 61e transmits, in response to a request from a viewing user of a video, purchase information for each of a plurality of gift objects that can be purchased in relation to the video to the viewing user device of the viewing user (e.g., the viewing user device 10 and the broadcasting user device 20a). The purchase information for each gift object may include the type of the gift object (effect object, normal object, or wearable object), an image of the gift object, the price of the gift object, and other information necessary for purchasing the gift object. The viewing user can select a gift object to purchase based on the purchase information of the gift object displayed on the viewing user device 10 or the broadcasting user device 20a. The selection of the gift object to be purchased may be performed by operating the viewing user device 10 or the broadcasting user device 20a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 60. The gift purchase processing unit 61e performs a payment process based on the purchase request. When this payment process is completed, the purchased gift object is held by the viewing user. The storage 23 may store the gift ID of the purchased gift (or the gift object ID of the gift object indicating the gift) in association with the user ID of the viewing user who purchased the gift.

The purchasable gift objects may be different for each video. The purchasable gift objects may be purchasable across multiple videos. That is, the purchasable gift objects may include unique gift objects that are unique to each video and common gift objects that are purchasable across multiple videos. For example, an effect object showing confetti may be a common gift object that is purchasable across multiple videos.

In one aspect, when an effect object is purchased while watching a specific video, the effect object to be purchased may be automatically displayed in the video being watched in response to completion of the payment process to purchase the effect object. When a normal object is purchased while watching a specific video, similar to the above, the normal gift object to be purchased may be automatically displayed in the video being watched in response to completion of the payment process to purchase the normal object.

In another aspect, in response to the completion of the payment process in the gift purchase processing unit 61e for the effect object to be purchased, a payment completion notification may be transmitted to the viewing user device 10, and a confirmation screen may be displayed on the viewing user device 10 to confirm to the viewing user whether or not to make a display request for the purchased effect object. If the viewing user selects to make a display request for the purchased effect object, a display request requesting the display of the purchased effect object may be transmitted from the viewing user's client device to the gift request processing unit 61d, and the gift request processing unit 61d may perform processing to display the purchased effect object in the video 70. When the object to be purchased is a normal object, a confirmation screen may be displayed on the viewing user device 10 to confirm to the viewing user whether or not to make a display request for the purchased normal object, as described above.

When a broadcast user receives a request to co-star from another broadcast user, the co-starring request processing unit 61f generates a co-starring video in which the broadcast user and the other broadcast user virtually co-star based on the co-starring request. The following explanation assumes a case in which a broadcast user Ua, who is watching a video including broadcast user Ub's character object 31, requests to co-star with broadcast user Ub. The co-starring request processing unit 61f can generate co-starring videos based on co-starring requests from various broadcast users, not just from a co-starring request from broadcast user Ua.

In one embodiment, the co-starring request processing unit 61f accepts a co-starring request from the broadcast user Ua and generates a co-starring video in response to the co-starring request. The broadcast user Ua can send a co-starring request to the server device 60 by operating the broadcast user device 20a. Specifically, when the co-starring request button 36 displayed on the broadcast user device 20a is selected, a co-starring request is sent from the broadcast user device 20a to the server device 60. The co-starring request button 36 can be selected, for example, by tapping on an area of the touch panel of the broadcast user device 20a where the co-starring request button 36 is displayed. In response to the co-starring request button 36 being selected, application software including a broadcast program may be launched in the broadcast user device 20a. The co-starring request sent from the broadcast user device 20a may include a user ID that identifies the broadcast user Ua.

In response to receiving a co-starring request from the broadcast user device 20a, the co-starring request processing unit 61f determines whether or not to permit the co-starring request. The co-starring request processing unit 61f can determine whether or not to permit a co-starring request based on various information about the broadcast user Ua who made the co-starring request. For example, if the broadcast user Ua's evaluations from other users are higher than a predetermined standard, the co-starring request from the broadcast user Ua can be permitted, and conversely, if the broadcast user Ua's evaluations from other users are lower than a predetermined standard, the co-starring request from the broadcast user Ua can be rejected. In addition, the broadcast user Ub may be inquired about whether or not to permit the co-starring request from the broadcast user Ua, and the co-starring request can be determined depending on the response.

In one embodiment, when a co-starring request from the broadcast user Ua is approved, the co-starring request processing unit 61f generates a co-starring video in which the broadcast user Ua and the broadcast user Ub appear together. To generate the co-starring video, the co-starring request processing unit 61f acquires face motion data and voice data of the broadcast user Ua from the broadcast user Ua. The face motion data of the broadcast user Ua may be transmitted from the broadcast user device 20a to the server device 60 together with the co-starring request, or may be transmitted from the broadcast user device 20a to the server device 60 in response to a request from the server device 60 after the co-starring request is approved. When the body movements of the broadcast user Ua are also represented as animation, the body motion data may be provided to the server device 60 together with the face motion data of the broadcast user Ua. When the co-starring request processing unit 61f cannot acquire face motion data from the broadcast user Ua, it may acquire only voice data from the broadcast user Ua. For example, if the broadcast user device 20a used by the broadcast user Ua does not have the function of the facial motion data generation unit 211a or other functions for video distribution, if that function is disabled, or in other cases, the co-starring request processing unit 61f may acquire audio data from the broadcast user Ua without acquiring facial motion data (and body motion data).

In one embodiment, the co-starring application processing unit 61f generates a co-starring image by adding animation of the character object of the broadcast user Ua to a video including the character object 31 of the broadcast user Ub based on the facial motion data of the broadcast user Ua. The animation of the character object of the broadcast user Ua may be generated in the animation generation unit 61a based on the facial motion data of the broadcast user Ua. The animation of the character object of the broadcast user Ua may be generated by applying the facial motion data of the broadcast user Ua to the model data for the broadcast user Ua included in the model data 63a. For example, the co-starring application processing unit 61f can generate a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub by generating a layer including animation of the character object of the broadcast user Ua and superimposing this layer on a video including the character object 31 of the broadcast user Ub. When the co-starring application processing unit 61f acquires voice data but not face motion data (and body motion data) from the broadcast user Ua, it can generate a co-starring video including the character object 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing voice generated based on the voice data acquired from the broadcast user Ua onto a video including the character object 31 of the broadcast user Ub. Even when model data for the broadcast user Ua is not set as the model data 63a, the co-starring application processing unit 61f can generate a co-starring video including the character object 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing voice generated based on the voice data acquired from the broadcast user Ua onto a video including the character object 31 of the broadcast user Ub. In this way, the broadcast user Ua can co-star with the broadcast user Ub using his or her own voice.

When the co-starring application processing unit 61f cannot obtain face motion data from the broadcast user Ua, it distributes a co-starring video including the voice of the broadcast user Ua and the character object 31 of the broadcast user Ub, and then generates a character object of the broadcast user Ua based on the face motion data of the broadcast user Ua at the timing when the face motion data is obtained from the broadcast user Ua, thereby generating a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub. In this way, the co-starring application processing unit 61f can switch a co-starring video including the voice of the broadcast user Ua and the character object 31 of the broadcast user Ub to a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub. Conversely, the co-starring application processing unit 61f can switch a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub to a co-starring video including the voice of the broadcast user Ua and the character object 31 of the broadcast user Ub. In this way, it may be possible to alternate between a co-starring video in which audio is played together (sometimes called an "audio co-starring video") and a co-starring video in which character objects are played together (sometimes called a "character co-starring video").

The generated co-starring video is distributed by the video distribution unit 61c. The co-starring video may be created by the broadcast user device 20a. When the co-starring video is generated by the broadcast user device 20a, the co-starring video is transmitted from the broadcast user device 20a to the server device 60 and distributed by the video distribution unit 61c of the server device 60.

Display examples of a co-starring video distributed from video distribution unit 61c are shown in Figures 8 and 9a-9b. In these figures, it is assumed that broadcast user Ua has applied to co-star with a video being distributed by broadcast user Ub, and as a result, a co-starring video including broadcast user Ua's character object and the broadcast user's character object is distributed, and broadcast user Ua has selected the co-starring application button 36 while viewing the image shown in Figure 7a.

As shown in FIG. 8, a display image 230 of the co-starring video distributed from the server device 60 is displayed on the display of the viewing user device 10. The display image 230 of the co-starring video displayed on the viewing user device 10 includes a character object 131 of the broadcasting user Ua in addition to a character object 31 of the broadcasting user Ub. The character object 131 of the broadcasting user Ua is generated in the animation generation unit 61a or the co-starring application processing unit 61f, as described above. The display image 230 of the co-starring video includes a gift button 32, a rating button 33, a comment button 34, and a comment display area 35, similar to the original distribution image shown in FIG. 3.

The distribution image 230 of the co-starring video is a horizontally long image as shown in the figure. When the co-starring application processing unit 61f or the video distribution unit 61c distributes the co-starring image, it distributes it as a horizontally long image. As a result, the distribution image 230 of the co-starring video is displayed as a horizontally long image on the viewing user device 10. In one embodiment, as shown in FIG. 3, even if the original video (image) is vertically long, the co-starring image is converted to a horizontally long image and distributed. Since the co-starring image includes character objects of two distribution users, by making it a horizontally long image, it is easier to display the character objects of two people without overlapping. For example, in the co-starring image, the left half from the viewpoint of the viewing user may be an area assigned to the character object of the original distribution user, and the right half may be an area assigned to the character object of the distribution user who made the co-starring application. The allocation of areas to each distribution user may be determined arbitrarily so that the character objects do not overlap.

9a and 9b, the display of the broadcast user device 20a and the broadcast user device 20b displays a display image 330 of the co-starring video broadcast from the server device 60. This display image 330 includes the same background image, character object image, and comment as the display image 230. On the other hand, the display image 330 differs from the display image 230 in that it does not include the gift button 32, the rating button 33, and the comment button 34, but includes the display instruction buttons 42a, 42c, and 42d. Since the broadcast user Ua and the broadcast user Ub are the broadcasters of the same co-starring image, the same display image 330 is displayed on the broadcast user device 20a of the broadcast user Ua and the broadcast user device 20b of the broadcast user Ub. Like the display image 230, the display image 330 is displayed horizontally from the viewpoint of arranging multiple character objects without overlapping. In the example shown in FIG. 8 and FIG. 9a-FIG. 9b, it is assumed that a viewing user viewing the co-starring image shown in FIG. 8 makes a display request (first display request) for a wearing gift showing earrings, and as a result, a display instruction object 42d is added to the display image of the broadcast user device 20a and the broadcast user device 20b in response to the display request. The display instruction object 42d is an object (button) for instructing the display of earrings with "ear" set as the wearing body part information.

When broadcast user Ua and broadcast user Ub are appearing together in the co-starring video shown in Figures 9a and 9b, broadcast user Ua can select the display instruction object 42d displayed on broadcast user device 20a to wear the wearing gift corresponding to the display instruction object 42d on his/her own character object 131. Similarly, broadcast user Ub can select the display instruction object 42d displayed on broadcast user device 20b to wear the wearing gift corresponding to the display instruction object 42d on his/her own character object 31. The wearing gift corresponding to the display instruction object 42d is worn on one or both of broadcast user Ua's character object 131 and broadcast user Ub's character object 31.

When the display instruction object 42d is selected by the broadcast user Ub, a selection notification indicating that the display instruction object 42d has been selected is sent from the broadcast user device 20b to the server device 60. In the server device 60, the gift request processing unit 61d displays the wearing object 138 indicating the earrings corresponding to the display instruction object 42d in the co-starring video being distributed. Since the wearing object 138 indicating the earrings is set to the "ear" as the wearing part, the wearing object 138 is worn on the ear of the character object 31. An example of a display of a video including a character object 31 wearing the wearing object 138 indicating the earrings is shown in FIG. 10 and FIG. 11a to FIG. 11b. In addition, as shown in FIG. 11a and FIG. 11b, the selected display instruction object 42d may be deleted from the display screen 330. When the display instruction object 42d is selected by the broadcast user Ub, the display instruction object 42d does not have to be deleted from the display screen 330. In this case, the co-starring broadcast user Ua can also select the display instruction object 42d. When the broadcast user Ua selects the display instruction object 42d, the attachment object 138 is attached to the character 131 of the broadcast user Ua. When the display instruction object 42d is selected by one of the broadcast users Ua and Ub who are performing together, the display instruction object 42d may be deleted from the display screen displayed on the broadcast user device of the broadcast user who made the selection, and the display instruction object 42d may continue to be displayed on the display screen of the broadcast user device of the broadcast user who did not make the selection. For example, when the broadcast user Ub selects the display instruction object 42d but the broadcast user Ua does not select the display instruction object 42d, the display instruction object 42d may be deleted from the display screen 330 of the broadcast user device 20b of the broadcast user Ub, and the display instruction object 42d may be left displayed as is on the display screen 330 of the broadcast user device 20a of the broadcast user Ua. This allows the broadcast user Ua to select the display instruction object 42d at a later timing than the broadcast user Ub, and to attach the attachment object 138 to his/her own character object 131.

When the display instruction object 42d is selected by the broadcast user Ua, the broadcast user device 20a notifies the server device 60 that the display instruction object 42d has been selected. In the server device 60, the gift request processing unit 61d generates a co-starring video in which the broadcast user Ua's character 131 wears a wearing object 138 representing an earring that corresponds to the display instruction object 42d. Display examples of a video including a character object 31 wearing a wearing object 138 representing an earring are shown in Figures 12 and 13a to 13b.

When broadcast user Ua and broadcast user Ub appear together in a co-starring video, a display instruction object (e.g., display instruction objects 42a-42d) for displaying the wearing gift is displayed on at least one of broadcast user device 20a of broadcast user Ua and broadcast user device 20b of broadcast user Ub. In the embodiment shown in Figures 9a and 9b, display instruction objects 42a, 42c, and 42d are displayed on both broadcast user device 20a and broadcast user device 20b. In this case, both broadcast user Ua and broadcast user Ub can select display instruction objects 42a, 42c, and 42d. In one embodiment, when one of broadcast user Ua and broadcast user Ub selects a displayed display instruction object, the other user cannot select the selected display instruction object. For example, as shown in Figures 11a and 11b, when a display instruction object 42d is selected by broadcast user Ub, the display instruction object 42d is deleted from the display image 330 displayed on broadcast user device 20b of broadcast user Ub, and is also deleted from the display image 330 displayed on broadcast user device 20a of broadcast user Ua. As a result, after a display instruction object 42d is selected by broadcast user Ub, the broadcast user Ua, who is the co-starring partner, cannot select the display instruction object 42d. Conversely, after a display instruction object 42d is selected by broadcast user Ua, the broadcast user Ub, who is the co-starring partner, cannot select the display instruction object 42d.

In another embodiment, when a viewing user gifts a wearable gift, the viewing user can specify which of the broadcast users who appear in the co-starring video the wearable gift is to be gifted to. More specifically, the viewing user can specify which of the broadcast users who appear in the co-starring video the wearable gift is to be gifted to in the first display request requesting the display of the wearable gift. For example, in the embodiment shown in FIG. 8 and FIG. 9a to FIG. 9b, a user viewing the co-starring image shown in FIG. 8 can select the wearable gift as the gifting target by selecting the gift button 32, and further select the broadcast user Ua or the broadcast user Ub as the gifting destination of the selected wearable gift. The selection of the broadcast user Ua or the broadcast user Ub may be performed through the selection of the respective character object 131 or character object 31. When the broadcast user Ub (character object 31) is specified in the display request for the wearable gift indicating the above-mentioned earrings, the display instruction object 42d corresponding to the wearable gift is displayed on the broadcast user device 20b of the broadcast user Ub, and may not be displayed on the broadcast user device 20a of the unspecified broadcast user Ua. In another aspect, when a broadcast user Ub (character object 31) is specified in a display request for a wearing gift showing earrings, the display instruction object 42d corresponding to the wearing gift is displayed on both the broadcast user device 20a of the broadcast user Ua and the broadcast user device 20b of the broadcast user Ub, but the display instruction object 42d may be made unselectable from the broadcast user device 20a of the unspecified broadcast user Ua. In this way, when a gifting destination is specified in a display request for a wearing gift, the display instruction object for the wearing gift is made selectable on the broadcast user device of the specified broadcast user, and the display instruction object for the wearing gift is made unselectable on the broadcast user devices of broadcast users other than the specified broadcast user.

In other embodiments, the display instruction object may be selectable only on the broadcast user device of the broadcast user who broadcast the original video of the co-starring video. In the example shown in Figures 8 and 9a-9b, broadcast user Ua applied to co-star with a video originally broadcast by broadcast user Ub, so the display instruction objects 42a, 42c, and 42d may be selectable on broadcast user device 20b of broadcast user Ub, but may not be selectable on broadcast user device 20a of broadcast user Ua. For example, the display instruction objects 42a, 42c, and 42d may be displayed on broadcast user device 20b, but may not be displayed on broadcast user device 20a of broadcast user Ua.

When a co-starring broadcast user selects a display instruction object to display the wearing gift, the broadcast user may specify a character object on which the selected wearing gift is to be worn. For example, when broadcast user Ub selects display instruction object 42d to display the wearing gift 138 in a co-starring video, the broadcast user may wear it on his/her own character object 31, or on the character 131 of broadcast user Ua, who is the co-starring partner. For example, when display instruction object 42d is selected on broadcast user device 20b, a selection of character objects may be displayed on the broadcast user device 20b.

Next, a video distribution process according to one aspect will be described with reference to Figs. 14 to 16. Fig. 14 is a flow diagram showing the flow of video distribution process in one embodiment, Fig. 15 is a flow diagram showing the flow of processing for displaying a normal object in one embodiment, and Fig. 16 is a flow diagram showing the flow of processing for displaying an attached object in one embodiment. In the video distribution process described with reference to these figures, a video generated based on face motion data acquired by a broadcast user Ub using a broadcast user device 20b is distributed, and it is assumed that a co-starring request is made from a broadcast user Ua who is watching this video.

First, in step S11, face motion data, which is a digital representation of the facial movements (facial expressions) of the broadcast user Ub, is generated. The generation of the face motion data is performed, for example, by the face motion data generation unit 211a of the broadcast user device 20. In the broadcast user device 20, voice data may be generated based on voice input from the broadcast user Ub. The generated face motion data and voice data are transmitted to the server device 60.

Next, in step S12, the facial motion data from the broadcast user device 20 is applied to the model data for broadcast user Ub, thereby generating an animation of a character object that moves in synchronization with the facial movements of broadcast user Ub. This animation is generated, for example, by the animation generation unit 61a described above.

Next, in step S13, a video including an animation of a character object corresponding to broadcast user Ub is generated. The voice of broadcast user Ub may be synthesized into this video. The animation of the character object is displayed superimposed on a background image. The generation of this video is performed, for example, by the video generation unit 61b described above.

Next, the process proceeds to step S14, where the video generated in step S13 is distributed. This video is distributed via network 50 to the viewing user device 10 and other viewing user devices and distribution user devices. The video is continuously distributed for a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, or any other time.

Next, the process proceeds to step S15, where it is determined whether a co-starring request has been made by a user other than broadcast user Ub. A co-starring request is made, for example, by broadcast user Ua. If a co-starring request has been made by broadcast user Ua, the process proceeds to step S16. In step S16, an animation of broadcast user Ua's character object 131 is generated based on the face motion data of broadcast user Ua. Then, a co-starring image is generated by adding the animation of broadcast user Ua's character object 131 to the video being distributed (video including broadcast user Ub's character object 31). The process in step S16 is performed, for example, by the co-starring request processing unit 61f described above.

Next, the process proceeds to step S17, where the co-starring video generated in step S16 is distributed. This co-starring video is distributed via network 50 to the viewing user device 10 and other viewing user devices and broadcasting user devices. The co-starring video includes, for example, an animation of the character object 131 of broadcasting user Ua and an animation of the character object 31 of broadcasting user Ub, as shown in Figures 8, 9a, and 9b.

Next, the process proceeds to step S18, where it is determined whether or not the end condition for ending the distribution of the video has been met. The end condition may be, for example, that the end time of the distribution has been reached, that the broadcast user Ub has performed an operation to end the distribution on the broadcast user device 20b, or other conditions. If the end condition has not been met, the processes of steps S11 to S17 are repeatedly executed, and the distribution of the video including animation synchronized with the movements of the broadcast user Ub, or the co-starring video if the co-starring with the broadcast user Ua is continuing, is continued. If it is determined that the end condition for the video has been met, the distribution process of the video is terminated.

Next, with further reference to FIG. 15, the process of displaying normal gifts that is performed during video distribution will be described. The process of displaying normal gifts is performed in parallel with the process of distributing the video shown in FIG. 14.

During the distribution of the video, in step S21, it is determined whether a display request for a regular gift has been made. For example, the viewing user can select one or more specific regular gifts from among the regular gifts he or she owns, and transmit a display request requesting the display of the selected regular gifts from the viewing user device 10 to the server device 60. As described above, a display request for a specific regular gift may be generated in response to the purchase process or payment process for the specific regular gift.

When a request to display a regular gift is made, the display process proceeds to step S22. In step S22, a process is performed to display the regular gift requested to be displayed in the video being distributed based on the display request. For example, when a request to display a regular gift is made during the distribution of a specific video, regular objects 37a, 37b corresponding to the regular gift requested to be displayed are displayed on the display screen 30 of the viewing user device 10, as shown in FIG. 5.

If no request for displaying a regular gift is made, the regular gift display process ends. The regular gift display process shown in FIG. 15 is performed repeatedly during the distribution period of the video. The effect gift display process may also be performed in the same procedure as the regular gift display process described above.

Next, further referring to FIG. 16, the display process of the wearing gift performed during video distribution will be described. The display process of the wearing gift is performed in parallel with the video distribution process shown in FIG. 14. The display process of the wearing gift may also be performed in parallel with the display process of the normal gift shown in FIG. 15.

During the distribution of the video, in step S31, it is determined whether a request to display the wearable gift has been made. For example, the first viewing user can transmit a display request to display the wearable gift that the first viewing user owns from the viewing user device 10 to the server device 60.

When a display request for a wearing gift is made, the display process proceeds to step S32. In step S32, a display instruction object associated with the wearing gift requested to be displayed is displayed on the display screen 40 of the broadcast user device 20 based on the display request. For example, when a display request is made for a wearing gift showing a headband, a display instruction object 42b associated with the wearing gift is displayed on the display screen 40 of the broadcast user device 20.

Next, in step S33, it is determined whether a specific display instruction object has been selected from among the display instruction objects included on the display screen 40 of the broadcast user device 20.

When a specific display instruction object is selected, in step S34, a process is performed in which an attachment gift corresponding to the selected specific display instruction object is displayed on the display screen of the video being distributed. For example, when display instruction object 42b included in display screen 40 is selected, as shown in Figures 6, 7a, and 7b, attachment object 38 corresponding to the selected display instruction object 42b is displayed in display image 30 and display image 40. In addition, the selected display instruction object 42b is deleted from display screen 40.

If no display instruction object is selected in step S33, and if the display process for the attached gift is completed in step S34, the display process for the attached gift ends.

According to the above embodiment, when a first display request is made by a user viewing a co-starring video to request the display of a wearable gift, the wearable gift is not immediately displayed in the co-starring video, but is displayed in response to the selection of display instruction objects 42a-42d by the distribution user Ua or distribution user Ub. This makes it possible to display the wearable objects in the co-starring video in an orderly manner even if a large number of wearable gifts are gifted by users viewing the co-starring video. This makes it possible to prevent a deterioration in the viewing experience of the viewing user. According to the above embodiment, the wearable gift is worn by only one of the character objects of the co-starring distribution user Ua and the character object of the co-starring distribution user Ub. In this case, the number of wearable objects displayed in the co-starring video can be reduced, so that the wearable objects can be displayed in the co-starring video in a more orderly manner.

According to the above embodiment, a display instruction object is displayed on both the broadcast user Ua's broadcast user device 20a and the broadcast user Ub's broadcast user device 20b. As a result, the broadcast user Ua who has requested to co-star is also given the opportunity to wear the wearable gift that has been gifted in the co-starring video. By requesting to co-star with the broadcast user Ub who has collected a lot of giftings, the broadcast user Ua can obtain the opportunity to wear many wearable gifts. Broadcast users wish to decorate their own character objects with attractive decorations. In this way, according to the above embodiment, an incentive can be given to the broadcast user Ua to request to co-star.

According to the above embodiment, the viewing user can specify the recipient of the wearable object. This allows the wearable gift to be gifted to the intended broadcasting user without it being snatched by the broadcasting user who is appearing with the viewer.

According to the above embodiment, the display instruction object is displayed only on the broadcast user device 20b of the broadcast user who broadcast the original video (e.g., broadcast user Ub). In a co-starring video, two or more broadcast users appear together, but it is desirable to have the broadcast user who broadcast the original video manage the video. According to the above embodiment, the decision as to whether or not to display the wearable gift can be left to the broadcast user who broadcast the original video, rather than to the co-star who requested to appear together.

The display time of normal gifts 37a, 37b can be set shorter than that of attached gift 38, and normal objects 37a, 37b may be displayed so as not to come into contact with character object 31 or behind character object 31 rather than in front of it. In this case, normal objects 37a, 37b have little effect on the visibility of character object 31 in the video being distributed. Therefore, even if normal gifts are automatically displayed in the video in response to a display request from a viewing user (without the permission of distribution users Ua, Ub), it is unlikely to lead to a deterioration in the user's viewing experience due to a deterioration in the visibility of character object 31.

According to the above embodiment, it is considered that a viewing user who watches a video including a character object such as character object 31 has an attachment to the character object. Therefore, by having a character object wear an attachment gift, the appearance of the character object can be improved compared to an effect gift or a normal gift, and the satisfaction of the viewing user who was provided with the attachment gift can be increased. In this way, the attachment object that can be worn by the character object can provide the user with an incentive to repeatedly watch the video including the character object.

In the video distribution system 1 according to the above embodiment, a user can gift a wearable object to a character. This makes it possible to provide a more unique system compared to a system in which such wearable objects cannot be gifted, and this system can provide a more unique service. This makes it possible to attract more users to the video distribution system 1, thereby increasing the number of views of videos in the video distribution system 1.

In the video distribution system 1 according to the above embodiment, the broadcast users Ua and Ub can distribute videos including character objects that move according to their facial expressions using a broadcast user device 20 equipped with a camera such as a smartphone. In this way, in the video distribution system 1, the equipment required for the broadcast users Ua and Ub to distribute videos is simplified, and a platform that is easy for the broadcast users Ua and Ub to participate in is realized.

In the processing procedures described in this specification, particularly in processing procedures described using flow diagrams, it is possible to omit some of the processes (steps) that make up the processing procedures, to add processes that are not explicitly stated as processes that make up the processing procedures, and/or to change the order of the steps, and processing procedures in which such omissions, additions, or changes in order have been made are also included within the scope of the present invention as long as they do not deviate from the spirit of the present invention.

At least a part of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the video distribution system 1. At least a part of the functions realized by the computer processor 61 may be realized, for example, by the computer processor 21 of the broadcasting user device 20, or by the computer processor of the viewing user device 10. Specifically, some or all of the functions of the animation generation unit 61a and video generation unit 61b may be executed in the broadcasting user device 20. For example, a video generated in the broadcasting user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

When a broadcast user Ua who is watching a video including the character object 31 of the broadcast user Ub makes a request to perform together with the broadcast user Ub, the animation of the character object 131 of the broadcast user Ua who made the request to perform together may be generated by the server device 60, the broadcast user device 20a of the broadcast user Ua, the broadcast user device 20b of the broadcast user Ub, the viewing user device 10, or other devices. In one example, when the animation of the character object 131 of the broadcast user Ua is generated by the broadcast user device 20b of the broadcast user Ub, the face motion data and voice data of the broadcast user Ua are transmitted from the broadcast user device 20a of the broadcast user Ua to the broadcast user device 20b of the broadcast user Ub. In the broadcast user device 20b, the animation of the character object 131 is generated by applying the face motion data and voice data of the broadcast user Ua received from the broadcast user device 20a to the model data for the broadcast user Ua. This model data for the broadcast user Ua may be transmitted from the server device 60 to the broadcast user device 20a. In another example, when animation of the character object 131 of the broadcast user Ua is generated in the viewing user device 10, facial motion data and voice data of the broadcast user Ua are transmitted from the broadcast user device 20a of the broadcast user Ua to the viewing user device 10, and facial motion data and voice data of the broadcast user Ub are transmitted from the broadcast user device 20b of the broadcast user Ub to the viewing user device 10. In the viewing user device 10, animation of the character object 131 may be generated by applying the facial motion data and voice data of the broadcast user Ua received from the broadcast user device 20a to the model data for the broadcast user Ua, and animation of the character object 31 may be generated by applying the facial motion data and voice data of the broadcast user Ub received from the broadcast user device 20b to the model data for the broadcast user Ub. This model data for the broadcast user Ua and the model data for the broadcast user Ub may be transmitted from the server device 60 to the viewing user device 10. In this way, animation of the character object of the broadcast user may be generated in any device included in the video distribution system 1. Animation of the character object may be generated in a device not explicitly shown in FIG. 1. To the device that generates the animation of the character object, facial motion data and voice data of broadcast user Ua are transmitted from broadcast user device 20a of broadcast user Ua, and facial motion data and voice data of broadcast user Ub are transmitted from broadcast user device 20b of broadcast user Ub. Body motion may be transmitted in addition to facial motion.

In addition, the generation of the co-starring video including the generated character object 131 of broadcast user Ua and the broadcast video and character object 31 of broadcast user Ub may be performed by any of the server device 60, the broadcast user device 20a of broadcast user Ua, the broadcast user device 20b of broadcast user Ub, or the viewing user device 10.

A co-starring video may include character objects of three or more broadcast users. In other words, three or more broadcast users may virtually appear together in a video using their respective character objects.

This specification also discloses the following technical matters.
[1]
one or more computer processors;
The one or more computer processors execute the computer readable instructions to:
A co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user is reproduced on a viewing user device of a viewing user;
displaying a display instruction object on a first user device of the first user and a second user device used by the second user in response to receiving a first display request regarding a first gift from the viewing user device;
in response to an operation on the display instruction object in the first user device, displaying the first gift in association with the first character object in the co-starring video and deleting the display instruction object from a screen of the first user device, while not deleting the display instruction object from a screen of the second user device;
Video distribution system.
[2]
the one or more computer processors, when the display instruction object is operated in the second user device after the display instruction object is operated in the first user device, display the first gift in the co-starring video in association with the second character object.
The video distribution system according to [1].
[3]
In the co-starring video, the first gift is displayed in association with both the first character object and the second character object.
The video distribution system according to [2].
[4]
one or more computer processors;
The one or more computer processors execute the computer readable instructions to:
A co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user is reproduced on a viewing user device of a viewing user;
In response to receiving a first display request regarding a first gift from the viewing user device, causing a first user device of the first user to display a display instruction object;
accepting, in the first user device, designation of a designated character object from among the plurality of character objects in response to an operation on the display instruction object in the first user device;
displaying the first gift in association with the designated character object in the co-starring video;
Video distribution system.
[5]
the plurality of character objects includes a third character object generated based on a movement of a third user;
The video distribution system according to [4].
[6]
when the display instruction object is selected, the one or more computer processors display, on the first user device, an option for selecting one of the plurality of character objects.
A video distribution system according to [4] or [5].
[7]
one or more computer processors;
The one or more computer processors execute the computer readable instructions to:
A co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user is reproduced on a viewing user device of a viewing user;
in response to receiving a first display request for a first gift from the viewing user device, displaying a display instruction object on a first user device of the first user and a second user device used by the second user in response to receiving a first display request for the first gift from the viewing user device;
when the display instruction object is operated on the first user device, the first gift is displayed in association with the first character object in the co-starring video and the display instruction object is made unselectable on the second user device, and when the display instruction object is operated on the second user device, the first gift is displayed in association with the second character object in the co-starring video and the display instruction object is made unselectable on the first user device.
Video distribution system.
[8]
The first gift is a wearing gift associated with a wearing site,
The wearing gift is displayed in the co-starring video at a position corresponding to the wearing part of any one of the plurality of character objects in response to an operation on the display instruction object.
A video distribution system according to any one of claims [1] to [7].
[9]
In response to receiving a second display request from the viewing user regarding a second gift different from the first gift, the second gift is displayed in the co-starring video.
A video distribution system according to any one of claims [1] to [8].
[10]
The second gift is displayed in the co-starring video without being associated with any particular part of the plurality of character objects.
The video distribution system according to [9].
[11]
The second gift is displayed so as to move in the co-starring video.
The video distribution system according to [9] or [10].
[12]
The second gift is displayed in the co-starring video in response to the viewing user purchasing the second gift.
A video distribution system according to any one of claims [9] to [11].
[13]
the display instruction object is switched between an activated state in which the display instruction object can be selected by an operation and a deactivated state in which the display instruction object cannot be selected by an operation;
A video distribution system according to any one of claims [1] to [12].
[14]
The co-starring video is generated by the viewing user device.
A video distribution system according to any one of claims [1] to [13].
[15]
The co-starring video is generated based on first motion data indicating a motion of the first user received from the first user device and second motion data indicating a motion of the second user received from a second user device used by the second user.
The video distribution system according to [14].
[16]
1. A method for streaming video that is executed by one or more computer processors executing computer readable instructions, comprising:
A step of playing back, on a viewing user device of a viewing user, a co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user;
In response to receiving a first display request for a first gift from the viewing user device, displaying a display instruction object on a first user device of the first user and a second user device used by the second user;
a step of displaying the first gift in association with the first character object in the co-starring video in response to an operation on the display instruction object in the first user device, and deleting the display instruction object from a screen of the first user device, while not deleting the display instruction object from a screen of the second user device;
A video distribution method comprising:
[17]
one or more computer processors,
A step of playing back, on a viewing user device of a viewing user, a co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user;
In response to receiving a first display request for a first gift from the viewing user device, displaying a display instruction object on a first user device of the first user and a second user device used by the second user;
a step of displaying the first gift in association with the first character object in the co-starring video in response to an operation on the display instruction object in the first user device, and deleting the display instruction object from a screen of the first user device, while not deleting the display instruction object from a screen of the second user device;
A video distribution program that executes the following.
[18]
1. A method for streaming video that is executed by one or more computer processors executing computer readable instructions, comprising:
A step of playing back, on a viewing user device of a viewing user, a co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user;
displaying a display instruction object on a first user device of the first user in response to receiving a first display request for a first gift from the viewing user device;
receiving, in the first user device, designation of a designated character object from among the plurality of character objects in response to an operation on the display instruction object in the first user device;
displaying the first gift in association with the designated character object in the co-starring video;
A video distribution method comprising:
[19]
one or more computer processors,
A step of playing back, on a viewing user device of a viewing user, a co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user;
displaying a display instruction object on a first user device of the first user in response to receiving a first display request for a first gift from the viewing user device;
receiving, in the first user device, designation of a designated character object from among the plurality of character objects in response to an operation on the display instruction object in the first user device;
displaying the first gift in association with the designated character object in the co-starring video;
A video distribution program that executes the following.
[20]
1. A method for streaming video that is executed by one or more computer processors executing computer readable instructions, comprising:
A step of playing back, on a viewing user device of a viewing user, a co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user;
a step of displaying a display instruction object on a first user device of the first user and a second user device used by the second user in response to receiving a first display request for a first gift from the viewing user device;
a step of displaying the first gift in association with the first character object in the co-starring video and making the display instruction object unselectable in the second user device when the display instruction object is operated in the first user device, and displaying the first gift in association with the second character object in the co-starring video and making the display instruction object unselectable in the first user device when the display instruction object is operated in the second user device;
A video distribution method comprising:
[21]
one or more computer processors,
A step of playing back, on a viewing user device of a viewing user, a co-starring video including a plurality of character objects including a first character object generated based on a movement of a first user and a second character object generated based on a movement of a second user;
a step of displaying a display instruction object on a first user device of the first user and a second user device used by the second user in response to receiving a first display request for a first gift from the viewing user device;
a step of displaying the first gift in association with the first character object in the co-starring video and making the display instruction object unselectable in the second user device when the display instruction object is operated in the first user device, and displaying the first gift in association with the second character object in the co-starring video and making the display instruction object unselectable in the first user device when the display instruction object is operated in the second user device;
A video distribution program that executes the following.

1 Video distribution system

Claims (12)

one or more computer processors;
The one or more computer processors execute the computer readable instructions to:
generating motion data representative of a movement of a first user;
playing a co-starring video including a plurality of character objects including a first character object generated based on the motion data and a second character object generated based on a movement of a second user;
displaying a display instruction object in response to receiving a first display request regarding a first gift from a viewing user device of a viewing user who views the co-starring video;
accepting designation of a designated character object from among the plurality of character objects in response to an operation on the display instruction object;
Displaying the first gift in the co-starring video in association with the designated character object ;
the first display request includes user designation information designating either the first user or the second user,
the display instruction object is displayed when the user designation information designates the first user, and is not displayed when the user designation information designates the second user;
User equipment. the plurality of character objects includes a third character object generated based on a movement of a third user;
The user device of claim 1. When the display instruction object is selected, an option for selecting one of the plurality of character objects is displayed.
3. A user device according to claim 1 or 2. the first gift is an attachment gift associated with an attachment portion of the first character object and an attachment portion of the second character object,
The wearing gift is displayed at a position corresponding to the wearing part in the co-starring video in response to an operation on the display instruction object.
A user equipment according to any one of claims 1 to 3 . In response to receiving a second display request from the viewing user regarding a second gift different from the first gift, displaying the second gift in the co-starring video.
A user equipment according to any one of claims 1 to 4 . The second gift is displayed in the co-starring video without being associated with any particular part of the plurality of character objects.
A user device according to claim 5 . The second gift is displayed so as to move in the co-starring video.
A user equipment according to claim 5 or 6 . The second gift is displayed in the co-starring video in response to the viewing user purchasing the second gift.
A user equipment according to any one of claims 5 to 7 . the display instruction object is switched between an activated state in which the display instruction object can be selected by an operation and a deactivated state in which the display instruction object cannot be selected by an operation;
A user equipment according to any one of claims 1 to 8 . The co-starring video is generated based on a co-starring request from the second user.
A user equipment according to any one of claims 1 to 9 . 1. A method of video playback performed by one or more computer processors executing computer readable instructions, comprising:
generating motion data representative of movements of a first user;
playing a co-starring video including a plurality of character objects including a first character object generated based on the motion data and a second character object generated based on a movement of a second user;
Displaying a display instruction object in response to receiving a first display request regarding a first gift from a viewing user device of a viewing user who views the co-starring video;
receiving a designation of a designated character object from among the plurality of character objects in response to an operation on the display instruction object;
displaying the first gift in association with the designated character object in the co-starring video;
Equipped with
the first display request includes user designation information designating either the first user or the second user,
the display instruction object is displayed when the user designation information designates the first user, and is not displayed when the user designation information designates the second user;
How to play videos. one or more computer processors,
generating motion data representative of movements of a first user;
playing a co-starring video including a plurality of character objects including a first character object generated based on the motion data and a second character object generated based on a movement of a second user;
Displaying a display instruction object in response to receiving a first display request regarding a first gift from a viewing user device of a viewing user who views the co-starring video;
receiving a designation of a designated character object from among the plurality of character objects in response to an operation on the display instruction object;
displaying the first gift in association with the designated character object in the co-starring video;
Run the command ,
the first display request includes user designation information designating either the first user or the second user,
the display instruction object is displayed when the user designation information designates the first user, and is not displayed when the user designation information designates the second user;
Video playback program.