JP2021033980A - Moving image distribution system, moving image distribution method and moving image distribution program - Google Patents

Abstract

To provide a moving image distribution system having one or more computer processors, a moving image distribution method, and a moving image distribution program.SOLUTION: In a moving image distribution system 1, a plurality of computer processors distributes a coaction moving image including a first character generated based on motion of a first user and a second character generated based on motion of a second user. A first object is displayed in association with the first character, and it is determined whether a matching object identical to the first object is being displayed in association with the second character. If it is not determined that the matching object is being displayed in association with the second character, a matching object identical to the first object is displayed in association with the second character in the coaction moving image.SELECTED DRAWING: Figure 1

Description

The disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program. More specifically, the disclosure in the present specification relates to a video distribution system, a video distribution method, and a video distribution program for live distribution of a video including a character generated based on a user's movement.

Various video distribution services have been known for a long time. In recent years, a video distribution system that generates a character animation based on the movement of a distribution user and performs live distribution of a video including the character animation has attracted attention. Such a video distribution system is described in, for example, Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1) and "Yusuke Hasegawa, the dawn of a new era of virtual idols PROJECT MariA, CG WORLD, Japan, Bone Digital Co., Ltd., November 2017. 10th, Vol. 231 pp. 74-79 ”(Non-Patent Document 1).

"Virtual cast" provided by Dwango Co., Ltd. is known as a video distribution service that distributes a video including a character generated based on the movement of a distribution user. In the virtual cast, characters of other users participate in a video distributed by a certain distribution user, so that two distribution users can virtually co-star in the video via each character.

There is also known a video distribution system that displays a gift object corresponding to a gift purchased by the viewing user on a display screen in response to a request from a viewing user who views the video. For example, in the video distribution system disclosed in Japanese Patent Application Laid-Open No. 2012-121998 (Patent Document 2), a viewing user purchases a gift item and provides the purchased gift item as a gift to the distribution user. Can be done. The gift is displayed in the video being delivered in response to a display request from the viewing user. The gift display request may also be automatically generated in response to the gift being purchased by the viewing user. The specification of Japanese Patent No. 6543403 (Patent Document 3) describes that a gifted object is displayed in association with a character that moves based on the movement of a distribution user.

JP 2015-184689 Japanese Unexamined Patent Publication No. 2012-121998 Patent No. 6543403

Yusuke Hasegawa, Dawn of a new era of virtual idols PROJECT MariA, CG WORLD, Japan, Bone Digital Co., Ltd., November 10, 2017, Volume 231 and pp. 74-79 Dwango Co., Ltd. ,? [Virtual Cast] Convex ″, [online], [Search on July 1, 2019], Internet <URL: https://qa.nicovideo.jp/faq/show/10740?category_id=718&site_domain=default>

When the host user character and the guest user character co-star in the co-starring video, the appearance of the host user character is determined by the host user's settings, and the appearance of the guest user character is determined by the guest user's settings. Be done. That is, the image of the character included in the co-starring movie is independently determined by each co-star. For this reason, there is a problem that it is difficult to express a sense of unity in the conventional co-starring video.

An object of the present invention is to provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. One of the more specific objects of the present invention is to provide a video distribution system, a video distribution method, and a video distribution program capable of distributing a co-starring moving image with an improved sense of unity.

One aspect of the present invention relates to a video distribution system including one or more computer processors. In one aspect, the one or more computer processors are generated based on the movements of the first character and the second user, which are generated based on the movements of the first user by executing computer-readable instructions. A co-starring video including the second character is distributed, the first object is displayed in association with the first character, and it is determined whether the same matching object as the first object is displayed in association with the second character. When it is determined that the matching object is not displayed in association with the second character, the same matching object as the first object is displayed in association with the second character in the co-starring moving image.

In one aspect of the present invention, the matching object displayed in association with the second character is displayed only in the co-starring moving image.

The moving image distribution system according to one aspect of the present invention is a display request for displaying the matching object in association with the second character when it is determined that the matching object is not displayed in association with the second character. The matching object is displayed in association with the second character in the co-starring moving image based on the display request.

When it is determined that the matching object is not displayed in association with the second character, the moving image distribution system according to one aspect of the present invention is directed to one or more viewing users who are viewing the co-starring moving image. It is urged to make a display request to display the matching object in association with the second character.

In the video distribution system according to one aspect of the present invention, when it is determined that the matching object is not displayed in association with the second character, the matching is associated with the second character for the first user. Prompt to make a display request to display the object.

In the video distribution system according to one aspect of the present invention, when it is determined that the matching object is not displayed in association with the second character, the matching is associated with the second character for the second user. Prompt to make a display request to display the object.

The moving image distribution system according to one aspect of the present invention gives a privilege to the first user when the matching object is displayed in association with the second character in the co-starring moving image. The moving image distribution system according to one aspect of the present invention gives a privilege to the second user when the matching object is displayed in association with the second character in the co-starring moving image. In the video distribution system according to one aspect of the present invention, there is a display request from the first viewing user among one or more viewing users who are viewing the co-starring video to display the matching object in association with the second character. When the matching object is displayed according to what has been done, a privilege is given to the first viewing user. The video distribution system according to one aspect of the present invention views the first user, the second user, and the co-starring video when the matching object is displayed in association with the second character in the co-starring video. Give benefits to each of one or more viewing users.

In one aspect of the present invention, the co-starring moving image is generated in response to receiving a co-starring application from the second user to apply for co-starring with the first user.

In one aspect of the present invention, the first object is displayed in association with the attachment portion of the first character, and the matching object is displayed in association with the attachment portion of the second character.

One aspect of the present invention relates to a video distribution method executed by one or more computer processors executing computer-readable instructions. The video distribution method is a first character generated based on the movement of the first user, a second character generated based on the movement of the second user, and a first character displayed in association with the first character. The step of distributing the co-starring moving image including the object, the step of determining whether or not the same matching object as the first object is displayed in association with the second character, and the step of associating the second character with the matching object. A step of displaying the same matching object as the first object in association with the second character in the co-starring moving image when it is determined that the characters are not displayed is provided.

One aspect of the present invention relates to a moving image distribution program. The video distribution program includes a first character generated based on the movement of the first user, a second character generated based on the movement of the second user, and the first character on one or more computer processors. A step of distributing a co-starring moving image including a first object displayed in association with each other, a step of determining whether or not a matching object same as the first object is displayed in association with the second character, and the second character. When it is determined that the matching object is not displayed in association with the above, the step of displaying the same matching object as the first object in association with the second character in the co-starring moving image is executed.

According to the embodiment of the present invention, it is possible to provide a moving image distribution system, a moving image distribution method, and a moving image distribution program capable of distributing a co-starring moving image with an improved sense of unity.

It is a block diagram which shows the moving image distribution system by one Embodiment. FIG. 5 is a schematic diagram schematically showing a distribution user who distributes a moving image distributed by the moving image distribution system of FIG. 1 and a distribution user device used by the distribution user. It is a figure explaining the gift object information stored in the moving image distribution system of FIG. It is a figure explaining the possession object information stored in the moving image distribution system of FIG. It is a figure explaining the object display information stored in the moving image distribution system of FIG. It is a figure which shows the example of the image of the moving image which is displayed on the viewing user apparatus 10 in one Embodiment. It is a figure which shows the example of the image of the moving image which is displayed on the distribution user apparatus 20a in one Embodiment. It is a figure which shows the example of the image of the moving image which is displayed on the distribution user apparatus 20b in one Embodiment. It is a figure which shows the example of the image of the moving image which is displayed on the viewing user apparatus 10 in one Embodiment. An object is usually displayed in the image of FIG. It is a figure which shows the example of the image of the moving image which is displayed on the viewing user apparatus 10 in one Embodiment. The attached object is displayed in the image of FIG. It is a figure which shows the example of the image of the moving image which is displayed on the distribution user apparatus 20a in one Embodiment. It is a figure which shows the example of the image of the moving image which is displayed on the distribution user apparatus 20b in one Embodiment. It is a figure which shows the example of the image of the co-starring moving image displayed on the viewing user apparatus 10 in one Embodiment. It is a figure which shows the example of the image of the co-starring moving image which is displayed on the distribution user apparatus 20a in one Embodiment. It is a figure which shows the example of the image of the co-starring moving image displayed on the distribution user apparatus 20b in one Embodiment. It is a figure which shows the example of the image of the co-starring moving image displayed on the viewing user apparatus 10 in one Embodiment. It is a flow figure which shows the flow of the moving image distribution processing in one Embodiment. It is a flow diagram which shows the flow of the process of delivering a co-starring moving image in one Embodiment. It is a flow chart which shows the flow of the process of displaying a matching object in one Embodiment.

Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. The same or similar components are designated by the same reference numerals in a plurality of drawings.

A moving image distribution system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram showing a video distribution system 1 according to an embodiment, and FIG. 2 is a distribution user device used by users Ua, Ub and the users Ua, Ub who distribute a video in the video distribution system 1. It is a schematic diagram which shows 20a, 20b schematically. The distribution user device 20a has a function for distributing a video including a character object generated based on the movement of the user Ua in the video distribution system 1, and the distribution user device 20b is a user in the video distribution system 1. It has a function for delivering a moving image including a character object generated based on the movement of Ub.

As will be described in detail later, the video distribution system 1 can generate a video including character objects of two or more distribution users and distribute the video. In other words, in the video distribution system 1, two or more distribution users can virtually co-star in the video via each character object. In this way, when two or more distribution users virtually co-star in a video via their respective character objects, the video is called a "co-star video". In the present specification, the character object of the distribution user included in the moving image may be simply referred to as a "character".

Both the user Ua and the user Ub are distribution users who distribute videos including characters generated based on movements, and are also viewing users who watch videos of other distribution users. In the present specification, a user who views a moving image using the viewing user device 10, the distribution user devices 20a, 20b, or other devices is referred to as a viewing user. Therefore, the distribution user devices 20a and 20b may have a function of viewing the moving image distributed by the moving image distribution system 1.

User Ua can apply for co-starring with user Ub. When this co-starring application is approved, a co-starring moving image including the character of the user Ub and the character of the user Ua is generated, and the co-starring moving image is distributed. When the user Ua participates in the video distributed by the user Ub and the user Ub and the user Ua co-star, the user Ua who has applied for co-starring and co-starred with the user Ub is called a "guest user", and the guest user participates. The user Ub that distributes the moving image may be referred to as a "host user". The concepts of host user and guest user are relative. For example, contrary to the above example, when the user Ub sends a co-starring application to the user Ua and the user Ub co-stars in the video of the user Ua based on the co-starring application, the user Ua becomes the host user and the user. Ub becomes a guest user. In the present specification, for convenience of explanation, it is assumed that the invitation is transmitted from the user Ub to the user Ua. That is, it is assumed that the user Ub is the host user and the user Ua is the guest user. However, the description of the user Ua in the present specification may be extended to the description of the guest user in general as much as possible. Similarly, the description of the user Ub herein can be extended to the host user in general as much as possible. For example, even when the distribution user Ua is described in the present specification, the description may be understood as a description regarding the guest user in general, and the description regarding the distribution user Ub may be understood as a description regarding the host user in general.

The video distribution system 1 includes a viewing user device 10, distribution user devices 20a and 20b, a server device 60, and a storage 70. The viewing user device 10, the distribution user device 20, the server device 60, and the storage 70 are connected to each other so as to be able to communicate with each other via the network 50. As will be described later, the server device 60 is configured to distribute a moving image including animations of characters of the distribution user Ua and the distribution user Ub.

This moving image is distributed from the server device 60 to the viewing user device 10 and the distribution user devices 20a and 20b. The delivered moving image is displayed on the display of the viewing user device 10. A viewing user who is a user of the viewing user device 10 can view the distributed moving image on the viewing user device 10. Although only one viewing user device 10 is shown in FIG. 1 for the sake of brevity in the drawings, the moving image distribution system 1 may include a plurality of viewing user devices. By viewing the distributed moving image, the distribution users Ua and Ub can perform the performance while checking the moving image in the moving image.

In the illustrated embodiment, the distribution user device 20a includes a computer processor 21a, a communication I / F 22a, a display 23a, a camera 24a, and a microphone 25a. Similarly, the distribution user device 20b includes a computer processor 21b, a communication I / F 22b, a display 23b, a camera 24b, and a microphone 25b. Since the distribution user device 20a and the distribution user device 20b have the same configuration and functions, when it is not necessary to distinguish between the two, they may be collectively referred to as the distribution user device 20. The components may also be referred to as a computer processor 21 or the like.

The computer processor 21 is an arithmetic unit that loads various programs that realize an operating system and various functions from storage into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a set of a plurality of physically separate computer processors.

The communication I / F 22 is implemented as hardware, firmware, communication software such as a TCP / IP driver or PPP driver, or a combination thereof. The distribution user device 20 can transmit / receive data to / from another device via the communication I / F 22.

The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect a player's touch operation (contact operation). The touch panel can detect various touch operations such as tapping, double tapping, and dragging of the player. The touch panel may include a capacitive proximity sensor and may be configured to be capable of detecting a player's non-contact operation.

The camera 24 continuously images the faces of the distribution users Ua and Ub, and acquires the image data of the faces of the distribution users Ua and Ub. The captured data of the faces of the distribution users Ua and Ub captured by the camera 24 is transmitted to the server device 60 via the communication I / F 22. The camera 24 may be a 3D camera capable of detecting the depth of a person's face. The camera 24 may capture images of parts other than the faces of the distribution users Ua and Ub, for example, hands, legs, fingers of the hands, or parts other than these, and acquire imaging data.

The microphone 25 is a sound collecting device configured to convert the input voice into voice data. The microphone 25 is configured to be able to acquire the voice input of the distribution users Ua and Ub. The voice inputs of the distribution users Ua and Ub acquired by the microphone 25 are converted into voice data, and this voice data is transmitted to the server device 60 via the communication I / F 22.

The viewing user device 10 may include the same components as the distribution user device 20. For example, the viewing user device 10 may include a computer processor, a communication I / F, a display, and a camera. The viewing user device 10 may perform the same function as the distribution user device 20 by downloading and installing the predetermined application software.

The viewing user device 10 and the distribution user device 20 are information processing devices such as smartphones. In addition to smartphones, the viewing user device 10 and the distribution user device 20 are mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and various information processing devices capable of playing moving images other than these. You may. In addition to the above components, each of the viewing user device 10 and the distribution user device 20 may include a sensor unit including various sensors such as a gyro sensor, and a storage for storing various information.

Next, the server device 60 will be described. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I / F 62, and a storage 63.

The computer processor 61 is an arithmetic unit that loads various programs that realize an operating system and various functions from the storage 63 or other storage into a memory and executes instructions included in the loaded programs. The computer processor 61 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic units other than these, or a combination thereof. The computer processor 61 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. Although the computer processor 21 is shown as a single component in FIG. 1, the computer processor 61 may be a set of a plurality of physically separate computer processors.

The communication I / F 62 is implemented as hardware, firmware, communication software such as a TCP / IP driver or PPP driver, or a combination thereof. The server device 60 can send and receive data to and from other devices via the communication I / F 62.

The storage 63 is a storage device accessed by the computer processor 61. The storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various storage devices other than those capable of storing data. Various programs can be stored in the storage 63. At least a part of the program and various data that can be stored in the storage 63 may be stored in a storage (for example, a storage 70) that is physically separate from the server device 60.

In the present specification, the program described as being executed by the computer processor 21 or the computer processor 61 or the instructions contained in the program may be executed by a single computer processor, or may be distributed by a plurality of computer processors. May be executed. Further, the program executed by the computer processor 21 or the computer processor 61 or the instructions included in the program may be executed by a plurality of virtual computer processors, respectively.

Next, the data stored in the storage 63 will be described. In the illustrated embodiment, the storage 63 includes model data 63a, object data 63b, gift object information 63c, possessed object information 63d, object display information 63e, and various other distribution videos necessary for generation and distribution. Data is stored.

The model data 63a is model data for generating a character animation. The model data 63a may be three-dimensional model data for generating a three-dimensional animation, or may be two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (sometimes referred to as “skeleton data”) indicating the face of the character and the skeleton of a portion other than the face, and surface data indicating the shape and texture of the surface of the character. The model data 63a can include a plurality of model data different from each other. The plurality of model data may have different rig data from each other, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data.

The object data 63b includes asset data for constructing a virtual space constituting a moving image. The object data 63b is data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and various objects displayed in the moving image other than these. Contains data. The object data 63b may include object position information indicating the position of the object in the virtual space.

The gift object information 63c is information for managing the gift object. An example of gift object information 63c is shown in FIG. As shown in the figure, in the gift object 63c, object information indicating the characteristics of the object is stored in association with the object identification information that identifies the object. The object information of a certain object includes image data indicating the image of the object, type data indicating the type of the object, mounting position data indicating the mounting position to the character when the object is a mounting object described later, and the object. The price of the object and various other data that characterize the object in question may be included.

In one embodiment, the gift object is displayed on the video based on a gift display request from a viewing user viewing the video. There are various types of gift objects. The gift object may include, for example, an effect object corresponding to an effect gift, a normal object corresponding to a normal gift, a wearing object corresponding to a wearing gift, and a message object corresponding to a message gift. The viewing user can purchase the desired gift. The distinction between the viewing user and the distribution user (for example, distribution users Ua, Ub) is a distinction focusing on the user's actions. For example, in the video distribution system 1, when a user views a video, the user is called a viewing user, but when the user distributes the video, the user is called a distribution user.

The effect object indicating the effect gift is an object that affects the impression of the entire viewing screen of the distributed video, for example, an object that imitates confetti. The object imitating confetti may be displayed on the entire viewing screen, whereby the impression of the entire viewing screen before and after the display can be changed. Effect objects may appear to overlap the character, but differ from wearing objects in that they are displayed without being associated with a particular part of the character.

A normal object indicating a normal gift is an object indicating a gift from a viewing user to a distribution user (for example, distribution users Ua, Ub), for example, a stuffed animal, a bouquet, an accessory, or an item suitable for a gift or present other than the above. It is an imitated object. In one aspect, the object is usually displayed on the moving image display screen so as not to come into contact with the character. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character. Ordinary objects may appear to overlap non-character objects in virtual space. Normally, an object may be displayed so as to overlap with a character, but it differs from a wearing object in that it is not displayed in association with a specific part of the character. In one aspect, when the normal object is displayed overlapping with the character, the normal object is displayed so as to overlap the part other than the head including the face of the character and not overlap with the head of the character. Will be done. In one aspect, when the normal object is displayed overlapping with the character, the normal object is displayed so as to overlap the part other than the upper body including the face of the character and not overlap with the upper body of the character. ..

The wearing object indicating the wearing gift is an object displayed on the display screen in association with a specific part (wearing part) of the character. In one aspect, the wearing object displayed on the display screen in association with a specific part of the character is displayed on the display screen so as to be in contact with the specific part of the character. In one aspect, the wearing object displayed on the display screen in association with a specific part of the character is displayed on the display screen so as to cover a part or all of the specific part of the character. The specific part may be specified by the three-dimensional position information indicating the position in the three-dimensional coordinate space, or may be associated with the position information in the three-dimensional coordinate space. For example, in the character's head, the specific parts are the front left side, front right side, back left side, back right side, center front side, center back side, left eye, right eye, left ear, right ear, and the entire hair. It may be determined.

The attached object is, for example, an accessory attached to the character (catcher, necklace, earring, etc.), clothes (T-shirt, etc.), a costume, and an object that can be attached to other characters. The gift object information 63c corresponding to the wearing object may include wearing part information indicating which part of the character the wearing object is associated with. The attachment part information of a certain attachment object can indicate to which part of the character the attachment object is attached. For example, when the wearing object is a Katyusha, the wearing part information of the wearing object may indicate that the wearing object is mounted on the "head" of the character. When the mounting site information on which the mounting object is mounted is specified as a position in the three-dimensional coordinate space, the mounting site information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, the wearing part information indicating the position where the wearing object indicating the “catching” is mounted may be associated with two parts of the character, “the left side behind the head” and “the right side behind the head”. That is, the wearing object indicating the "alice band" may be mounted on both the "left side behind the head" and the "right side behind the head". When the wearing object is a T-shirt, the wearing part information of the wearing object may indicate that the wearing object is mounted on the "body" of the character.

Two types of mounting objects that have a common mounting site are displayed in the moving image at intervals. That is, the two types of mounting objects having the same mounting site are mounted on the character at intervals of time. In other words, the two types of mounting objects that have the same mounting location are not mounted on the character at the same time. For example, with respect to the wearing object indicating the hat, and the wearing object indicating the hat, when the "head" is set as the wearing part, the wearing object indicating the Katyusha and the wearing object indicating the hat are not displayed at the same time.

A display time may be set for each of the gift objects according to the type of the gift object. In one aspect, the display time of the attached object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the attached object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

The possessed object information 63d is a list indicating the objects possessed by the users (viewing user and distribution user) of the video distribution system. An example of the possessed object information 63c is shown in FIG. As shown in the figure, in the possessed object information 63c, an object ID that identifies an object owned by the viewing user is stored in association with the account information of the viewing user. The viewing user account information is, for example, a user ID that identifies the viewing user. The object owned by the viewing user is, for example, the gift object described above. The distribution user can attach the object possessed by the character included in the moving image during the distribution of the moving image.

The object display information 63e is information for managing the attached object displayed in association with the character of the distribution user in the moving image. An example of the object display information 63d is shown in FIG. As shown in the figure, in the object display information 63d, an object ID that identifies an object displayed in the moving image is stored in association with the account information of the distribution user who distributes the moving image. In the object display information 63d, an object ID that identifies the attached object displayed in the video is stored in association with the account information of the distribution user who distributes the video, in association with the character of the distribution user. You may. The account information of the distribution user is, for example, a user ID that identifies the distribution user.

Next, the functions realized by the computer processors 21a and 21b will be described more specifically. The computer processor 21a functions as the face motion data generation unit 21a1 by executing a computer-readable instruction included in the distribution program. Similarly, the computer processor 21b functions as the face motion data generation unit 21b1 by executing a computer-readable instruction included in the distribution program. At least a part of the functions realized by the computer processors 21a and 21b may be realized by a computer processor other than the computer processors 21a and 21b of the moving image distribution system 1. At least a part of the functions realized by the computer processors 21a and 21b may be realized by, for example, the computer processor 61 mounted on the server device 60.

The face motion data generation unit 21a1 generates face motion data which is a digital representation of the face movement of the distribution user Ua based on the image data of the camera 24a.
Similarly, the face motion data generation unit 21b1 generates face motion data which is a digital representation of the face movement of the distribution user Ub based on the image data of the camera 24b. Face motion data is generated at any time with the passage of time. Face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data generated by the face motion data generation unit 21a1 can digitally represent the face movement (change in facial expression) of the distribution user Ua in time series, and the face motion data generation unit 21b1 can be used. The face motion data generated in the above can digitally represent the facial movement (change of facial expression) of the distribution user Ub in time series. The face motion data generated by the face motion data generation units 21a1,21b1 is transmitted to the server device 60 via the communication I / F22a, 22b.

In the distribution user device 20, in addition to the face motion data generated by the face motion data generation unit 21a1, body motion data which is a digital representation of the position and orientation of each part other than the face of the body of the distribution users Ua and Ub. May be generated. The distribution user device 20 may transmit body motion data to the server device 60 in addition to the face motion data. In order to generate body motion data, the distribution users Ua and Ub may be equipped with a motion sensor. The distribution user device 20 may be configured to be able to generate body motion data based on the detection information of the motion sensors attached to the distribution users Ua and Ub. Body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data expresses the body movements of the distribution users Ua and Ub as digital data in chronological order. The generation of body motion data based on the detection information of the motion sensors attached to the distribution users Ua and Ub may be performed in, for example, a shooting studio. The shooting studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor mounted on the distribution users Ua and Ub may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station provided in the shooting studio may be, for example, a base station provided by HTC CORPORATION. In addition, a supporter computer may be installed in a room separate from the shooting studio. The display in the shooting studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room where the supporter computer is installed. The room where the supporter computer is installed and the shooting studio may be separated by a glass window. In this case, the operator of the supporter computer (sometimes referred to as "supporter" in the present specification) can visually recognize the distribution users Ua and Ub. The supporter computer may be configured so that the settings of various devices provided in the shooting studio can be changed according to the operation of the supporter. The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various other devices. The supporter can input a message to the supporter computer and display the input message on the display of the shooting studio.

The distribution user device 20 may realize a function other than the face motion data generation unit 21a1 by executing the distribution program and / or other programs on the computer processor. For example, the distribution user device 20 may realize a function of playing back a received moving image by executing a viewing program for watching a moving image. The distribution program and the viewing program may be packaged in one application software, or may be provided as separate application software.

The viewing user device 10 may be configured to provide the same functions as the distribution user device 20. For example, the viewing user device 10 may realize a function of reproducing the received moving image by executing a viewing program for viewing a moving image, and is similar to the function of the face motion data generation unit 21a1 by executing the distribution program. The function of may be realized.

Next, the functions realized by the computer processor 61 will be described more specifically. The computer processor 61 executes a computer-readable instruction included in the distribution program to execute an animation generation unit 61a, a video generation unit 61b, a video distribution unit 61c, a gift request processing unit 61d, a gift purchase processing unit 61e, and a co-star application. It functions as a processing unit 61f, a determination unit 61g, a matching processing unit 61h, and a privilege giving unit 61i.

The animation generation unit 61a generates a character animation by applying the face motion data generated by the face motion data generation unit 21a1 of the distribution user device 20 to predetermined model data included in the model data 63a. It is composed. The animation generation unit 61a can generate an animation of the character so that the facial expression of the character changes based on the face motion data. Specifically, the animation generation unit 61a can generate an animation of a character that moves in synchronization with the movement of the facial expression of the distribution user Ua based on the face motion data related to the distribution user Ua. Similarly, the animation generation unit 61a can generate an animation of a character that moves in synchronization with the movement of the facial expression of the distribution user Ub based on the face motion data related to the distribution user Ub.

When the distribution user apparatus 20 provides body motion data relating to the distribution users Ua and Ub, the animation generation unit 61a determines the distribution users Ua and Ub based on the body motion data and the face motion data relating to the distribution users Ua and Ub. It is possible to generate an animation of a character that moves in synchronization with the movement of the body and facial expression.

When distributing the video of the distribution user Ua, the video generation unit 61b generates a background image showing the background using the object data 63b, and generates the background image and the animation of the character corresponding to the distribution user Ua. You can generate a video that includes it. The moving image generation unit 61b can synthesize the sound of the distribution user Ua generated based on the voice data received from the distribution user device 20a with the generated moving image. Similarly, when the moving image of the distribution user Ub is distributed, the moving image generation unit 61b generates a background image showing the background using the object data 63b, and the background image and the animation of the character corresponding to the distribution user Ub. And can generate a video containing. The moving image generation unit 61b can attach an object possessed to its own character to its own character in response to a request from the distribution user Ua or the distribution user Ub. The object that can be attached is, for example, the above-mentioned attachment object. By operating the distribution user device 20a or the distribution user device 20b, the distribution user Ua or the distribution user Ub makes a display request for attaching the attached object to its own character before or after the start of distribution of the moving image. It can be transmitted to 60. Based on this display request, the moving image generation unit 61b can attach the wearing object to the character of the distribution user device 20a or the distribution user device 20b. The moving image generation unit 61b can synthesize the sound of the distribution user Ub generated based on the voice data received from the distribution user device 20b with the generated moving image. In the moving image generated by the moving image generation unit 61b, the characters corresponding to the distribution users Ua and Ub are displayed superimposed on the background image. As described above, the moving image generation unit 61b generates an animation of a character that moves in synchronization with the movement of the facial expression of the distribution user Ua or the distribution user Ub, and the voice of the distribution user Ua or the distribution user Ub is synthesized with this animation. It is possible to generate a video for distribution. The co-starring video including both the character of the distribution user Ua and the character of the distribution user Ub will be described later.

The moving image distribution unit 61c distributes the moving image generated by the moving image generation unit 61b. This moving image is distributed to the viewing user device 10 and other viewing user devices via the network 50. The generated moving image is also distributed to the distribution user devices 20a and 20b. The received moving image is reproduced in the viewing user device 10 and the distribution user devices 20a and 20b.

A display example of the moving image distributed from the moving image distribution unit 61c is shown in FIGS. 6, 7a, and 7b. In these figures, it is assumed that the distribution user Ub distributes a moving image including its own character using the distribution user device 20b, and the moving image is played back on the viewing user device 10 and the distribution user devices 20a and 20b. There is. In FIG. 7a, it is assumed that the distribution user Ua does not distribute the video and is viewing the video distributed by the distribution user Ub, which is another distribution user. Therefore, in the description of FIGS. 6 and 7a to 7b, the distribution user Ua may also be referred to as a viewing user. FIG. 6 shows a display example of a moving image played on the viewing user device 10, FIG. 7a shows a display example of a moving image played on the distribution user device 20a, and FIG. 7b shows a display example of the moving image played on the distribution user device 20b. A display example of the moving image is shown.

As shown in FIG. 6, the image 30 of the moving image distributed from the server device 60 is displayed on the display of the viewing user device 10. The image 30 displayed on the viewing user device 10 includes the character 31 of the distribution user Ub generated by the animation generation unit 61a, the gift button 32, the evaluation button 33, the comment button 34, and the comment display area 35. And are included.

As shown in FIG. 7a, the image 40a of the moving image distributed from the server device 60 is displayed on the display of the distribution user device 20a. Similar to the image 30, the image 40a includes a character 31 of the distribution user Ub, a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35. In addition to this, the image 40a includes a co-starring application button 36 for applying for co-starring with the distribution user Ub in the moving image distributed by the distribution user Ub. The distribution user device 20a can display the image 40a of the distributed moving image by executing the application software including the viewing program, for example.

As shown in FIG. 6, in one embodiment, the image 30 of the viewing user device 10 does not include the co-star application button 36. For example, when the application software including the distribution program is not downloaded or installed in the viewing user device 10, or when the application software including the distribution program is not started in the viewing user device 10, the co-star application button 36 is included. The image 30 of the viewing user device 10 is generated so as not to be prevented. In another embodiment, the co-star application button 36 may also be displayed on the image 30 of the viewing user device 10. For example, the co-star application button 36 is included when the application software including the distribution program is downloaded or installed in the viewing user device 10, or when the application software including the distribution program is started in the viewing user device 10. The image 30 of the viewing user device 10 is generated as described above.

Since the character 31 is generated by applying the face motion data of the distribution user Ub to the model data included in the model data 63a as described above, the character 31 is synchronized with the movement of the facial expression of the distribution user Ub. The facial expression changes. When the body motion data is provided from the distribution user device 20, the character 31 can be controlled so that the parts other than the face also change in synchronization with the movement of the body of the distribution user Ub.

The gift button 32 is displayed on the image 30 so as to be selectable by operating the viewing user device 10. The gift button 32 can be selected, for example, by tapping on the area of the touch panel of the viewing user device 10 where the gift button 32 is displayed. In one embodiment, when the gift button 32 is selected, the window for selecting a gift to be given to the distribution user (here, the distribution user Ub) who is distributing the video being viewed is the image 30. Is displayed in. The viewing user can purchase a gift to be gifted from the gifts displayed in the window. In another embodiment, the image 30 displays a window containing a list of purchased gifts, depending on the gift button 32 being selected. In this case, the viewing user can select a gift to be gifted from the gifts displayed in the window. Gifting or purchaseable gifts may include effect gifts, regular gifts, wearing gifts, and other gifts.

The evaluation button 33 is displayed on the image 30 so as to be selectable by the viewing user who uses the viewing user device 10. The evaluation button 33 can be selected, for example, by tapping the area of the touch panel of the viewing user device 10 on which the evaluation button 33 is displayed. When the evaluation button 33 is selected by the viewing user who is viewing the moving image, evaluation information indicating that the moving image has been positively evaluated may be transmitted to the server device 60. The server device 60 can aggregate evaluation information from the viewing user device 10 and other viewing user devices. By selecting the evaluation button 33, evaluation information indicating that the moving image has been negatively evaluated may be transmitted to the server device 60. The evaluation information indicating a positive evaluation of the moving image may be referred to as positive evaluation information, and the evaluation information indicating that the negative evaluation of the moving image has been made may be referred to as negative evaluation information.

The comment button 34 is displayed on the image 30 so as to be selectable by the user. When the comment button 34 is selected by, for example, a tap operation, a comment input window for inputting a comment is displayed on the image 30. The viewing user can input a comment via the input mechanism of the viewing user device 10 or the distribution user device 20a. The input comment is transmitted from the viewing user device 10 and the distribution user device 20a to the server device 60. The server device 60 receives comments from the viewing user device 10, the distribution user device 20a, and other user devices, and displays the comments in the comment display area 35 in the image 30. In the comment display area 35, comments posted by each user are displayed, for example, in chronological order. The comment display area 35 occupies a part of the image 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When a comment exceeding the upper limit set in the comment display area 35 is posted, the comment with the oldest posting time is deleted from the comment display area 35 in order. Therefore, the higher the frequency of the received comments, the shorter the display time of each comment in the comment area 35. In one embodiment, a scroll bar is provided in the image 30, and the comment deleted from the comment display area 35 can be viewed by operating the scroll bar to scroll the comment.

As shown in FIG. 7b, the image 40b of the moving image distributed from the server device 60 is displayed on the display of the distribution user device 20b. The image 40b displayed on the distribution user device 20b includes a character 31 corresponding to the distribution user Ub, display instruction buttons 42a to 42c for displaying a wearing gift for which a display request has been made by the viewing user, and a comment display area. 35 and are included. The image 40b displayed on the distribution user device 20b includes the same background image, character image, and comment as the image 30 and the image 40a. On the other hand, the image 40b is different from the images 30 and 40a in that it does not include the gift button 32, the evaluation button 33, the comment button 34, and the co-star application button 36, but includes the display instruction buttons 42a to 42c. ..

The display instruction buttons 42a to 42c are displayed on the display screen 40 in response to receiving a display request for displaying the attached gift, which will be described later, from the viewing user. In the illustrated embodiment, three display instruction buttons 42a to 42c are displayed on the image 40b. Each of the display instruction buttons 42a to 42c is displayed on the display screen 40 so as to be selectable by the distribution user. When any of the display instruction buttons 42a to 42c is selected by, for example, a tap operation,
An operation is performed to display the wearing gift corresponding to the selected display instruction button. As described above, the display instruction buttons 42a to 42c are display instruction objects for giving an instruction to display the attached gift on the moving image being distributed. Therefore, in the present specification, the display instruction buttons 42a to 42c may be referred to as display instruction objects 42a to 42c. When it is not necessary to distinguish the display instruction objects 42a to 42c from each other, the display instruction objects 42a to 42c may be simply referred to as display instruction objects 42. A specific example of displaying the attached gift will be described later. The image 40b may be displayed on the supporter computer described above. The display instruction objects 42a to 42c may be selected according to the operation of the supporter computer by the supporter.

Each time a display request requesting the display of the attached gift is received, a display instruction object 42 corresponding to the display request is added to the image 40b. There is an upper limit to the number of display instruction objects 42 that can be displayed on the image 40b. In the illustrated embodiment, the upper limit of the number of display instruction objects 42 that can be displayed on the image 40b is 3. In this case, the image 40b has a display area capable of displaying three display instruction objects. When four or more display requests for the attached gift are received, the display instruction object 42 corresponding to the fourth and subsequent display requests is not displayed in the image 40b. The display instruction object 42 corresponding to the display request of the attached gift received fourth is when any of the three display instruction objects 42 already displayed is selected and a space is created in the display area. It is displayed in the image 40b.

The gift request processing unit 61d receives a gift display request from the viewing user, and performs a process for displaying the gift object in response to the display request. Each viewing user can send a gift display request to the server device 60 by operating his / her viewing user device. The gift display request includes the user ID of the viewing user, the gift identification information (gift ID) that identifies the gift that requests display, and / or the object identification information (object) that identifies the gift object that corresponds to the gift that requests display. ID) and may be included.

As described above, the gift object indicating the gift may include an effect object corresponding to the effect gift, a normal object corresponding to the normal gift, and a wearing object corresponding to the wearing gift.

In one aspect, when the gift request processing unit 61d receives a display request for a specific normal gift from the viewing user, the gift request processing unit 61d displays a normal object indicating the normal gift for which the display is requested in the moving image based on the display request. Perform processing. For example, when a display request for a normal gift indicating a bag is made, as shown in FIG. 8, the gift request processing unit 61d displays a normal object 37a indicating the bag on the image 30 based on the display request. Similarly, when a display request for a normal gift indicating a teddy bear is made, as shown in FIG. 8, the gift request processing unit 61d displays a normal object 37b indicating the teddy bear based on the display request in the image 30. Is displayed in. Although not shown, the images 40a in the distribution user device 20a and the image 40b in the distribution user device 20b also display the normal objects 37a and 37b in the same manner as the image 30.

In one aspect, when the gift request processing unit 61d receives a display request for a specific effect gift from the viewing user, the effect object corresponding to the effect gift requested to be displayed is converted into a video display image based on the display request. Perform processing to display. For example, when a display request for an effect gift indicating confetti or fireworks is made, the gift request processing unit 61d displays an effect object (not shown) corresponding to the effect gift indicating confetti or fireworks based on the display request. ) Is displayed in the image 30, the image 40a, and the image 40b.

The display request of the normal gift may include a display position specification parameter that specifies the display position of the normal object indicating the normal gift. In this case, the gift request processing unit 61d can display the normal object at the position specified by the display position specification parameter. When the display position and display range of the character 31 are defined, the position relative to the character 31 can be specified as the display position of the normal object by the display position specification parameter.

In one aspect, the normal object may be displayed to move within the moving image 30. For example, the normal objects 37a and 37b may be displayed so as to fall from the top to the bottom of the screen. In this case, the normal objects 37a and 37b may be displayed in the image 30 while falling from the start of the fall to the lower end of the image 30, and may disappear from the image 30 after falling to the lower end of the image 30. The moving direction of the normal objects 37a and 37b in the screen can be set arbitrarily. For example, the normal objects 37a and 37b may move in the image 30 from left to right, right to left, upper left to lower left, or in any other direction. The normal objects 37a and 37b can move on various orbits. For example, the normal objects 37a and 37b can move on a linear orbit, a circular orbit, an elliptical orbit, a spiral orbit, or an orbit other than these. The viewing user moves the movement direction parameter and the normal object 37a, 37b that specify the movement direction of the normal object 37a, 37b in addition to the display position specification parameter or in place of the display position specification parameter in the display request of the normal object. It can include at least one of the orbital parameters that specify the orbit. In one embodiment, among the effect object and the normal object, those whose size in the virtual space is smaller than the reference size may be partially or wholly overlapped and displayed on the character 31. In one embodiment, among the effect object and the normal object, those whose size in the image 30 is larger than the reference size are displayed at positions that do not overlap with the character 31. In another embodiment, the effect object and the normal object whose size in the virtual space is larger than the reference size may be displayed after the character 31. The normal objects 37a and 37b may be displayed so as to move as described above in the images 40a and 40b.

In one aspect, when the gift request processing unit 61d receives a display request for a specific wearing object from the viewing user, the display instruction object is displayed on the image 40b in the distribution user device 20 as shown in FIG. 7b based on the display request. 42a to 42c are displayed. Each of the display instruction objects 42a to 42c is associated with a wearing gift for which a display request has been made. When any of the display instruction objects 42a to 42c is selected, the wearing gift associated with the selected display instruction object is displayed in the video being delivered. For example, when the display instruction object 42b is associated with a cat ears imitating a cat ears and the display instruction object 42b is selected, the gift request processing unit 61d receives the cutie corresponding to the selected display instruction object 42b. The attached object 38 indicating the above is displayed on the moving image being distributed. 9 and 10a to 10b show examples of displaying a moving image including the wearing object 38 showing the Katyusha. Further, as shown in FIG. 10b, the selected display instruction object 42b is deleted from the image 40b.

The attached object is displayed in the moving image in association with a specific part (attached part) of the character. For example, the wearing object may be displayed in the moving image so as to be in contact with the wearing part of the character. The wearing object 38 may be displayed in the moving image so as to be mounted on the wearing portion of the character. In one embodiment, the wearing object 38 indicating the Katyusha is associated with the head of the character. Therefore, in the display examples shown in FIGS. 9 and 10a to 10b, the wearing object 38 is mounted on the head of the character 31. The attached object may be displayed in the moving image display screen so as to move along with the movement of the attached portion of the character. For example, when the head of the character 31 wearing the wearing object 38 indicating the alice band moves, the wearing object 38 showing the alice band also accompanies the head of the character 31 as if the alice band were attached to the head of the character 31. And move.

As described above, the gift object information 63c may include the wearing part information indicating which part of the character the wearing object is associated with. In one aspect, when the attached object is attached to the character, the gift request processing unit 61d is the same as or overlaps with the portion indicated by the attached portion information of the attached object until the display time of the attached object elapses. Prohibit the display of other attached objects attached to the part to be attached. For example, the Katyusha associated with both the "left rear of the head" and the "right posterior head" and the hair accessory associated with the "left posterior head" overlap the "left posterior head". Therefore, when the Katyusha is displayed, the display of the hair accessory for which "the left side behind the head" is set as the wearing part information is prohibited. On the other hand, the Katyusha associated with "left behind the head" and "right behind the head" and the earrings associated with "left ear (of the head)" and "right ear (of the head)" Since the mounting parts of the character do not overlap, they can be mounted at the same time.

In one embodiment, in order to prohibit the display of a plurality of wearing objects having the same or overlapping mounting parts, the display instruction object 42 for displaying the wearing objects whose display is prohibited may be deactivated. In the embodiment shown in FIG. 7b, it is assumed that the display instruction object 42a is an object (button) for instructing the display of the hair accessory for which "the left side behind the head" is set as the wearing part information. In this case, since the character 31 is wearing the wearing object 38 indicating the Katyusha, the wearing object indicating the hair accessory is prohibited from being displayed in the moving image while the wearing object 38 is wearing the character 31. .. In one embodiment, the display instruction object 42a associated with the wearing object indicating the hair accessory is deactivated in order to prohibit the display of the wearing object indicating the hair accessory in the moving image. For example, the display instruction object 42a cannot be selected even if it is operated while the wearing object 38 is mounted on the character 31. In another embodiment, the display instruction object 42a is erased from the image 40b while the wearing object 38 is mounted on the character 31. The deactivated display instruction object 42a is reactivated as the display time of the Katyusha elapses. In order to reactivate the display instruction object 42a, for example, the display instruction object 42a that was not selectable may be made selectable again, or the hidden display instruction object 42a is displayed again on the image 40b. You may let me.

The gift request processing unit 61d performs a process for displaying the gift object corresponding to the gift display request from the viewing user and a process for updating the object display information 63e. For example, when the attached object 38 is displayed in the moving image distributed by the distribution user Ub, the object ID that identifies the attached object 38a is associated with the user ID that identifies the distribution user Ub in the object display information 63e. It will be remembered. Similarly, when another wearing object is displayed, the object ID that identifies the displayed wearing object is stored in association with the user ID of the distribution user Ub. When the attached object displayed in the moving image disappears from the screen (when the attached object is no longer attached), the gift request processing unit 61d sets the object ID that identifies the attached object disappeared from the screen as the object display information 63e. You may delete it from.

In one aspect, the gift purchase processing unit 61e, in response to a request from the viewing user of the video, provides the purchase information of each of the plurality of gift objects that can be purchased in connection with the video to the viewing user device (for example, , The viewing user device 10 and the distribution user device 20a). The purchase information for each gift object includes the type of gift object (effect object, regular object, or wearing object), the image of the gift object, the price of the gift object, and the information required to purchase other gift objects. Can be included. The viewing user can select the gift object to be purchased based on the purchase information of the gift object displayed on the viewing user device 10 or the distribution user device 20a. The gift object to be purchased may be selected by operating the viewing user device 10 or the distribution user device 20a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 60. The gift purchase processing unit 61e performs payment processing based on the purchase request. When this payment process is completed, the purchased gift object is held by the viewing user. The storage 23 may store the gift ID of the purchased gift (or the gift object ID of the gift object indicating the gift) in association with the user ID of the viewing user who purchased the gift. The purchase of gift objects may be made using a lottery, loot box, or roulette wheel. That is, the viewing user may acquire the gift item through the purchase of a lottery, a loot box, or a roulette wheel without specifying the gift object to be purchased. In the present specification, obtaining a gift item without specifying the gift object to be purchased may be included in the "purchase" of the gift item.

The gift objects that can be purchased may vary from video to video. The gift objects that can be purchased may be available for purchase in a plurality of videos. That is, the gift object that can be purchased may include a unique gift object that is unique to each video and a common gift object that can be purchased in a plurality of videos. For example, the effect object indicating confetti may be a common gift object that can be purchased in a plurality of moving images.

In one aspect, when an effect object is purchased while watching a predetermined video, the effect object to be purchased becomes the video being viewed in response to the completion of the payment process for purchasing the effect object. It may be displayed automatically. If a normal object is purchased while watching a predetermined video, the normal gift object to be purchased is the video being watched in response to the completion of the payment process for purchasing the normal object, as described above. May be displayed automatically.

In another aspect, a payment completion notification is transmitted to the viewing user device 10 in response to the completion of the payment processing in the gift purchase processing unit 61e for the effect object to be purchased, and the effect object is purchased in the viewing user device 10. A confirmation screen may be displayed to confirm with the viewing user whether or not to request the display of the effect object. When the viewing user chooses to make a display request for the purchased effect object, the display request requesting the display of the purchased effect object is sent from the client device of the viewing user to the gift request processing unit 61d. The gift request processing unit 61d may perform a process of displaying the effect object to be purchased on the moving image 70. Even when the purchase target is a normal object, a confirmation screen for confirming with the viewing user whether or not to request the display of the purchased normal object may be displayed on the viewing user device 10 in the same manner as described above.

When a co-starring application is made to one distribution user by another distribution user, the co-starring application processing unit 61f virtually causes the one distribution user and the other distribution user to perform the co-starring application based on the co-starring application. Generate a co-starring video to co-star. In the following, the description will be made on the assumption that the distribution user Ua who is viewing the video including the character 31 of the distribution user Ub applies for co-starring with the distribution user Ub. The co-starring application processing unit 61f can generate a co-starring video based on not only the co-starring application from the distribution user Ua but also the co-starring application from various distribution users.

In one embodiment, the co-starring application processing unit 61f receives a co-starring application from the distribution user Ua and generates a co-starring moving image in response to the co-starring application. The distribution user Ua can send the co-starring application to the server device 60 by operating the distribution user device 20a. Specifically, when the co-starring application button 36 displayed on the distribution user device 20a is selected, the co-starring application is transmitted from the distribution user device 20a to the server device 60. The co-star application button 36 can be selected, for example, by tapping the touch panel of the distribution user device 20a to the area where the co-star application button 36 is displayed. Depending on the selection of the co-star application button 36, the application software including the distribution program may be started in the distribution user device 20a. The co-starring application transmitted from the distribution user device 20a may include a user ID that identifies the distribution user Ua. The co-star application button 36 may be displayed from the time of distribution of the moving image, or may be displayed in response to the distribution user Ub inviting the distribution user Ua. The distribution user Ub may send an invitation for inviting the distribution user Ua to co-star from the distribution user device 20b to the distribution user device 20a via the server device 60 or without the server device 60.

The co-starring application processing unit 61f may decide whether or not to approve the co-starring application in response to receiving the co-starring application from the distribution user device 20a. The co-star application processing unit 61f can determine whether or not co-starring is possible based on various information about the distribution user Ua who applied for co-starring. For example, when the evaluation of the distribution user Ua by other users is higher than the predetermined standard, the co-star application from the distribution user Ua can be permitted, and conversely, the evaluation of the distribution user Ua by other users is predetermined. If it is lower than the standard, the co-starring application from the distribution user Ua can be rejected. Further, the distribution user Ub may be inquired as to whether or not the application for co-starring from the distribution user Ua is permitted, and the possibility of co-starring may be decided according to the answer.

In one embodiment, when the co-starring application from the distribution user Ua is permitted, the co-starring application processing unit 61f generates a co-starring video in which the distribution user Ua and the distribution user Ub co-star. In order to generate the co-starring moving image, the co-starring application processing unit 61f acquires the face motion data and the voice data of the distribution user Ua from the distribution user Ua. The face motion data of the distribution user Ua may be transmitted from the distribution user device 20a to the server device 60 together with the co-star application, or the server device 20a responds to a request from the server device 60 after the co-star application is approved. It may be transmitted to the device 60. When the body movement of the distribution user Ua is also expressed as an animation, the body motion data may be provided to the server device 60 together with the face motion data of the distribution user Ua. When the face motion data cannot be acquired from the distribution user Ua, the co-star application processing unit 61f may acquire only the voice data from the distribution user Ua. For example, when the distribution user device 20a used by the distribution user Ua does not have the function of the face motion data generation unit 21a1 or other functions for video distribution, the function is disabled, and other than these. In the case of, the co-star application processing unit 61f may acquire the voice data without acquiring the face motion data (and the body motion data) from the distribution user Ua.

In one embodiment, the co-starring application processing unit 61f adds an animation of the character of the distribution user Ua to the video including the character 31 of the distribution user Ub based on the face motion data of the distribution user Ua to create a co-starring image. Generate. The animation of the character of the distribution user Ua may be generated by the animation generation unit 61a based on the face motion data of the distribution user Ua. The animation of the character of the distribution user Ua may be generated by applying the face motion data of the distribution user Ua to the model data for the distribution user Ua included in the model data 63a. For example, the co-star application processing unit 61f generates a layer including the animation of the character of the distribution user Ua, and superimposes this layer on the video including the character 31 of the distribution user Ub to superimpose the character of the distribution user Ua and the distribution user Ub. It is possible to generate a co-starring moving image including the character 31 of. When the co-star application processing unit 61f acquires the voice data without acquiring the face motion data (and body motion data) from the distribution user Ua, the co-star application processing unit 61f acquires the video including the character 31 of the distribution user Ub from the distribution user Ua. By superimposing the voice generated based on the voice data, it is possible to generate a co-starring moving image including the character 31 of the distribution user Ub and the voice of the distribution user Ua. The co-star application processing unit 61f generates the video including the character 31 of the distribution user Ub based on the audio data acquired from the distribution user Ua even when the model data for the distribution user Ua is not set as the model data 63a. By superimposing the voices to be generated, it is possible to generate a co-starring moving image including the character 31 of the distribution user Ub and the voice of the distribution user Ua. In this way, the distribution user Ua can co-star with the distribution user Ub by his / her own voice.

When the co-starring application processing unit 61f cannot acquire the face motion data from the distribution user Ua, the co-starring video including the voice of the distribution user Ua and the character 31 of the distribution user Ub is distributed, and then the face motion data is acquired from the distribution user Ua. By generating the character of the distribution user Ua based on the face motion data of the distribution user Ua at the timing, it is possible to generate a co-starring moving image including the character of the distribution user Ua and the character 31 of the distribution user Ub. In this way, the co-starring application processing unit 61f can switch the co-starring video including the voice of the distribution user Ua and the character 31 of the distribution user Ub to the co-starring video including the character 31 of the distribution user Ua and the character 31 of the distribution user Ub. .. On the contrary, the co-starring application processing unit 61f switches the co-starring video including the character of the distribution user Ua and the character 31 of the distribution user Ub to the co-starring video including the voice of the distribution user Ua and the character 31 of the distribution user Ub. Can be done. In this way, a co-starring video in which voice co-starring is performed (sometimes referred to as "voice co-starring video") and a co-starring video in which characters are co-starring (sometimes referred to as "character co-starring video"). ) May be switched alternately.

The generated co-starring moving image is distributed by the moving image distribution unit 61c. The co-starring moving image may be created by the distribution user device 20a or the distribution user device 20b. When the co-starring moving image is generated by the distribution user device 20a, the co-starring moving image is transmitted from the distribution user device 20a to the server device 60 and distributed by the moving image distribution unit 61c of the server device 60. When the co-starring moving image is generated by the distribution user device 20b, the co-starring moving image is transmitted from the distribution user device 20b to the server device 60 and distributed by the moving image distribution unit 61c of the server device 60.

11 and 12a to 12b show a display example of the co-starring moving image distributed from the moving image distribution unit 61c. In these figures, the distribution user Ua applies for co-starring with the video distributed by the distribution user Ub, and as a result, the co-starring video including the character of the distribution user Ua and the character of the distribution user is distributed. It is assumed that the distribution user Ua has selected the co-star application button 36 while viewing the image shown in FIG. 10a.

As shown in FIG. 11, the image 130 of the co-starring moving image distributed from the server device 60 is displayed on the display of the viewing user device 10. The image 130 of the co-starring moving image displayed on the viewing user device 10 includes the character 131 of the distribution user Ua in addition to the character 31 of the distribution user Ub. As described above, the character 131 of the distribution user Ua is generated by the animation generation unit 61a or the co-star application processing unit 61f. The image 130 of the co-starring moving image includes a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35, similar to the original distribution image shown in FIG.

The image 130 of the co-starring moving image is displayed horizontally as shown in the figure. When the co-starring application processing unit 61f or the moving image distribution unit 61c distributes the co-starring image, it distributes it as a horizontally long image. As a result, the co-starring moving image is displayed as a horizontally long image 130 on the viewing user device 10. In one embodiment, as shown in FIG. 6, even if the original moving image (image) is vertically long, the co-starring image is converted to horizontally long and distributed. Since the co-starring image includes the characters of the two distribution users, it is easy to display the characters of the two people without duplication by making the image horizontally long. For example, in the co-starring image, the left half is the area allocated to the character of the original distribution user (host user) from the viewpoint of the viewing user, and the right half is the character of the distribution user (guest user) who applied for co-starring. It may be an allocated area. The allocation of the area to each distribution user may be arbitrarily determined so that the characters do not overlap with each other.

As shown in FIGS. 12a and 12b, the image 140a of the co-starring video distributed from the server device 60 is displayed on the distribution user device 20a, and the image 140b of the co-starring video is displayed on the display of the distribution user device 20b. Is displayed. The image 140a and the image 140b include the same background image, character image, and comment as the image 130. On the other hand, the images 140a and 140b are different from the image 130 in that they do not include the gift button 32, the evaluation button 33, and the comment button 34, but include the display instruction buttons 42a, 42c, and 42d. Since the distribution user Ua and the distribution user Ub co-star in the same co-starring image, the image 140a displayed on the distribution user device 20a of the distribution user Ua and the image 140b displayed on the distribution user device 20b of the distribution user Ub. May be the same as. Similar to the image 130, the images 140a and 140b are also displayed horizontally from the viewpoint of arranging a plurality of characters without duplication. In the examples shown in FIGS. 11 and 12a to 12b, the viewing user who is viewing the co-starring image shown in FIG. 11 requests the display of the wearing gift indicating the earring, and as a result, the display request. It is assumed that the display instruction object 42d is added to the display images of the distribution user device 20a and the distribution user device 20b accordingly. The display instruction object 42d is an object (button) for instructing the display of earrings in which "ears" are set as wearing part information.

When the object is displayed in association with one character of the host user and the guest user in the co-starring video, the determination unit 61g determines whether the same object as the object is displayed in association with the other character. To do. Therefore, when one of the characters of the host user and the guest user is wearing the wearing object, the determination unit 61g can determine whether or not the other character is wearing the same wearing object. The determination by the determination unit 61g may be performed with reference to the object display information 63e. In the object display information 63e, as described above, the object ID that identifies the wearing object that is displayed in association with the character of the distribution user in the moving image in association with the account information of the distribution user is stored. Therefore, based on the object display information 63e, the wearing object worn on the character 31 of the host user and the wearing object worn on the character 131 of the guest user can be specified. The determination unit 61g can determine whether or not the host user and the guest user are wearing the same wearing object based on the object display information 63e.

A specific example of the determination in the determination unit 61g will be described by taking the co-starring moving image displayed in FIG. 11 as an example. In the image 130 of the co-starring moving image shown in FIG. 11, the attached object 38 is displayed in association with the character 31 of the host user, while the attached object is displayed in association with the character 131 of the guest user. not exist. Therefore, the determination unit 61g does not display the attached object 38, which is displayed in association with the character 31 of the host user, in association with the character 131 of the guest user based on the object display information 63e (the character 131 does not display the attached object 38). It is determined that the attached object 38 is not attached). When at least one of the host user character 31 and the guest user character 131 is equipped with a plurality of wearing objects, the determination unit 61g can make the above determination for each of the plurality of wearing objects.

The matching processing unit 61h displays a matching object in the co-starring moving image according to the determination result in the determination unit 61g. Specifically, in the determination unit 61g, when one character of the host user and the guest user is displaying the wearing object, it is determined that the same object as the wearing object is not displayed in association with the other character. At that time, a process of displaying the same matching object as the object displayed in association with the other character is performed.

A specific example of the processing in the matching processing unit 61h will be described with reference to FIGS. 11 and 13. When the co-starring moving image illustrated in FIG. 11 is distributed, in the determination unit 61g, the wearing object 38 displayed in association with the character 31 of the distribution user Ub (host user) is the distribution user Ua (guest user). ) Is not displayed in association with the character 131. Based on the determination in the determination unit 61g, the matching processing unit 61h displays the matching object 138 in association with the character 131 of the guest user who does not have the wearing object 38 attached. In other words, the matching object 138 is attached to the character 131. The matching object 138 is the same object as the wearing object 38. In the illustrated example, the wearing object 38 and the matching object 138 are both objects showing a cat ears imitating a cat ears. Since the attached object 38 and the matching object 138 are the same attached object, they may be identified by the same object ID.

The matching processing unit 61h may perform a process of displaying the matching object based on the display request requesting the display of the matching object. In one embodiment, when the matching processing unit 61h determines that the attached object 38 displayed in association with the host user character 31 is not displayed in association with the guest user character 131 in the co-starring moving image. , It is possible to perform a process of urging the viewing user of the co-starring video to send a display request for the matching object. For example, the gift button 32 can be highlighted in the image 130 of the viewing user device 10 playing the co-starring moving image. The highlighting of the gift button 32 can be made, for example, by blinking the gift button 32, changing the color of the gift button 32, changing the size of the gift button 32, and other aspects. Various modes can be considered for the process of prompting the viewing user to display the matching object. The process of prompting the viewing user to display the matching object includes, for example, a process of highlighting the attached object 38 attached to the character 31 in the image 130, and an attached object 38 attached to only one character in the image 130. It may include a process of displaying a message indicating that the message is displayed, a process of displaying a message prompting the user to request display of a matching object other than the above, and a process other than the above.

The viewing user can operate the viewing user device 10 to send the matching object display request to the server device 60 when a process for prompting the viewing user to display the matching object is performed. For example, the viewing user selects the same object as the attached object 38 as the object to be gifted by operating the gift button 32, and sends a display request for the selected object (matching object) to the server device 60. Can be done. The display request of the matching object may include an object ID that identifies the matching object to be displayed. When the viewing user device 10 receives the matching object display request in the server device 60, the gift request processing unit 61d displays the matching object 138 in association with the character 131 based on the display request. Since the matching object 138 is a kind of attached object, the matching object is displayed on at least one of the image 140a displayed on the distribution user device 20a and the image 140b displayed on the distribution user device 20b when a display request for the matching object is made. The display instruction object associated with 138 may be displayed. In this case, the matching object 138 may be displayed in the co-starring moving image according to the selection of the display instruction object associated with the matching object 138. The matching object 138 may be displayed in the co-starring moving image according to the reception of the display request of the matching object 138 by the server device 60, regardless of the selection of the display instruction object.

A display example of the matching object 138 is shown in FIG. FIG. 13 shows a display example of an image of a co-starring moving image in which the matching object 138 is displayed in association with the character 131. As shown in FIG. 13, in the co-starring moving image 130 displayed on the viewing user device 10, the matching object 138 is displayed in association with the character 131. Similarly, in the image 140a displayed on the distribution user device 20a and the image 140b displayed on the distribution user device 20b, the matching object 138 is displayed in association with the character 131. As shown in the figure, the mounting object 38 and the matching object 138 are mounted on the same mounting portion of the character 31 and the character 131. Specifically, the wearing object 38 and the matching object 138 are displayed in association with the head of the character 31 and the head of the character 131, respectively.

In another embodiment, the matching processing unit 61h determines that the wearing object 38 displayed in association with the host user character 31 in the co-starring video is not displayed in association with the guest user character 131. In addition, it is possible to perform a process of urging the user (delivery user Ua) of the character 131 who does not wear the wearing object 38 to send a display request for the matching object. Various modes can be considered for the process of prompting the distribution user Ua, who is the user of the character 131 who does not wear the wearing object 38, to request the display of the matching object. The process of prompting the distribution user Ua to display the matching object includes, for example, a process of highlighting the attached object 38 attached to the character 31 in the image 140a, and a process of highlighting the attached object 38 attached to the character 31 in the image 140a. A process of displaying a message indicating that the object is attached, a process of displaying a message prompting to request a display of a matching object other than the above, and a process other than the above may be included. When the distribution user Ua is processed to prompt the distribution user Ua to display the matching object, the distribution user Ua can operate the distribution user device 20a to send the matching object display request to the server device 60. The moving image generation unit 61b displays the matching object 138 in association with the character 131 based on the display request.

In another embodiment, when the matching processing unit 61h determines that the attached object 38 displayed in association with the host user character 31 is not displayed in association with the guest user character 131 in the co-starring moving image. In addition, it is possible to perform a process of urging the user (delivery user Ub) of the character 31 wearing the wearing object 38 to send a display request for the matching object. Various modes can be considered for the process of prompting the distribution user Ub, who is the user of the character 31 wearing the wearing object 38, to request the display of the matching object. The process of prompting the distribution user Ub to display the matching object includes, for example, a process of highlighting the attached object 38 attached to the character 31 in the image 140b, and a process of highlighting the attached object 38 attached to the character 31 in the image 140b. A process of displaying a message indicating that the object is attached, a process of displaying a message prompting to request a display of a matching object other than the above, and a process other than the above may be included. When the distribution user Ub is processed to prompt the distribution user Ub to display the matching object, the distribution user Ub can operate the distribution user device 20b to send the matching object display request to the server device 60. The moving image generation unit 61b displays the matching object 138 in association with the character 131 based on the display request.

By displaying the matching object 138 in the co-starring moving image, both the character 31 and the character 131 are equipped with the same wearing object. This improves the uniformity of the co-starring video. More specifically, in the co-starring video, the uniformity of appearance between the character of the host user and the character of the guest user is improved.

The matching object 138 is displayed in the co-starring moving image based on the display request of the matching object 138 by the viewing user, the display request by the distribution user Ua, or the display request by the distribution user Ub. The matching object 138 may be attached to the character 131 only in the co-starring moving image. In other words, the matching object (for example, matching object 138) displayed in the specific co-starring video based on the display request of the matching object 138 by the viewing user, the display request by the distribution user Ua, or the display request by the distribution user Ub is Cannot be used by other videos.

When the matching object is displayed in association with one character of the user co-starring in the co-starring video, the privilege giving unit 61i grants the privilege to the other user. For example, in the example shown in FIGS. 11 and 13, when the matching object 138 is displayed in association with the character 131, the privilege giving unit 61i gives a privilege to the distribution user Ub who is the user of the character 31. Is given. When the matching object 138 is displayed in association with the character 131, the privilege granting unit 61i may grant the privilege to the distribution user Ua who is the user of the character 131. The privilege giving unit 61i may give a privilege to a viewing user who is viewing the co-starring video when the matching object 138 is displayed in association with the character 131. The privilege granting unit 61i may grant the privilege to all the viewing users who are watching the co-starring video, or grant the privilege only to a part of the viewing users who are watching the co-starring video. Is also good. The privilege giving unit 61i may give a privilege to each of the distribution user Ua, the distribution user Ub, and the viewing user. The privilege granting unit 61i may grant the privilege only to the viewing user who has given the matching object 138 among the viewing users who are watching the co-starring video. The benefits given by the privilege granting unit 61i include points that can be used in the video distribution service provided by the video distribution system 1, points that can be used on a specific platform other than the video distribution system 1, and crypto assets such as Bitcoin. It may include gifts for giving to other distribution users (eg, distribution user Ub), objects that can be displayed in the distributed video, and various other perks.

Next, with reference to FIGS. 14 to 16, a moving image distribution process according to one aspect will be described. FIG. 14 is a flow diagram showing the flow of the moving image distribution process in one embodiment, FIG. 15 is a flow diagram showing the flow of the process of distributing the co-starring moving image in one embodiment, and FIG. 16 is a flow diagram showing the flow of the process of distributing the co-starring moving image in one embodiment. It is a flow diagram which shows the flow of the process of displaying a matching object in. In the video distribution process described with reference to these figures, a video generated based on the face motion data acquired by the distribution user Ub using the distribution user device 20b is distributed, and the video is viewed. It is assumed that a co-starring application will be made from the distribution user Ua.

First, in step S11, face motion data, which is a digital representation of the facial movement (facial expression) of the distribution user Ub, is generated. The face motion data is generated, for example, by the face motion data generation unit 121b of the distribution user device 20b. In the distribution user device 20b, voice data may be generated based on voice input from the distribution users Ua and Ub. The generated face motion data and voice data are transmitted to the server device 60.

Next, in step S12, the face motion data from the distribution user device 20b is applied to the model data for the distribution user Ub, so that an animation of the character object 31 that moves in synchronization with the movement of the facial expression of the distribution user Ub is generated. Will be done. This animation is generated, for example, by the animation generation unit 61a described above.

Next, in step S13, a moving image including the animation of the character object 31 of the distribution user Ub is generated. The voice of the distribution user Ub may be synthesized with this moving image. The animation of the character object 31 is displayed superimposed on the background image. This moving image is generated, for example, by the moving image generation unit 61b described above.

Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50. When the delivered moving image is played back on the viewing user device 10, for example, an image of the moving image as shown in FIG. 5 is displayed on the viewing user device 10. The video is continuously distributed over a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other time. This moving image is distributed, for example, by the above-mentioned moving image distribution unit 61c.

Next, the process proceeds to step S15, and it is determined whether or not the termination condition for terminating the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the distribution user Ub has performed an operation for ending the distribution on the distribution user device 20b, or a condition other than these. If the end condition is not satisfied, the processes of steps S11 to S14 are repeatedly executed, and a video including an animation synchronized with the movement of the distribution user Ub, or a co-starring video when co-starring with the distribution user Ua continues. Delivery will continue. If it is determined that the end condition for the video is satisfied, the distribution process of the video is terminated.

Next, with reference to FIG. 15, the distribution process of the co-starring moving image in one embodiment will be described. FIG. 15 is a flow chart showing a flow of processing for distributing a co-starring moving image in one embodiment. In the distribution process of the co-starring video described with reference to FIG. 15, it is assumed that the distribution user Ua viewing the video including the character object of the distribution user Ub makes a co-starring application to the distribution user Ub. ing. The co-starring moving image distribution process is performed in parallel with the moving image distribution process shown in FIG.

First, it is determined in step S21 whether or not a co-star application has been made by a user other than the distribution user Ub during distribution of the moving image including the character object of the distribution user Ub. The co-starring application is made, for example, by the distribution user Ua. When the co-starring application is made by the distribution user Ua, the process proceeds to step S22.

In step S22, one or more guest users are selected from the distribution user Ua who applied for co-starring and other users. In this embodiment, it is assumed that the distribution user Ua is selected as the guest user. For example, the co-star application processing unit 61f determines whether or not to allow the co-star application.

If the co-starring application of the distribution user Ua is permitted in step S22, the process proceeds to step S23. In step S23, the animation of the character object 131 of the distribution user Ua is generated based on the face motion data of the distribution user Ua. Then, the co-starring video is generated by adding the animation of the character object 131 of the distribution user Ua to the video being distributed (the video including the character object 31 of the distribution user Ub). The process in step S22 is performed, for example, by the co-star application processing unit 61f described above.

Next, the process proceeds to step S24. In step S24, the co-starring moving image generated in step S23 is delivered. This co-starring moving image is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50. The co-starring moving image includes, for example, an animation of the character object 131 of the distribution user Ua and an animation of the character object 31 of the distribution user Ub, as shown in FIGS. 11 and 12a to 12b.

Next, the process proceeds to step S25. In step S25, it is determined whether or not the co-starring end condition is satisfied. For example, when the character object 131 of the distribution user Ua, which is a guest user, is in the inactive state, when the co-starring user evaluation point is equal to or less than a predetermined threshold value, or when a co-starring end instruction is received from the distribution user Ub, which is the host user. , Or, when any of the conditions that a predetermined time or more has passed from the start of distribution of the co-starring video is satisfied, it is determined that the co-starring end condition is satisfied. If the co-starring end condition is satisfied, the process proceeds to step S26.

In step S26, a process for terminating the distribution of the co-starring moving image is performed. For example, the character object 131 of the distribution user Ua, which is a guest user, is excluded from the co-starring video, so that the co-starring of the distribution user Ua and the distribution user Ub is terminated. Even if the co-starring is over, the video may continue to be distributed. The moving image distributed after the co-starring is completed does not include the character object 131 of the distribution user Ua.

Next, with reference to FIG. 16, a flow of processing for displaying matching objects in one implementation system will be described. In the matching object display process described with reference to FIG. 16, as shown in FIG. 11, a co-starring video in which the character 31 of the distribution user Ub and the character 131 of the distribution user Ua co-star is distributed. It is assumed that the character 131 is not equipped with the wearing object 38 worn by the character 31. The display processing of the matching object may be performed in parallel with the distribution processing of the co-starring moving image shown in FIG.

First, in step S31, a co-starring moving image in which the character 31 of the distribution user Ub and the character 131 of the distribution user Ua are co-starring is distributed. The generation and distribution of the co-starring moving image is performed by, for example, the co-starring application processing unit 61f and the moving image distribution unit 61c described above.

Next, in step S32, it is determined whether or not the characters co-starring in the co-starring moving image are wearing the same wearing object. The determination process in step S32 is performed by, for example, the determination unit 61g described above. In the co-starring video, since the character 31 which is one of the co-starring characters is wearing the wearing object 38, whether or not the character 131 which is the other of the co-starring characters is wearing the wearing object 38 is It is judged. If the character 131 is equipped with the same object as the attached object 38, the matching object display process ends. If the character 131 does not have the same object as the attached object 38 as in the example shown in FIG. 11, the process proceeds to step S33.

In step S33, it is determined whether or not the matching object display request has been made. The display request of the matching object is made by, for example, the viewing user of the co-starring video, the distribution user Ua, or the distribution user Ub. In step S33, a process may be performed to urge at least one of the viewing user, the distribution user Ua, and the distribution user Ub of the co-starring video to transmit the display request of the matching object. The viewing user, the distribution user Ua, or the distribution user Ub of the co-starring video operates the viewing user device 10, the distribution user device 20a, or the distribution user device 20b in response to the process of prompting the transmission of the display request of the matching object. A display request for a matching object can be sent to the server device 60. The determination of whether or not the matching object display request has been made is performed, for example, by the matching processing unit 61h described above. When the display request of the matching object is made, the process proceeds to step S34.

In step S34, a display process for displaying the matching object is performed. For example, the matching object 138 is displayed in association with the character 131 in the co-starring moving image. As described above, in the co-starring video, the character 31 of the distribution user Ub and the character 131 of the distribution user Ua can attach the same wearing object.

The matching object display process shown in FIG. 16 may be repeated during the distribution of the co-starring moving image. In the matching object display process, the matching object may be automatically displayed when it is determined that the co-starring characters do not wear the same wearing object. Therefore, step S33 can be omitted.

Subsequently, an example of the action and effect of the above embodiment will be described. According to the above embodiment, the same wearing object can be attached to each of the characters co-starring in the co-starring moving image. For example, in the co-starring moving image, when the character 31 is wearing the wearing object 38, the character 131 can be fitted with the same matching object 138 as the wearing object. As a result, the uniformity of the co-starring video can be improved.

According to the above embodiment, the matching object can be used only in the co-starring video in which the matching object is displayed. In one embodiment, the distribution user purchases an object (for example, a wearing object) that is displayed in association with the character in the moving image, and then displays the object in the moving image. For this reason, if an object purchased by oneself for a fee is given to another user who is a co-star in a form that can be freely used free of charge, fairness among users will be lacking. In the above embodiment, the matching object displayed in the co-starring video can be used only in the co-starring video, and cannot be used in other videos. By limiting the range of use of the matching object in this way, it is possible to improve the uniformity in the co-starring video and maintain the fairness among the users of the video distribution system.

According to the above embodiment, the matching object can be displayed in the co-starring moving image based on the display request from the viewing user. Therefore, according to the above embodiment, it is possible to promote the gifting of the matching object by the viewing user. If the viewing user does not have the matching object, the viewing user may purchase the matching object and then give it. In this case, the purchase of matching objects is also promoted.

According to the above embodiment, the matching object can be displayed in the co-starring moving image based on the display request from the user of the character wearing the wearing object (for example, the distribution user Ub). Therefore, according to the above embodiment, it is possible to give an incentive to appear in the co-starring video to a user who does not have the attached object or has a small number of attached objects.

According to the above embodiment, the matching object can be displayed in the co-starring moving image based on the display request from the user of the character who does not wear the wearing object (for example, the distribution user Ua). If the user of the character who does not wear the wearing object does not have the matching object at the time when he / she is prompted to make the display request of the matching object, he / she purchases the matching object and makes the display request. .. Therefore, according to the above embodiment, it is possible to promote the purchase of the matching object by the user of the character who does not wear the wearing object.

According to the above embodiment, the matching object 138 is displayed in association with the character of the distribution user Ua among the distribution user Ua (guest user) and the distribution user Ub (host user) who are co-starring in the co-starring video. In this case, the privilege is given to the distribution user Ub who is the host user. Therefore, when distributing the co-starring video, there is an opportunity to obtain a privilege by wearing the wearing object. Therefore, it is possible to give an incentive to the participants (host user and guest user) of the co-starring video to attach many attached objects. This facilitates the acquisition and purchase of mounted objects.

According to the above embodiment, when the matching object 138 is displayed in association with the character of the distribution user Ua among the distribution user Ua and the distribution user Ub co-starring in the co-starring video, the distribution is a guest user. Benefits are given to user Ua. Therefore, since the privilege can be obtained by becoming a guest user in the co-starring video, it is possible to encourage the viewing user to apply for co-starring.

According to the above embodiment, among the viewing users who are viewing the co-starring video, the viewing user who has given the matching object 138 is given a privilege. As a result, it is possible to give the viewing user an incentive to give the matching object 138.

According to the above embodiment, when the matching object 138 is displayed in association with the character of the distribution user Ua among the distribution user Ua and the distribution user Ub co-starring in the co-starring video, the distribution user Ua and the distribution user Ua are distributed. Benefits may be given to each of the user Ub and the viewing user. As a result, benefits will be given to all users involved in the co-starring video, so gifting and message transmission will become active after the benefits are given, and it will be possible to produce excitement in the co-starring video. it can.

According to the above embodiment, the matching object is mounted on the same wearing portion as the same object as the matching object worn by the co-star. For example, the matching object 138 is mounted on the same mounting site (ie, head) as the mounting object 38. As a result, the sense of unity in the co-starring video can be further improved.

In the video distribution system 1 according to the above embodiment, the distribution users Ua and Ub can distribute a video including a character that moves according to their facial expressions by a distribution user device 20 provided with a camera such as a smartphone. As described above, in the video distribution system 1, since the equipment for the distribution users Ua and Ub to distribute the video is simplified, a platform in which the distribution users Ua and Ub can easily participate is realized.

In the processing procedure described in the present specification, particularly the processing procedure described using the flow chart, a part of the steps (steps) constituting the processing procedure is omitted, as a step constituting the processing procedure. It is possible to add steps that are not specified and / or to change the order of the steps, and the processing procedure in which such omissions, additions, and changes in order are made does not deviate from the gist of the present invention. It is included in the scope of the invention.

At least a part of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 61 may be realized by, for example, the computer processor 21 of the distribution user device 20 or the computer processor of the viewing user device 10. Specifically, a part or all of the functions of the animation generation unit 61a and the moving image generation unit 61b may be executed by the distribution user device 20. For example, the moving image generated by the distribution user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

When a distribution user Ua viewing a video including the character 31 of the distribution user Ub applies for co-starring with the distribution user Ub, the animation of the character 131 of the distribution user Ua who applied for co-starring is the server device 60. , Distribution user device 20a of distribution user Ua, distribution user device 20b of distribution user Ub, viewing user device 10, or other devices. In one example, when the animation of the character 131 of the distribution user Ua is generated by the distribution user device 20b of the distribution user Ub, the distribution user device 20a of the distribution user Ua to the distribution user device 20b of the distribution user Ub. , Face motion data and voice data of the distribution user Ua are transmitted. In the distribution user device 20b, the animation of the character 131 is generated by applying the face motion data and the voice data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua. The model data for the distribution user Ua may be transmitted from the server device 60 to the distribution user device 20a. In another example, when the animation of the character 131 of the distribution user Ua is generated by the viewing user device 10, the face motion data of the distribution user Ua and the face motion data of the distribution user Ua from the distribution user device 20a of the distribution user Ua to the viewing user device 10 The voice data is transmitted, and the face motion data and the voice data of the distribution user Ub are transmitted from the distribution user device 20b of the distribution user Ub to the viewing user device 10. In the viewing user device 10, the animation of the character 131 is generated by applying the face motion data and the voice data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua, and is received from the distribution user device 20b. The animation of the character 31 may be generated by applying the face motion data and the voice data of the distribution user Ub to the model data for the distribution user Ub. The model data for the distribution user Ua and the model data for the distribution user Ub may be transmitted from the server device 60 to the viewing user device 10. As described above, the co-starring moving image including the animation of the character of the distribution user and / or the animation of the character object can be generated by any device included in the moving image distribution system 1. Character animations may be generated on devices not explicitly shown in FIG. The face motion data and voice data of the distribution user Ua are transmitted from the distribution user device 20a of the distribution user Ua to the device that generates the animation of the character, and the face motion data of the distribution user Ub and the face motion data of the distribution user Ub are transmitted from the distribution user device 20b of the distribution user Ub. Voice data is transmitted. Body motion may be transmitted in addition to face motion.

Further, the generation of the co-starring video including the generated character 131 of the distribution user Ua, the distribution video of the distribution user Ub, and the character 31 is generated by the server device 60, the distribution user device 20a of the distribution user Ua, and the distribution user device of the distribution user Ub. It may be performed by either 20b or the viewing user device 10. The co-starring moving image may be shared and generated by the server device 60, the distribution user device 20a, the distribution user device 20b, the viewing user device 10, and other devices. When the gift object is included in the co-starring moving image, data for displaying the gift object may be transmitted from the server device 60 or other devices to the device that generates the co-starring moving image.

The co-starring video may include characters of three or more distribution users. That is, three or more distribution users may virtually co-star in the moving image using each character.

1 Video distribution system 10 Viewing user equipment 20a, 20b Distribution user equipment 61a Animation generation unit 61b Video generation unit 61c Video distribution unit 61d Gift request processing unit 61e Gift purchase processing unit 61f Co-star application processing unit 61g Judgment unit 61h Matching processing unit 61i Benefits Granting department

Claims (15)

Equipped with one or more computer processors
The one or more computer processors may execute computer-readable instructions.
Distribute the co-starring video including the first character generated based on the movement of the first user and the second character generated based on the movement of the second user.
The first object is displayed in association with the first character,
It is determined whether the same matching object as the first object is displayed in association with the second character.
When it is determined that the matching object is not displayed in association with the second character, the same matching object as the first object is displayed in association with the second character in the co-starring moving image.
Video distribution system. The matching object displayed in association with the second character is displayed only in the co-starring moving image.
The video distribution system according to claim 1. When it is determined that the matching object is not displayed in association with the second character, a display request for displaying the matching object in association with the second character is urged to be performed.
Based on the display request, the matching object is displayed in association with the second character in the co-starring moving image.
The video distribution system according to claim 1 or 2. When it is determined that the matching object is not displayed in association with the second character, the matching object is associated with the second character for one or more viewing users who are viewing the co-starring moving image. Prompt to make a display request to display
The video distribution system according to claim 3. When it is determined that the matching object is not displayed in association with the second character, the first user is urged to make a display request for displaying the matching object in association with the second character. ,
The video distribution system according to claim 3 or 4. When it is determined that the matching object is not displayed in association with the second character, the second user is urged to make a display request for displaying the matching object in association with the second character. ,
The video distribution system according to any one of claims 3 to 5. When the matching object is displayed in association with the second character in the co-starring moving image, a privilege is given to the first user.
The video distribution system according to any one of claims 1 to 6. When the matching object is displayed in association with the second character in the co-starring moving image, a privilege is given to the second user.
The video distribution system according to any one of claims 1 to 7. When the matching object is displayed in association with the second character in the co-starring moving image, a privilege is given to the first user.
The video distribution system according to any one of claims 1 to 7. The matching object is displayed in response to a display request for displaying the matching object in association with the second character from the first viewing user among one or more viewing users who are viewing the co-starring video. If this is done, a privilege is given to the first viewing user.
The video distribution system according to any one of claims 1 to 7. When the matching object is displayed in association with the second character in the co-starring video, the first user, the second user, and one or more viewing users who are watching the co-starring video Give benefits to
The video distribution system according to any one of claims 1 to 7. The co-starring video is generated in response to receiving a co-starring application from the second user to apply for co-starring with the first user.
The video distribution system according to any one of claims 1 to 11. The first object is displayed in association with the mounting portion of the first character, and is displayed.
The matching object is displayed in association with the mounting portion of the second character.
The video distribution system according to any one of claims 1 to 12. A video distribution method executed by one or more computer processors executing computer-readable instructions.
A co-star movie including a first character generated based on the movement of the first user, a second character generated based on the movement of the second user, and a first object displayed in association with the first character. The process of delivery and
A step of determining whether the same matching object as the first object is displayed in association with the second character, and
When it is determined that the matching object is not displayed in association with the second character, the step of displaying the same matching object as the first object in association with the second character in the co-starring moving image.
Video distribution method with. For one or more computer processors
A co-star movie including a first character generated based on the movement of the first user, a second character generated based on the movement of the second user, and a first object displayed in association with the first character. The process of delivery and
A step of determining whether the same matching object as the first object is displayed in association with the second character, and
When it is determined that the matching object is not displayed in association with the second character, the step of displaying the same matching object as the first object in association with the second character in the co-starring moving image.
A video distribution program that executes.

Images