JP7044923B6 - Video distribution system, video distribution method and video distribution program - Google Patents

Description

The invention disclosed herein relates to a video distribution system, a video distribution method, and a video distribution program.

Various video distribution services have been known for a long time. In recent years, a video distribution system that generates an animation of a character object based on the movement of a distribution user and distributes a video including the animation of the character object live has attracted attention. Such a video distribution system is, for example, JP-A-2015-184689 (Patent Document 1) and "Yusuke Hasegawa, the dawn of a new era of virtual idols PROJECT MariA, CG WORLD, Japan, Bone Digital Co., Ltd., November 2017. 10th, Vol. 231 pp. 74-79 ”(Non-Patent Document 1).

"Virtual Cast" provided by Dwango Co., Ltd. is known as a video distribution service that distributes a video including a character object generated based on the movement of a distribution user. In the virtual cast, a character object of another user participates in a video distributed by one distribution user, and two distribution users can virtually co-star in the video via each character object.

JP-A-2015-184689

Yusuke Hasegawa, Dawn of a new era of virtual idols PROJECT MariA, CG WORLD, Japan, Bone Digital Co., Ltd., November 10, 2017, Vol. 231., Pp. 74-79 Dwango Co., Ltd., "[Virtual Cast] Convex", [online], [Search on July 1, 2019], Internet <URL: https://qa.nicovideo.jp/faq/show/10740?category_id=718&site_domain = default>

In a conventional video distribution system that enables virtual co-starring between users, a user who watches a video sends a co-starring application for applying for co-starring to a distribution user who is distributing the video, and the co-starring is performed. The guest user of the co-star is selected based on the application. Many problems remain in the process for achieving this co-starring, as illustrated below.

First, since the user who is watching the video wants to co-star with a popular distribution user, the co-star application is concentrated on some popular distribution users. Since videos are often streamed live, co-starring applications tend to be concentrated in a short period of time. Therefore, there is a problem that the processing load for processing the co-starring application that is concentrated in a short time is large. If the user who watches the video can apply for co-starring unconditionally, the problem of processing load for processing the co-starring application becomes apparent.

Secondly, for the less popular distribution users, there is a problem that it is difficult to utilize the co-starring function because there are few or no viewing users who apply for co-starring themselves.

Thirdly, what kind of distribution user will be a co-star in order to maintain the quality of the distribution video is a serious concern for the distribution user, but it is famous when virtually co-starring through a character object. Unless you want to co-star with a distribution user of a variety of videos, you have to apply for co-starring with almost no knowledge of the distribution user who should be the co-starring partner. And, because he does not know the distribution user well, he may hesitate to apply for co-starring to the distribution user. In this way, in the conventional co-starring application process, since the information disclosure about the distribution user is insufficient, it becomes easy to apply for co-starring to a popular distribution user who is familiar with it, and as a result, co-starring to the popular distribution user. The tendency for applications to be concentrated will be strengthened.

As described above, there is a problem that the co-starring function in the video distribution system is not fully utilized. In addition to the above, there are unsolved problems in the co-starring function of the conventional video distribution system. Some of these problems will become apparent with reference to the entire specification.

An object of the present invention is to provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. One of the more specific objects of the present invention is to provide a new video distribution system, a video distribution method, and a video distribution program that can promote the utilization of the co-starring function. One of the more specific objects of the present invention is to provide a novel video distribution system, video distribution method, and video distribution program capable of reducing the processing load and / or traffic for providing the co-starring function.

One aspect of the invention relates to a video distribution system comprising one or more computer processors. In the video distribution system of one embodiment, the one or more computer processors distribute a video including an animation of a character object generated based on the movement of a first user by executing a computer-readable instruction. , The first user from the second user who received the invitation by transmitting an invitation associated with the host user information about the first user to the second user among the plurality of viewing users who watch the moving image. In response to the acceptance of the co-starring application, the co-starring video in which the first user and the second user co-star is generated, and the co-starring video is distributed to one or more viewing users.

In one aspect of the present invention, the co-starring application is accepted only from one or more invited users who have received the invitation among the plurality of viewing users. The second user is included in the one or more invited users.

In one aspect of the invention, the host user information is presented to the second user.

In one aspect of the present invention, the host user information includes user evaluation information indicating an evaluation for the first user. In one aspect of the present invention, the host user information includes viewer number information indicating the number of viewer users of the moving image. In one aspect of the present invention, the host user evaluation information indicating the evaluation of the first user in the co-starring moving image is included. In one aspect of the present invention, the host user information includes moving image evaluation information indicating an evaluation for the moving image.

In one aspect of the present invention, the invitation includes first privilege information indicating a first privilege given to the second user when the second user makes the co-starring application. In one aspect of the present invention, the invitation is a second privilege information indicating a second privilege given to the second user when the co-starring moving image in which the second user and the first user co-star is generated. including.

In one aspect of the present invention, at least one of the first privilege and the second privilege changes according to the evaluation of the co-starring moving image. In one aspect of the present invention, at least one of the first privilege and the second privilege changes according to the evaluation of the second user during the distribution of the co-starring moving image.

In one aspect of the present invention, at least one of the first privilege and the second privilege is an object that can be used by the second user in the co-starring moving image.

In one aspect of the present invention, the co-starring moving image includes a character co-starring moving image including a first character object generated based on the movement of the first user and a second character object generated based on the movement of the second user. Is.

In one aspect of the present invention, the co-starring moving image is a voice co-starring moving image including a first character object generated based on the movement of the first user and the voice of the second user.

In one aspect of the present invention, the co-starring moving image includes a character co-starring moving image including a first character object generated based on the movement of the first user and a second character object generated based on the movement of the second user. Alternatively, it is a voice co-starring moving image including a first character object generated based on the movement of the first user and the voice of the second user, and the character co-starring moving image and the voice co-starring moving image can be switched alternately.

In one aspect of the invention, the one or more computer processors deliver a moving image containing an animation of a character object generated based on the movement of a first user by executing a computer-readable instruction. An invitation was sent to one or more viewing users who watch the video, and the co-starring application was accepted only from one or more invited users who received the invitation among the plurality of viewing users, and the co-starring application was accepted. A co-starring video in which the first user and the second user included in the one or more invited users co-star is generated according to the above, and the co-starring video is distributed to one or more viewing users.

One aspect of the invention relates to a video distribution method executed by one or more computer processors executing computer-readable instructions. In one embodiment, the video distribution method includes a step of distributing a video including an animation of a character object generated based on the movement of a first user, and a second user among a plurality of viewing users who watch the video. In response to the process of transmitting an invitation associated with the host user information regarding the first user and the acceptance of a co-starring application for co-starring with the first user from the second user who received the invitation. The process includes a step of generating a co-starring moving image in which the first user and the second user co-star, and a step of distributing the co-starring moving image to one or a plurality of viewing users.

The video distribution program according to one aspect of the present invention includes a step of distributing a video including an animation of a character object generated based on the movement of a first user to one or a plurality of computer processors, and a plurality of viewing the video. The process of transmitting an invitation associated with the host user information regarding the first user to the second user among the viewing users, and the second user who received the invitation apply for co-starring with the first user. In response to the acceptance of the co-starring application, the step of generating the co-starring moving image in which the first user and the second user co-starring and the step of distributing the co-starring moving image to one or a plurality of viewing users are executed.

According to the embodiment of the present invention, it is possible to provide a new video distribution system, a video distribution method, and a video distribution program that can promote the utilization of the co-starring function.

It is a block diagram which shows the moving image distribution system by one Embodiment. FIG. 3 is a schematic diagram schematically showing a distribution user who distributes a moving image distributed by the moving image distribution system of FIG. 1 and a distribution user device used by the distribution user. It is a figure explaining the user information stored in the moving image distribution system of FIG. It is a figure explaining the co-starring moving image information stored in the moving image distribution system of FIG. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. It is a figure which shows the example of the display screen displayed on the distribution user apparatus 20a in one Embodiment. It is a figure which shows the example of the display screen displayed on the distribution user apparatus 20b in one Embodiment. It is a figure explaining the setting window displayed on the distribution user apparatus 20b. It is a figure which shows the display example of the invitation in the distribution user apparatus 20a which received an invitation. It is a figure which shows the example of the display screen of the co-starring moving image which is displayed on the viewing user apparatus 10 in one Embodiment. It is a figure which shows the example of the display screen of the co-starring moving image which is displayed on the distribution user apparatus 20a in one Embodiment. It is a figure which shows the example of the display screen of the co-starring moving image which is displayed on the distribution user apparatus 20b in one Embodiment. It is a flow diagram which shows the flow of the moving image distribution processing by one Embodiment. It is a flow chart which shows the flow of the invitation process to a co-star in one embodiment. It is a flow diagram which shows the flow of the process of delivering a co-starring moving image in one embodiment.

Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. The same or similar components in multiple drawings are labeled with the same reference numerals.

A moving image distribution system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram showing a video distribution system 1 according to an embodiment, and FIG. 2 is a distribution user device used by users Ua, Ub and the user Ua, Ub who distribute a video in the video distribution system 1. It is a schematic diagram which shows 20a, 20b schematically. The distribution user device 20a has a function for distributing a video including a character object generated based on the movement of the user Ua in the video distribution system 1, and the distribution user device 20b is a user in the video distribution system 1. It has a function for delivering a moving image including a character object generated based on the movement of Ub. As will be described in detail later, the moving image distribution system 1 can generate a moving image including character objects of two or more distribution users and distribute the moving image. In other words, in the moving image distribution system 1, two or more distribution users can virtually co-star in the moving image via each character object. In this way, when two or more distribution users virtually co-star in a video via their respective character objects, the video is called a co-star video.

Both the user Ua and the user Ub are distribution users who distribute a video including a character object generated based on the movement, and are also viewing users who watch the videos of other distribution users. Therefore, the distribution user devices 20a and 20b may have a function of viewing the moving image distributed by the moving image distribution system 1.

User Ua and User Ub can send invitations to other viewing users to invite them to their videos. For example, when a moving image including a character object generated based on the movement of the user Ub is distributed, the user Ub can send an invitation to the user Ua to invite the user Ub to the moving image. Based on this invitation, the user Ua can apply for co-starring with the user Ub. When this co-starring application is approved, a co-starring moving image including the character object of the user Ub and the character object of the user Ua is generated, and the co-starring moving image is distributed. Invitations for co-starring in a video may be transmitted from the distribution user to any other viewing user. When the user Ua participates in the video distributed by the user Ub by an invitation from the user Ub and the user Ub and the user Ua co-star, the user Ub who sent the invitation is called a "host user" and responds to this invitation. The user Ua who co-starred with the user Ub may be referred to as a "guest user". The concepts of host user and guest user are relative. For example, contrary to the above example, when the user Ub co-stars in the video of the user Ua based on the invitation sent by the user Ua to the user Ub, the user Ua becomes the host user and the user Ub becomes the guest user. Become. In the present specification, for convenience of explanation, it is assumed that the invitation is transmitted from the user Ub to the user Ua. That is, it is assumed that the user Ub is the host user and the user Ua is the guest user. However, the description of the user Ua in the present specification may be extended to the description of the guest user in general as much as possible. Similarly, the description of the user Ub herein can be extended to the host user in general as much as possible. For example, even when the description of the distribution user Ua is described in the present specification, the description can be understood as the description of the guest user in general, and the description of the distribution user Ub can be understood as the description of the host user in general.

The video distribution system 1 includes a viewing user device 10, distribution user devices 20a and 20b, a server device 60, and a storage 70. The viewing user device 10, the distribution user devices 20a and 20b, the server device 60, and the storage 70 are connected to each other so as to be communicable with each other via the network 50. As will be described later, the server device 60 is configured to deliver a moving image including animations of character objects of the delivery user Ua and the delivery user Ub. The server device 60 may be configured to deliver a moving image other than the moving image including the animation of the character object. In addition to the video distribution service, the server device 60 may provide a social networking service for users to interact with each other or a platform function for the service.

In the moving image distribution system 1, the moving image is distributed from the server device 60 to the viewing user device 10 and the distribution user devices 20a and 20b. The delivered moving image is displayed on the display of the viewing user device 10. A viewing user who is a user of the viewing user device 10 can view the delivered moving image by the viewing user device 10. By viewing the distributed video, the distribution users Ua and Ub can perform the performance while checking the video being distributed. Further, the distribution users Ua and Ub can watch the moving images including the character objects of other users by the distribution user devices 20a and 20b. Although only one viewing user device 10 is shown in FIG. 1 for the sake of brevity, the moving image distribution system 1 may include a plurality of viewing user devices. Further, although only two distribution user devices are shown in FIG. 1, the moving image distribution system 1 may include three or more distribution user devices. As described above, the distribution users Ua and Ub are also viewing users. Therefore, when the own moving image is not distributed, the moving image distributed by another distribution user can be viewed by the distribution user devices 20a and 20b.

In the illustrated embodiment, the distribution user device 20a includes a computer processor 21a, a communication I / F 22a, a display 23a, a camera 24a, and a microphone 25a. Similarly, the distribution user device 20b includes a computer processor 21b, a communication I / F 22b, a display 23b, a camera 24b, and a microphone 25b. Since the distribution user device 20a and the distribution user device 20b have the same configuration and functions, when it is not necessary to distinguish between the two, they may be collectively referred to as the distribution user device 20. The components may also be referred to as a computer processor 21 or the like.

The computer processor 21 is an arithmetic unit that loads various programs that realize an operating system and various functions from the storage into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, MCU, or the like. In FIG. 1, the computer processor 21 is illustrated as a single component, but the computer processor 21 may be a set of a plurality of physically separate computer processors.

The communication I / F 22 is implemented as hardware, firmware, communication software such as a TCP / IP driver or PPP driver, or a combination thereof. The distribution user device 20 can send and receive data to and from other devices via the communication I / F 22.

The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect a player's touch operation (contact operation). The touch panel can detect various touch operations such as tapping, double tapping, and dragging of the player. The touch panel may be provided with a capacitive proximity sensor and may be configured to be capable of detecting a player's non-contact operation.

The camera 24 continuously images the faces of the distribution users Ua and Ub, and acquires the image capture data of the faces of the distribution users Ua and Ub. The captured data of the faces of the distribution users Ua and Ub captured by the camera 24 is transmitted to the server device 60 via the communication I / F 22. The camera 24 may be a 3D camera capable of detecting the depth of a person's face. The camera 24 may take an image of a part other than the face of the distribution user Ua, Ub, for example, a hand, a leg, a finger of a hand, or a part other than these, and acquire the image pickup data.

The microphone 25 is a sound collecting device configured to convert the input voice into voice data. The microphone 25 is configured to be able to acquire the voice input of the distribution users Ua and Ub. The voice inputs of the distribution users Ua and Ub acquired by the microphone 25 are converted into voice data, and this voice data is transmitted to the server device 60 via the communication I / F 22.

The viewing user device 10 may include the same components as the distribution user device 20. For example, the viewing user device 10 may include a computer processor, a communication I / F, a display, and a camera. The viewing user device 10 may perform the same function as the distribution user device 20 by downloading and installing the predetermined application software.

The viewing user device 10 and the distribution user device 20 are information processing devices such as smartphones. In addition to smartphones, the viewing user device 10 and the distribution user device 20 are mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and various information processing devices capable of playing moving images other than these. You may. In addition to the above components, each of the viewing user device 10 and the distribution user device 20 may include a sensor unit including various sensors such as a gyro sensor, and a storage for storing various information.

Next, the server device 60 will be described. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I / F 62, and a storage 63.

The computer processor 61 is an arithmetic unit that loads various programs that realize an operating system and various functions from the storage 63 or other storage into a memory and executes instructions included in the loaded programs. The computer processor 61 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic units other than these, or a combination thereof. The computer processor 61 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. In FIG. 1, the computer processor 61 is illustrated as a single component, but the computer processor 61 may be a collection of a plurality of physically separate computer processors.

The communication I / F 62 is implemented as hardware, firmware, communication software such as a TCP / IP driver or PPP driver, or a combination thereof. The server device 60 can send and receive data to and from other devices via the communication I / F 62.

The storage 63 is a storage device accessed by the computer processor 61. The storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various storage devices other than those capable of storing data. Various programs can be stored in the storage 63. At least a part of the program and various data that can be stored in the storage 63 may be stored in a storage (for example, a storage 70) that is physically separate from the server device 60.

In the present specification, the program described as being executed by the computer processor 21 or the computer processor 61 or the instructions contained in the program may be executed by a single computer processor or distributed by a plurality of computer processors. May be executed. Further, the program executed by the computer processor 21 or the computer processor 61 or the instructions included in the program may be executed by a plurality of virtual computer processors, respectively.

Next, the data stored in the storage 63 will be described. In the illustrated embodiment, the storage 63 stores model data 63a, object data 63b, user information 63c, co-starring moving image information 63d, and various data necessary for generation and distribution of distribution moving images other than the above.

The model data 63a is model data for generating a character animation. The model data 63a may be three-dimensional model data for generating a three-dimensional animation, or may be two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (sometimes referred to as “skeleton data”) showing the face of the character and the skeleton of a portion other than the face, and surface data showing the shape and texture of the surface of the character. Surface data is sometimes called skin data. The model data 63a can include a plurality of model data different from each other. The plurality of model data may have different rig data from each other, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data.

The object data 63b includes asset data for constructing a virtual space constituting a moving image. The object data 63b is data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and various objects displayed in the moving image other than these. Contains data. The object data 63b may include object position information indicating the position of the object in the virtual space.

An example of user information 63c is shown in FIG. As shown in the figure, various data related to the user are stored as the user information 63c in association with the account information of the distribution user who uses the video distribution system 1. As will be described later, host user information is generated based on the user information 63c. The user information 63c of a certain user includes user evaluation information indicating an evaluation for the user, viewer number information indicating the number of viewers of the video distributed or being distributed by the user, and evaluation of the video video distributed by the user. The moving image evaluation information to be shown and the privilege information given to the guest user when co-starring with the user may be included. The user information 63c may include information other than the above.

The user's account information is, for example, user identification information (user ID) that identifies the user. The user ID is assigned to the user when the user first registers the use of the service in the video distribution system 1.

The user evaluation information associated with the user's account information is information indicating the evaluation of the user by another user. The user evaluation information is, for example, a user evaluation point represented by a natural number. The user of the moving image distribution system 1 can distribute a moving image including his / her own character object via the server device 60. The user evaluation points of a user may be updated based on the feedback from the viewing user on the video delivered by the user. For example, feedback from viewers includes selecting a "Like" button that appears on the viewing screen, selecting a "Boo" button that represents a negative rating, and gifting gifts for items that appear on the viewing screen. Includes giving a gift), sending comments from the viewing screen, and various other feedbacks. The "Like" button is expected to be selected when the viewer likes the viewing video or the distribution user who distributes the viewing video. The "Like" button may be shown as an icon on the viewing screen that includes characters indicating a favorable impression such as "Like" or "Like". The "boo" button is supposed to be selected when the viewer has a negative impression such as an antipathy toward the viewing video or the distribution user who distributes the viewing video. The "boo" button may be shown as an icon on the viewing screen that includes characters that indicate "bad" or "dislike". In the present specification, the buttons and icons for showing a favorable impression may be referred to as "favorable button" and "favorable icon", respectively, and the buttons and icons for indicating an antipathy may be referred to as "antipathy button" and "antipathy icon", respectively. be. Rating points may include favor button selections, anti-favorite button selections, gift gifting (or gifting amount), comments, or other parameters related to feedback from viewing users. For example, the user evaluation points may be increased when positive feedback or negative feedback is given from the viewing user. The user evaluation points may evaluate the number or amount of positive feedback from the viewing user as the number of points, or evaluate the number or amount of negative feedback from the viewing user as the number of points. May be. Further, the number of positive feedback and the number of negative feedback may increase or decrease the user evaluation points. More specifically, the user evaluation points may be increased when positive feedback is given, decreased when negative feedback is given, or vice versa. The user evaluation points of a user may be updated at an opportunity other than feedback on the video delivered by the user. For example, when a user interacts with another user by using the social networking service provided by the server device 60, the user evaluation points may be updated based on the activity using the social networking service.

The video evaluation information associated with the user's account information is information indicating the evaluation of the video delivered by the user from other users. The moving image evaluation information is, for example, a moving image evaluation point represented by a natural number. The video evaluation points of a user may be updated based on the feedback from the viewing user on the video delivered by the user. When a viewing user who has watched the video gives positive feedback or negative feedback to the video delivered by a user, the video evaluation point of the user may be increased. When feedback is given to a video delivered by a user, both the user evaluation point and the video evaluation point may be updated.

The number of viewers information associated with the user's account information indicates the number of viewing users who have watched or are watching the video delivered by the user. The viewer number information of a certain user may be the cumulative number of viewer users who have watched the moving image delivered by the user. For example, when a user has distributed a moving image 10 times so far, the number of viewers information may be the total number of viewing users in each of the 10 distributions. A new viewing user may start viewing while the video is being distributed, or a user who has been watching may stop viewing in the middle. Therefore, the number of users viewing a certain moving image may differ depending on when the measurement is performed from the start of viewing the moving image. A log of the number of viewing users may be taken at regular time intervals, an average of viewing users may be obtained based on this log, and the obtained average may be used as the number of viewing users of the moving image. For example, for a 10-minute moving image, a total of 10 viewers may be recorded at 1-minute intervals, and the average of the 10 recorded viewers may be used as the number of viewing users of the moving image. In another embodiment, the number of viewing users who were watching the moving image at the end of distribution of the moving image may be used as the number of viewing users. The information on the number of viewers of the moving image may be information other than the above that correlates with the number of viewing users of the moving image.

The privilege information associated with the user's account information indicates the privilege given to the guest user who has applied for co-starring with the user in the video distributed by the user. The privilege associated with the account information of a user may be set by the user. The privilege associated with the account information of a certain user may be set by a person other than the user. For example, the privilege associated with the account information of a certain user may be determined by the operator of the video distribution system 1. The operator of the video distribution system 1 can determine the privilege based on the usage status of the service by the user and / or the user of the video distribution system 1 other than the user and other information. The privilege may be given to all the users who applied for co-starring, or may be given only to a part of them. For example, among the users who have applied for co-starring, the privilege may be given only to the guest user who actually co-starred with the host user. When a co-starring application is made, the first privilege may be given, and when the co-starring is actually performed by the co-starring application, a second privilege different from the first privilege may be given. Benefits given to guest users include points that can be used in the video distribution service provided by distribution system 1, points that can be used on specific platforms other than distribution system 1, cryptographic assets such as Bitcoin, and distribution users (for example). , Distribution user Ub) may include gifts for gifting, objects that can be displayed in the distributed video, and various other benefits. The object that can be displayed in the moving image may be, for example, an object that can be used only in the co-starring moving image.

An example of co-starring video information is shown in FIG. As shown in the figure, various data related to the co-starring moving image are stored as the co-starring moving image information 63d in association with the co-starring moving image identification information for identifying the co-starring moving image. The co-starring video information 63d of a co-starring video includes host user evaluation information indicating the evaluation of the host user in the co-starring video, guest user evaluation information indicating the evaluation of the guest user in the co-starring video, and the co-starring start of the co-starring video. Co-starring time information indicating the elapsed time may be included.

The host user evaluation information indicates the evaluation of the host user in the co-starring video. The host user evaluation information of a host user is, for example, a host user evaluation point represented by a natural number.

The guest user evaluation information indicates the evaluation for the guest user. The guest user evaluation information of a guest user is, for example, a guest user evaluation point represented by a natural number.

The co-starring time information indicates the elapsed time from the start of co-starring between the guest user and the host user.

Next, the functions realized by the computer processors 21a and 21b will be described more specifically. The computer processor 21a functions as a face motion data generation unit 21a1, an invitation presentation unit 21a2, and a co-star application unit 21a3 by executing a computer-readable instruction included in the distribution program. Similarly, the computer processor 21b functions as a face motion data generation unit 21b1 and an invitation request unit 21b2 by executing a computer-readable instruction included in the distribution program. At least a part of the functions realized by the computer processors 21a and 21b may be realized by a computer processor other than the computer processors 21a and 21b of the moving image distribution system 1. At least a part of the functions realized by the computer processors 21a and 21b may be realized by, for example, the computer processor 61 mounted on the server device 60.

The face motion data generation unit 21a1 generates face motion data, which is a digital representation of the face movement of the distribution user Ua, based on the image pickup data of the camera 24a. Similarly, the face motion data generation unit 21b1 generates face motion data which is a digital representation of the face movement of the distribution user Ub based on the image pickup data of the camera 24b. Face motion data is generated at any time over time. Face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data generated by the face motion data generation unit 21a1 can digitally represent the movement (change of facial expression) of the face of the distribution user Ua in time series, and the face motion data generation unit 21b1 can be used. The face motion data generated in the above can digitally represent the facial movement (change of facial expression) of the distribution user Ub in time series. The face motion data generated by the face motion data generation units 21a1,21b1 is transmitted to the server device 60 via the communication I / F22a, 22b.

In the distribution user device 20, in addition to the face motion data generated by the face motion data generation unit 21a1, body motion data that is a digital representation of the position and orientation of each part other than the face of the distribution users Ua and Ub. May be generated. The distribution user device 20 may transmit body motion data to the server device 60 in addition to the face motion data. In order to generate body motion data, the distribution users Ua and Ub may be equipped with a motion sensor. The distribution user device 20 may be configured to be able to generate body motion data based on the detection information of the motion sensors attached to the distribution users Ua and Ub. Body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data expresses the body movements of the distribution users Ua and Ub as digital data in chronological order. The generation of body motion data based on the detection information of the motion sensors attached to the distribution users Ua and Ub may be performed, for example, in a photography studio. The studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor mounted on the distribution users Ua and Ub may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station provided in the shooting studio may be, for example, a base station provided by HTC CORPORATION. In addition, a supporter computer may be installed in the shooting studio and a separate room. The display in the studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room where the supporter computer is installed. The room where the supporter computer is installed and the shooting studio may be separated by a glass window. In this case, the operator of the supporter computer (sometimes referred to as "supporter" in the present specification) can visually recognize the distribution users Ua and Ub. The supporter computer may be configured so that the settings of various devices provided in the shooting studio can be changed according to the operation of the supporter. The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various other devices. The supporter can input a message to the supporter computer and display the input message on the display of the shooting studio.

In the distribution user device 20b, the invitation request unit 21b2 requests the server device 60 to transmit the invitation in response to the operation of the distribution user Ub. The invitation is transmitted from the server device 60 to the distribution user device 20a and other distribution user devices. The server device 60 may transmit host user information regarding the distribution user Ub who requested the transmission of the invitation in association with the invitation from the distribution user Ub. The invitation may be included in the delivered video or may be transmitted separately from the delivered video.

In the distribution user device 20a, the invitation presenting unit 21a2 presents the invitation to the distribution user Ua when the invitation from another distribution user is received from the server device 60. The invitation is, for example, an invitation in which the user Ub invites the user Ua to the video being distributed. The invitation presentation unit 21a2 may present the host user information regarding the distribution user who requested the transmission of the invitation together with the invitation. The invitation presentation unit 21a2 may display the content of the invitation and the host user information regarding the distribution user who transmitted the invitation on the display 23a.

The co-star application unit 21a3 transmits a co-star application for co-starring with the other distribution user to the server device 60 based on the operation of the distribution user Ua on the distribution user device 20a.
As will be described later, the distribution user device 20a may display an operation button for applying for co-starring according to the receipt of the invitation, and an operation for applying for co-starring regardless of whether or not the invitation has been received. You may display a button.

In the present specification, since it is assumed that the invitation is transmitted from the distribution user Ub using the distribution user device 20b to the distribution user Ua using the distribution user device 20a, the invitation request unit 21b2 is the distribution user. Described as a function performed by the computer processor 21b of the apparatus 20b. Since it is assumed that the distribution user Ua transmits an invitation, the distribution user device 20a may execute the same function as the invitation request unit 21b2. Similarly, since it is assumed that the distribution user Ub receives the invitation, the distribution user device 20b may execute the same functions as the invitation presentation unit 21a2 and the co-star application unit 21a3.

The distribution user device 20 may realize a function other than the face motion data generation unit 21a1 by executing the distribution program and / or other programs on the computer processor. For example, the distribution user device 20 may realize a function of playing back a received moving image by executing a viewing program for watching a moving image. The distribution program and the viewing program may be packaged in one application software or may be provided as separate application software.

The viewing user device 10 may be configured to provide the same functions as the distribution user device 20. For example, the viewing user device 10 may realize a function of reproducing the received moving image by executing a viewing program for viewing a moving image, and is similar to the function of the face motion data generation unit 21a1 by executing the distribution program. The function of may be realized.

Next, the functions realized by the computer processor 61 will be described more specifically. The computer processor 61 executes the computer-readable instructions included in the distribution program to execute the animation generation unit 61a, the video generation unit 61b, the video distribution unit 61c, the invitation processing unit 61d, the co-star application processing unit 61e, and the co-star end. It functions as a processing unit 61f.

The animation generation unit 61a applies the face motion data generated by the face motion data generation unit 21a of the distribution user device 20a or the face motion data generation unit 21b1 of the distribution user device 20b to predetermined model data included in the model data 63a. By doing so, it is configured to generate an animation of the character object. The animation generation unit 61a can generate an animation of the character object so that the facial expression of the character object changes based on the face motion data. Specifically, the animation generation unit 61a can generate an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user Ua based on the face motion data related to the distribution user Ua. Similarly, the animation generation unit 61a can generate an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user Ub based on the face motion data related to the distribution user Ub.

When the distribution user apparatus 20 provides body motion data relating to the distribution users Ua and Ub, the animation generation unit 61a determines the distribution users Ua and Ub based on the body motion data and the face motion data relating to the distribution users Ua and Ub. It is possible to generate an animation of a character object that moves in synchronization with the movement of the body and facial expression.

When the video of the distribution user Ua is distributed, the video generation unit 61b generates a background image showing the background using the object data 63b, and the background image, the animation of the character object corresponding to the distribution user Ua, and the animation of the character object corresponding to the distribution user Ua. Can generate videos containing. The moving image generation unit 61b can synthesize the voice of the distribution user Ua generated based on the voice data received from the distribution user device 20a with the generated video. Similarly, when the moving image of the distribution user Ub is distributed, the moving image generation unit 61b generates a background image showing the background using the object data 63b, and the background image and the character object corresponding to the distribution user Ub. You can generate animations and videos that include. The moving image generation unit 61b can synthesize the sound of the distribution user Ub generated based on the voice data received from the distribution user device 20b with the generated moving image. In the moving image generated by the moving image generation unit 61b, the character objects corresponding to the distribution users Ua and Ub are displayed superimposed on the background image. As described above, the moving image generation unit 61b generates an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user Ua or the distribution user Ub, and the voice of the distribution user Ua or the distribution user Ub is synthesized with this animation. It is possible to generate a video for distribution.

The moving image distribution unit 61c distributes the moving image generated by the moving image generation unit 61b. This moving image is distributed to the viewing user device 10 and other viewing user devices via the network 50. The generated moving image is also distributed to the distribution user devices 20a and 20b. The received moving image is played back in the viewing user device 10 and the distribution user devices 20a and 20b. The video distribution unit 61c may monitor at least one of the distribution time and the number of distributions of the video for each distribution user.

5 and 6a to 6b show an example of displaying a moving image distributed from the moving image distribution unit 61c. In these figures, it is assumed that the distribution user Ub distributes a moving image including its own character object using the distribution user device 20b, and the moving image is played back on the viewing user device 10 and the distribution user devices 20a and 20b. ing. In FIG. 6a, it is assumed that the distribution user Ua is not distributing the video and is watching the video distributed by the distribution user Ub, which is another distribution user. Therefore, in the description of FIGS. 5 and 6a to 6b, the distribution user Ua may also be referred to as a viewing user. FIG. 5 shows a display example of a moving image being played on the viewing user device 10, FIG. 6a shows a display example of a moving image being played on the distribution user device 20a, and FIG. 6b shows a display example of the moving image being played on the distribution user device 20b. A display example of the moving image is shown.

As shown in FIG. 5, the image 30 including the moving image delivered from the server device 60 is displayed on the display of the viewing user device 10. The image 30 displayed on the viewing user device 10 includes a character object 31 of the distribution user Ub generated by the animation generation unit 61a, a gift button 32, an evaluation button 33, a comment button 34, and a comment display area. 35 and are included.

As shown in FIG. 6a, the display 23a of the distribution user device 20a displays the image 40a including the moving image distributed from the server device 60. Similar to the image 30, the image 40a includes a character object 31 of the distribution user Ub, a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35. In addition to this, the image 40a may include a co-star application button 36. The co-starring application button 36 is an operation button for transmitting a co-starring application for applying for co-starring with the distribution user Ub in the video distributed by the distribution user Ub. The distribution user Ua can transmit a co-starring application for applying for co-starring with the distribution user Ub from the distribution user device 20a to the server device 60 by selecting the co-starring application button 36 on the distribution user device 20a. The distribution user device 20a can display the image 40a of the distributed moving image by, for example, executing application software including a viewing program.

As shown in FIG. 5, the image 30 displayed on the viewing user device 10 does not have to include the co-starring application button 36. For example, when the application software including the distribution program is not downloaded or installed in the viewing user device 10, or when the application software including the distribution program is not started in the viewing user device 10, the co-star application button 36 is included. The image 30 is generated so that it does not exist. In another embodiment, the co-starring application button 36 may also be displayed on the image 30 of the viewing user device 10. For example, the co-star application button 36 is included when the application software including the distribution program is downloaded or installed in the viewing user device 10, or when the application software including the distribution program is started in the viewing user device 10. The image 30 is generated as described above.

Since the character object 31 is generated by applying the face motion data of the distribution user Ub to the model data included in the model data 63a as described above, the character object 31 is synchronized with the movement of the facial expression of the distribution user Ub. The expression changes. When the body motion data is provided from the distribution user device 20, the character object 31 can be controlled so that the parts other than the face also change in synchronization with the movement of the body of the distribution user Ub.

The gift button 32 is displayed on the display screen 30 so as to be selectable by operating the viewing user device 10. The gift button 32 may be selected, for example, by tapping on the area of the touch panel of the viewing user device 10 where the gift button 32 is displayed. In one embodiment, when the gift button 32 is selected, the display screen 30 selects a gift to be given to the distribution user (here, the distribution user Ub) who is distributing the video being viewed. Window is displayed. The viewing user can purchase a gift to be gifted from the gifts displayed in the window. In another embodiment, depending on the selection of the gift button 32, the display screen 30 displays a window containing a list of purchased gifts. In this case, the viewing user can select a gift to be gifted from the gifts displayed in the window. When the gift button 32 is selected in the viewing user device 10, gifting information may be transmitted to the server device 60. The gifting information may include gift identification information (gift ID) that identifies the gift to be gifted. In this way, the viewing user who is viewing the video can provide (gift) a desired gift to the distribution user who is distributing the video by selecting the gift button 32.

The evaluation button 33 is displayed on the display screen 30 so as to be selectable by the viewing user who uses the viewing user device 10. The evaluation button 33 may be selected, for example, by tapping on the area of the touch panel of the viewing user device 10 where the evaluation button 33 is displayed. When the evaluation button 33 is selected by the viewing user who is watching the video, a positive evaluation is given to the distribution user (in the illustrated example, the distribution user Ub) that distributes the video, or an affirmation to the distributed video. Evaluation update information indicating that the evaluation has been made may be transmitted to the server device 60. In the server device 60, the user information 63c can be updated based on the evaluation update information from the viewing user. For example, at least one of the user evaluation information and the moving image evaluation information included in the user information 63c may be updated based on the evaluation update information from the viewing user. For example, when the evaluation button 33 included in the image 30 shown in FIG. 5 is selected by the viewing user, the user evaluation information and the moving image of the distribution user Ub distributing the moving image displayed on the viewing user device 10. At least one of the evaluation information may be updated. By selecting the evaluation button 33, evaluation information indicating that the moving image has been negatively evaluated may be transmitted to the server device 60. The evaluation information indicating a positive evaluation of the moving image may be referred to as positive evaluation information, and the evaluation information indicating that the negative evaluation of the moving image has been made may be referred to as negative evaluation information. When the server device 60 receives the positive evaluation information, at least one of the user evaluation information and the moving image evaluation information may be increased. When the server device 60 receives the negative evaluation information, at least one of the user evaluation information and the moving image evaluation information may be reduced.

The comment button 34 is displayed on the image 30 so as to be selectable by the user. When the comment button 34 is selected by, for example, a tap operation, a comment input window for inputting a comment is displayed on the display screen 30. The viewing user can input a comment via the input mechanism of the viewing user device 10 or the distribution user device 20a. The input comment is transmitted from the viewing user device 10 and the distribution user device 20a to the server device 60. The server device 60 receives comments from the viewing user device 10, the distribution user device 20a, and other user devices, and displays the comments in the comment display area 35 in the image 30. In the comment display area 35, comments posted by each user are displayed, for example, in chronological order. The comment display area 35 occupies a part of the display screen 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When a comment exceeding the upper limit set in the comment display area 35 is posted, the comment with the oldest posting time is deleted from the comment display area 35 in order. Therefore, as the frequency of accepting comments increases, the display time of each comment in the comment display area 35 becomes shorter. In one embodiment, a scroll bar is provided in the image 30, and the comment deleted from the comment display area 35 can be viewed by operating the scroll bar to scroll the comment.

As shown in FIG. 6b, the image 40b distributed from the server device 60 is displayed on the display of the distribution user device 20b. The image 40b displayed on the distribution user device 20b includes a character object 31 corresponding to the distribution user Ub, display instruction buttons 42a to 42c for displaying the gift received from the viewing user in the moving image, and a comment display area. 35 and are included. The image 40b displayed on the distribution user device 20b includes the same background image, character object image, and comment as the image 30 and the image 40a. On the other hand, the image 40b is different from the images 30 and 40a in that it does not include the gift button 32, the evaluation button 33, the comment button 34, and the co-starring application button 36, but includes the display instruction buttons 42a to 42c. .. The display instruction buttons 42a to 42c are displayed on the image 40, for example, in response to receiving a gift from the viewing user. In the illustrated embodiment, the image 40 displays three display instruction buttons 42a to 42c. Each of the display instruction buttons 42a to 42c is displayed on the image 40 so as to be selectable by the distribution user. When any of the display instruction buttons 42a to 42c is selected by, for example, a tap operation, an operation for displaying the gift corresponding to the selected display instruction button is performed. As described above, the display instruction buttons 42a to 42c are display instruction objects for instructing the moving image of the gift to be distributed.

The invitation processing unit 61d transmits an invitation to one or more distribution user devices included in the video distribution system 1 based on the invitation request from the invitation request unit 21b2. The invitation may be transmitted to the viewing user device 10. As described above, this invitation is a notification for inviting another distribution user to the video distributed by the distribution user Ub. The invitation request transmitted from the distribution user apparatus 20b will be further described with reference to FIG. 7. FIG. 7 is a diagram illustrating a window for setting an invitation request displayed on the distribution user device 20b. The distribution user device 20b displays the setting window 41 before the start of distribution of the moving image or after the start of distribution of the moving image. The setting window 41 may be displayed according to the operation of the user, or may be displayed at a predetermined timing before the start of video distribution or after the start of video distribution without user operation.

In the illustrated embodiment, the setting window 41 includes a switch 41a, a stepper 41b, and a password setting area 41c. The switch 41a is a switch for switching whether or not to transmit the invitation. The switch 41a is switched on or off according to the operation of the user. When the switch 41a is turned on, the setting is switched to send the invitation request to the server device 60. When the switch 41a is turned off, the invitation request is not transmitted to the server device 60. For example, an invitation request is transmitted to the server device 60 when the window 41 is closed after the switch 41a is turned on.

The stepper 41b is an operation unit for increasing or decreasing the numerical value input according to the operation of the user. In the illustrated embodiment, the stepper 41b can increase or decrease the number of co-stars who can co-star in the moving image scheduled to be distributed or the moving image being distributed. In the example of FIG. 7, 10 people are set as the number of people who can co-star. The number of people set when "-" is selected in the stepper 41b is reduced from 10 to, for example, 9 people, and the number of people set when "+" is selected in the stepper 41b is, for example, 11 people. Will increase to. In one embodiment, the number of co-stars may mean the maximum number of users who co-star at the same time in the video to be distributed. In this embodiment, if the number of co-stars is set to 10, 10 users can co-star in the moving image at the same time through the character. In another embodiment, the number of people who can co-star at the same time is set to a smaller number (for example, two people) than the maximum number of co-stars to be set. In this case, the upper limit of the number of co-stars means the upper limit of the number of users who can co-star within the delivery time. For example, if the number of people who can co-star in a video is set to 2 and the upper limit of the number of co-stars is set to 10, the appearance order is set for 10 guest users, and the guest users are set according to this appearance order. Will co-star with the host user one by one. Instead of setting the number of co-stars, or in addition to setting the number of co-stars, the distribution user Ub may specify the destination of the invitation. For example, a candidate for a distribution user to be an invitation destination may be displayed in a window 41 so as to be selectable by the distribution user Ub, and the distribution user selected by the distribution user Ub may be set as an invitation destination.

In the password setting area 41c, a co-star password provided to a guest user who wishes to co-star is set. This co-star password is, for example, a 4-digit number string. The distribution user Ub can perform co-starring only with the specific distribution user by notifying the co-starring password only to the specific distribution user among the distribution users using the distribution system 1. In other words, the distribution user Ub can avoid co-starring with the distribution user who has not notified the co-starring password. When notifying the co-star password only to a specific distribution user, the distribution user Ub can specify the specific distribution user by inputting the user ID of the distribution user to be notified. There is no particular limitation on the method of specifying a specific distribution user to notify the co-star password. If the password input is not required when applying for co-starring, the password setting area 41c is omitted.

The invitation request unit 21b2 generates an invitation request based on the settings determined through the setting window 41 and other input interfaces as necessary, and transmits the invitation request to the server device 60. The invitation request also includes the user ID of the distribution user Ub. The invitation request may include the number of co-stars, the co-star password, information for identifying the distribution user who is the destination of the invitation, and other information necessary for performing the invitation.

The invitation processing unit 61d generates an invitation based on the invitation request from the invitation request unit 21b2, and transmits the generated invitation to one or a plurality of distribution user devices. For example, when the invitation destination is specified in the invitation request, the invitation processing unit 61d transmits the invitation to the distribution user device of the specified distribution user. When the number of co-stars is set, the invitation processing unit 61d selects a distribution user to be the destination of the invitation until the set number of co-stars is reached, and invites the selected distribution user. Send. The delivery user to be the destination of the invitation may be randomly selected or may be selected based on a predetermined algorithm. When the invitation request includes the co-star password, the invitation processing unit 61d notifies the distribution user to be notified of the invitation of the co-star password.

When the invitation processing unit 61d receives the invitation request from the distribution user Ub, the invitation processing unit 61d refers to the user information 63c stored in the storage 63 and generates the host user information of the distribution user Ub. In one embodiment, the host user information of the distribution user (distribution user Ub) who made the invitation request is the user evaluation information stored in the user information 63c in association with the user account information of the distribution user (distribution user Ub). , Video rating information, number of viewers information, and privilege information, or generated based on these information. In other words, the host user information of the distribution user who made the invitation request is among the user evaluation information, the video evaluation information, the number of viewers information, and the privilege information stored in association with the user account information of the distribution user. It may be at least one, or it may be a score generated based on this information. The host user information is preferably a referenceable index for determining whether or not the invited distribution user applies for co-starring with the distribution user Ub, for example, a profile of the distribution user Ub as a host user. It is desirable that it is an index to represent.

The invitation processing unit 61d can transmit the host user information of the distribution user Ub to the distribution user Ua and other distribution users in association with the invitation for inviting the co-starring with the distribution user Ub. As a result, the distribution user who receives the invitation from the distribution user Ub can access the host user information of the distribution user Ub. In other words, the host user information of the distribution user Ub is associated with the invitation so that it can be presented to the distribution user who received the invitation from the distribution user Ub. In one embodiment, the host user information is transmitted to the distribution user as part of the invitation. The host user information may be sent to the distribution user along with the invitation. In another embodiment, the host user information is stored in the server device 60, and the invitation may include a link to the host user information stored in the server device 60.

Next, with reference to FIG. 8, the processing in the distribution user apparatus of the distribution user who received the invitation will be described. FIG. 8 shows an example of displaying an invitation in the distribution user device 20a of the distribution user Ua who has received the invitation from the distribution user Ub. Upon receiving the invitation from the distribution user Ub, the invitation presentation unit 21a2 of the distribution user device 20a displays the window 37 on the display 23a of the distribution user device 20a as shown in the figure. The window 37 contains the character string "Invited by Ub" indicating that the invitation has been received. As a result, the distribution user Ua can know that the invitation from the distribution user Ub has been received. In addition to the character string, the window 37 can include a display area 37a, a co-starring application button 37b, and a co-starring decline button 37c.

The invitation presentation unit 21a2 displays the host user information of the distribution user Ub in the display area 37a. As described above, the host user information in one embodiment is an index representing the profile of the distribution user Ub as a host user. The host user information may be, for example, viewer number information. When the number of viewing users of the moving image distributed by the distribution user Ub is large, the distribution user Ua may be able to acquire a large number of viewing users by co-starring with the distribution user Ub. The host user information may be user evaluation information. A high user evaluation information of the distribution user Ub means that the distribution user Ub has acquired a high reputation from other users. Therefore, when the user evaluation information of the distribution user Ub is high, the distribution user Ua may be able to obtain a high evaluation by co-starring with the distribution user Ub. The host user information may be moving image evaluation information. A high video evaluation information of the distribution user Ub means that the video distributed by the distribution user Ub has a high reputation. Therefore, when the video evaluation information of the distribution user Ub is high, the distribution user Ua may be able to obtain a high evaluation by appearing in the video of the distribution user Ub. The host user information may be privilege information. The privilege information indicates the privilege obtained by the distribution user Ua by applying for the co-starring with the distribution user Ub, or the privilege obtained by the distribution user Ua by realizing the co-starring with the distribution user Ub. Such a privilege is an incentive for co-starring with the distribution user Ub.

The host user information may be a score calculated by a predetermined algorithm based on a part or all of the number of viewers information, the user evaluation information, the video evaluation information, and the privilege information. For example, since many distribution users are expected to aim to acquire more viewing users, the number of viewers information may be more important to guest users than other information contained in the user information 63c. .. Therefore, for the viewer number information, the user evaluation information, and the video evaluation information, it is possible to calculate a weighted average in which more weight is applied to the viewer number information, and use the score represented by this weighted average as the host user information. can. The method of calculating the score indicating the host user information is not limited to that explicitly described herein.

As described above, the viewer number information, user evaluation information, video evaluation information, privilege information of the distribution user Ub, and the score calculated based on these information are the profile or co-starring partner of the distribution user Ub as the host user. It can be an index showing the attractiveness of the product. By displaying such host user information in the display area 37a, it is possible to convey information that can be referred to when deciding whether or not to co-star with the distribution user Ub who sent the invitation to the distribution user Ua who received the invitation. .. The distribution user Ua can determine whether or not to perform co-starring with the distribution user Ub based on the host user information.

The co-starring application button 37b included in the window 37 is an operation button for transmitting a co-starring application for applying for co-starring with the distribution user Ub in the video distributed by the distribution user Ub. The co-starring application is transmitted to the server device 60 by selecting the co-starring application button 37b, and the transmitted co-starring application is accepted by the server device 60. The server device 60 can accept not only the co-starring application from the distribution user Ua but also the co-starring application from various distribution users. If neither the co-starring application button 37b nor the co-starring decline button 37c is selected within a predetermined time after the window 37 is displayed, the window 37 may be deleted from the screen. As described above, the co-starring application button 36 may be displayed on the moving image 40a displayed on the distribution user device 20a. Therefore, the window 37 does not have to include the co-star application button 37b. When the window 37 does not include the co-starring application button 37b, the distribution user Ua can select the co-starring application button 36 when applying for co-starring with the distribution user Ub.

In the illustrated embodiment, the co-starring application button 36 is displayed before the window 37 is displayed. In this case, even before receiving the invitation, the distribution user Ua can apply for co-starring with the distribution user Ub by selecting the co-starring application button 36. In this way, when accepting a co-starring application from a distribution user who has not received an invitation, there is a possibility that an excessive number of co-starring applications will be made. In particular, when the distribution user Ub is a popular distribution user, there is a possibility that a large number of co-starring applications will be made. Therefore, in another embodiment of the present invention, the co-star application button 36 may be displayed only on the distribution user device of the distribution user who received the invitation after receiving the invitation. When the invitation is received, the co-starring application button 37b is displayed in the window 37, but the co-starring application button 36 may be displayed in the image 40a after the window 37 disappears from the image. As a result, the co-starring application can be accepted only from the user who received the invitation (hereinafter, may be referred to as "invited user").

In one embodiment of the present invention, the co-star application button 36 may be displayed on the image 40a regardless of whether or not an invitation has been received. In this case, the input of the co-star password may be requested when the co-star application button 36 is selected, and the co-star request may be transmitted to the server device 60 only when the co-star password is authenticated. The distribution user Ub can control the number of co-starring applications by notifying the co-starring password only to the user who approves the co-starring application. The notification of the co-star password is sent to the user through the messaging function used in the video distribution system 1, the messaging function different from the video distribution system 1 (for example, LINE provided by LINE Corporation), and channels other than these. Can be notified. In this way, the co-star password can be transmitted to the user who is watching the video distributed by the related user Ub or other users without associating with the invitation from the distribution user Ub. By including the co-star password in the video, the co-star password may be notified to all the viewing users who are watching the video. A distribution user who has not secured a sufficient number of viewing users can increase the possibility of receiving a co-starring application by sending a co-starring password to many viewing users (may be all users). This makes it easier for distribution users who have not gained high popularity to use the co-starring function as a host user.

When the co-starring application processing unit 61e receives a co-starring application from a certain user (for example, distribution user Ua), the co-starring application processing unit 61e determines whether or not to allow the co-starring application of the user. The co-starring application processing unit 61e may determine whether or not to allow co-starring between the distribution user Ua and the distribution user Ub based on at least a part of the user information 63c of the distribution user Ua who applied for the co-starring. For example, when the user evaluation point of the distribution user Ua who applied for co-starring is larger than a predetermined threshold value, co-starring with the distribution user Ub of the distribution user Ua is permitted, and when the user evaluation point is equal to or less than the threshold value, the distribution user of the distribution user Ua Co-starring with Ub may be refused. There are no particular restrictions on this criterion.

The co-star application processing unit 61e grants the privilege to the user who applied for the co-star when the host user information includes the privilege information and the privilege is an object that can be displayed in the video. You may perform the processing for. When the privilege is a point that can be used in the video distribution system 1, the co-starring application processing unit 61e can perform a process for granting the point to the user who has applied for co-starring. If the privilege is an object that can be displayed in the moving image, a process for granting the object to the user who applied for co-starring is performed. For example, an object ID that identifies an object given as a privilege is stored in association with the user ID of the user who applied for co-starring.

When the co-starring application from the distribution user Ua is permitted, the co-starring application processing unit 61e generates a co-starring video in which the distribution user Ua and the distribution user Ub co-star based on the co-starring application. For the generation of the co-starring moving image, the co-starring application processing unit 61e acquires the face motion data and the voice data of the distribution user Ua from the distribution user Ua. The face motion data of the distribution user Ua may be transmitted from the distribution user device 20a to the server device 60 together with the co-starring application, or the server from the distribution user device 20a in response to a request from the server device 60 after the co-starring application is approved. It may be transmitted to the device 60. When the movement of the body of the distribution user Ua is also expressed as an animation, the body motion data may be provided to the server device 60 together with the face motion data of the distribution user Ua. When the face motion data cannot be acquired from the distribution user Ua, the co-star application processing unit 61e may acquire only the voice data from the distribution user Ua. For example, if the distribution user device 20a used by the distribution user Ua does not have the function of the face motion data generation unit 21a1 or other functions for video distribution, the function is disabled, and other than these. In the case of, the co-starring application processing unit 61e may acquire voice data without acquiring face motion data (and body motion data) from the distribution user Ua.

In one embodiment, the co-star application processing unit 61e adds an animation of the character object of the distribution user Ua to the video being distributed including the character object 31 of the distribution user Ub based on the face motion data of the distribution user Ua. Then, generate a co-starring video. The animation of the character object of the distribution user Ua may be generated in the animation generation unit 61a based on the face motion data of the distribution user Ua. The animation of the character object of the distribution user Ua may be generated by applying the face motion data of the distribution user Ua to the model data for the distribution user Ua included in the model data 63a. For example, the co-star application processing unit 61e generates a layer including an animation of the character object of the distribution user Ua, and superimposes this layer on the moving image including the character object 31 of the distribution user Ub to obtain the character object of the distribution user Ua and the character object of the distribution user Ua. It is possible to generate a co-starring moving image including the character object 31 of the distribution user Ub. By generating a co-starring video including the character object of the distribution user Ua and the character object 31 of the distribution user Ub, the distribution user Ua and the distribution user Ub are using the video distribution system 1 from a point distant from each other. However, it is possible to virtually co-star in the co-starring video. When the co-star application processing unit 61e acquires the voice data without acquiring the face motion data (and body motion data) from the distribution user Ua, the video including the character object 31 of the distribution user Ub is acquired from the distribution user Ua. By superimposing the voice generated based on the generated voice data, it is possible to generate a co-starring moving image including the character object 31 of the distribution user Ub and the voice of the distribution user Ua. The co-star application processing unit 61e is based on the audio data acquired from the distribution user Ua in the video including the character object 31 of the distribution user Ub even when the model data for the distribution user Ua is not set as the model data 63a. By superimposing the generated voice, it is possible to generate a co-starring moving image including the character object 31 of the distribution user Ub and the voice of the distribution user Ua. In this way, the distribution user Ua can co-star with the distribution user Ub by his / her own voice.

When the co-starring application processing unit 61e cannot acquire the face motion data from the distribution user Ua, the co-starring video including the voice of the distribution user Ua and the character object 31 of the distribution user Ub is distributed, and then the face motion data is acquired from the distribution user Ua. By generating the character object of the distribution user Ua based on the face motion data of the distribution user Ua at the same timing, it is possible to generate the co-starring video including the character object of the distribution user Ua and the character object 31 of the distribution user Ub. .. As described above, the co-starring application processing unit 61e converts the co-starring video including the voice of the distribution user Ua and the character object 31 of the distribution user Ub into the co-starring video including the character object 131 of the distribution user Ua and the character object 31 of the distribution user Ub. You can switch. On the contrary, the co-starring application processing unit 61e performs a co-starring video including the character object 131 of the distribution user Ua and the character object 31 of the distribution user Ub, and co-stars the voice of the distribution user Ua and the character object 31 of the distribution user Ub. You can switch to video. In this way, a co-starring video in which voice co-starring is performed (sometimes referred to as "voice co-starring video") and a co-starring video in which character objects are co-starring (sometimes referred to as "character co-starring video"). .) May be interchangeably switchable.

The generated co-starring video is distributed by the video distribution unit 61c. The co-starring moving image may be created by the distribution user device 20a. When the co-starring moving image is generated by the distribution user device 20a, the co-starring moving image is transmitted from the distribution user device 20a to the server device 60 and distributed by the moving image distribution unit 61c of the server device 60.

9 and 10a to 10b show an example of displaying the co-starring moving image distributed from the moving image distribution unit 61c. In these figures, since the co-starring application is permitted from the distribution user Ua to the distribution user Ub, it is assumed that the co-starring video including the character object 131 of the distribution user Ua and the character object 31 of the distribution user Ub is distributed. There is.

As shown in FIG. 9, the image 230 of the co-starring moving image distributed from the server device 60 is displayed on the display of the viewing user device 10. The image 230 of the co-starring moving image displayed on the viewing user device 10 includes the character object 131 of the distribution user Ua in addition to the character object 31 of the distribution user Ub. As described above, the character object 131 of the distribution user Ua is generated by the animation generation unit 61a or the co-starring application processing unit 61e. The image 230 of the co-starring moving image includes a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35, similar to the original distribution image shown in FIG. In addition to these, the image 230 of the co-starring moving image may include guest evaluation buttons 133a and 133b. The guest evaluation button 133a is a button for transmitting positive evaluation information indicating a positive evaluation to the guest user (in the illustrated example, the distribution user Ua is the guest user) to the server device 60, and is a guest evaluation. The button 133b is a button for transmitting negative evaluation information indicating a negative evaluation to the guest user to the server device 60. When the guest evaluation button 133a is selected by the viewing user who is watching the video, guest evaluation information indicating that the guest user has been positively evaluated is transmitted to the server device 60, and the guest evaluation button 133b is selected. Then, the guest evaluation information indicating that the positive evaluation has been made to the guest user may be transmitted to the server device 60. In the server device 60, the guest user evaluation information in the co-starring moving image information 63d may be updated based on the guest evaluation information from the viewing user. Although not shown, one or more host evaluation buttons for evaluating the host user may be displayed together with the co-starring video. When the host evaluation button is selected by the viewing user who is watching the video, host evaluation information indicating that the host user (delivery user Ub) has been positively or negatively evaluated is transmitted to the server device 60. May be done. In the server device 60, the host user evaluation information in the co-starring moving image information 63d may be updated based on the host evaluation information from the viewing user. In one embodiment, the host user information of the distribution user (for example, distribution user Ub) who has transmitted the invitation may be generated based on the co-starring moving image information 63d in addition to the user information 63c or instead of the user information 63c. For example, the host user information of the distribution user Ub may include the host user evaluation information of the co-starring video information 63d, and is generated based on the host user evaluation information and, if necessary, a score generated based on other information. You may. The host user evaluation information reflects positive or negative feedback from the viewing user regarding the behavior as the host user in the co-starring video. The distribution user who received the invitation applies for co-starring when the host user evaluation information of the distribution user who sent the invitation has a high value (that is, when the distribution user has a high evaluation as a host user). This makes it possible to co-star with an excellent host user.

As shown in the figure, the image 230 of the co-starring moving image is a horizontally long image. The co-starring application processing unit 61e or the video distribution unit 61c may distribute the co-starring video as a horizontally long video. As a result, the image 230 of the co-starring moving image is displayed as a horizontally long image on the viewing user device 10. In one embodiment, even if the original moving image (image) is vertically long as shown in FIG. 5, the co-starring moving image is converted into horizontally long and distributed. Since the co-starring video includes the character objects of the two distribution users, it is easy to display the character objects of the two people without duplication by making the image horizontally long. For example, in the co-starring video, the left half may be allocated to the character object of the original distribution user from the viewpoint of the viewing user, and the right half may be allocated to the character object of the distribution user who applied for co-starring. .. The allocation of the area to each distribution user may be arbitrarily determined so that the character objects do not overlap with each other.

As shown in FIG. 10a, the image 330 of the co-starring moving image distributed from the server device 60 is displayed on the distribution user device 20a of the distribution user Ua. The image 330 of the co-starring moving image displayed on the distribution user device 20a includes the same background image, character object image, and comment as the image 230 of the co-starring moving image displayed on the viewing user device 10. On the other hand, the image 330 of the co-starring video is different from the image 230 in that it does not include the gift button 32, the evaluation button 33, the comment button 34, and the co-starring application button 36, but includes the display instruction buttons 42a to 42c. ..

The privilege display button 142 may be displayed on the image 330 of the co-starring moving image displayed on the distribution user device 20a. The privilege display button 142 is displayed on the image 330 so as to be selectable by the distribution user Ua. The privilege display button 142 is displayed on the image 330, for example, when the host user information includes the privilege information and the privilege is an object that can be displayed in the moving image. In this case, the privilege display button 142 is associated with an object that is a privilege acquired by the distribution user Ua applying for co-starring in response to an invitation from the distribution user Ub. By selecting the privilege display button 142, the object associated with the privilege display button 142 may be displayed in the co-starring video. For example, the object may be an object indicating an accessory that can be worn by the character. In this case, when the privilege display button 142 is selected, the accessory, which is an object associated with the display instruction button, is attached to the character. The privilege display button 142 may not be displayed on the image 330 when the privilege information is not included in the host user information.

When the host user information of the distribution user Ub associated with the invitation received by the distribution user Ua includes the privilege information, as described above, the distribution user Ua is subjected to the co-starring application and the co-starring. Benefits are granted at least on one of the occasions. The privilege given to the distribution user Ua may change depending on the evaluation of the co-starring video after the distribution of the co-starring video is started. For example, when points for 100 points used in the distribution system 1 are given as privilege information, the points can be increased when the evaluation of the co-starring video is high. The evaluation of the co-starring moving image may be determined based on the evaluation update information transmitted by selecting the evaluation button 33 after the start of distribution of the co-starring moving image. In another embodiment, the privilege given to the distribution user Ua may change depending on the evaluation of the distribution user Ua during the distribution of the co-starring moving image. The evaluation to the distribution user Ua during the distribution of the co-starring video may be determined based on the guest user evaluation information of the co-starring video information 63d.

As shown in FIG. 10b, the image 430 of the co-starring moving image distributed from the server device 60 is displayed on the display of the distribution user device 20b. The image 430 of the co-starring video displayed on the distribution user device 20b has the same background image, character objects 31, 131, comments 35, and display as the image 330 displayed on the distribution user device 20a of the distribution user Ua of the co-starring partner. The instruction buttons 42a to 42c are included. On the other hand, in the image 430, a co-starring end button 45 for ending the co-starring is displayed. In one embodiment, the co-starring end button 45 is not only the image 430 of the co-starring video in the distribution user device 20b of the distribution user Ub who received the co-starring application, but also the co-starring in the distribution user device 20b of the distribution user Ua who applied for the co-starring. It may be displayed on the image 330 of the moving image. When the co-starring end button 45 is selected, a process for ending the co-starring with the distribution user Ua is performed in the co-starring video. For example, in response to the selection of the co-starring end button 45 in the distribution user device 20b, the distribution user device 20b transmits a co-starring end instruction to the server device 60. The distribution user Ub can set the distribution user Ua, which is a guest user, as a co-star prohibition user while playing the co-star video. For example, when the distribution user Ua performs an undesired action or behavior in the co-starring video, the distribution user Ua can be set as the co-starring prohibited user. The setting of the distribution user Ua as a co-starring prohibited user may be performed by recording the user ID of the distribution user Ub in the appearance prohibition information of the user information 63c of the distribution user Ua. For example, when the server device 60 receives the co-starring end instruction from the distribution user device 20b, the server device 60 can automatically register the distribution user Ua as a co-star prohibition user in the user information 63c of the distribution user Ub. The distribution user Ub may set the distribution user Ua as a prohibited user other than when playing back the co-starring video. For example, the distribution user Ua may be set as a prohibited user in response to the confirmation of the posting of an unwanted message by the distribution user Ua in the messaging service provided by the video distribution system 1. Contrary to the above example, when the distribution user Ub performs an undesired action or behavior, the host user is set as the co-star prohibition user according to the selection of the co-star end button 45 on the distribution user device 20a. May be good.

A warning button (not shown) for giving a warning to the guest user may be displayed on the image 430 of the co-starring moving image in the distribution user device 20b of the distribution user Ub who is the host user. This warning button may be displayed on the image 330 of the co-starring moving image in the distribution user device 20a of the distribution user Ua who is a guest user. Unlike the co-star end button 45, the warning button does not immediately end the co-star, but when the guest user takes an undesired action for the host user or the host user takes an undesired action by the guest user. It is expected to be selected in some cases. When the warning button is selected in the distribution user device of the host user (for example, the distribution user device 20b of the distribution user Ub), the distribution user device 20b transmits a warning instruction to the server device 60. When the warning button is selected in the distribution user device of the host user, the host user gives a warning in the image 330 of the co-starring video displayed on the distribution user device of the guest user (for example, the distribution user device 20a of the distribution user Ua). Warning information indicating that may be displayed. The warning information may be displayed on the image 230 in the viewing user device 10. The co-starring moving image including the warning information may be generated in the server device 60. By displaying the warning information on the image 230 of the viewing user, it is possible to indicate to the viewing user that the host user is responding to the undesired behavior of the guest user. The server device 60 counts the number of times a warning instruction is given from a certain host user to a certain guest user, and when the number of warning instructions reaches a predetermined number of times (for example, three times), the host user and the guest user. You may perform the process to end the co-starring with. The number of times a warning instruction is given from a host user to a guest user may be stored as user information 63c in association with the user account of the host user. The process for ending the co-starring based on the warning instruction more than a predetermined number of times may be the same process as the process for ending the co-starring based on the above-mentioned co-starring end instruction.

The co-star application processing unit 61e may issue a video ID that identifies the created co-star video. In association with this moving image ID, the co-starring moving image information regarding the co-starring moving image can be stored in the storage 63. As described above, the co-starring time information of the co-starring moving image may be updated in association with the moving image ID of the co-starring moving image being distributed. The co-starring time information may be updated based on the monitoring result of monitoring the distribution time of the co-starring moving image in the moving image distribution unit 61c.

Of the co-starring video information, the guest user evaluation information includes positive evaluation information indicating a positive evaluation to the distribution user Ua who is a guest user from the viewing user device 10 and negative evaluation information indicating a negative evaluation to the distribution user Ua. May be updated based on. For example, when the server device 60 receives the positive evaluation information indicating a positive evaluation to the distribution user Ua from the viewing user device 10, the guest user evaluation points may be increased, and the negative evaluation point to the distribution user Ua may be increased. When the negative evaluation information indicating the evaluation is received, the guest user evaluation points may be reduced. If the viewing user stops watching the co-starring video in the middle, the viewing user may not be satisfied with the co-starring video. Therefore, when the viewing user stops viewing the co-starring video in the middle, the guest user evaluation points of the guest user may be reduced, assuming that the guest user has a negative evaluation. At least one of the positive and negative assessment information may be updated to decrease over time. For example, even if the distribution user Ua has 100 points of positive evaluation information at a certain time, the positive evaluation information may be updated to approach zero with the passage of time. When the negative evaluation information for a certain user exceeds a predetermined value, the co-starring with another user may be prohibited for the user. For example, in the image displayed on the distribution user device of the user whose negative evaluation information exceeds a predetermined value, a process may be performed in which the co-starring application button is not displayed.

The co-starring end processing unit 61f is a guest user distribution user Ua and a host user distribution user Ua when the co-starring end condition for terminating the co-starring between the guest user distribution user Ua and the host user distribution user Ub is satisfied. Performs processing for ending the co-starring with the user Ub. In one embodiment, when the co-starring end processing unit 61f receives the co-starring end instruction from the distribution user device 20b of the distribution user Ub who is the host user, it determines that the co-starring end condition is satisfied and ends the distribution of the co-starring moving image. Is processed. For example, when the co-starring end processing unit 61f receives the co-starring end instruction, the animation generation of the character object 131 of the distribution user Ua is stopped, and the character object 31 of the distribution user Ub is not included in the character object 131 of the distribution user Ua. Generate a video that contains. In other words, the character object 131 of the distribution user Ua, which is a guest user, is excluded from the video to be distributed. By eliminating the character object 131 of the distribution user Ua, which is a guest user, the co-starring of the distribution user Ua and the distribution user Ub ends. After the co-starring is completed, the distribution of the moving image including the character object 31 without including the character object 131 may be continued. The moving image delivered after the end of the co-starring may be generated as a vertically long moving image as shown in FIG. That is, the orientation of the moving image may be changed according to the end of the co-starring. In one embodiment, the orientation of the moving image may be changed from landscape to portrait depending on the end of the co-starring. In another embodiment, the distribution of the moving image by the distribution user Ub, which is the host user, may be terminated according to the end of the co-starring. In one embodiment, if a co-starring application from another user has already been received when the co-starring with the distribution user Ub is completed, the co-starring application processing unit 61e will co-star with the other user based on the co-starring application. It may be determined whether or not it is possible.

In one embodiment, the co-starring end processing unit 61f determines whether or not the character object 131 of the distribution user Ua, which is a guest user, is in the non-active state, and if it is determined that the character object 131 is in the non-active state, the co-starring end processing unit 61f. It is determined that the condition is satisfied. In one embodiment, whether or not the character object 131 of the distribution user Ua is in the inactive state is determined by at least one of face motion data, body motion data, and voice data received from the distribution user device 20a of the distribution user Ua. Judgment is based on. Since face motion data, body motion data, and voice data are all data indicating the movement of the distribution user, they may be collectively referred to as "motion data" in the present specification. Whether or not the character object 131 of the distribution user Ua is in the inactive state is determined based on the motion data, that is, based on at least one of the face motion data, the body motion data, and the voice data. For example, if the face motion data is not input from the distribution user device 20a of the distribution user Ua for a certain period of time, the facial expression of the character object 131 of the distribution user Ua does not move for the certain period in the co-starring video, so that the character object 131 is inactive. It may be determined that it is in a state. If the body motion data is not input from the distribution user device 20a of the distribution user Ua for a certain period of time, the body movement of the character object 131 of the distribution user Ua does not move for the certain period in the co-starring video, so that the character object 131 is inactive. It may be determined that it is in a state. When the audio data is not input from the distribution user device 20a of the distribution user Ua for a certain period of time, the character object 131 of the distribution user Ua becomes silent for the certain period in the co-starring video, so that the character object 131 is in the inactive state. It may be determined.

In one embodiment, the co-starring end processing unit 61f ends the co-starring by excluding the character object 131 of the distribution user Ua, which is a guest user, from the moving image according to the co-starring moving image information of the co-starring moving image being distributed. For example, when the guest user evaluation information is a guest user evaluation point, the co-star end processing unit 61f excludes the character object 131 of the distribution user Ua from the moving image when the guest user evaluation point becomes smaller than a predetermined threshold value. By doing so, the co-starring with the distribution user Ua can be terminated. The more negative evaluation information is received from the viewing user to the distribution user Ua, which is the guest user, the smaller the guest user evaluation point becomes. Therefore, by determining whether or not to end the co-starring with the distribution user Ua based on the guest user evaluation points, it is possible to avoid co-starring with a user having a low evaluation from the viewing user for a long period of time.

Next, with reference to FIG. 11, a moving image distribution process according to one aspect will be described. FIG. 11 is a flow chart showing the flow of the moving image distribution process in one embodiment. In the moving image distribution process described with reference to FIG. 11, it is assumed that the moving image generated based on the face motion data acquired by the distribution user Ub using the distribution user device 20b is distributed.

First, in step S11, face motion data, which is a digital representation of the facial movement (facial expression) of the distribution user Ub, is generated. The face motion data is generated, for example, by the face motion data generation unit 121b of the distribution user device 20b. In the distribution user device 20b, voice data may be generated based on voice input from distribution users Ua and Ub. The generated face motion data and voice data are transmitted to the server device 60.

Next, in step S12, the face motion data from the distribution user device 20b is applied to the model data for the distribution user Ub, so that an animation of the character object 31 that moves in synchronization with the movement of the facial expression of the distribution user Ub is generated. Will be done. This animation is generated, for example, by the animation generation unit 61a described above.

Next, in step S13, a moving image including an animation of the character object 31 of the distribution user Ub is generated. The voice of the distribution user Ub may be synthesized with this moving image. The animation of the character object 31 is displayed superimposed on the background image. This moving image is generated, for example, by the moving image generation unit 61b described above.

Next, the process proceeds to step S14, and the moving image generated in step S13 is delivered. This moving image is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50. When the delivered moving image is played back on the viewing user device 10, for example, an image of the moving image as shown in FIG. 5 is displayed on the viewing user device 10. The moving image is continuously distributed over a predetermined distribution period. The distribution period of the moving image may be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other time. The moving image is distributed, for example, by the moving image distribution unit 61c described above.

Next, the process proceeds to step S15, and it is determined whether or not the termination condition for terminating the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the distribution user Ub has performed an operation for terminating the distribution on the distribution user device 20b, or a condition other than these. If the end condition is not fulfilled, the processes of steps S11 to S14 are repeatedly executed, and a video including an animation synchronized with the movement of the distribution user Ub, or a co-starring video when co-starring with the distribution user Ua continues. Delivery will continue. If it is determined that the end condition for the video is satisfied, the distribution process of the video is terminated.

Next, with reference to FIG. 12, a process of presenting an invitation to an invited user in one embodiment will be described. FIG. 12 is a flow chart showing a flow of a process of inviting a distribution user who distributes a moving image to another distribution user to co-star in the moving image in one embodiment. In the distribution process of the co-starring video described with reference to FIG. 12, the distribution user Ub may invite the distribution user Ua who is viewing the video including the character object of the distribution user Ub to co-star. It is supposed. The invitation process for co-starring may be performed in parallel with the video distribution process shown in FIG. 11, or may be performed before the start of the video distribution process shown in FIG.

First, in step S21, an invitation request is transmitted to the server device 60 before or during distribution of the moving image including the character object of the distribution user Ub. The invitation request is transmitted from the distribution user device 20b to the server device 60 in response to the operation of the distribution user Ub. The invitation request transmission process is performed by, for example, the invitation request unit 21b2.

Next, in step S22, the host user information of the distribution user Ub is generated based on the invitation request from the distribution user Ub. As described above, the host user information is generated by referring to at least one of the user information 63c and the co-starring moving image information 63d stored in the storage 63. The host user information generation process is performed by, for example, the invitation processing unit 61d described above.

Next, in step S23, an invitation to invite the distribution user Ub to co-star in the moving image is transmitted to one or a plurality of distribution user devices including the distribution user device 20a of the distribution user Ua. Further, the host user information of the distribution user Ub is transmitted in association with this invitation. The invitation processing and the transmission processing of the host user information are performed by, for example, the invitation processing unit 61d described above.

Next, in step S24, the invitation is received in the distribution user device 20a of the distribution user Ua. In the distribution user device 20a, the character string "Invited by Ub" indicating that the invitation has been received from the distribution user Ub and the host user information of the distribution user Ub are displayed. As described above, the host user information is information generated based on the user information 63c, and is preferably an index showing the attractiveness of the distribution user Ub as a co-star. The display of the host user information is performed by, for example, the invitation presentation unit 21a2 described above. The distribution user Ua can determine whether or not to apply for co-starring based on the host user information of the distribution user Ub displayed on the distribution user device 20a. The distribution user Ua can apply for co-starring by selecting the co-starring application button 37b displayed on the distribution user device 20a together with the host user information.

When a co-starring application is made, the co-starring video is subsequently distributed. With reference to FIG. 13, the distribution process of the co-starring moving image in one embodiment will be described. FIG. 13 is a flow chart showing a flow of processing for distributing a co-starring moving image in one embodiment. In the distribution process of the co-starring video described with reference to FIG. 13, it is assumed that the distribution user Ua viewing the video including the character object of the distribution user Ub has applied for co-starring to the distribution user Ub. ing. The distribution process of the co-starring moving image is performed in parallel with the distribution processing of the moving image shown in FIG.

First, in step S31, it is determined whether or not a co-starring application has been made by a user other than the distribution user Ub during distribution of the moving image including the character object of the distribution user Ub. The co-starring application is made, for example, by the distribution user Ua. As described above, the distribution user Ua can apply for co-starring by selecting the co-starring application button 37b displayed on the distribution user device 20a after receiving the invitation. The co-starring application may be made by selecting the co-starring application button 36. The co-starring application may be made before receiving the invitation, or may be made by a user who has not received the invitation. If you apply for co-starring before receiving the invitation, or if you apply for co-starring by a user who has not received the invitation, you will be required to enter the co-starring password, and you will only apply for co-starring if the correct co-starring password is entered. Is also good. When the co-starring application is made by the distribution user Ua, the process proceeds to step S32. The co-starring application may also be made by one or more distribution users other than the distribution user Ua.

In step S32, a guest user to be co-starred in the video of the distribution user Ub is selected from the users who have applied for co-starring. The guest users selected may be singular or plural. If an upper limit is set for the number of co-stars, guest users are selected until the upper limit is reached.

If the distribution user Ua is selected as the guest user in step S32, the process proceeds to step S33. In step S33, the animation of the character object 131 of the distribution user Ua is generated based on the face motion data of the distribution user Ua. Then, the co-starring video is generated by adding the animation of the character object 131 of the distribution user Ua to the video being distributed (the video including the character object 31 of the distribution user Ub). The processing in step S33 is performed, for example, by the co-starring application processing unit 61e described above.

Next, the process proceeds to step S34. In step S34, the co-starring moving image generated in step S33 is delivered. This co-starring moving image is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50. The co-starring moving image includes, for example, an animation of the character object 131 of the distribution user Ua and an animation of the character object 31 of the distribution user Ub, as shown in FIGS. 9 and 10a to 10b.

Next, the process proceeds to step S35. In step S35, it is determined whether or not the co-starring end condition is satisfied. For example, when the character object 131 of the distribution user Ua who is a guest user is in the inactive state, when the guest user evaluation point becomes equal to or less than a predetermined threshold value, or when a co-star end instruction is received from the distribution user Ub who is the host user. , When the co-starring end instruction is received from the distribution user Ua who is a guest user, when a predetermined time or more has passed from the start of distribution of the co-starring video, or when the conditions for ending the co-starring other than these are satisfied, the co-starring is performed. It is determined that the end condition is satisfied. If the co-starring end condition is satisfied, the process proceeds to step S36.

In step S36, a process for terminating the distribution of the co-starring moving image is performed. For example, the character object 131 of the distribution user Ua, which is a guest user, is excluded from the co-starring video, so that the co-starring of the distribution user Ua and the distribution user Ub is terminated. Even if the co-starring is over, the video may continue to be delivered. The moving image distributed after the co-starring is completed does not include the character object 131 of the distribution user Ua. The determination of the co-starring end condition and the co-starring end processing are performed by, for example, the co-starring end processing unit 61f.

Subsequently, an example of the action and effect of the above embodiment will be described. According to the above embodiment, another distribution user (for example, distribution user Ua) who has received an invitation from the distribution user Ub is a distribution user based on the host user information of the distribution user Ub associated with the invitation. It is possible to decide whether or not to apply for co-starring with Ub. Therefore, the user who has received the invitation can decide whether or not to apply for co-starring after understanding the distribution user Ub as the host user. When processing a co-starring application based on an invitation, the viewing user will receive a large number of invitations from unknown distribution users, and the viewing user may decide which distribution user to co-star with. It can be difficult. In this way, simply using the invitation may hinder the use of the co-starring function. In the above embodiment, the host user information of the distribution user is presented to other distribution users in association with the invitation from the distribution user, so that the user who received the invitation can use which distribution based on the host user information of the distribution user. You can choose whether to perform with the user.

According to the above embodiment, when the distribution user Ub wants to co-star with another user in the video distributed by himself / herself, he / she sends an invitation including his / her own host user information to distribute the other. It is possible to promote co-starring applications from users.

According to the above embodiment, the co-starring application can be accepted only from the invited user who received the invitation. For example, the co-starring application buttons 36 and 37b are displayed only on the distribution user device that has received the invitation. As a result, since the co-starring application from the viewing user who has not received the invitation is not accepted, the processing load of the co-starring application can be reduced. In particular, for popular distribution users, adjusting the number of invited users to send invitations can prevent receiving an excessive amount of co-starring applications.

According to the above embodiment, the host user information includes information on the number of viewers who have viewed the video of the distribution user (for example, distribution user Ub) who has transmitted the invitation. As a result, the user who received the invitation (for example, the distribution user Ua) decides whether or not to apply for co-starring with the distribution user Ub based on the number of viewing users of the video distributed by the distribution user Ub. Can be done.

According to the above embodiment, the host user information includes information on the number of viewers who have viewed the video of the distribution user (for example, distribution user Ub) who has transmitted the invitation. As a result, the user who received the invitation (for example, the distribution user Ua) decides whether or not to apply for co-starring with the distribution user Ub based on the number of viewing users of the video distributed by the distribution user Ub. Can be done.

According to the above embodiment, the host user information includes user evaluation information of the distribution user (for example, distribution user Ub) who has transmitted the invitation. Thereby, the user who received the invitation (for example, the distribution user Ua) can decide whether or not to apply for co-starring with the distribution user Ub based on the evaluation of the distribution user Ub. According to the above embodiment, the host user information includes the distribution user (for example, distribution user Ub) video evaluation value information that has transmitted the invitation. Thereby, the user who received the invitation (for example, the distribution user Ua) can decide whether or not to apply for co-starring with the distribution user Ub based on the evaluation of the video distributed by the distribution user Ub.

According to the above embodiment, the host user information includes host user evaluation information. The host user evaluation information reflects positive or negative feedback from the viewing user regarding the behavior as the host user in the co-starring video. The distribution user who received the invitation applies for co-starring when the host user evaluation information of the distribution user who sent the invitation has a high value (that is, when the distribution user has a high evaluation as a host user). This makes it possible to co-star with an excellent host user.

In the video distribution system 1 according to the above embodiment, the distribution users Ua and Ub can distribute a video including a character object that moves according to their facial expressions by a distribution user device 20 provided with a camera such as a smartphone. As described above, in the video distribution system 1, since the equipment for the distribution users Ua and Ub to distribute the video is simplified, a platform in which the distribution users Ua and Ub can easily participate is realized.

In the processing procedure described in the present specification, particularly the processing procedure described using the flow chart, a part of the process (step) constituting the processing procedure is omitted, as a step constituting the processing procedure. It is possible to add steps not specified and / or change the order of the steps, and the processing procedure in which such omissions, additions, and changes are made is not intended to deviate from the gist of the present invention. Included in the scope of the invention.

At least a part of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 61 may be realized by, for example, the computer processor 21 of the distribution user device 20 or the computer processor of the viewing user device 10. Specifically, a part or all of the functions of the animation generation unit 61a and the moving image generation unit 61b may be executed in the distribution user device 20. For example, the moving image generated by the distribution user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

When the distribution user Ua who is watching the video including the character object 31 of the distribution user Ub makes a co-starring application with the distribution user Ub, the animation of the character object 131 of the distribution user Ua who made the co-starring application is the server. It may be generated by any of the device 60, the distribution user device 20a of the distribution user Ua, the distribution user device 20b of the distribution user Ub, or the viewing user device 10. Further, the generation of the co-starring video including the generated character object 131 of the distribution user Ua, the distribution video of the distribution user Ub, and the character object 31 is performed by the server device 60, the distribution user device 20a of the distribution user Ua, and the distribution user Ub. It may be performed by either the user device 20b or the viewing user device 10. The co-starring moving image may be shared and generated by the server device 60, the distribution user device 20a, the distribution user device 20b, the viewing user device 10, and devices other than these. In one example, when the animation of the character object 131 of the distribution user Ua is generated by the distribution user device 20b of the distribution user Ub, the distribution user device 20a of the distribution user Ua to the distribution user device 20b of the distribution user Ub. Then, the face motion data and the voice data of the distribution user Ua are transmitted. When the gift object is included in the co-starring moving image, data for displaying the gift object may be transmitted from the distribution user device 20a or the server device 60 to the distribution user device 20b. In the distribution user device 20b, the animation of the character object 131 is generated by applying the face motion data and the voice data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua. The model data for the distribution user Ua may be transmitted from the server device 60 to the distribution user device 20a. In another example, when the animation of the character object 131 of the distribution user Ua is generated by the viewing user device 10, the face motion data of the distribution user Ua is generated from the distribution user device 20a of the distribution user Ua to the viewing user device 10. And voice data is transmitted, and face motion data and voice data of the distribution user Ub are transmitted from the distribution user device 20b of the distribution user Ub to the viewing user device 10. In the viewing user device 10, the animation of the character object 131 is generated by applying the face motion data and the voice data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua, and the animation of the character object 131 is generated from the distribution user device 20b. An animation of the character object 31 may be generated by applying the received face motion data and voice data of the distribution user Ub to the model data for the distribution user Ub. The model data for the distribution user Ua and the model data for the distribution user Ub may be transmitted from the server device 60 to the viewing user device 10. When the gift object is included in the co-starring moving image, data for displaying the gift object may be transmitted from the distribution user device 20a, the distribution user device 20b, or the server device 60 to the viewing user device 10. As described above, the co-starring moving image including the animation of the character object of the distribution user and / or the animation of the character object can be generated by any device included in the moving image distribution system 1. Animations of character objects may be generated by devices not explicitly shown in FIG. The face motion data and voice data of the distribution user Ua are transmitted from the distribution user device 20a of the distribution user Ua to the device that generates the animation of the character object, and the face motion data of the distribution user Ub is transmitted from the distribution user device 20b of the distribution user Ub. And voice data is transmitted. Body motion may be transmitted in addition to face motion.

The co-starring video may include character objects of three or more distribution users. That is, three or more distribution users may virtually co-star in the moving image using each character object. An upper limit may be set for the number of distribution users who can co-star. When the number of distribution users who can co-star reaches the upper limit, the process of not displaying the co-star application button 36 on the image of the video being viewed by the distribution user (for example, image 40a), or the image of the video being viewed by the distribution user. In, a process (disable process) may be performed in which the co-star application button 36 cannot be selected.

Hereinafter, the inventions described in the claims at the time of filing the original application of the present application are added.
[1]
Equipped with one or more computer processors
The one or more computer processors may execute computer-readable instructions.
Deliver a video containing an animation of a character object generated based on the movement of the first user,
An invitation associated with the host user information regarding the first user is transmitted to the second user among the plurality of viewing users who watch the moving image.
In response to receiving a co-starring application for co-starring with the first user from the second user who received the invitation, a co-starring video in which the first user and the second user co-star is generated.
Distribute the co-starring video to one or more viewing users,
Video distribution system.
[2]
The co-starring application is accepted only from one or more invited users who have received the invitation among the plurality of viewing users.
The second user is included in the one or more invited users.
The video distribution system described in [1].
[3]
The host user information is presented to the second user.
The video distribution system according to [1] or [2].
[4]
The host user information includes user evaluation information indicating an evaluation for the first user.
The video distribution system according to any one of [1] to [3].
[5]
The host user information includes viewer number information indicating the number of viewing users of the moving image.
The video distribution system according to any one of [1] to [4].
[6]
The host user information includes host user evaluation information indicating an evaluation for the first user in the co-starring video.
The video distribution system according to any one of [1] to [5].
[7]
The host user information includes video evaluation information indicating an evaluation of the video.
The video distribution system according to any one of [1] to [6].
[8]
The invitation includes first privilege information indicating a first privilege given to the second user when the second user makes the co-starring application.
The video distribution system according to any one of [1] to [7].
[9]
The invitation includes a second privilege information indicating a second privilege given to the second user when the co-starring video in which the second user and the first user co-star is generated.
The video distribution system according to any one of [1] to [8].
[10]
At least one of the first privilege and the second privilege changes according to the evaluation of the co-starring video.
The video distribution system according to [8] or [9].
[11]
At least one of the first privilege and the second privilege changes according to the evaluation of the second user during the distribution of the co-starring video.
The video distribution system according to any one of [8] to [10].
[12]
At least one of the first privilege and the second privilege is an object that can be used by the second user in the co-starring video.
The video distribution system according to any one of [8] to [11].
[13]
The co-starring video is a character co-starring video including a first character object generated based on the movement of the first user and a second character object generated based on the movement of the second user.
The video distribution system according to any one of [1] to [12].
[14]
The co-starring video is a voice co-starring video including a first character object generated based on the movement of the first user and the voice of the second user.
The video distribution system according to any one of [1] to [13].
[15]
The co-starring video is a character co-starring video including a first character object generated based on the movement of the first user and a second character object generated based on the movement of the second user, or the movement of the first user. It is a voice co-starring video including the voice of the first character object and the voice of the second user generated based on.
The character co-starring video and the voice co-starring video can be switched alternately.
The video distribution system according to any one of [1] to [14].
[16]
Equipped with one or more computer processors
The one or more computer processors may execute computer-readable instructions.
Deliver a video containing an animation of a character object generated based on the movement of the first user,
Invitation is sent to one or more viewing users who watch the video,
Co-starring applications are accepted only from one or more invited users who have received the invitation among the plurality of viewing users.
In response to the acceptance of the co-starring application, a co-starring video in which the first user and the second user included in the one or more invited users co-star is generated.
Distribute the co-starring video to one or more viewing users,
Video distribution system.
[17]
A method of video distribution performed by one or more computer processors executing computer-readable instructions.
The process of delivering a video containing an animation of a character object generated based on the movement of the first user, and
A step of transmitting an invitation associated with host user information regarding the first user to a second user among a plurality of viewing users who watch the moving image, and a process of transmitting the invitation.
A process of generating a co-starring video in which the first user and the second user co-star in response to receiving a co-starring application for co-starring with the first user from the second user who received the invitation.
The process of distributing the co-starring video to one or more viewing users, and
Video distribution method with.
[18]
For one or more computer processors
The process of delivering a video containing an animation of a character object generated based on the movement of the first user, and
A step of transmitting an invitation associated with host user information regarding the first user to a second user among a plurality of viewing users who watch the moving image, and a process of transmitting the invitation.
A process of generating a co-starring video in which the first user and the second user co-star in response to receiving a co-starring application for co-starring with the first user from the second user who received the invitation.
The process of distributing the co-starring video to one or more viewing users, and
A video distribution program that runs.

1 Video distribution system 10 Viewing user equipment 20a, 20b Distribution user equipment 21a1, 21b1 Face motion data generation unit 21a2 Invitation presentation unit 21a3 Co-star application unit 21b2 Invitation request unit 60 Server device 61a Animation generation unit 61b Video distribution unit 61d Invitation processing unit 61e Co-star application processing unit 61f Co-star end processing unit 63 Storage

Claims (20)

Equipped with one or more computer processors
The one or more computer processors may execute computer-readable instructions.
Deliver a video containing an animation of a character object generated based on the movement of the first user,
An invitation associated with host user information, which is an index representing the profile of the first user as a host user, is transmitted to the second user among the plurality of viewing users who watch the moving image.
In response to receiving a co-starring application for co-starring with the first user from the second user who received the invitation, a co-starring video in which the first user and the second user co-star is generated.
Distribute the co-starring video to one or more viewing users,
Video distribution system. The co-starring application is accepted only from one or more invited users who have received the invitation among the plurality of viewing users.
The second user is included in the one or more invited users.
The video distribution system according to claim 1. The host user information is presented to the second user.
The video distribution system according to claim 1 or 2. The host user information includes user evaluation information indicating an evaluation for the first user.
The video distribution system according to any one of claims 1 to 3. The host user information includes viewer number information indicating the number of viewing users of the moving image.
The video distribution system according to any one of claims 1 to 4. The host user information includes host user evaluation information indicating an evaluation for the first user in the co-starring video.
The video distribution system according to any one of claims 1 to 5. The host user information includes video evaluation information indicating an evaluation of the video.
The video distribution system according to any one of claims 1 to 6. The host user information includes first privilege information indicating a first privilege given to the second user when the second user makes the co-starring application.
The video distribution system according to any one of claims 1 to 7. The first privilege changes according to the evaluation of the co-starring video.
The video distribution system according to claim 8. The first privilege changes according to the evaluation of the second user during the distribution of the co-starring video.
The video distribution system according to claim 8 or 9. The first privilege is an object that can be used by the second user in the co-starring video.
The video distribution system according to any one of claims 8 to 10. The host user information includes a second privilege information indicating a second privilege given to the second user when the co-starring moving image in which the second user and the first user co-star is generated.
The video distribution system according to any one of claims 1 to 11. The second privilege changes according to the evaluation of the co-starring video.
The video distribution system according to claim 12. The second privilege changes according to the evaluation of the second user during the distribution of the co-starring video.
The video distribution system according to claim 12 or 13. The second privilege is an object that can be used by the second user in the co-starring video.
The video distribution system according to any one of claims 12 to 14. The co-starring video is a character co-starring video including a first character object generated based on the movement of the first user and a second character object generated based on the movement of the second user.
The video distribution system according to any one of claims 1 to 15. The co-starring video is a voice co-starring video including a first character object generated based on the movement of the first user and the voice of the second user.
The video distribution system according to any one of claims 1 to 16. The co-starring video is a character co-starring video including a first character object generated based on the movement of the first user and a second character object generated based on the movement of the second user, or the movement of the first user. It is a voice co-starring video including the voice of the first character object and the voice of the second user generated based on.
The character co-starring video and the voice co-starring video can be switched alternately.
The video distribution system according to any one of claims 1 to 17. A method of video distribution performed by one or more computer processors executing computer-readable instructions.
The process of delivering a video containing an animation of a character object generated based on the movement of the first user, and
A step of transmitting an invitation associated with host user information, which is an index representing the profile of the first user as a host user, to a second user among a plurality of viewing users who watch the moving image.
A process of generating a co-starring video in which the first user and the second user co-star in response to receiving a co-starring application for co-starring with the first user from the second user who received the invitation.
The process of distributing the co-starring video to one or more viewing users, and
Video distribution method with. For one or more computer processors
The process of delivering a video containing an animation of a character object generated based on the movement of the first user, and
A step of transmitting an invitation associated with host user information, which is an index representing the profile of the first user as a host user, to a second user among a plurality of viewing users who watch the moving image.
A process of generating a co-starring video in which the first user and the second user co-star in response to receiving a co-starring application for co-starring with the first user from the second user who received the invitation.
The process of distributing the co-starring video to one or more viewing users, and
A video distribution program that runs.

Images