JP2020096341A - Video distribution system, video distribution method, and video distribution program - Google Patents

Abstract

To provide a video distribution system that can neatly display a gift from a viewer on a co-star video.SOLUTION: A server device 60 delivers a first video including a first character object of a first user, and causes a first user device of the first user to display a display instruction object in response to receiving a first display request regarding a first gift from a user viewing the first video, and causes a viewing user device used by the viewing user and a second user device used by a second user not to display the display instruction object. On the other hand, the display instruction object is displayed on the first user device and the second user device which display the co-star video including the first user first character object of the first user and the second character object of the second user. The first gift is displayed in association with at least one of the first character object and the second character object in the co-star video in response to an operation on the display instruction object.SELECTED DRAWING: Figure 1

Description

The disclosure in this specification relates to a moving image distribution system, a moving image distribution method, and a moving image distribution program. More specifically, the disclosure in the present specification relates to a moving image distribution system, a moving image distribution method, and a moving image distribution program for live distribution of a moving image including a character object generated based on a movement of a user.

2. Description of the Related Art Conventionally, there is known a moving image distribution system that generates an animation of a character object based on a motion of a distribution user and distributes a moving image including the animation of the character object live. Such a moving image distribution system is disclosed, for example, in JP-A-2005-184689 (Patent Document 1) and “Yusuke Hasegawa, the dawn of a new era of virtual idol PROJECT MariA, CG WORK, Japan, Bone Digital Co., Ltd., November 2017. 10th, Volume 231 pp.74-79” (Non-Patent Document 1).

There is provided a moving image distribution service that distributes a moving image including a character object generated based on the movement of a distribution user. As such a service, "Virtual Cast" provided by Dwango Co., Ltd. is known. In the virtual cast, a character object of another user enters a moving image distributed by a certain distribution user, and two distribution users can virtually co-star in the moving image via each character object.

There is also known a content distribution system that displays a gift object corresponding to a gift purchased by the viewing user on a display screen in response to a request from the viewing user who views the content. For example, in the moving image distribution system disclosed in Japanese Unexamined Patent Application Publication No. 2012-120098 (Patent Document 2), a viewing user purchases a gift item and provides the purchased gift item as a gift to the distribution user. You can The gift is displayed on the moving image that is being delivered in response to a display request from the viewing user. The gift display request may be automatically generated in response to the purchase of the gift by the viewing user.

JP, 2005-184689, A JP 2012-120098 A

Yusuke Hasegawa, opening of a new era of virtual idol PROJECT MariA, CG WORLD, Japan, Bone Digital Co., Ltd., November 10, 2017, Volume 231, pp. 74-79 Dwango Co., Ltd. [Virtualcast] Convex”, [online], [November 25, 2018 search], Internet <URL: https://qa.nicovideo.jp/faq/show/10740?back=front %2Fcategory%3Ashow&category_id=718&page=1&site_domain=default&sort=sort_access&sort_order=desc〉

In the conventional moving image distribution system, a gift is provided from the viewing user to the distribution user. When a co-star video in which two or more distribution users co-star, accepts gifts from the viewing user to each of the distribution users, the number of gifts that can be accepted is larger than when each distribution user distributes the video alone. . Therefore, when the gift received in the co-star video is displayed, the gift provided to each distribution user makes the distribution video cluttered, and the quality of the distribution video cannot be maintained.

It is an object of the present disclosure to provide a technical improvement that solves or alleviates at least some of the above-mentioned problems of the prior art. One of the more specific objects of the present disclosure is to provide a moving image distribution system, a moving image distribution method, and a moving image distribution program that can display gifts from viewing users in a co-star moving image in an orderly manner.

A moving image distribution system according to an aspect of the present invention includes one or more computer processors, and the one or more computer processors are generated based on movement of a first user by executing computer-readable instructions. The first moving image including the first character object is displayed, and the first moving image is displayed in response to receiving a first display request regarding the first gift from a viewing user who views the first moving image. The display instruction object is displayed on the first user device of the user, while the display instruction object is displayed on the viewing user device used by the viewing user and the second user device used by the second user displaying the first moving image. Without displaying, the co-star movie including the first character object and the second character object generated based on the movement of the second user is distributed based on the co-star application from the second user. The display instruction object is displayed on the first user device to be displayed and the second user device to display the co-starring video, and the first character object and the object are displayed in the co-starring video according to an operation on the display instruction object. The first gift is displayed in association with at least one of the second character objects.

In one aspect of the present invention, when the display instruction object is operated on the first user device, the display instruction object is disabled from the second user device, and the display instruction object is displayed on the second user device. When operated, the display instruction object cannot be selected from the first user device.

In one aspect of the present invention, the display instruction object is selectable on the first user device, while the display instruction object is not selectable on the second user device.

In one aspect of the present invention, the first gift is displayed in the co-star moving image in association with the second character object by operating the display instruction object in the first user device.

In one aspect of the present invention, the first gift is a wearing gift associated with the wearing parts of the first character object and the second character object, and the wearing gift is in accordance with an operation on the display instruction object. And is displayed at a position corresponding to the wearing part in the co-starring moving image.

In one aspect of the present invention, the co-starring is performed in response to receiving a second display request related to a second gift from the viewing user without being associated with specific parts of the first character object and the second character object. Display the second gift in the video.

In one aspect of the present invention, the first gift is displayed in association with only one of the first character object and the second character object in the co-star moving image in response to an operation on the display instruction object.

One aspect of the present invention relates to a moving image distribution method executed by one or more computer processors executing computer-readable instructions. The moving image distribution method includes a step of distributing a first moving image including a first character object generated based on a movement of the first user, and a first display request regarding a first gift from a viewing user who views the first moving image. In response to receiving the first moving image, the first user device of the first user displaying the first moving image displays the display instruction object while displaying the viewing user device used by the viewing user and the first moving image. Based on the movement of the first character object and the second user, based on the step of not displaying the display instruction object on the second user device used by the second user, and the co-star application from the second user. Distributing a co-star movie including the generated second character object, and displaying a display instruction object on the first user device that displays the co-star movie and the second user device that displays the co-star movie. A step of displaying the first gift in association with at least one of the first character object and the second character object in the co-star moving image in response to an operation on the display instruction object.

A moving image distribution program according to an aspect of the present invention distributes a first moving image including a first character object generated based on a movement of a first user to one or more computer processors, and the first moving image. The viewing user is displayed on the first user device of the first user who displays the first moving image in response to accepting the first display request regarding the first gift from the viewing user who views the viewing user. Based on a co-starring application from the second user and a step of not displaying the display instruction object on the viewing user device used by the second user device used by the second user who displays the first moving image. Distributing a co-starring movie including one character object and a second character object generated based on the movement of the second user; the first user device displaying the co-starring movie; and the first displaying the co-starring movie. 2 Displaying the display instruction object on the user device, and in response to an operation on the display instruction object, the first gift in association with at least one of the first character object and the second character object in the co-star movie. And a step of displaying.

According to the embodiment of the present invention, gifts from the viewing user can be displayed in order in the co-star movie.

FIG. 1 is a block diagram showing a moving image distribution system according to an embodiment. It is a schematic diagram which shows typically the delivery user who delivers the animation delivered by the animation delivery system of FIG. 1, and the delivery user apparatus which the said delivery user is using. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. It is a figure which shows the example of the display screen displayed on the delivery user apparatus 20a in one embodiment. It is a figure which shows the example of the display screen displayed on the delivery user apparatus 20b in one embodiment. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. On the display screen of FIG. 5, an example of a normal object is displayed. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. An example of the attached object is displayed on the display screen of FIG. It is a figure which shows the example of the display screen displayed on the delivery user apparatus 20a in one embodiment. An example of the attached object is displayed on the display screen of FIG. 7a. It is a figure which shows the example of the display screen displayed on the delivery user apparatus 20b in one embodiment. An example of the attached object is displayed on the display screen of FIG. 7b. It is a figure which shows the example of the display screen of the co-star animation displayed on the viewing user apparatus 10 in one embodiment. It is a figure which shows the example of the display screen of the co-star animation displayed on distribution user apparatus 20a in one embodiment. It is a figure which shows the example of the display screen of the co-star animation displayed on distribution user apparatus 20b in one embodiment. It is a figure which shows the example of the display screen of the co-star animation displayed on the viewing user apparatus 10 in one embodiment. In the display screen of FIG. 10, the wearing object 138 is attached to the character object 31. It is a figure which shows the example of the display screen of the co-star animation displayed on distribution user apparatus 20a in one embodiment. In the display screen of FIG. 11A, the wearing object 138 is attached to the character object 31. It is a figure which shows the example of the display screen of the co-star animation displayed on distribution user apparatus 20b in one embodiment. In the display screen of FIG. 11b, the wearing object 138 is attached to the character object 31. It is a figure which shows the example of the display screen of the co-star animation displayed on the viewing user apparatus 10 in one embodiment. In the display screen of FIG. 12, the attached object 138 is attached to the character object 131. It is a figure which shows the example of the display screen of the co-star animation displayed on distribution user apparatus 20a in one embodiment. In the display screen of FIG. 13A, the wearing object 138 is attached to the character object 131. It is a figure which shows the example of the display screen of the co-star animation displayed on distribution user apparatus 20b in one embodiment. In the display screen of FIG. 13B, the wearing object 138 is attached to the character object 131. It is a flow figure showing the flow of the animation distribution processing in one embodiment. It is a flow figure showing a flow of processing which displays a usual gift in one embodiment. It is a flow figure showing a flow of processing which displays a wearing gift in one embodiment.

Various embodiments of the present invention will be described below with reference to the drawings. The same or similar components are denoted by the same reference symbols in the drawings.

A moving image distribution system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram showing a moving image delivery system 1 according to one embodiment, and FIG. 2 is a user Ua, Ub who delivers a moving image in the moving image delivery system 1 and a delivery user device used by the user Ua, Ub. It is a schematic diagram which shows 20a, 20b typically. The distribution device 20a and the distribution device 20b may have a function of viewing a moving image distributed by the moving image distribution system 1.

The moving image distribution system 1 includes a viewing user device 10, distribution user devices 20a and 20b, a server device 60, and a storage 70. The viewing user device 10, the distribution user device 20, the server device 60, and the storage 70 are communicably connected via a network 50. As will be described later, the server device 60 is configured to deliver a moving image including animations of characters of the delivery user Ua and the delivery user Ub.

This moving image is distributed from the server device 60 to the viewing user device 10 and the distribution user devices 20a and 20b. The distributed moving image is displayed on the display of the viewing user apparatus 10. The viewing user who is the user of the viewing user device 10 can view the distributed moving image by the viewing user device 10. Although only one viewing user device 10 is shown in FIG. 1 for simplicity of the drawing, the moving image distribution system 1 may include a plurality of viewing user devices. The distribution users Ua and Ub can perform a performance by viewing the distributed moving image and checking the moving image in the moving image.

In the illustrated embodiment, the distribution user device 20a includes a computer processor 21a, a communication I/F 22a, a display 23a, a camera 24a, and a microphone 25a. Similarly, the distribution user device 20b includes a computer processor 21b, a communication I/F 22b, a display 23b, a camera 24b, and a microphone 25b. Since the distribution user device 20a and the distribution user device 20b have the same configuration and function, both of them may be collectively referred to as the distribution user device 20 unless it is necessary to distinguish between them. The components may also be called the computer processor 21 and the like.

The computer processor 21 is an arithmetic device that loads various programs that realize an operating system and various functions from a storage into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, MCU or the like. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a collection of a plurality of physically separate computer processors.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver or a PPP driver, or a combination thereof. The distribution user device 20 can send and receive data to and from other devices via the communication I/F 22.

The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect a touch operation (contact operation) by the player. The touch panel can detect various touch operations such as tapping, double tapping, and dragging by the player. The touch panel may include a capacitance type proximity sensor and may be configured to detect a non-contact operation by the player.

The camera 24 continuously images the faces of the distribution users Ua and Ub, and acquires the imaged data of the faces of the distribution users Ua and Ub. The imaged data of the faces of the distribution users Ua and Ub captured by the camera 24 are transmitted to the server device 60 via the communication I/F 22. The camera 24 may be a 3D camera capable of detecting the depth of the face of a person.

The microphone 25 is a sound collecting device configured to convert input voice into voice data. The microphone 25 is configured to be able to acquire the voice input of the distribution users Ua and Ub. The voice input of the distribution users Ua and Ub acquired by the microphone 25 is converted into voice data, and this voice data is transmitted to the server device 60 via the communication I/F 22.

The viewing user device 10 may include the same components as the distribution user device 20. For example, the viewing user device 10 may include a computer processor, a communication I/F, a display, and a camera. The viewing user device 10 may have the same function as the distribution user device 20 by downloading and installing predetermined application software.

The viewing user device 10 and the distribution user device 20 are information processing devices such as smartphones. The viewing user device 10 and the distribution user device 20 are a mobile phone, a tablet terminal, a personal computer, an electronic book reader, a wearable computer, a game console, and various information processing devices other than these smartphones that can reproduce moving images. You may. Each of the viewing user device 10 and the distribution user device 20 may include a sensor unit including various sensors such as a gyro sensor and a storage that stores various information, in addition to the above-described constituent elements.

Next, the server device 60 will be described. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I/F 62, and a storage 63.

The computer processor 61 is an arithmetic unit that loads an operating system and various programs that realize various functions from a storage 63 or another storage into a memory and executes instructions included in the loaded programs. The computer processor 61 is, for example, a CPU, MPU, DSP, GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 61 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, MCU or the like. Although the computer processor 21 is shown as a single component in FIG. 1, the computer processor 61 may be a collection of a plurality of physically separate computer processors.

The communication I/F 62 is implemented as hardware, firmware, communication software such as a TCP/IP driver or a PPP driver, or a combination thereof. The server device 60 can send and receive data to and from other devices via the communication I/F 62.

The storage 63 is a storage device accessed by the computer processor 61. The storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various storage devices other than the above that can store data. Various programs may be stored in the storage 63. At least a part of the programs and various data that can be stored in the storage 63 may be stored in a storage physically separate from the server device 60 (for example, the storage 70).

In the present specification, the program described as being executed by the computer processor 21 or the computer processor 61 or the instructions included in the program may be executed by a single computer processor or may be distributed by a plurality of computer processors. May be executed. Further, each of the program executed by the computer processor 21 or the computer processor 61 or the instruction included in the program may be executed by a plurality of virtual computer processors.

Next, the data stored in the storage 63 will be described. In the illustrated embodiment, the storage 63 stores model data 63a, object data 63b, and various data necessary for generating and distributing a distribution moving image other than the above.

The model data 63a is model data for generating a character animation. The model data 63a may be three-dimensional model data for generating a three-dimensional animation, or may be two-dimensional model data for generating a two-dimensional model data. The model data 63a includes, for example, rig data (also referred to as “skeleton data”) that shows the skeleton of the face and parts other than the face of the character, and surface data that shows the shape and texture of the surface of the character. The model data 63a may include a plurality of different model data. The plurality of model data may have different rig data, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data.

The object data 63b includes asset data for constructing a virtual space forming a moving image. The object data 63b is data for drawing the background of the virtual space forming the moving image, data for drawing various objects displayed in the moving image, and for drawing various objects displayed in the moving image other than these. Contains data. The object data 63b may include object position information indicating the position of the object in the virtual space.

The object data 63b may include a gift object other than the above. The gift object is displayed in the video based on a gift display request from a viewing user who is viewing the video. The gift objects may include effect objects corresponding to effect gifts, normal objects corresponding to normal gifts, wearing objects corresponding to wearing gifts, and message objects corresponding to message gifts. The viewing user can purchase a desired gift. The distinction between the viewing user and the distribution user (for example, the distribution users Ua and Ub) is a distinction focusing on the user's action. For example, in the video distribution system 1, when a user views a video, the user is called a viewing user, and when the user distributes the video, it is called a distribution user.

The effect object indicating the effect gift is an object that affects the impression of the entire viewing screen of the distribution video, and is, for example, an object imitating confetti. The object imitating confetti may be displayed on the entire viewing screen, which can change the impression of the entire viewing screen before and after the display. The effect object may be displayed so as to overlap with the character object, but is different from the attached object in that the effect object is displayed without being associated with a specific part of the character object.

The normal object indicating a normal gift is an object indicating a gift from the viewing user to the distribution user (for example, the distribution users Ua and Ub), and includes, for example, a stuffed animal, a bouquet, an accessory, or an item suitable for gifts or presents other than the above. It is an imitated object. In one aspect, the normal object is displayed on the display screen of the moving image so as not to contact the character object. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character object. The normal object may be displayed so as to overlap an object other than the character object in the virtual space. The normal object may be displayed so as to overlap with the character object, but is different from the attached object in that it is not displayed in association with a specific part of the character object. In one aspect, when the normal object is displayed overlapping with the character object, the normal object overlaps with a portion other than the head including the face of the character object, and does not overlap with the head of the character object. Is displayed. In one aspect, when the normal object is displayed overlapping with the character object, the normal object overlaps with a portion other than the upper half of the body including the face of the character object, and does not overlap with the upper half of the character object. Is displayed.

The wearing object indicating the wearing gift is an object displayed on the display screen in association with a specific part (wearing part) of the character object. In one aspect, the wearing object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the wearing object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object. The specific part may be specified by the three-dimensional position information indicating the position in the three-dimensional coordinate space, or may be associated with the position information in the three-dimensional coordinate space. For example, in the head of the character, the specific parts are the front left side, front right side, rear left side, rear right side, center front side, center back side, left eye, right eye, left ear, right ear, and whole hair. May be set.

The wearing object is, for example, an accessory (a headband, a necklace, an earring, etc.), a clothing (a T-shirt, etc.), a costume, or an object that can be worn by a character object other than these, which is worn on the character object. The object data 63b corresponding to the attached object may include attached part information indicating which part of the character object the attached object is associated with. The mounting part information of a certain mounting object can indicate to which part of the character object the mounting object is mounted. For example, when the attached object is a headband, the attached part information of the attached object may indicate that the attached object is attached to the “head” of the character object. When the mounting part information on which the mounting object is mounted is specified as the position in the three-dimensional coordinate space, the mounting part information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, the mounting part information indicating the position where the mounting object indicating the “headband” is mounted may be associated with two parts of the character object, namely, the “back side of the head” and the “right side of the head”. That is, the wearing object indicating "headband" may be worn on both "the head rear left" and "the head rear right". When the wearing object is a T-shirt, the wearing part information of the wearing object may indicate that the wearing object is worn on the “body” of the character object.

The two types of wearing objects having the same wearing part are displayed in a moving image at intervals. That is, the two types of wearing objects having the same wearing part are attached to the character object at a time interval. In other words, the two types of wearing objects having the same wearing site are not simultaneously worn on the character object. For example, with respect to the wearing object indicating the headband and the wearing object indicating the hat, when "head" is set as the wearing part, the wearing object indicating the headband and the wearing object indicating the hat are not displayed at the same time.

A display time may be set for each gift object according to its type. In one aspect, the display time of the wearing object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the wearing object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

Next, the functions implemented by the computer processors 21a and 21b will be described more specifically. The computer processor 21a functions as the face motion data generation unit 211a by executing computer-readable instructions included in the distribution program. Similarly, the computer processor 21b functions as the face motion data generation unit 211b by executing a computer-readable instruction included in the distribution program. At least some of the functions implemented by the computer processors 21a and 21b may be implemented by computer processors other than the computer processors 21a and 21b of the moving image distribution system 1. At least a part of the functions implemented by the computer processors 21a and 21b may be implemented by the computer processor 61 mounted in the server device 60, for example.

The face motion data generation unit 211a generates face motion data, which is a digital expression of the movement of the face of the distribution user Ua, based on the imaged data of the camera 24a. Similarly, the face motion data generation unit 211b generates face motion data, which is a digital expression of the movement of the face of the distribution user Ub, based on the imaged data of the camera 24b. Face motion data is generated as needed over time. The face motion data may be generated at predetermined sampling time intervals. As described above, the face motion data generated by the face motion data generation unit 211a can digitally represent the movement (change of facial expression) of the face of the distribution user Ua in time series. The face motion data generated in (1) can digitally represent the movement of the face (change of facial expression) of the distribution user Ub in time series. The face motion data generated by the face motion data generation units 211a and 211b is transmitted to the server device 60 via the communication I/Fs 22a and 22b.

In the distribution user device 20, in addition to the face motion data generated by the face motion data generation unit 211a, body motion data that is a digital representation of the position and orientation of each part of the distribution users Ua and Ub other than the body face. May be generated. The distribution user device 20 may transmit the body motion data to the server device 60 in addition to the face motion data. To generate the body motion data, the distribution users Ua and Ub may wear motion sensors. The distribution user device 20 may be configured to be able to generate body motion data based on the detection information of the motion sensors attached to the distribution users Ua and Ub. The body motion data may be generated at predetermined sampling time intervals. As described above, the body motion data represents the body movements of the distribution users Ua and Ub in time series as digital data. The generation of the body motion data based on the detection information of the motion sensor attached to the distribution users Ua and Ub may be performed in a shooting studio, for example. The photography studio may include a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor attached to the distribution users Ua and Ub may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station provided in the shooting studio may be, for example, a base station provided by HTC CORPORATION. A supporter computer may be installed in a room separate from the shooting studio. The display of the photography studio may be configured to display the information received from the support computer. The server device 60 may be installed in the same room where the supporter computer is installed. The room in which the supporter computer is installed may be separated from the shooting studio by a glass window. In this case, the operator of the supporter computer (may be referred to as “supporter” in this specification) can visually recognize the distribution users Ua and Ub. The supporter computer may be configured to be able to change the settings of various devices provided in the shooting studio in accordance with the operation of the supporter. The supporter computer can, for example, set a scanning interval by the base station, set a tracking sensor, and change various settings of various devices other than these. The supporter can input a message to the supporter computer and display the input message on the display of the photography studio.

The distribution user device 20 may realize a function other than the face motion data generation unit 211a by executing a distribution program and/or a program other than the distribution program with a computer processor. For example, the distribution user device 20 may realize a function of playing the received moving image by executing a viewing program for viewing the moving image. The distribution program and the viewing program may be packaged in one application software, or may be provided as separate application software.

Viewing user device 10 may be configured to provide similar functionality as distribution user device 20. For example, the viewing user apparatus 10 may realize a function of playing a received moving image by executing a viewing program for watching a moving image, and by executing a distribution program, the same as the function of the face motion data generation unit 211a. May realize the function of

Next, the function realized by the computer processor 61 will be described more specifically. The computer processor 61 executes a computer-readable instruction included in the distribution program to generate an animation generation unit 61a, a motion picture generation unit 61b, a motion picture distribution unit 61c, a gift request processing unit 61d, a gift purchase processing unit 61e, and a co-star. It functions as the application processing unit 61f.

The animation generation unit 61a applies the face motion data generated by the face motion data generation unit 211a of the distribution user device 20 to predetermined model data included in the model data 63a to generate the animation of the character object. Is composed of. The animation generation unit 61a can generate the animation of the character object such that the facial expression of the character object changes based on the face motion data. Specifically, the animation generation unit 61a can generate an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user Ua based on the face motion data regarding the distribution user Ua. Similarly, the animation generation unit 61a can generate an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user Ub, based on the face motion data regarding the distribution user Ub.

When the distribution user device 20 provides the body motion data regarding the distribution users Ua and Ub, the animation generation unit 61a determines the distribution users Ua and Ub based on the body motion data and the face motion data regarding the distribution users Ua and Ub. It is possible to generate an animation of a character object that moves in synchronization with the movements of the body and facial expressions.

When distributing the moving image of the distribution user Ua, the moving image generation unit 61b generates a background image indicating the background using the object data 63b, and the background image and the animation of the character object corresponding to the distribution user Ua. It is possible to generate a moving image including. The moving image generation unit 61b can synthesize the generated moving image with the voice of the distribution user Ua generated based on the sound data received from the distribution user device 20a. Similarly, when the moving image of the distribution user Ub is distributed, the moving image generation unit 61b generates a background image indicating the background using the object data 63b, and the background image and the character object corresponding to the distribution user Ub. An animation and a moving image including the animation can be generated. The moving image generation unit 61b can synthesize the generated moving image with the voice of the delivery user Ub generated based on the voice data received from the delivery user device 20b. In the moving image generated by the moving image generation unit 61b, the character objects corresponding to the distribution users Ua and Ub are displayed by being superimposed on the background image. As described above, the moving image generation unit 61b generates an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user Ua or the distribution user Ub, and the sound of the distribution user Ua or the distribution user Ub is combined with this animation. It is possible to generate a distributed video for distribution. The co-star movie including both the character object of the distribution user Ua and the character object of the distribution user Ub will be described later.

The moving image distribution unit 61c distributes the moving image generated by the moving image generation unit 61b. This moving image is distributed to the viewing user device 10 and other viewing user devices via the network 50. The generated moving image is also distributed to the distribution user devices 20a and 20b. The received moving image is reproduced on the viewing user device 10 and the distribution user devices 20a and 20b.

A display example of a moving image distributed from the moving image distribution unit 61c is shown in FIGS. 3 and 4a to 4b. In these figures, it is assumed that the distribution user Ub uses the distribution user device 20b to distribute a moving image including its own character object, and that the moving image is reproduced on the viewing user device 10 and the distribution user devices 20a and 20b. ing. In FIG. 4a, it is assumed that the distribution user Ua is not distributing a moving image but is watching a moving image distributed by another distribution user Ub. Similar assumptions are made for FIGS. 6, 7a, and 7b described below. Therefore, in the description relating to FIGS. 3, 4a to 4b, 6 and 7a to 7b, the distribution user Ua may also be referred to as a viewing user. 3 shows a display example of a moving image reproduced on the viewing user device 10, FIG. 4a shows a display example of a moving image reproduced on the distribution user device 20a, and FIG. 4b shows a reproduction example on the distribution user device 20b. The display example of the moving image shown is shown.

As shown in FIG. 3, the display image 30 of the moving image distributed from the server device 60 is displayed on the display of the viewing user device 10. In the display image 30 displayed on the viewing user device 10, the character object 31 of the delivery user Ub generated by the animation generation unit 61a, the gift button 32, the evaluation button 33, the comment button 34, and the comment display. A region 35 and is included.

As shown in FIG. 4a, the display image 130 of the moving image distributed from the server device 60 is displayed on the display of the distribution user device 20a. Similar to the display image 30, the display image 130 includes the character object 31 of the delivery user Ub, the gift button 32, the evaluation button 33, the comment button 34, and the comment display area 35. In addition to this, the display image 130 includes a co-starring request button 36 for requesting a co-starring with the distribution user Ub in the video distributed by the distribution user Ub. The distribution user device 20a can display the distributed display image 130 of the moving image by executing application software including a viewing program, for example.

As shown in FIG. 3, in one embodiment, the display image 30 of the viewing user device 10 does not include the co-star application button 36. For example, if the application software including the distribution program is not downloaded or installed in the viewing user apparatus 10 or if the application software including the distribution program is not activated in the viewing user apparatus 10, the co-star application button 36 is included. The display image 30 of the viewing user device 10 is generated so as not to appear. In another embodiment, the co-star application button 36 may be displayed on the display image 30 of the viewing user device 10. For example, the co-star application button 36 is included when the application software including the distribution program is downloaded or installed in the viewing user apparatus 10, or when the application software including the distribution program is activated in the viewing user apparatus 10. Thus, the display image 30 of the viewing user device 10 is generated.

Since the character object 31 is generated by applying the face motion data of the distribution user Ub to the model data included in the model data 63a as described above, the character object 31 is synchronized with the movement of the facial expression of the distribution user Ub. The expression changes. When the body motion data is provided from the distribution user device 20, the character object 31 can be controlled so that the parts other than the face thereof also change in synchronization with the body movement of the distribution user Ub.

The gift button 32 is displayed on the display screen 30 in a selectable manner by operating the viewing user device 10. The gift button 32 can be selected by, for example, a tap operation on the area where the gift button 32 is displayed on the touch panel of the viewing user apparatus 10. In one embodiment, when the gift button 32 is selected, on the display screen 30, in order to select a gift to be gifted to a distribution user (here, the distribution user Ub) who is distributing the moving image being viewed. Window is displayed. The viewing user can purchase a gift to be gifted from the gifts displayed in the window. In another embodiment, the display screen 30 displays a window containing a list of purchased gifts in response to the selection of the gift button 32. In this case, the viewing user can select a gift to be gifted from the gifts displayed in the window. Gifts that can be gifted or purchased may include effect gifts, regular gifts, wear gifts, and other gifts.

The evaluation button 33 is displayed on the display screen 30 so as to be selectable by the viewing user who uses the viewing user device 10. The evaluation button 33 can be selected, for example, by a tap operation on the area where the evaluation button 33 is displayed on the touch panel of the viewing user apparatus 10. When the rating button 33 is selected by the viewing user who is watching the video, the evaluation information indicating that the video is positively evaluated may be transmitted to the server device 60. The server device 60 can collect evaluation information from the viewing user device 10 and other viewing user devices. By selecting the evaluation button 33, evaluation information indicating that a negative evaluation is made on the moving image may be transmitted to the server device 60. The evaluation information indicating a positive evaluation of the moving image may be referred to as positive evaluation information, and the evaluation information indicating that the moving image is negatively evaluated may be referred to as negative evaluation information.

The comment button 34 is displayed on the display screen 30 so that the user can select it. When the comment button 34 is selected by, for example, a tap operation, a comment input window for inputting a comment is displayed on the display screen 30. The viewing user can input a comment via the input mechanism of the viewing user device 10 or the distribution user device 20a. The input comment is transmitted from the viewing user device 10 and the distribution user device 20a to the server device 60. The server device 60 receives comments from the viewing user device 10, the distribution user device 20a, and user devices other than these, and displays the comments in the comment display area 35 in the display image 30. In the comment display area 35, comments posted by each user are displayed in chronological order, for example. The comment display area 35 occupies a part of the display screen 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When a comment is posted that exceeds the upper limit set in the comment display area 35, the comments are deleted from the comment display area 35 in order from the oldest posted time. Therefore, the display time of each comment in the comment area 35 becomes shorter as the frequency of received comments becomes higher.

As shown in FIG. 4b, the display image 40 of the moving image distributed from the server device 60 is displayed on the display of the distribution user device 20b. In the display image 40 displayed on the distribution user device 20b, the character object 31 corresponding to the distribution user Ub, the display instruction buttons 42a to 42c for displaying the wearing gift requested to be displayed by the viewing user, and the comment. A display area 35 is included. The display image 40 displayed on the distribution user device 20b includes the same background image as the display image 30 and the display image 130, a character object image, and a comment. On the other hand, the display image 40 does not include the gift button 32, the evaluation button 33, the comment button 34, and the co-starring request button 36, but includes the display instruction buttons 42a to 42c. Different.

The display instruction buttons 42a to 42c are displayed on the display screen 40 in response to the reception of a display request for displaying a wearing gift described later from the viewing user. In the illustrated embodiment, three display instruction buttons 42a to 42c are displayed on the display image 40. Each of the display instruction buttons 42a to 42c is displayed on the display screen 40 so as to be selectable by the distribution user. When any of the display instruction buttons 42a to 42c is selected by, for example, a tap operation, an operation for displaying the wearing gift corresponding to the selected display instruction button is performed. As described above, the display instruction buttons 42a to 42c are display instruction objects for giving an instruction to display the wearing gift on the moving image being distributed. Therefore, in the present specification, the display instruction buttons 42a to 42c may be referred to as display instruction objects 42a to 42c. Further, when it is not necessary to distinguish the display instruction objects 42a to 42c from each other, they may be simply referred to as the display instruction object 42. A specific example of displaying the attached gift will be described later. The display screen 40 may be displayed on the supporter computer described above. The display instruction objects 42a to 42c may be selected according to the operation of the supporter computer by the supporter.

Each time a display request requesting the display of the attached gift is accepted, the display instruction object 42 corresponding to the display request is added to the display screen 40. There is an upper limit to the number of display instruction objects 42 that can be displayed on the display screen 40. In the illustrated embodiment, the maximum number of display instruction objects 42 that can be displayed on the display screen 40 is three. In this case, the display screen 40 has a display area in which three display instruction objects can be displayed. When four or more display requests for wearing gifts are received, the display instruction object 42 corresponding to the fourth and subsequent display requests is not displayed on the display screen 40. When the display instruction object 42 corresponding to the display request for the attached gift that is accepted fourth is selected from any of the three display instruction objects 42 that are already displayed, and there is a vacancy in the display area. It is displayed on the display screen 40.

The gift request processing unit 61d receives a gift display request from the viewing user and performs processing for displaying a gift object according to the display request. Each viewing user can transmit a gift display request to the server device 60 by operating his or her viewing user device. The gift display request includes the user ID of the viewing user, the gift identification information (gift ID) identifying the gift whose display is requested, and/or the gift object identification information identifying the gift object corresponding to the gift whose display is requested ( Gift object ID) and may be included.

As described above, the gift object indicating the gift may include the effect object corresponding to the effect gift, the normal object corresponding to the normal gift, and the wearing object corresponding to the wearing gift. The wearing gift is an example of the first gift. The wearing object may be referred to as a first gift object. The display request for requesting the display of the attached gift (or the attached object) is an example of the first display request. Effect gifts and regular gifts are examples of second gifts. The effect object and the normal object may be collectively referred to as a second gift object. The display request for requesting display of the effect gift (or effect object) or the normal gift (or normal object) is an example of the second display request.

In one aspect, when the gift request processing unit 61d receives a display request for a specific normal gift from the viewing user, based on the display request, the gift request processing unit 61d displays a normal object indicating the normal gift requested to be displayed in the moving image. Perform processing. For example, if a display request for a normal gift indicating a bag is made, as shown in FIG. 5, the gift request processing unit 61d displays the normal object 37a indicating a bag on the display image 30 based on the display request. .. Similarly, when a display request for a normal gift indicating a teddy bear is made, as shown in FIG. 5, the gift request processing unit 61d displays the normal object 37b indicating the teddy bear based on the display request. It is displayed on 30. Although not shown, the normal objects 37a and 37b are also displayed on the display image 130 on the distribution user device 20a and the display image 40 on the distribution user device 20b, similar to the display image 30.

In one aspect, when the gift request processing unit 61d receives a display request for a specific effect gift from the viewing user, an effect object corresponding to the effect gift requested to be displayed is displayed as a moving image on the basis of the display request. Perform processing for displaying. For example, when a request to display an effect gift indicating confetti or fireworks is made, the gift request processing unit 61d causes the effect object (not shown) corresponding to the effect gift indicating confetti or fireworks based on the display request. ) Is displayed on the display image 30, the display image 130, and the display image 40.

The display request for the normal gift may include a display position specifying parameter for specifying the display position of the normal object indicating the normal gift. In this case, the gift request processing unit 61d can display the normal object at the position designated by the display position designation parameter. When the display position and the display range of the character object 31 are defined, the position relative to the character object 31 can be specified as the display position of the normal object by the display position specification parameter.

In one aspect, the normal object may be displayed so as to move within the display image 30 of the moving image. For example, the normal objects 37a and 37b may be displayed so as to drop from the top of the screen to the bottom. In this case, the normal objects 37a and 37b may be displayed in the display image 30 during the fall from the start of the fall to the lower end of the display image 30, and may disappear from the display image 30 after falling at the lower end of the display image 30. . The moving directions of the normal objects 37a and 37b on the screen can be set arbitrarily. For example, the normal objects 37a and 37b may move in the display image 30 from left to right, right to left, upper left to lower left, or any other direction. The normal objects 37a and 37b can move on various trajectories. For example, the normal objects 37a and 37b can move on a linear trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or a trajectory other than these. The viewing user moves the normal object 37a, 37b and the moving direction parameter for specifying the moving direction of the normal objects 37a, 37b in addition to the display position specifying parameter or in place of the display position specifying parameter in the display request for the normal object. At least one of the trajectory parameters that specify the trajectory can be included. In one embodiment, an effect object and a normal object having a size smaller than the reference size in the virtual space may be displayed in the character object 31 in a part or all overlapping. In one embodiment, an effect object and a normal object whose size in the display image 30 is larger than the reference size are displayed at positions that do not overlap with the character object 31. In another embodiment, an effect object and a normal object whose size in the virtual space is larger than the reference size may be displayed behind the character object 31. The normal objects 37a and 37b may be displayed so as to move in the display image 130 and the display image 40 as described above.

In one aspect, when the gift request processing unit 61d receives a display request for a specific mounted object from the viewing user, based on the display request, the gift request processing unit 61d displays a display instruction on the display screen 40 of the distribution user device 20, as shown in FIG. 4b. The objects 42a to 42c are displayed. Each of the display instruction objects 42a to 42c is associated with the wearing gift for which the display request is made. When any of the display instruction objects 42a to 42c is selected, the wearing gift associated with the selected display instruction object is displayed in the moving image being delivered. For example, when the display instruction object 42b is associated with a headband simulating a cat's ear and the display instruction object 42b is selected, the gift request processing unit 61d causes the headband corresponding to the selected display instruction object 42b. Is displayed on the moving image being delivered. A display example of a moving image including the wearing object 38 showing the headband is shown in FIGS. 6 and 7a to 7b. Further, as shown in FIG. 7b, the selected display instruction object 42b is deleted from the display screen 40.

The wearing object is displayed in the moving image in association with a specific part (wearing part) of the character object. For example, the wearing object may be displayed in the moving image so as to contact the wearing part of the character object. The mounting object 38 may be displayed in the moving image so as to be mounted on the mounting site of the character object. In one embodiment, the wearing object 38 that represents a headband is associated with the head of the character object. Therefore, in the display examples shown in FIGS. 6 and 7a to 7b, the wearing object 38 is worn on the head of the character object 31. The wearing object may be displayed in the moving image display screen so as to move along with the movement of the wearing part of the character object. For example, when the head of the character object 31 wearing the wearing object 38 representing the headband moves, the wearing object 38 representing the headband also moves to the head of the character object 31 as if the headband of the character object 31 were wearing. It moves with the department.

As described above, the object data 63b may include mounting part information indicating which part of the character object the mounting object is associated with. In one aspect, when the wearing object is attached to the character object, the gift request processing unit 61d is the same as the part indicated by the wearing part information of the wearing object until the display time of the wearing object elapses. The display of other attached objects attached to the overlapping parts is prohibited. For example, a headband associated with both “back left side of head” and “right rear side of head” and a hair accessory associated with “left side back of head” have “back side of left head” overlapping. Therefore, when the headband is displayed, the display of the hair accessory for which "head rear left side" is set as the wearing site information is prohibited. On the other hand, the headband associated with the “back of the head on the left side” and the “right of the head of the head” and the earrings associated with “the left ear (of the head)” and “the right ear of the head” are Since the attachment parts of the character object do not overlap, they can be attached at the same time.

In one embodiment, the display instruction object 42 for displaying the mounted object whose display is prohibited may be deactivated in order to prohibit the display of a plurality of mounted objects having the same or overlapping mounting parts. In the embodiment shown in FIG. 4b, it is assumed that the display instruction object 42a is an object (button) for instructing the display of the hair accessory for which "head rear left side" is set as the attachment site information. In this case, since the wearing object indicating the hair accessory is wearing the wearing object 38 indicating the headband, the wearing object 38 is prohibited from being displayed in the moving image while the wearing object 38 is worn on the character object 31. To be done. In one embodiment, in order to prohibit the display of the wearing object showing the hair accessory in the moving image, the display instruction object 42a associated with the wearing object showing the hair accessory is deactivated. For example, the display instruction object 42a is not selectable even if it is operated while the attachment object 38 is attached to the character object 31. In another embodiment, the display instruction object 42 a is erased from the display screen 40 while the mounting object 38 is mounted on the character object 31. The deactivated display instruction object 42a is reactivated according to the elapse of the display time of the headband. In order to reactivate the display instruction object 42a, for example, the display instruction object 42a that is not selectable may be made selectable again, or the display instruction object 42a that has been hidden may be displayed again on the display screen 40. It may be displayed.

In one aspect, the gift purchase processing unit 61e receives purchase information of each of a plurality of gift objects that can be purchased in association with the video, in response to a request from the video viewing user, of the viewing user of the viewing user. , The viewing user device 10 and the distribution user device 20a). The purchase information of each gift object includes the type of the gift object (effect object, normal object, or wearing object), the image of the gift object, the price of the gift object, and information necessary for purchasing other gift objects. Can be included. The viewing user can select a gift object to purchase based on the purchase information of the gift object displayed on the viewing user device 10 or the distribution user device 20a. The selection of the gift object to be purchased may be performed by operating the viewing user device 10 or the distribution user device 20a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 60. The gift purchase processing unit 61e performs payment processing based on the purchase request. When this settlement process is completed, the purchased gift object is held by the viewing user. The storage 23 may store the gift ID of the purchased gift (or the gift object ID of the gift object indicating the gift) in association with the user ID of the viewing user who purchased the gift.

The gift objects that can be purchased may be different for each video. The purchasable gift object may be purchasable in multiple videos. That is, the gift object that can be purchased may include a unique gift object that is unique to each moving image and a common gift object that can be purchased in a plurality of moving images. For example, the effect object indicating confetti may be a common gift object that can be purchased in multiple videos.

In one aspect, when an effect object is purchased while watching a predetermined moving image, the effect object to be purchased is changed to the moving image being watched in response to completion of payment processing for purchasing the effect object. It may be displayed automatically. When a normal object is purchased while watching a predetermined video, the normal gift object to be purchased is watching the video being watched, in the same manner as above, in response to the completion of the payment process for purchasing the normal object. May be automatically displayed in.

In another aspect, the payment completion notification is transmitted to the viewing user apparatus 10 in response to the completion of the payment processing in the gift purchase processing unit 61e for the effect object to be purchased, and the purchase is made in the viewing user apparatus 10. A confirmation screen may be displayed to confirm with the viewing user whether or not to make a display request for the effect object. When the viewing user selects to make a display request for the purchased effect object, the gift request processing unit 61d sends a display request for displaying the purchased effect object from the client device of the viewing user. The gift request processing unit 61d may display the effect object to be purchased on the moving image 70. Even when the purchase target is a normal object, a confirmation screen for confirming with the viewing user whether or not to make a display request for the purchased normal object may be displayed on the viewing user apparatus 10 as in the above case.

The co-star application processing unit 61f virtually sets the one delivery user and the other delivery user based on the co-star application when the one delivery user receives a co-star application from another delivery user. Generate a co-star video to co-star. In the following, description will be made assuming a case where a distribution user Ua who is watching a moving image including the character object 31 of the distribution user Ub makes a joint performance application with the distribution user Ub. The co-star application processing unit 61f can generate a co-star video based on not only the co-star application from the delivery user Ua but also co-star applications from various delivery users.

In one embodiment, the co-star application processing unit 61f receives a co-star application from the distribution user Ua and generates a co-star video in accordance with the co-star application. The distribution user Ua can transmit the co-star application to the server device 60 by operating the distribution user device 20a. Specifically, when the co-star application button 36 displayed on the distribution user device 20a is selected, the co-star application is transmitted from the distribution user device 20a to the server device 60. The co-star application button 36 can be selected by, for example, a tap operation on an area where the co-star application button 36 is displayed on the touch panel of the distribution user device 20a. In response to the selection of the co-starring request button 36, the application software including the distribution program may be activated in the distribution user device 20a. The co-star application transmitted from the distribution user device 20a may include a user ID for identifying the distribution user Ua.

Upon receiving the co-star application from the distribution user device 20a, the co-star application processing unit 61f determines whether or not to permit the co-star application. The co-star application processing unit 61f can determine co-performability based on various information regarding the distribution user Ua who has submitted the co-star application. For example, a co-star application from the distribution user Ua can be permitted when the evaluation from the other users to the distribution user Ua is higher than a predetermined standard, and conversely, the evaluation from the other users to the distribution user Ua is predetermined. When it is lower than the standard, it is possible to reject the co-star application from the distribution user Ua. Further, the distribution user Ub may be queried as to whether or not to permit the co-starring application from the distribution user Ua, and whether or not the co-starring is allowed may be determined according to the answer.

In one embodiment, when the co-star application from the delivery user Ua is permitted, the co-star application processing unit 61f generates a co-star video in which the delivery user Ua and the delivery user Ub co-star. In order to generate the co-star movie, the co-star application processing unit 61f acquires the face motion data and the voice data of the delivery user Ua from the delivery user Ua. The face motion data of the distribution user Ua may be transmitted from the distribution user device 20a to the server device 60 together with the co-star application, or after the co-star application is permitted, the distribution user device 20a sends a server to the server in response to a request from the server device 60. It may be transmitted to the device 60. When the movement of the body of the distribution user Ua is also expressed as an animation, the body motion data may be provided to the server device 60 together with the face motion data of the distribution user Ua. When the face motion data cannot be acquired from the distribution user Ua, the co-star application processing unit 61f may acquire only the voice data from the distribution user Ua. For example, when the distribution user device 20a used by the distribution user Ua does not have the function of the face motion data generation unit 211a or other functions for moving image distribution, when the function is disabled, and other than these. In this case, the co-star application processing unit 61f may acquire voice data without acquiring face motion data (and body motion data) from the distribution user Ua.

In one embodiment, the co-star application processing unit 61f adds the animation of the character object of the distribution user Ua to the moving image including the character object 31 of the distribution user Ub based on the face motion data of the distribution user Ua, thereby performing the co-star. Generate an image. The animation of the character object of the distribution user Ua may be generated in the animation generation unit 61a based on the face motion data of the distribution user Ua. The animation of the character object of the distribution user Ua may be generated by applying the face motion data of the distribution user Ua to the model data for the distribution user Ua included in the model data 63a. For example, the co-star application processing unit 61f generates a layer including the animation of the character object of the distribution user Ua, and superimposes this layer on the moving image including the character object 31 of the distribution user Ub, thereby It is possible to generate a co-star movie including the character object 31 of the delivery user Ub. When the voice performance data (and body motion data) is not acquired from the distribution user Ua, the co-star application processing unit 61f acquires from the distribution user Ua in a moving image including the character object 31 of the distribution user Ub. By superimposing the sound generated based on the generated sound data, the co-star movie including the character object 31 of the distribution user Ub and the sound of the distribution user Ua can be generated. Even if the model data for the distribution user Ua is not set as the model data 63a, the co-star application processing unit 61f determines that the moving image including the character object 31 of the distribution user Ub is based on the audio data acquired from the distribution user Ua. By superimposing the generated sound, it is possible to generate a co-star movie including the character object 31 of the distribution user Ub and the sound of the distribution user Ua. In this way, the distribution user Ua can perform together with the distribution user Ub with his own voice.

The co-star application processing unit 61f delivers the co-star video including the voice of the delivery user Ua and the character object 31 of the delivery user Ub when the face motion data cannot be obtained from the delivery user Ua, and then acquires the face motion data from the delivery user Ua. By generating the character object of the distribution user Ua based on the face motion data of the distribution user Ua at the timing, it is possible to generate a co-star movie including the character object of the distribution user Ua and the character object 31 of the distribution user Ub. . In this way, the co-star application processing unit 61f switches the co-star video including the voice of the delivery user Ua and the character object 31 of the delivery user Ub to the co-star video including the character object of the delivery user Ua and the character object 31 of the delivery user Ub. be able to. On the contrary, the co-star application processing unit 61f generates a co-star video containing the character object 31 of the delivery user Ua and the character object 31 of the delivery user Ub, and a co-star video including the voice of the delivery user Ua and the character object 31 of the delivery user Ub. Can be switched to. In this way, a co-starring video that is co-starred by voice (sometimes called a "voice co-starring video") and a co-starring video that is co-starred by a character object (sometimes called a "character co-star video"). .) and may be alternately switchable.

The generated co-star moving image is distributed by the moving image distribution unit 61c. The co-star movie may be created by the distribution user device 20a. When the co-starring video is generated by the distribution user device 20a, the co-starring video is transmitted from the distribution user device 20a to the server device 60, and is distributed by the video distribution unit 61c of the server device 60.

A display example of the co-star movie distributed from the movie distribution unit 61c is shown in FIGS. 8 and 9a to 9b. In these figures, the distribution user Ua makes a co-star application for the video distributed by the distribution user Ub, and as a result, the co-star video including the character object of the distribution user Ua and the character object of the distribution user is distributed. Therefore, it is assumed that the distribution user Ua selects the co-star application button 36 while viewing the image shown in FIG. 7a.

As shown in FIG. 8, the display image 230 of the co-star moving image distributed from the server device 60 is displayed on the display of the viewing user device 10. The display image 230 of the co-star moving image displayed on the viewing user device 10 includes the character object 131 of the distribution user Ua in addition to the character object 31 of the distribution user Ub. The character object 131 of the distribution user Ua is generated by the animation generation unit 61a or the co-star application processing unit 61f as described above. The co-star moving image display image 230 includes a gift button 32, an evaluation button 33, a comment button 34, and a comment display area 35, like the original distribution image shown in FIG.

The distributed image 230 of the co-star moving image is a horizontally long image, as shown in the figure. The co-star application processing unit 61f or the moving image delivery unit 61c delivers the co-star image as a horizontally long image when delivering the co-star image. As a result, the distribution image 230 of the co-starring moving image is displayed on the viewing user device 10 as a horizontally long image. In one embodiment, as shown in FIG. 3, even if the original moving image (image) is vertically long, the co-starring image is converted to horizontally long and distributed. Since the co-starring image includes the character objects of two distribution users, by making the image horizontally long, it becomes easy to display the character objects for the two people without duplication. For example, in the co-starring image, the left half from the viewing user's point of view may be the area allocated to the original distribution user's character object, and the right half may be the area allocated to the distribution user's character object making the co-starring application. .. The allocation of the area to each distribution user may be arbitrarily determined so that the character objects do not overlap each other.

As shown in FIGS. 9a and 9b, the display images 330 of the co-star moving image distributed from the server device 60 are displayed on the displays of the distribution user devices 20a and 20b. The display image 330 includes the same background image, character object image, and comment as the display image 230. On the other hand, the display image 330 differs from the display image 230 in that it does not include the gift button 32, the evaluation button 33, and the comment button 34, but includes the display instruction buttons 42a, 42c, and 42d. Since the distribution user Ua and the distribution user Ub are distributors of the same co-starring image, the same display image 330 is displayed on the distribution user device 20a of the distribution user Ua and the distribution user device 20b of the distribution user Ub. Similar to the display image 230, the display image 330 is also displayed in a landscape orientation from the viewpoint of arranging a plurality of character objects without overlapping. In the example shown in FIGS. 8 and 9a to 9b, the viewing user who is viewing the co-starring image shown in FIG. 8 makes a display request (first display request) for wearing gifts showing earrings, As a result, it is assumed that the display instruction object 42d is added to the display images of the distribution user device 20a and the distribution user device 20b in response to the display request. The display instruction object 42d is an object (button) for instructing the display of earrings in which "ears" are set as the wearing site information.

When the distribution user Ua and the distribution user Ub co-star in the co-star movie shown in FIGS. 9a and 9b, the distribution user Ua selects the display instruction object 42d displayed on the distribution user device 20a. The wearing gift corresponding to the display instruction object 42d can be worn on the character object 131 of the player. Similarly, the distribution user Ub can wear the wearing gift corresponding to the display instruction object 42d on his/her character object 31 by selecting the display instruction object 42d displayed on the distribution user device 20b. The attached gift corresponding to the display instruction object 42d is attached to one or both of the character object 131 of the distribution user Ua and the character object 31 of the distribution user Ub.

When the distribution user Ub selects the display instruction object 42d, the distribution user device 20b transmits a selection notification indicating that the display instruction object 42d has been selected to the server device 60. In the server device 60, the gift request processing unit 61d causes the wearing object 138 indicating the earring corresponding to the display instruction object 42d to be displayed in the co-starring moving image being distributed. Since the “ear” is set as the wearing part in the wearing object 138 indicating the earring, the wearing object 138 is worn on the ear of the character object 31. A display example of a moving image including the character object 31 wearing the wearing object 138 showing earrings is shown in FIGS. 10 and 11a to 11b. Further, as shown in FIGS. 11a and 11b, the selected display instruction object 42d may be deleted from the display screen 330. When the distribution user Ub selects the display instruction object 42d, the display instruction object 42d does not have to be deleted from the display screen 330. In this case, the distribution user Ua who is the co-star can also select the display instruction object 42d. When the distribution user Ua selects the display instruction object 42d, the mounting object 138 is mounted on the character 131 of the distribution user Ua. When the display instruction object 42d is selected by one of the co-starring distribution users Ua and Ub, the display instruction object 42d is deleted from the display screen displayed on the distribution user device of the selected distribution user. However, the display instruction object 42d may be continuously displayed on the display screen of the distribution user device of the distribution user who has not selected. For example, when the distribution user Ub selects the display instruction object 42d and the distribution user Ua does not select the display instruction object 42d, the display instruction object 42d is deleted from the display screen 330 of the distribution user device 20b of the distribution user Ub. However, the display instruction object 42d may be displayed as it is on the display screen 330 of the distribution user device 20a of the distribution user Ua. As a result, the distribution user Ua can select the display instruction object 42d at a timing later than that of the distribution user Ub and attach the wearing object 138 to the character object 131 of itself.

When the display instruction object 42d is selected by the distribution user Ua, the distribution user device 20a notifies the server device 60 that the display instruction object 42d has been selected. In the server device 60, the gift request processing unit 61d generates a co-star moving image in which the wearing object 138 indicating the earring corresponding to the display instruction object 42d is mounted on the character 131 of the distribution user Ua. A display example of a moving image including the character object 31 wearing the wearing object 138 showing earrings is shown in FIGS. 12 and 13a to 13b.

When the distribution user Ua and the distribution user Ub co-star in the co-star video, the display instruction object (for example, the display instruction objects 42a to 42d) for displaying the wearing gift is distributed with the distribution user device 20a of the distribution user Ua. It is displayed on at least one of the distribution user devices 20b of the user Ub. In the embodiment shown in FIGS. 9a and 9b, the display instruction objects 42a, 42c, 42d are displayed on both the distribution user device 20a and the distribution user device 20b. In this case, both the distribution user Ua and the distribution user Ub can select the display instruction objects 42a, 42c, 42d. In one embodiment, when one of the distribution user Ua and the distribution user Ub selects the displayed instruction object, the other user cannot select the selected display instruction object. For example, as shown in FIGS. 11A and 11B, when the display instruction object 42d is selected by the distribution user Ub, the display instruction object 42d is displayed from the display image 330 displayed on the distribution user device 20b of the distribution user Ub. Is deleted, and the display instruction object 42d is deleted from the display image 330 displayed on the distribution user device 20a of the distribution user Ua. As a result, after the display instruction object 42d is selected by the distribution user Ub, the display instruction object 42d cannot be selected by the distribution user Ua who is the co-star. On the contrary, after the distribution user Ua selects the display instruction object 42d, the distribution user Ub, who is the co-star, cannot select the display instruction object 42d.

In another embodiment, when the viewing user gifts the wearing gift, it is possible to specify which of the distribution users who co-star in the co-star video to perform the gifting. More specifically, the viewing user specifies, in the first display request for requesting the display of the wearing gift, to which of the distribution users co-starring in the co-starring video, the wearing gift should be gifted. be able to. For example, in the embodiment shown in FIGS. 8 and 9a to 9b, the user who is viewing the co-starring image shown in FIG. 8 selects the gift button 32 to select it as a gifting target. It is possible to select the mounting gift and further select the distribution user Ua or the distribution user Ub as the gifting destination of the selected mounting gift. The selection of the distribution user Ua or the distribution user Ub may be performed through the selection of the respective character object 131 or character object 31. When the distribution user Ub (character object 31) is designated in the display request for the wearing gift indicating the earrings, the display instruction object 42d corresponding to the wearing gift is the distribution user device 20b of the distribution user Ub. Is not displayed on the distribution user device 20a of the distribution user Ua that is not specified. In another aspect, when the distribution user Ub (character object 31) is specified in the display request for the wearing gift indicating the earrings, the display instruction object 42d corresponding to the wearing gift is distributed by the distributing user Ua. Although displayed on both the user device 20a and the distribution user device 20b of the distribution user Ub, the display instruction object 42d may not be selectable from the distribution user device 20a of the distribution user Ua not specified. In this way, when the gifting destination is specified in the display request for the attached gift, the display instruction object for the attached gift can be selected in the delivery user device of the specified delivery user, and the specified delivery is performed. In the distribution user device of the distribution user other than the user, the display instruction object for the attached gift cannot be selected.

In another embodiment, the display instruction object may be selectable only in the distribution user device of the distribution user who has distributed the video that is the source of the co-star video. In the example displayed in FIGS. 8 and 9a to 9b, since the distribution user Ua applied for the co-starring request to the video originally distributed by the distribution user Ub, the display instruction objects 42a, 42c, and 42d are distributed by the distribution user. The distribution user device 20b of Ub may be selectable, while the distribution user device 20a of the distribution user Ua may not be selectable. For example, the display instruction objects 42a, 42c, and 42d may be displayed on the distribution user device 20b but not displayed on the distribution user device 20a of the distribution user Ua.

When the co-starring distribution user selects the display instruction object to display the attached gift, the character object to which the selected attached gift is attached may be designated. For example, when the distribution user Ub selects the display instruction object 42d to display the wearing gift 138 in the co-starring movie, the distribution user Ub may wear it on his or her own character object 31 or on the character 131 of the co-starring distribution user Ua. You may let me. For example, when the display instruction object 42d is selected on the distribution user device 20b, the option of the character object may be displayed on the distribution user device 20b.

Next, a moving image distribution process according to one aspect will be described with reference to FIGS. 14 to 16. FIG. 14 is a flow diagram showing a flow of a moving image distribution process in one embodiment, FIG. 15 is a flow diagram showing a flow of a process for displaying a normal object in one embodiment, and FIG. 16 is one embodiment. 6 is a flowchart showing a flow of processing for displaying a mounted object in FIG. In the moving image distribution process described with reference to these figures, a moving image generated based on the face motion data acquired by the distribution user Ub using the distribution user device 20b is distributed, and this moving image is viewed. It is assumed that the distribution user Ua is making a co-star application.

First, in step S11, face motion data, which is a digital expression of the facial movements (expressions) of the distribution users Ua and Ub, are generated. The generation of the face motion data is performed by, for example, the face motion data generation unit 211a of the distribution user device 20. In the distribution user device 20, voice data may be generated based on voice input from the distribution users Ua and Ub. The generated face motion data and voice data are transmitted to the server device 60.

Next, in step S12, the face motion data from the distribution user device 20 is applied to the model data for the distribution users Ua and Ub, thereby moving in synchronization with the facial expressions of the distribution users Ua and Ub. Animation is generated. The generation of this animation is performed, for example, by the animation generation unit 61a.

Next, in step S13, a moving image including animations of character objects corresponding to the distribution users Ua and Ub is generated. The voices of the distribution users Ua and Ub may be combined with this moving image. The animation of the character object is displayed superimposed on the background image. The generation of the moving image is performed by, for example, the moving image generating unit 61b described above.

Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50. The moving image is continuously distributed for a predetermined distribution period. The distribution period of the moving image can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any time other than these.

Next, in step S15, it is determined whether a co-star application has been made by a user other than the distribution user Ub. The co-star application is made, for example, by the distribution user Ua. If the distribution user Ua makes a co-star application, the process proceeds to step S16. In step S16, an animation of the character object 131 of the distribution user Ua is generated based on the face motion data of the distribution user Ua. Then, the co-starring image is generated by adding the animation of the character object 131 of the distribution user Ua to the moving image that is being distributed (the moving image including the character object 31 of the distribution user Ub). The process in step S16 is performed, for example, by the co-star application processing unit 61f.

Next, the process proceeds to step S17, and the co-starring moving image generated in step S16 is distributed. This co-starring video is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50. The co-star movie includes, for example, as shown in FIGS. 8, 9a, and 9b, an animation of the character object 131 of the distribution user Ua and an animation of the character object 31 of the distribution user Ub.

Next, in step S18, it is determined whether or not an end condition for ending the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, the distribution user Ub has performed an operation for ending the distribution in the distribution user device 20b, or any other condition. If the end condition is not satisfied, the processes of steps S11 to S17 are repeatedly executed, and a moving image including an animation synchronized with the movement of the distribution user Ub, or a co-starring video if the co-starring with the distribution user Ua continues. Will continue to be delivered. When it is determined that the ending condition is satisfied for the moving image, the distribution process of the moving image is ended.

Next, with reference to FIG. 15, the normal gift display process performed during the distribution of the moving image will be described. The normal gift display process is performed in parallel with the moving image distribution process shown in FIG.

During the distribution of the moving image, in step S21, it is determined whether or not the display request for the normal gift is made. For example, the viewing user selects one or a plurality of specific normal gifts from the normal gifts that the viewing user owns, and the viewing user apparatus 10 sends a display request to the server apparatus 60 to display the selected normal gift. Can be sent to. As described above, the display request for the predetermined normal gift may be generated in response to the purchase processing or the payment processing for the predetermined normal gift.

When the normal gift display request is made, the display processing proceeds to step S22. In step S22, based on the display request, a process for displaying the normal gift requested to be displayed in the moving image being distributed is performed. For example, when a normal gift display request is made during distribution of a predetermined moving image, as shown in FIG. 5, the normal gift corresponding to the normal gift requested to be displayed in the display screen 30 of the viewing user apparatus 10 is displayed. Objects 37a and 37b are displayed.

If the normal gift display request has not been made, the normal gift display process ends. The normal gift display process shown in FIG. 15 is repeatedly performed during the moving image distribution period. The effect gift display process may be performed in the same procedure as the above-described normal gift display process.

Next, with reference to FIG. 16, the display process of the attached gift performed during the distribution of the moving image will be described. The display process of the attached gift is performed in parallel with the distribution process of the moving image shown in FIG. Further, the display processing of the attached gift may be performed in parallel with the display processing of the normal gift shown in FIG.

During the distribution of the moving image, in step S31, it is determined whether or not a display request for the wearing gift is made. For example, the first viewing user can transmit a display request requesting the display of the wearing gift owned by the first viewing user from the viewing user device 10 to the server device 60.

When the display request for the attached gift is made, the display process proceeds to step S32. In step S32, based on the display request, the display instruction object associated with the wearing gift requested to be displayed is displayed on the display screen 40 of the distribution user device 20. For example, when the display request for the attached gift indicating the headband is made, the display instruction object 42b associated with the attached gift is displayed on the display screen 40 of the distribution user device 20.

Next, in step S33, it is determined whether or not a specific display instruction object is selected from the display instruction objects included in the display screen 40 of the distribution user device 20.

When the specific display instruction object is selected, in step S34, a process of displaying the wearing gift corresponding to the selected specific display instruction object on the display screen of the moving image being distributed. For example, when the display instruction object 42b included in the display screen 40 is selected, the display image 30 and the display image 40 are selected as shown in FIGS. 6, 7a and 7b. The mounted object 38 associated with the display instruction object 42b is displayed. Further, the selected display instruction object 42b is deleted from the display screen 40.

If no display instruction object is selected in step S33, and if the display processing of the attached gift is completed in step S34, the display processing of the attached gift ends.

According to the above-described embodiment, when the viewing user of the co-starring video makes a first display request for displaying the wearing gift, the wearing gift is not immediately displayed in the co-starring video but is distributed to the distribution user Ua. Alternatively, the attached gift is displayed according to the selection of the display instruction objects 42a to 42d by the distribution user Ub. Accordingly, even if a user who watches the co-starring video gives a large amount of gifts of the mounted gift, the mounted object can be displayed neatly in the co-starring video. As a result, it is possible to prevent the viewing experience of the viewing user from deteriorating. According to the above embodiment, the wearing gift is worn only on one of the character object of the distribution user Ua and the character object of the distribution user Ub who are performing together. In this case, the number of attached objects displayed in the co-star moving image can be suppressed, so that the attached objects can be displayed more neatly in the co-star moving image.

According to the above embodiment, the display instruction object is displayed on both the distribution user device 20a of the distribution user Ua and the distribution user device 20b of the distribution user Ub. As a result, the distribution user Ua who has applied for the co-star application is also given the opportunity to wear the wearing gift gifted in the co-star video. The distribution user Ua can get an opportunity to wear many wearing gifts by applying for a co-star with the distribution user Ub who collects a lot of gifting. Delivery users want to make attractive decorations on their character objects. As described above, according to the above-described embodiment, it is possible to give the delivery user Ua an incentive to make a co-star application.

According to the above-described embodiment, it is possible for the viewing user to specify the gifting destination of the wearing object. Thereby, the wearing gift can be gifted to the intended distribution user without being intercepted by the co-starring distribution user.

According to the above embodiment, the display instruction object is displayed only on the distribution user device 20b of the distribution user (for example, the distribution user Ub) who has distributed the original moving image. In the co-starring video, two or more distribution users co-star, but it is desirable to let the distribution user who has distributed the original video manage the video. According to the above-described embodiment, whether to display the wearing gift can be left to the distribution user who has distributed the original video, not the co-star who has applied for the co-star application.

The display time of the normal gifts 37a and 37b can be set shorter than that of the wearing gift 38, and the normal objects 37a and 37b do not come into contact with the character object 31 or the front side of the character object 31 rather than the front side thereof. May be displayed in. In this case, the normal objects 37a and 37b have little influence on the visibility of the character object 31 in the moving image being distributed. Therefore, with respect to the normal gift, even if it is automatically displayed in the moving image (without the permission of the distribution users Ua and Ub) in response to the display request from the viewing user, the viewing experience of the user due to the deterioration of the visibility of the character object 31 is provided. Hard to lead to deterioration.

According to the above-described embodiment, the viewing user who views a moving image including a character object such as the character object 31 is considered to be attached to the character object. Therefore, it is possible to improve the appearance of the character object by attaching the wearing gift to the character object rather than the effect gift or the normal gift, and thus it is possible to enhance the satisfaction of the viewing user who provided the wearing gift. In this way, the wearing object on which the character object can be worn can provide the user with an incentive to repeatedly view the video including the character object.

In the moving image distribution system 1 according to the above embodiment, the user can give a wearing object to the character. As a result, it is possible to provide a highly unique system as compared with a system that cannot give such a wearing object, and it is possible to provide a highly unique service to the system. As a result, since more users can be attracted to the moving image distribution system 1, it is possible to increase the number of times the moving image is viewed in the moving image distribution system 1.

In the moving image distribution system 1 according to the above-described embodiment, the distribution users Ua and Ub can distribute a moving image including a character object that moves according to their facial expressions by the distribution user device 20 including a camera such as a smartphone. As described above, in the moving image distribution system 1, since the facilities for distributing the moving images to the distribution users Ua and Ub are simplified, a platform in which the distribution users Ua and Ub can easily participate is realized.

In the processing procedure described in this specification, particularly in the processing procedure described using the flowchart, some of the steps (steps) constituting the processing procedure are omitted, It is possible to add steps that are not explicitly shown and/or change the order of the steps, and a processing procedure in which such omissions, additions, and changes in order are made without departing from the spirit of the present invention. It is included in the scope of the invention.

At least a part of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the moving image distribution system 1. At least a part of the functions implemented by the computer processor 61 may be implemented by the computer processor 21 of the distribution user device 20 or the computer processor of the viewing user device 10, for example. Specifically, some or all of the functions of the animation generation unit 61a and the moving image generation unit 61b may be executed by the distribution user device 20. For example, the moving image generated in the distribution user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

When a distribution user Ua who is watching a video including the character object 31 of the distribution user Ub makes a request for co-starring with the distribution user Ub, the animation of the character object 131 of the distribution user Ua who has made the co-starring request is performed by the server. It may be generated by the device 60, the distribution user device 20a of the distribution user Ua, the distribution user device 20b of the distribution user Ub, the viewing user device 10, or a device other than these. In one example, when the animation of the character object 131 of the delivery user Ua is generated by the delivery user device 20b of the delivery user Ub, the delivery user device 20a of the delivery user Ua sends the delivery user device 20b of the delivery user Ub to the delivery user device 20b. Then, the face motion data and voice data of the distribution user Ua are transmitted. In the distribution user device 20b, the animation of the character object 131 is generated by applying the face motion data and the voice data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua. The model data for the distribution user Ua may be transmitted from the server device 60 to the distribution user device 20a. In another example, when the animation of the character object 131 of the distribution user Ua is generated in the viewing user device 10, the distribution user device 20a of the distribution user Ua sends the face motion data of the distribution user Ua to the viewing user device 10. And the voice data are transmitted, and the face motion data and the voice data of the delivery user Ub are transmitted from the delivery user device 20b of the delivery user Ub to the viewing user device 10. In the viewing user device 10, by applying the face motion data and the voice data of the distribution user Ua received from the distribution user device 20a to the model data for the distribution user Ua, the animation of the character object 131 is generated, and from the distribution user device 20b. The animation of the character object 31 may be generated by applying the received face motion data and voice data of the distribution user Ub to the model data for the distribution user Ub. The model data for the distribution user Ua and the model data for the distribution user Ub may be transmitted from the server device 60 to the viewing user device 10. As described above, the animation of the character object of the distribution user can be generated by any device included in the moving image distribution system 1. Animations of character objects may be generated on devices not explicitly shown in FIG. Face motion data and voice data of the distribution user Ua are transmitted from the distribution user device 20a of the distribution user Ua to the device that generates the animation of the character object, and face motion data of the distribution user Ub is transmitted from the distribution user device 20b of the distribution user Ub. And voice data is transmitted. Body motion may be transmitted in addition to face motion.

In addition, the server device 60, the distribution user device 20a of the distribution user Ua, and the distribution user Ub generate the co-star moving image including the generated distribution object Ua of the distribution user Ua, the distribution moving image of the distribution user Ub, and the character object 31. It may be performed by either the user device 20b or the viewing user device 10.

The co-star video may include character objects of three or more distribution users. That is, three or more distribution users may virtually co-star in the moving image by using each character object.

The inventions described in the claims at the time of filing the original application of the present application will be additionally described below.
[1]
Comprises one or more computer processors,
The one or more computer processors execute computer-readable instructions to:
Delivering a first moving image including a first character object generated based on the movement of the first user,
One of displaying the display instruction object on the first user device of the first user who displays the first moving image in response to receiving the first display request regarding the first gift from the viewing user who views the first moving image Therefore, the display instruction object is not displayed on the viewing user device used by the viewing user and the second user device used by the second user who displays the first moving image,
Distributing a co-star movie including the first character object and a second character object generated based on the movement of the second user based on a co-star application from the second user;
Display the display instruction object on the first user device that displays the co-starring video and the second user device that displays the co-starring video,
In response to an operation on the display instruction object, the first gift is displayed in association with at least one of the first character object and the second character object in the co-star movie.
Video distribution system.
[2]
When the display instruction object is operated on the first user device, the display instruction object is not selectable from the second user device, and when the display instruction object is operated on the second user device, the display instruction object is not selected. Disabling the display instruction object from the first user device,
The moving image distribution system according to [1].
[3]
The display instruction object is selectable in the first user device, while the display instruction object is not selectable in the second user device,
The moving image distribution system according to [1].
[4]
By operating the display instruction object on the first user device, the first gift is displayed in the co-star moving image in association with the second character object.
The moving image distribution system according to [3].
[5]
The first gift is a wearing gift associated with the wearing parts of the first character object and the second character object,
The wearing gift is displayed at a position corresponding to the wearing site in the co-starring movie in accordance with an operation on the display instruction object,
The moving image distribution system according to any one of [1] to [4].
[6]
When the second display request regarding the second gift is received from the viewing user without being associated with the specific parts of the first character object and the second character object, the second gift is added to the co-star movie. To display,
The moving image distribution system according to any one of [1] to [5].
[7]
In response to an operation on the display instruction object, the first gift is displayed in association with only one of the first character object and the second character object in the co-star movie.
The moving image distribution system according to any one of [1] to [6].
[8]
A video distribution method executed by one or more computer processors executing computer readable instructions, comprising:
Distributing a first moving image including a first character object generated based on the movement of the first user;
One of displaying the display instruction object on the first user device of the first user who displays the first moving image in response to receiving the first display request regarding the first gift from the viewing user who views the first moving image A step of not displaying the display instruction object on the viewing user device used by the viewing user and the second user device used by the second user who displays the first moving image;
Delivering a co-star movie including the first character object and a second character object generated based on the movement of the second user based on a co-star application from the second user;
Displaying a display instruction object on the first user device that displays the co-starring video and the second user device that displays the co-starring video;
Displaying the first gift in association with at least one of the first character object and the second character object in the co-star movie in response to an operation on the display instruction object;
Video distribution method that includes.
[9]
One or more computer processors,
Distributing a first moving image including a first character object generated based on the movement of the first user;
One of displaying the display instruction object on the first user device of the first user who displays the first moving image in response to receiving the first display request regarding the first gift from the viewing user who views the first moving image A step of not displaying the display instruction object on the viewing user device used by the viewing user and the second user device used by the second user who displays the first moving image;
Delivering a co-star movie including the first character object and a second character object generated based on the movement of the second user based on a co-star application from the second user;
Displaying a display instruction object on the first user device that displays the co-starring video and the second user device that displays the co-starring video;
Displaying the first gift in association with at least one of the first character object and the second character object in the co-star movie in response to an operation on the display instruction object;
A video distribution program that executes.

1 Video distribution system

First, in step S11, face motion data, which is a digital expression of the movement (expression) of the face of the distribution user Ub , is generated. The generation of the face motion data is performed by, for example, the face motion data generation unit 211a of the distribution user device 20. In the distribution user device 20, sound data may be generated based on a sound input from the distribution user Ub . The generated face motion data and voice data are transmitted to the server device 60.

Next, in step S12, the face motion data from the distributing user device 20, delivery by being applied to the model data for the user Ub, the animation of the character object moving in synchronism with the movement of the facial expression of the distributing user Ub is generated To be done. The generation of this animation is performed, for example, by the animation generation unit 61a.

Next, in step S13, a moving image including the animation of the character object corresponding to the distribution user Ub is generated. The voice of the distribution user Ub may be synthesized with this moving image. The animation of the character object is displayed superimposed on the background image. The generation of the moving image is performed by, for example, the moving image generating unit 61b described above.

Claims (1)

Comprises one or more computer processors,
The one or more computer processors execute computer-readable instructions to:
Delivering a first moving image including a first character object generated based on the movement of the first user,
One of displaying the display instruction object on the first user device of the first user who displays the first moving image in response to receiving the first display request regarding the first gift from the viewing user who views the first moving image Therefore, the display instruction object is not displayed on the viewing user device used by the viewing user and the second user device used by the second user who displays the first moving image,
Distributing a co-star movie including the first character object and a second character object generated based on the movement of the second user based on a co-star application from the second user;
Display the display instruction object on the first user device that displays the co-starring video and the second user device that displays the co-starring video,
In response to an operation on the display instruction object, the first gift is displayed in association with at least one of the first character object and the second character object in the co-star movie.
Video distribution system.

Images