JP7284329B2 - Video distribution system, video distribution method, and video distribution program for live distribution of video containing animation of character object generated based on movement of distribution user - Google Patents

Description

Application of Patent Law Article 30, Paragraph 2 GREE Co., Ltd. disclosed the claimed invention at a business policy briefing held on August 7, 2018 by its subsidiary, Wright Flyer Live Entertainment Co., Ltd.

Article 30, Paragraph 2 of the Patent Law applies https://le. wrightflyer. net/reality/GREE Co., Ltd. has published the claimed invention on the VTuber-dedicated live distribution platform "REALITY" provided by Wright Flyer Live Entertainment Co., Ltd. from August 7, 2018 at the above URL.

The disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program for live distribution of a video containing animation of a character object generated based on the movement of a distribution user.

2. Description of the Related Art Conventionally, there has been known a moving image distribution system that generates an animation of a character object based on movements of a distribution user and performs live distribution of a moving image including the animation of the character object. Such video distribution systems are disclosed, for example, in Japanese Unexamined Patent Application Publication No. 2015-184689 (Patent Document 1) and “Yusuke Hasegawa, Dawn of a New Era of Virtual Idols, PROJECT MariA, CG WORLD, Japan, Bourne Digital Co., Ltd., November 2017. 10, Vol. 231, pp. 74-79” (Non-Patent Document 1).

There is also known a content distribution system that displays on a display screen a gift object corresponding to a gift purchased by a viewing user viewing content in response to a request from the viewing user. For example, in the video distribution system disclosed in Japanese Patent Application Laid-Open No. 2012-120098 (Patent Document 2), a viewing user purchases a gift item and provides the purchased gift item as a gift to the distribution user. can be done. The gift is displayed in the video being distributed in response to a display request from the viewing user. A gift display request may also be automatically generated in response to the gift being purchased by a viewing user.

JP 2015-184689 A JP 2012-120098 A

Yusuke Hasegawa, Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital, Inc., November 10, 2017, Vol.231, pp. 74-79

In the conventional technology described above, the gift is automatically displayed in the moving image being distributed in response to the display request of the gift from the viewing user. Therefore, the gift may be displayed in the video at a timing not desired by the distribution user. As a result, there is a problem for the distribution user that performance through the character object is disturbed. For example, if a gift is conspicuously displayed in a video during a performance, the performance cannot be fully expressed in the video.

Also, if the gift is displayed in the video at a timing that does not match the desire of the distribution user, the viewing experience of the viewing user may be degraded. For example, if the main part of the video is obscured by a gift, the viewer may feel blocked from watching the video. In particular, if a large number of gifts are displayed overlapping with the video, such a problem may be aggravated. Therefore, in Patent Document 2, the gift object is not displayed in the content display area where the moving image is displayed, but is displayed in the background area outside the content display area. As described above, in the conventional video distribution system, there is a possibility that the gift is displayed in the video at a timing that does not match the desire of the distribution user. There is a constraint that makes it difficult to arrange the display area for

It is an object of the present disclosure to provide technical improvements that solve or alleviate at least some of the problems in the prior art discussed above. One of the more specific objects of the present disclosure is to provide a moving image distribution system, a moving image distribution method, and a moving image distribution program capable of displaying a gift at a timing desired by a distribution user in a distributed moving image.

One aspect of the present invention relates to a moving image distribution system for live distribution of a moving image including animation of a character object generated based on movements of a distribution user. The video distribution system includes one or more computer processors, and the one or more computer processors have received a first display request regarding a first gift from the viewing user by executing computer-readable instructions. Accordingly, a display instruction object is displayed in a display area that occupies a part of a display screen of the distribution user device used by the distribution user, and the first gift is displayed in response to an operation on the display instruction object. show in the video. An upper limit number of the display instruction objects that can be displayed in the display area is set in the display area. In one embodiment, if the upper limit number of display instruction objects are displayed in the display area when the first display request is received, the display of the upper limit number displayed in the display area is performed. After any one of the instruction objects is operated, a new display instruction object corresponding to the first display request is displayed in the display area.

In one aspect of the present invention, the first gift is an equipable gift associated with an equipable part of the character object, and the equipable gift is attached to the equipable part in the moving image in response to an operation on the display instruction object. is displayed at the corresponding position.

In one aspect of the present invention, the attached gift includes a first attached gift associated with a first attached portion of the attached portions, and the first attached gift includes a first gift displayed in the moving image. A display time is set, and when the first mountable gift is displayed in the moving image, the one or more computer processors display the first mountable gift among the mountable gifts until the first display time elapses. The display of the second wearable gift associated with one wearable part in the moving image is prohibited.

In one aspect of the present invention, the one or more computer processors, when the first attachable gift is displayed in the moving image, are configured to display the first attachable gift among the attachable gifts until the first display time elapses. Deactivating the display instruction object for displaying the second wearable gift associated with the wearing site.

In one aspect of the present invention, in response to receiving a message gift associated with a message from the viewing user, the message is displayed on the delivery user device, and in response to a display instruction operation on the delivery user device, The message gift is displayed on the animation.

In one aspect of the present invention, the moving image is synthesized with the voice of the distribution user, and the distribution user receives a voice change gift for changing the voice of the distribution user from the viewing user. A voice change instruction object is displayed on the user device, and the voice of the distribution user is changed to the voice designated by the voice change gift according to an operation on the voice change instruction object.

In one aspect of the present invention, in response to receiving a second display request regarding a second gift displayed in the moving image without being associated with a specific part of the character object from a viewing user viewing the moving image, The second gift is displayed on the moving image.

In one aspect of the present invention, a gift display prohibited period is set within the distribution period of the moving image, and the second gift is displayed in the moving picture at a timing other than the gift display prohibited period during the distribution period of the moving image.

One aspect of the present invention relates to a video distribution method for live distribution of a video containing animation of a character object generated based on the movement of a distribution user by one or more computer processors executing computer-readable instructions. . In the moving image distribution method, in response to receiving a first display request regarding a first gift from the viewing user, a display instruction object is displayed in a display area occupying a part of a display screen of a distribution user device used by the distribution user. and displaying the first gift in the moving image according to an operation on the display instruction object. An upper limit number of the display instruction objects that can be displayed in the display area is set in the display area.

One aspect of the present invention relates to a video distribution program for live distribution of a video including animation of a character object generated based on motion of a distribution user. The video distribution program instructs one or more computer processors to display part of the display screen of the distribution user device used by the distribution user in response to receiving a first display request regarding the first gift from the viewing user. and displaying the first gift in the moving image in response to an operation on the display instruction object. An upper limit number of the display instruction objects that can be displayed in the display area is set in the display area.

According to the embodiment of the present invention, a gift can be displayed at a timing desired by the distribution user during the distribution moving image.

1 is a block diagram illustrating a video distribution system according to one embodiment; FIG. FIG. 2 is a schematic diagram schematically showing distribution users who distribute moving images distributed by the moving image distribution system of FIG. 1 and distribution user devices used by the distribution users; 4 is a diagram showing an example of a display screen displayed on the viewing user device 10 in one embodiment. FIG. FIG. 4 is a diagram showing an example of a display screen displayed on the distribution user device 20 in one embodiment; 4 is a diagram showing an example of a display screen displayed on the viewing user device 10 in one embodiment. FIG. An example of a normal object is displayed on the display screen of FIG. 4 is a diagram showing an example of a display screen displayed on the viewing user device 10 in one embodiment. FIG. An example of a wearable object is displayed in the display screen of FIG. 5a. FIG. 4 is a diagram showing an example of a display screen displayed on the distribution user device 20 in one embodiment; An example of a wearable object is displayed in the display screen of FIG. 5b. FIG. 4 is a diagram showing an example of a display screen displayed on the distribution user device 20 in one embodiment; An example of a message confirmation window is displayed on the display screen of FIG. 4 is a diagram showing an example of a display screen displayed on the viewing user device 10 in one embodiment. FIG. An example message window is shown in the display screen of FIG. 7a. FIG. 4 is a diagram showing an example of a display screen displayed on the distribution user device 20 in one embodiment; An example message window is shown in the display screen of FIG. 7b. FIG. 4 is a flow diagram showing the flow of video distribution processing in one embodiment. FIG. 10 is a flow diagram showing the flow of processing for displaying normal gifts in one embodiment. FIG. 10 is a flow diagram showing the flow of processing for displaying an attached gift in one embodiment; FIG. 10 is a flow diagram illustrating a process flow for displaying message gifts in one embodiment. 2 is a diagram for explaining a gift display prohibition period set in a video distributed in the video distribution system of FIG. 1; FIG.

Various embodiments of the present invention will now be described with appropriate reference to the drawings. Identical or similar components are provided with the same reference numerals in several drawings.

A video distribution system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG. FIG. 1 is a block diagram showing a video distribution system 1 according to one embodiment, and FIG. 2 shows distribution users U1 who distribute videos distributed by the video distribution system 1 and distribution user devices used by the distribution users. 20 is a schematic diagram schematically showing 20. FIG.

The video distribution system 1 includes a viewing user device 10 , a distribution user device 20 , a server device 60 and a storage 70 . The viewing user device 10, the distribution user device 20, the server device 60, and the storage 70 are connected via the network 50 so as to be able to communicate with each other. The server device 60 is configured to distribute moving images including animation of characters of distribution user U1, as will be described later.

This moving image is distributed from the server device 60 to the viewing user device 10 and the distribution user device 20 . The distributed video is displayed on the display of the viewing user device 10 . A viewing user who is a user of the viewing user device 10 can view the distributed video using the viewing user device 10 . Although only one viewing user device 10 is shown in FIG. 1 to simplify the drawing, the moving image distribution system 1 may include a plurality of viewing user devices. By viewing the distributed video, the distribution user U1 can perform while checking the video in the video.

First, the distribution user device 20 will be described. In the illustrated embodiment, the Broadcast User Device 20 comprises a computer processor 21 , a communication I/F 22 , a display 23 , a camera 24 and a microphone 25 .

The computer processor 21 is an arithmetic device that loads an operating system and various programs that implement various functions from storage into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as ASIC, PLD, FPGA, MCU. Although computer processor 21 is illustrated as a single component in FIG. 1, computer processor 21 may be a collection of a plurality of physically separate computer processors.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver or PPP driver, or a combination thereof. The distribution user device 20 can transmit and receive data to and from other devices via the communication I/F 22 .

The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect a player's touch operation (contact operation). The touch panel can detect various touch operations such as tapping, double tapping, and dragging by the player. The touch panel may include a capacitive proximity sensor and be configured to detect non-contact operations by the player.

The camera 24 continuously captures images of the face of the distribution user U1, and acquires imaged data of the face of the distribution user U1. Imaged data of distribution user U1's face imaged by camera 24 is transmitted to server device 60 via communication I/F 22 . The camera 24 may be a 3D camera capable of detecting the depth of a person's face.

The microphone 25 is a sound collecting device configured to convert input sound into sound data. The microphone 25 is configured to be able to acquire the voice input of the distribution user U1. The voice input of distribution user U1 acquired by microphone 25 is converted into voice data, and this voice data is transmitted to server device 60 via communication I/F 22 .

The viewing user equipment 10 may comprise similar components to the broadcasting user equipment 20 . For example, viewing user device 10 may include a computer processor, communication I/F, display, and camera.

The viewing user device 10 and the distribution user device 20 are information processing devices such as smart phones. The viewing user device 10 and the distribution user device 20 are mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and other various information processing devices capable of reproducing moving images, in addition to smartphones. may Each of the viewing user device 10 and the distribution user device 20 may include, in addition to the components described above, a sensor unit including various sensors such as a gyro sensor, and a storage for storing various information.

Next, the server device 60 will be described. In the illustrated embodiment, the server device 60 comprises a computer processor 61 , a communication I/F 62 and a storage 63 .

The computer processor 61 is an arithmetic device that loads an operating system and various programs that implement various functions from the storage 63 or other storage into its memory, and executes instructions included in the loaded programs. The computer processor 61 is, for example, a CPU, MPU, DSP, GPU, various arithmetic units other than these, or a combination thereof. The computer processor 61 may be realized by an integrated circuit such as ASIC, PLD, FPGA, MCU. Although computer processor 21 is illustrated as a single component in FIG. 1, computer processor 61 may be a collection of a plurality of physically separate computer processors.

The communication I/F 62 is implemented as hardware, firmware, communication software such as a TCP/IP driver or PPP driver, or a combination thereof. Server device 60 can transmit and receive data to and from other devices via communication I/F 62 .

Storage 63 is a storage device accessed by computer processor 61 . The storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices capable of storing data. Various programs can be stored in the storage 63 . At least part of the programs and various data that can be stored in the storage 63 may be stored in a storage that is physically separate from the server device 60 (for example, the storage 70).

Programs or instructions contained therein that are described herein as being executed by computer processor 21 or computer processor 61, respectively, may be executed by a single computer processor or may be distributed among multiple computer processors. may be executed as Also, programs executed by computer processor 21 or computer processor 61 or instructions included in the programs may each be executed by multiple virtual computer processors.

Next, data stored in the storage 63 will be described. In the illustrated embodiment, the storage 63 stores model data 63a, object data 63b, and various other data necessary for generating and distributing distribution moving images.

The model data 63a is model data for generating character animation. The model data 63a may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (also referred to as “skeleton data”) indicating the skeleton of the character's face and parts other than the face, and surface data indicating the surface shape and texture of the character. The model data 63a can include a plurality of different model data. The plurality of model data may have rig data different from each other, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data.

The object data 63b includes asset data for constructing a virtual space that constitutes a moving image. The object data 63b includes data for drawing the background of the virtual space that constitutes the moving image, data for drawing various objects displayed in the moving image, and data for drawing various objects displayed in the moving image. Contains data. The object data 63b may include object position information indicating the position of the object in the virtual space.

The object data 63b may include gift objects in addition to the above. The gift object is displayed in the moving image based on a gift display request from the viewing user who is viewing the moving image. The gift objects can include effect objects corresponding to effect gifts, normal objects corresponding to normal gifts, attachment objects corresponding to attachment gifts, and message objects corresponding to message gifts. A viewing user can purchase a desired gift.

The effect object indicating the effect gift is an object that affects the impression of the entire viewing screen of the distributed moving image, and is an object that imitates confetti, for example. The confetti-like object may be displayed on the entire viewing screen, thereby changing the impression of the entire viewing screen before and after the display. Effect objects are sometimes displayed so as to overlap with character objects, but differ from wearing objects in that they are displayed without being associated with specific parts of the character object.

A normal object indicating a normal gift is an object that indicates a gift from a viewing user to a distribution user (for example, distribution user U1), such as a stuffed toy, a bouquet, an accessory, or an item suitable for a gift or present other than the above. is an object. In one aspect, the normal object is displayed on the moving image display screen so as not to come in contact with the character object. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character object. A normal object may be displayed so as to overlap an object other than the character object in the virtual space. A normal object may be displayed so as to overlap with a character object, but differs from a wearable object in that it is not displayed in association with a specific part of the character object. In one aspect, when the normal object is displayed so as to overlap with the character object, the normal object overlaps a portion of the character object other than the head including the face, and does not overlap the head of the character object. is displayed. In one aspect, when the normal object is displayed so as to overlap with the character object, the normal object overlaps the part of the character object other than the upper body including the face, and does not overlap the upper body of the character object. Is displayed.

A wearable object indicating a wearable gift is an object displayed on the display screen in association with a specific part (wearing part) of the character object. In one aspect, the mountable object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the mountable object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover part or all of the specific part of the character object. The specific part may be specified by three-dimensional position information indicating the position in the three-dimensional coordinate space, or may be associated with position information in the three-dimensional coordinate space. For example, in the character's head, the specific parts include the front left side, front right side, rear left side, rear right side, center front side, center rear side, left eye, right eye, left ear, right ear, and the entire hair. may be defined.

Wearable objects are, for example, accessories (headbands, necklaces, earrings, etc.), clothes (T-shirts, etc.), costumes, and other objects that can be worn on character objects. The object data 63b corresponding to the wearable object may include wearable part information indicating which part of the character object the wearable object is associated with. Mounting part information of a certain mountable object can indicate on which part of the character object the mountable object is to be mounted. For example, when the wearable object is a headband, the wearable part information of the wearable object may indicate that the wearable object is worn on the "head" of the character object. When the mounting site information on which the mounting object is mounted is specified as a position in the three-dimensional coordinate space, the mounting site information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, wearing part information indicating a position where a wearable object representing a "headband" is worn may be associated with two parts of the character object, namely, "rear left side of head" and "rear right side of head". In other words, the wearable object representing the "headband" may be worn on both the "left rear side of the head" and the "right rear side of the head". When the wearable object is a T-shirt, the wearable part information of the wearable object may indicate that the wearable object is worn on the "torso" of the character object.

Two types of wearable objects having a common wearing part are displayed in the moving image at intervals of time. In other words, two types of wearable objects having the same wearing part are worn on the character object with a time interval between them. In other words, two types of wearable objects that share the same wearable part are not worn on the character object at the same time. For example, with regard to the wearing object representing the headband and the wearing object representing the hat, if "head" is set as the wearing part for both, the wearing object representing the headband and the wearing object representing the hat are not displayed at the same time.

A message object representing a message gift contains a message from a viewing user. The message object may be displayed in the moving image in a more conspicuous manner than the comment displayed in the comment display area 35, which will be described later. The message object may be displayed in the animation for a longer period of time than the comment displayed in the comment display area 35.

Each gift object may have a display time set according to its type. In one aspect, the display time of the wearable object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the wearable object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

Next, functions realized by the computer processor 21 will be described more specifically. The computer processor 21 functions as a face motion data generator 21a by executing computer-readable instructions included in the distribution program. At least part of the functions implemented by the computer processor 21 may be implemented by a computer processor other than the computer processor 21 of the video distribution system 1 . At least part of the functions implemented by the computer processor 21 may be implemented by the computer processor 61 installed in the server device 60, for example.

The face motion data generation unit 21a generates face motion data, which is a digital representation of the movement of the face of the distribution user U1, based on the imaging data of the camera 24. FIG. Face motion data is generated as needed over time. Face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data can digitally represent the movement of the distribution user U1's face (change in facial expression) in chronological order. The face motion data generated by the face motion data generator 21a is transmitted to the server device 60 via the communication I/F 22. FIG.

In addition to the face motion data generated by the face motion data generation unit 21a, the distribution user device 20 generates body motion data, which is a digital representation of the position and orientation of each part of the body of the distribution user U1 other than the face. You may The distribution user device 20 may transmit body motion data to the server device 60 in addition to face motion data. To generate body motion data, broadcast user U1 may wear a motion sensor. The broadcast user device 20 may be configured to generate body motion data based on the detection information of the motion sensor attached to the broadcast user U1. Body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data expresses the movement of the delivery user U1's body in time series as digital data. Generation of body motion data based on the detection information of the motion sensor attached to distribution user U1 may be performed, for example, in a photography studio. A photography studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor worn by broadcast user U1 may be, for example, Vive Tracker provided by HTC CORPORATION. The base station provided in the photography studio may be, for example, a base station provided by HTC CORPORATION. Also, a supporter computer may be installed in the photography studio and the separate room. A display in the photography studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room as the room where the supporter computer is installed. The room in which the supporter computer is installed and the photography studio may be separated by a glass window. In this case, the operator of the supporter computer (which may be referred to as a "supporter" in this specification) can visually recognize the distribution user U1. The supporter computer may be configured to be able to change the settings of various devices provided in the photography studio according to the operation of the supporter. The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various devices other than these. A supporter can input a message to the supporter computer and display the input message on the display of the photography studio.

Next, functions realized by the computer processor 61 will be described more specifically. The computer processor 61 functions as an animation generation unit 61a, a video generation unit 61b, a video distribution unit 61c, a gift request processing unit 61d, and a gift purchase processing unit 61e by executing computer-readable instructions included in the distribution program. do. At least part of the functions implemented by the computer processor 61 may be implemented by a computer processor other than the computer processor 61 of the video distribution system 1 . At least part of the functions implemented by the computer processor 61 may be implemented by the computer processor 21 of the distribution user device 20 or by the computer processor of the viewing user device 10, for example. Specifically, some or all of the functions of the animation generation unit 61 a and the moving image generation unit 61 b may be executed in the distribution user device 20 . For example, a video generated by the distribution user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10 .

The animation generation unit 61a applies the face motion data generated by the face motion data generation unit 21a of the distribution user device 20 to predetermined model data included in the model data 63a to generate animation of the character object. configured to The animation generator 61a can generate animation of the character object such that the expression of the character object changes based on the face motion data. Specifically, the animation generation unit 61a can generate an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user U1, based on the face motion data regarding the distribution user U1.

When the body motion data regarding the distribution user U1 is provided from the distribution user device 20, the animation generation unit 61a generates the movement of the body and facial expression of the distribution user U1 based on the body motion data and the face motion data regarding the distribution user U1. It is possible to generate an animation of a character object that moves in synchronism with.

The moving image generation unit 61b can generate a background image showing a background using the object data 63b, and can generate a moving image including this background image and an animation of a character object corresponding to distribution user U1. In the moving image generated by the moving image generation unit 61b, the character object corresponding to distribution user U1 is displayed superimposed on the background image.

The moving image generation unit 61b can synthesize the generated moving image with the voice of the distribution user U1 generated based on the voice data received from the distribution user device 20 . As described above, the moving image generating unit 61b generates an animation of the character object that moves in synchronization with the facial expression of the distribution user U1, and generates a moving image for distribution by synthesizing the voice of the distribution user U1 with this animation. can do.

The moving image distribution unit 61c distributes the moving image generated by the moving image generation unit 61b. This moving image is distributed to the viewing user device 10 and other viewing user devices via the network 50 . The generated moving image is distributed to the distribution user device 20 as well. The received moving image is reproduced on the viewing user device 10 and the broadcasting user device 20 .

FIG. 3a shows a display example of a moving image distributed from the moving image distribution unit 61c and being reproduced on the viewing user device 10. It is shown in FIG. 3b. As shown in FIG. 3a, the display of the viewing user device 10 displays the display image 30 of the moving image distributed from the server device 20. As shown in FIG. The display image 30 displayed on the viewing user device 10 includes a character object 31 of the distribution user U1 generated by the animation generation unit 61a, a gift button 32, an evaluation button 33, a comment button 34, and a comment display. area 35 and .

Since the character object 31 is generated by applying the face motion data of the distribution user U1 to the model data included in the model data 63a as described above, the character object 31 is generated in synchronization with the movement of the facial expression of the distribution user U1. Its expression changes. When body motion data is provided from distribution user device 20, character object 31 can be controlled so that parts other than the face also change in synchronization with distribution user U1's body movements.

The gift button 32 is displayed on the display screen 30 so as to be selectable by operating the viewing user device 10 . The gift button 32 can be selected, for example, by tapping an area of the touch panel of the viewing user device 10 where the gift button 32 is displayed. In one embodiment, when gift button 32 is selected, display screen 30 displays a window for selecting a gift to be gifted to the broadcast user who is delivering the video being viewed. The viewing user can purchase a gift to be gifted from among the gifts displayed in the window. In another embodiment, a window containing a list of purchased gifts is displayed on display screen 30 in response to selection of gift button 32 . In this case, the viewing user can select a gift to be gifted from the gifts displayed in the window. Gifting or purchasable gifts may include effect gifts, regular gifts, wearing gifts, message gifts, and other gifts.

The evaluation button 33 is displayed on the display screen 30 so as to be selectable by the viewing user using the viewing user device 10 . The evaluation button 33 can be selected, for example, by tapping an area of the touch panel of the viewing user device 10 where the evaluation button 33 is displayed. When the evaluation button 33 is selected by the viewing user who is viewing the moving image, evaluation information indicating that the moving image has been positively evaluated may be transmitted to the server device 60 . The server device 60 can aggregate evaluation information from the viewing user device 10 and other viewing user devices.

The comment button 34 is displayed on the display screen 30 so as to be selectable by the viewing user. When the comment button 34 is selected by tapping, for example, a comment input window for inputting a comment is displayed on the display screen 30 . The viewing user can enter comments via the input mechanism of the viewing user device 10 . The input comment is transmitted from the viewing user device 10 to the server device 60 . The server device 60 receives comments from the viewing user device 10 and other viewing user devices, and displays the comments in the comment display area 35 within the display image 30 . In the comment display area 35, comments posted by the viewing user device 10 and other viewing user devices are displayed, for example, in chronological order. The comment display area 35 occupies part of the display screen 30 . The number of comments that can be displayed in the comment display area 35 has an upper limit. In the illustrated example, up to three comments can be displayed in the comment display area 35 . When comments exceeding the upper limit set in the comment display area 35 are posted, the comments are deleted from the comment display area 35 in order of posting time. Therefore, the display time of each comment in the comment area 35 becomes shorter as the frequency of comments received from viewing users increases.

As shown in FIG. 3B , the display of the distribution user device 20 displays the display image 40 of the moving image distributed from the server device 20 . The display image 40 displayed on the distribution user device 20 includes a character object 31 corresponding to the distribution user U1, display instruction buttons 42a to 42c for displaying the attached gift requested by the viewing user, and a comment. A display area 35 is included. The display image 40 displayed on the distribution user device 20 includes the same background image, character object image, and comment as the display image 30 displayed on the viewing user device 10 . On the other hand, the display image 40 differs from the display image 30 in that it does not include the gift button 32, the evaluation button 33, and the comment button 34, but includes display instruction buttons 42a to 42c.

The display instruction buttons 42a to 42c are displayed on the display screen 40 in response to receiving a display request from the viewing user for displaying the attached gift, which will be described later. In the illustrated embodiment, the display image 40 displays three display instruction buttons 42a-42c. Each of the display instruction buttons 42a to 42c is displayed on the display screen 40 so as to be selectable by the distribution user. When one of the display instruction buttons 42a to 42c is selected by tapping, for example, an operation is performed to display the attached gift corresponding to the selected display instruction button. As described above, the display instruction buttons 42a to 42c are display instruction objects for instructing display of the attached gift in the moving image being distributed. Therefore, in this specification, the display instruction buttons 42a to 42c are sometimes referred to as display instruction objects 42a to 42c. In addition, the display instruction objects 42a to 42c may be simply referred to as the display instruction object 42 when it is not necessary to distinguish them from each other. A specific example of display of the attached gift will be described later. The display screen 40 may be displayed on the supporter computer described above. The display instruction objects 42a to 42c may be selected according to the operation of the supporter's computer by the supporter.

Each time a display request for displaying an attached gift is accepted, a display instruction object 42 corresponding to the display request is added to the display screen 40 . There is an upper limit to the number of display instruction objects 42 that can be displayed on the display screen 40 . In the illustrated embodiment, the maximum number of display instruction objects 42 that can be displayed on the display screen 40 is three. In this case, the display screen 40 has a display area capable of displaying three display instruction objects. When four or more display requests for the attached gift are received, the display instruction objects 42 corresponding to the fourth and subsequent display requests are not displayed on the display screen 40 . The display instruction object 42 corresponding to the display request for the attached gift received fourth is displayed when one of the three display instruction objects 42 already displayed is selected and an empty space is created in the display area. It is displayed on the display screen 40 .

The gift request processing unit 61d receives a gift display request from the viewing user, and performs processing for displaying the gift object corresponding to the display request. Each viewing user can transmit a gift display request to the server device 60 by operating his own viewing user device. The gift display request includes the user ID of the viewing user, gift identification information (gift ID) identifying the gift requested to be displayed, and/or gift object identification information identifying the gift object corresponding to the gift requested to be displayed ( gift object ID) and may be included.

As described above, gift objects representing gifts can include effect objects corresponding to effect gifts, normal objects corresponding to normal gifts, and wearable objects corresponding to wearable gifts. A wearing gift is an example of a first gift. The wearing object may be called a first gift object. A display request requesting display of a wearable gift (or wearable object) is an example of a first display request. Effect gifts and normal gifts are examples of second gifts. Effect objects and normal objects are sometimes collectively referred to as second gift objects. A display request requesting display of an effect gift (or effect object) or a normal gift (or normal object) is an example of a second display request.

In one aspect, when the gift request processing unit 61d receives a display request for a specific normal gift from the viewing user, the gift request processing unit 61d, based on the display request, displays the normal object indicating the requested normal gift in the moving image. process. For example, when a display request for a normal gift representing a bag is made, the normal object 36 representing a bag is displayed on the display image 30 by the gift request processing unit 61d based on the display request, as shown in FIG. . Similarly, when a display request for a normal gift representing a stuffed bear is made, as shown in FIG. 30. Although illustration is omitted, the normal object 36 and the normal object 37 are displayed on the display image 40 on the distribution user device 20 as well as the display image 30 .

In one aspect, when the gift request processing unit 61d receives a display request for a specific effect gift from the viewing user, the effect object corresponding to the effect gift requested to be displayed is displayed in the display image of the moving image based on the display request. Perform processing to display. For example, when a request is made to display an effect gift showing confetti or fireworks, the gift request processing unit 61d generates an effect object (not shown) corresponding to the effect gift showing confetti or fireworks based on the display request. ) is displayed on the display image 30 and the display image 40 .

The normal gift display request may include a display position designation parameter that designates the display position of the normal object representing the normal gift. In this case, the gift request processing section 61d can display the normal object at the position designated by the display position designation parameter. When the display position and display range of the character object 31 are defined, a position relative to the character object 31 can be designated as the display position of the normal object by the display position designation parameter.

In one aspect, when the gift request processing unit 61d receives a display request for a specific wearable object from the viewing user, the gift request processing unit 61d instructs the display screen 40 of the distribution user device 20 to display the display as shown in FIG. 3b based on the display request. Objects 42a-42c are displayed. Each of the display instruction objects 42a to 42c is associated with an attached gift for which a display request has been made. When one of the display instruction objects 42a to 42c is selected, the attached gift associated with the selected display instruction object is displayed in the moving image being distributed. For example, when the display instruction object 42b is associated with a headband imitating cat ears and the display instruction object 42b is selected, the gift request processing unit 61d selects the headband corresponding to the selected display instruction object 42b. is displayed on the moving image being distributed. An example display of an animation including a wearable object 38 showing a headband is shown in Figures 5a and 5b. Also, the selected display instruction object 42b is deleted from the display screen 40, as shown in FIG. 5b.

The wearable object is displayed in the moving image in association with a specific part (wearing part) of the character object. For example, the wearable object may be displayed in the moving image so as to be in contact with the wearable part of the character object. The wearable object 38 may be displayed in the moving image so as to be worn on the corresponding wearable part of the character object. In one embodiment, the wearable object 38 representing a headband is associated with the character object's head. Therefore, in the display examples shown in FIGS. 5a and 5b, the wearable object 38 is worn on the head of the character object 31. FIG. The wearable object may be displayed in the moving image display screen so as to move along with the movement of the wearable part of the character object. For example, when the head of the character object 31 wearing the wearable object 38 representing the headband moves, the wearable object 38 representing the headband also moves to the head of the character object 31 as if the headband was worn on the head of the character object 31 . Move along with the department.

As described above, the object data 63b may include attachment site information indicating which part of the character object the attachment object is associated with. In one aspect, when the character object is equipped with the mountable object, the gift request processing unit 61d sets the display time of the mountable object until the display time of the mountable object elapses. Prohibits the display of other wearable objects that are worn on overlapping parts. For example, the headband associated with both the “rear left side of the head” and the “rear right side of the head” and the hair accessory associated with the “rear left side of the head” overlap with the “rear left side of the head”. Therefore, when the headband is displayed, display of the hair accessory for which "rear left side of the head" is set as the wearing part information is prohibited. On the other hand, the headband associated with the "left side of the back of the head" and the "right side of the back of the head" and the earrings associated with the "left ear (of the head)" and "right ear (of the head)" are Since the parts to be worn in the character object do not overlap, they can be worn at the same time.

In one embodiment, the display instruction object 42 for displaying mountable objects whose display is prohibited may be deactivated in order to prohibit display of a plurality of mountable objects having the same or overlapping mounting sites. In the embodiment shown in FIG. 5B, it is assumed that the display instruction object 42a is a hair accessory for which "rear left side of the head" is set as the wearing part information. In this case, since the character object 31 is wearing the wearable object 38 representing the headband, the wearable object representing the hair accessory is prohibited from being displayed in the moving image while the wearable object 38 is worn on the character object 31. be done. In one embodiment, the display instruction object 42a associated with the wearable object representing the hair accessory is deactivated in order to prohibit display of the wearable object representing the hair accessory in the moving image. For example, the display instruction object 42 a cannot be selected even if it is operated while the wearable object 38 is worn on the character object 31 . In another embodiment, the display instruction object 42 a is erased from the display screen 40 while the wearable object 38 is being worn by the character object 31 . The deactivated display instruction object 42a is activated again when the headband display time elapses. In order to reactivate the display instruction object 42a, for example, the display instruction object 42a that has been disabled may be made selectable again, or the display instruction object 42a that has been hidden may be displayed on the display screen 40 again. may be displayed.

In one aspect, a viewing user watching a video can send a display request to server device 60 requesting that a message gift containing a particular message be displayed in the video. Upon receiving a message gift display request associated with a specific message from the viewing user, the gift request processing unit 61d displays a message on the display screen 40 of the delivery user device 20 based on the display request, as shown in FIG. A confirmation screen 43 is displayed. The message confirmation screen 43 includes a message input by the viewing user who made the display request, a button for permitting display of the message in the video, and a button for refusing display of the message in the video. is included. The distribution user U1 confirms the message from the viewing user on the message confirmation screen 43, and selects a button labeled "Display" if the message gift including the message is permitted to be displayed on the video. By doing so, a message gift display instruction operation is performed. Conversely, when rejecting the display of the message gift on the moving image, the delivery user U1 selects a button labeled "Do not display" to perform a display rejection operation.

When the distribution user U1 permits the display of the message gift, the message gift is displayed on the display screen 30 of the viewing user device 10 and the display screen of the distribution user device 20 as shown in FIGS. 7a and 7b. is displayed. The message object 39 contains text data indicating the message associated with the message gift. The message object 39 may include an indication (for example, the user name, nickname, etc. of the viewing user) indicating the viewing user who requested the display of the message gift.

In one aspect, a viewing user who is watching a moving image can transmit to the server device 60 a voice change gift for changing the voice of the distribution user U1 synthesized with the moving image being distributed. Upon receiving the voice change gift, the gift request processing unit 61d displays a confirmation screen (not shown) on the display screen 40 of the distribution user device 20. FIG. The confirmation screen for confirming whether or not the voice can be changed may include information specifying the content of the voice change. For example, this confirmation screen includes information specifying the voice change, such as changing a male voice to a female voice, or changing a human voice to an electronic robot-like sound. may The confirmation screen also includes a button for permitting the voice change requested in the voice change gift and a button for rejecting the voice change. On this confirmation screen, the distribution user U1 confirms the content of the voice change and performs an instruction operation for permitting or refusing the change.

In one aspect, a viewing user who is watching a moving image can transmit to the server device 60 a motion gift that designates a motion other than the head of the character object 31 included in the moving image being distributed. Upon receiving the motion gift, the gift request processing unit 61d controls the motion of the character object 31 so that the character object 31 takes the motion specified by the motion gift. A confirmation screen (not shown) for confirming whether or not the motion specified by the motion gift can be reflected on the character object 31 is displayed on the display screen 40 of the delivery user device 20, and the motion specified by the delivery user U1 is displayed. The movement specified by the motion gift may be reflected in the character object 31 only when an instruction operation permitting the reflection is performed.

In one aspect, the gift purchase processing unit 61e sends purchase information for each of a plurality of gift objects that can be purchased in relation to the moving image to the viewing user's device (for example, the , to the viewing user device 10). The purchase information of each gift object includes the type of the gift object (effect object, normal object, or wearing object), the image of the gift object, the price of the gift object, and other information necessary for purchasing the gift object. can be included. The viewing user can select a gift object to purchase based on the gift object purchase information displayed on the viewing user device 10 . A gift object to be purchased may be selected by operating the viewing user device 10 . When the viewing user selects a gift object to be purchased, a purchase request for the gift object is transmitted to the server device 60 . The gift purchase processing unit 61e performs settlement processing based on the purchase request. When this payment processing is completed, the purchased gift object is owned by the viewing user. The storage 23 may store the gift ID of the purchased gift (or the gift object ID of the gift object indicating the gift) in association with the user ID of the viewing user who purchased the gift.

The purchasable gift object may differ from movie to movie. A purchasable gift object may be purchasable in multiple videos. That is, the purchasable gift objects may include unique gift objects specific to each animation and common gift objects purchasable in multiple animations. For example, an effect object showing confetti may be a common gift object that can be purchased in multiple videos.

In one aspect, when an effect object is purchased while watching a predetermined video, the effect object to be purchased is added to the video being watched in response to completion of payment processing for purchasing the effect object. May be displayed automatically. If a normal object is purchased while watching a predetermined video, in the same way as above, upon completion of the payment process for purchasing the normal object, the normal gift object to be purchased will be transferred to the video being watched. may be automatically displayed in

In another aspect, in response to the completion of the payment processing in the gift purchase processing unit 61e for the effect object to be purchased, a payment completion notification is transmitted to the viewing user device 10, and the viewing user device 10 receives the purchased effect object. A confirmation screen may be displayed for asking the viewing user whether or not to request the display of the effect object. When the viewing user selects to make a display request for the purchased effect object, a display request for displaying the purchased effect object is transmitted from the viewing user's client device to the gift request processing unit 61d. , and the gift request processing unit 61 d may perform processing for displaying the effect object to be purchased on the moving image 70 . Even when the purchase target is a normal object, similarly to the above, a confirmation screen may be displayed on the viewing user device 10 for asking the viewing user whether or not to request display of the purchased normal object.

Next, a video distribution process according to one aspect will be described with reference to FIGS. 8 to 11. FIG. FIG. 8 is a flow chart showing the flow of video distribution processing in one embodiment, FIG. 9 is a flow chart showing the flow of processing for displaying normal objects in one embodiment, and FIG. 11 is a flow diagram showing the flow of processing for displaying a wearable object in , and FIG. 11 is a flow diagram showing the flow of processing for displaying a message object in one embodiment. In the video distribution process described with reference to these drawings, it is assumed that the distribution user U1 performs video distribution based on the face motion data acquired using the distribution user device 20. FIG.

First, in step S11, face motion data, which is a digital representation of the facial movement (expression) of distribution user U1, is generated. Generation of face motion data is performed by the face motion data generation unit 21a of the distribution user device 20, for example. In the distribution user device 20, voice data may be generated based on the voice input from the distribution user U1. The generated face motion data and voice data are transmitted to the server device 60 .

Next, in step S12, the face motion data from the distribution user device 20 is applied to the model data for the distribution user U1, thereby generating an animation of the character object that moves in synchronization with the movement of the facial expression of the distribution user U1. be done. This animation is generated by, for example, the animation generation unit 61a.

Next, in step S13, a moving image including animation of the character object corresponding to distribution user U1 is generated. The voice of distribution user U1 may be synthesized with this moving image. The animation of the character object is superimposed on the background image and displayed. This moving image is generated by, for example, the moving image generation unit 61b.

Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50 . The moving images are distributed continuously over a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any time other than these.

Next, proceeding to step S15, it is determined whether or not the end condition for ending the distribution of the moving image is satisfied. The termination condition is, for example, that the delivery end time has been reached, that the delivery user U1 has performed an operation to end the delivery on the delivery user device 20, or other conditions. If the end condition is not satisfied, the processes of steps S11 to S14 are repeatedly executed, and the distribution of moving images including animation synchronized with the movement of distribution user U1 and distribution user A2 is continued. When it is determined that the termination condition is satisfied for the moving image, the distribution processing for the moving image is terminated.

Next, with reference to FIG. 9, normal gift display processing performed during distribution of moving images will be described. The normal gift display processing is performed in parallel with the moving image distribution processing shown in FIG.

During distribution of moving images, it is determined in step S21 whether or not a display request for a normal gift has been made. For example, the viewing user selects one or more specific normal gifts from the normal gifts owned by the viewing user, and sends a display request from the viewing user device 10 to the server device 60 to request the display of the selected normal gifts. can be sent to As described above, a display request for a predetermined normal gift may be generated in response to purchase processing or settlement processing for a predetermined normal gift.

When the display request for the normal gift is made, the display process proceeds to step S22. In step S22, based on the display request, a process for displaying the normal gift requested to be displayed on the moving image being distributed is performed. For example, when a request for displaying a normal gift is made during distribution of a predetermined moving image, as shown in FIG. An object 36 is displayed. Although not shown, the normal object 36 may also be displayed within the display image 40 of the distribution user device 20 .

If the normal gift display request has not been made, the normal gift display processing ends. The normal gift display processing shown in FIG. 9 is repeatedly performed during the distribution period of the moving image. The effect gift display process can also be performed in the same procedure as the normal gift display process described above.

Next, with further reference to FIG. 10, display processing of the attached gift performed during distribution of moving images will be described. The process of displaying the gift to be worn is performed in parallel with the process of distributing the moving image shown in FIG. Further, the process of displaying the attached gift may be performed in parallel with the process of displaying the normal gift shown in FIG.

During distribution of the moving image, in step S31, it is determined whether or not a display request for an attached gift has been made. For example, the first viewing user can transmit, from the viewing user device 10 to the server device 60, a display request requesting display of an attached gift held by the first viewing user.

When the display request for the attached gift is made, the display process proceeds to step S32. In step S<b>32 , the display instruction object associated with the attached gift requested to be displayed is displayed on the display screen 40 of the delivery user device 20 based on the display request. For example, when a display request for an attached gift indicating a headband is made, a display instruction object 42 b associated with the attached gift is displayed on the display screen 40 of the distribution user device 20 .

Next, in step S33, it is determined whether or not a specific display instruction object has been selected from the display instruction objects included in the display screen 40 of the distribution user device 20. FIG.

When a specific display instruction object is selected, in step S34, processing is performed to display an attached gift corresponding to the selected specific display instruction object on the display screen of the moving image being distributed. For example, when the display instruction object 42b included in the display screen 40 is selected, the selected display instruction object is displayed on the display image 30 and the display image 40 as shown in FIGS. 5a and 5b. The mounted object 38 associated with 42b is displayed. Also, the selected display instruction object 42 b is deleted from the display screen 40 .

If none of the display instruction objects is selected in step S33, and if the attached gift display process is completed in step S34, the attached gift display process ends.

Next, with further reference to FIG. 11, message gift display processing performed during distribution of moving images will be described. The message gift display processing is performed in parallel with the moving image distribution processing shown in FIG. Further, the message gift display process may be performed in parallel with the normal gift display process shown in FIG. 9 and the attached gift display process shown in FIG.

During distribution of moving images, it is determined in step S41 whether or not a message gift display request has been made. For example, the first viewing user can transmit, from the viewing user device 10 to the server device 60, a display request requesting display of a message gift including a message text-inputted by the first viewing user.

If a message gift display request has been made, the display process proceeds to step S42. In step S42, the message confirmation screen 43 associated with the message gift requested to be displayed is displayed on the display screen 40 of the delivery user device 20 based on the display request.

Next, in step S43, it is determined whether display of the message gift in the moving image is permitted. For example, it is determined whether or not the button associated with permission to display the message gift on the moving image included in the message confirmation screen 43 included in the display screen 40 of the delivery user device 20 has been selected.

When the button associated with permission to display the message gift on the moving image is selected, in step S44, processing is performed to display the message gift on the display screen of the moving image being distributed. For example, if the button associated with allowing the display of the message gift in the animation included in the message confirmation screen 43 is selected, the display image 30 and The display image 40 displays the message gift 39 requested to be displayed.

In step S43, if the button associated with rejecting the display of the message gift in the video included in the message confirmation screen 43 is selected, and in step S44, if the display processing of the message gift is completed (for example, If the display time set for the message gift has elapsed), the display processing for the message gift ends.

In one embodiment, an object display prohibited section in which the display of the gift object is prohibited may be provided in the video distribution. FIG. 12 is a diagram schematically explaining an object display prohibited section. FIG. 12 shows that moving images are distributed from time t1 to time t2. In other words, the time t1 is the video distribution start time, and the time t2 is the video distribution end time. A gift display prohibition period 81 is between the time t3 and the time t4 in the video distribution period. Even if the gift display request r1 is made during the gift display prohibition period 81, the gift object is not displayed in the display image of the moving image during the gift display prohibition period 81. FIG. Specifically, when an effect gift or a normal gift among the gifts is requested to be displayed during the gift display prohibition period 81, the effect gift or normal gift requested to be displayed is not being distributed during the gift display prohibition period 81. It is not displayed in the moving image, and is displayed in the moving image after the gift display prohibition period 81 has elapsed (that is, after time t4). When the display of the attached gift is requested during the gift display prohibition period 81, the display instruction button for instructing the display of the attached gift for which the display request is made is not displayed on the display screen 40 of the delivery user device 20. , is displayed on the display screen 40 after the gift display prohibition period 81 has elapsed. When a message gift display request is made during the gift display prohibition period 81 , a message confirmation screen 43 for confirming whether or not the requested message gift can be displayed is displayed on the display screen 40 of the delivery user device 20 . is displayed on the display screen 40 after the gift display prohibition period 81 has elapsed. As a result, during the gift display prohibition period 81, the distribution user U1 can distribute the moving image without being interfered by the display of the effect gift or the normal gift. In addition, during the gift display prohibition period 81, the distribution user U1 does not need to worry about adding a display instruction button for confirming the attached gift or confirming whether or not the gift message can be displayed. can concentrate. Even during the gift display prohibition period 81, when one of the display instruction buttons 42a to 42c is selected by the distribution user U1, even if the attached gift corresponding to the selected display instruction button is displayed. good. As a result, the distribution user U1 can distribute the performance using the character object equipped with the desired gift.

According to the above embodiment, among the gifts displayed in the moving image, only the wearable object is displayed in association with the character object. In a moving image in which an animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the viewer's attention. In the above embodiment, even if there is a request to display an attached gift displayed in association with the character object 31, the display instruction button for displaying the attached gift is displayed on the delivery user device 20 of the delivery user U1, Since the equipable gift is not displayed in the moving image until the display instruction button is selected, it is possible to prevent the equipable gift from being randomly displayed around the character object or overlapped with the character object. This can prevent deterioration of the viewing experience of the viewing user.

In the conventional moving picture distribution system, regardless of the type of gift object, it was displayed in the moving picture in response to a request for display on the moving picture. Therefore, if the gifts can be displayed in duplicate in the video, a large number of gifts will be displayed in the video, degrading the viewing experience of the user viewing the video. In the above-described embodiment, by providing a category of gifts that are displayed in association with character objects in gifts, the display timing of the gift that is displayed in association with character objects, which are the main part of the moving image, can be determined by the delivery user. Made it controllable in U1.

The display time of the normal gifts 36 and 37 can be set shorter than that of the attached gift 38, and the normal objects 36 and 37 are arranged so as not to contact the character object 31 or behind the character object 31 rather than in front of it. may be displayed in In this case, the normal objects 36 and 37 have little effect on the visibility of the character object 31 in the moving image being distributed. Therefore, even if the normal gift is automatically displayed in the video (without the permission of the distribution user U1) in response to the display request from the viewing user, the user's viewing experience will not be deteriorated due to the deterioration of the visibility of the character object 31. is difficult to connect.

In the moving image distribution system 1 according to the above-described embodiment, the user can give the wearable object to the character. As a result, it is possible to provide a highly unique system compared to a system in which such a wearable object cannot be given, and to provide a highly unique service by the system. As a result, more users can be attracted to the moving image distribution system 1, so that the number of views of moving images in the moving image distribution system 1 can be increased.

In the moving image distribution system 1 according to the above-described embodiment, the distribution user U1 can distribute a moving image including a character object that moves according to his or her facial expression using a distribution user device 20 such as a smartphone equipped with a camera. In this way, in the moving image distribution system 1, facilities for distributing moving images by the distributing user U1 are simplified, so that a platform in which the distributing user U1 can easily participate is realized.

The operational effects of the above embodiment will be further described below.

In one aspect of the present invention, the display instruction object 42 is displayed on the distribution user device 20 used by the distribution user U1 in response to receiving the first display request regarding the first gift from the viewing user. According to the operation to 42, the first gift is displayed in the moving image being distributed. According to the above aspect, the timing of displaying the first gift requested by the viewing user in the video is determined by the operation of the display instruction object 42 displayed on the distribution user device 20 . Accordingly, it is possible to prevent the first gift from being displayed in the video at a timing not desired by the distribution user U1.

The first gift may be an equipable gift associated with an equipable part of the character object. The attached gift is displayed at a position corresponding to the attachment site set for the attached gift in the moving image being distributed in accordance with the operation on the display instruction object 42 displayed on the distribution user device 20 . An example of a wearable gift is a gift representing a headband associated with the character object's head. The attached gift representing the headband is displayed in the animation as if it is attached to the head of the character object 31 in response to the operation of the display instruction object 42 corresponding to the attached gift. A wearable gift that overlaps or is displayed around the character object tends to interfere with the performance of the distribution user U1 through the character object 31, and tends to deteriorate the viewing experience of the viewing user. According to the above embodiment, the display timing of the wearable gift associated with the wearable part of the character object 31 in the moving image is determined according to the operation of the display instruction object 42 displayed on the distribution user device 20 . . As a result, it is possible to prevent the wearable gift from being displayed in the moving image at a timing not desired by the distribution user U1, which tends to deteriorate the performance of the distribution user U1 through the character object 31 and the viewing experience of the viewing user.

A display time to be displayed in the moving image may be set for each wearing gift. The display time may be different depending on the type of attached gift, or a predetermined display time may be uniformly set. In one aspect, when the first attached gift among the attached gifts is displayed in the video, the same attached part as the first attached gift is set until the display time set for the first attached gift elapses. Displaying other wearable gifts in the video is prohibited. In a specific aspect, when the first wearable gift is displayed in the video, the same wearing site as the first wearable gift is set until the display time set for the first wearable gift has passed. The display instruction object 42 for displaying other attached gifts is deactivated. According to this aspect, it is possible to prevent a plurality of wearable gifts from being redundantly displayed at the wearing site of the character object.

In one aspect, in response to receiving a message gift associated with a message from a viewing user, a message confirmation screen 43 for confirming the message is displayed on the broadcast user device 20 . When the broadcast user U1 permits the display of the message gift including the message on the moving image, the broadcast user device 20 performs a message gift display instruction operation. Messages posted by viewing users through Message Gifts may include messages that are not desirable to be displayed in the video. According to the above aspect, based on the message displayed on the message confirmation screen 43 displayed on the broadcast user device 20, the broadcast user U1 can decide whether or not to display the message gift. As a result, it is possible to prevent display of a message gift that is not desirable to be displayed in the moving image.

In one aspect, the voice of the broadcast user U1 is synthesized with the video, and the voice change is performed by the broadcast user device 20 in response to receiving a voice change gift for changing the voice of the broadcast user U1 from the viewing user. An instruction object is displayed, and the voice of the distribution user is changed to the voice specified by the gear voice change gift according to the operation on the voice change instruction object. According to this aspect, it is possible to prevent a change to a voice that is not desired by distribution user U1.

In one aspect, in response to receiving a second display request regarding a second gift displayed in the moving image without being associated with a specific part of the character object 31 from the viewing user, the second gift is displayed in the moving image. is displayed. The second gift includes effect gifts and normal gifts. According to this aspect, the second gift displayed in the video without being associated with a specific part of the character object can be displayed in the video in response to a display request from the viewing user (without requiring an operation or instruction by the distribution user). can be displayed in Since the second gift is not displayed in association with a specific part of the character object, it is less likely to interfere with the performance of the distribution user U1 through the character object 31 and deteriorate the viewing experience of the viewing user. Therefore, by enabling the second gift to be displayed in the moving image without requiring an operation by the distribution user U1, it becomes easier to activate the interaction with the viewing user.

In one aspect, the gift display prohibition period 81 is set within the distribution period of the video, and the second gift is displayed in the video at a timing other than the gift display prohibition period 81 . According to this aspect, during the gift display prohibition period 81, a moving image that does not include the second gift can be distributed to the viewing user. For example, by setting the gift display prohibition period 81 to the time zone during which the distribution user U1 performs through the character object 31, it is possible to prevent the viewing user's attention from being diverted from the character object 31. FIG.

In the processing procedures described in this specification, especially in the processing procedures described using flow diagrams, some of the steps that make up the processing procedure are omitted, and as a step that makes up the processing procedure It is possible to add steps that are not specified and/or change the order of the steps, and the processing procedures in which such omissions, additions, and order changes do not deviate from the spirit of the present invention. Included within the scope of the invention.

The invention described in the scope of claims as originally filed in the original application of the present application will be additionally described below.
[1]
A system that enables live playback of a moving image including animation of a character object generated based on the movement of a distribution user on a viewing user terminal used by the viewing user,
comprising one or more computer processors,
The one or more computer processors, by executing computer readable instructions,
displaying a display instruction object on a distribution user device used by the distribution user on which the moving image is displayed, in response to receiving a first display request regarding the first gift from the viewing user;
displaying the first gift in the video in response to an operation on the display instruction object;
video distribution system.
[2]
the display instruction object is selected by a contact operation on the distribution user device;
the first gift corresponding to the display instruction object selected by the contact operation is displayed in the moving image;
The video delivery system according to [1].
[3]
the display instruction object displayed on the delivery user device is deactivated so as to be unselectable;
The moving image distribution system according to [1] or [2].
[4]
The deactivated display instruction object is activated so as to be selectable;
[3] The video distribution system described in [3].
[5]
if the maximum number of display instruction objects are displayed in the display area of the delivery user device when the first display request is received, the maximum number of display instruction objects displayed in the display area; to display a new display instruction object corresponding to the first display request in the display area after any of the is operated;
The moving image distribution system according to any one of [1] to [4].
[6]
the first gift is a first wearable gift associated with a wearable part of the character object;
When the one or more processors receive a second display request regarding a second wearable gift associated with the wearing part of the character object from the viewing user or a viewing user different from the viewing user, the one or more processors display the Deactivating the display instruction object for displaying the second attached gift while the first attached gift is being displayed;
The moving image distribution system according to any one of [1] to [5].
[7]
The one or more processors activate the display instruction object for displaying the deactivated second attachable gift in response to completion of the display of the first attachable gift.
The moving image distribution system according to [6].
[8]
the first gift is a first wearable gift associated with a wearable part of the character object;
When the one or more processors receive a second display request regarding a second wearable gift associated with the wearing part of the character object from the viewing user or a viewing user different from the viewing user, the one or more processors display the setting the display instruction object for displaying the second attachable gift to a non-display state while the first attachable gift is being displayed;
The moving image distribution system according to any one of [1] to [5].
[9]
The one or more processors display, on the delivery user device, the display instruction object for displaying the second attached gift in response to completion of the display of the first attached gift.
The video delivery system according to [8].
[10]
The display instruction object is also displayed on the display of the supporter computer that changes the settings for generating the moving image,
By selecting the display instruction object displayed on the supporter computer, the first gift corresponding to the display instruction object is displayed in the moving image.
The moving image distribution system according to any one of [1] to [9].
[11]
The one or more computer processors are
causing the character object to perform the motion indicated by the motion gift in response to receiving a motion gift designating the motion of the character object from the viewing user;
The moving image distribution system according to any one of [1] to [10].
[12]
causing a distribution user device used by the distribution user to display a confirmation screen for confirming whether or not the character object can perform the movement specified by the motion gift, and responding to a display instruction operation on the distribution user device , causing the character object to perform the motion indicated by the motion gift;
[11] The video distribution system described in [11].
[13]
The motion gift designates a movement of the character object other than the head,
The moving picture delivery system according to [11] or [12].
[14]
the animation of the character object is generated based on the movement of the distribution user's face;
[13] The video delivery system described in [13].
[15]
displaying the third gift in the moving image in response to receiving from the viewing user a third display request regarding a third gift displayed in the moving image without being associated with a specific part of the character object;
The moving image distribution system according to any one of [1] to [14].
[16]
A gift display prohibition period is set within the distribution period of the video,
The third gift is displayed in the video at a timing other than the gift display prohibition period during the distribution period of the video.
[15] The video distribution system described in [15].
[17]
One or more computer processors execute computer-readable instructions to enable live playback of a moving image including animation of a character object generated based on the movement of a broadcasting user on a viewing user terminal used by the viewing user. a method,
a step of displaying a display instruction object on a distribution user device used by the distribution user and on which the moving image is displayed, in response to receiving a first display request regarding the first gift from the viewing user;
displaying the first gift in the video in response to an operation on the display instruction object;
How to prepare.
[18]
A program for enabling live playback of a moving image including animation of a character object generated based on the movement of a distribution user by a viewing user terminal used by the viewing user,
to one or more computer processors;
a step of displaying a display instruction object on a distribution user device used by the distribution user and on which the moving image is displayed, in response to receiving a first display request regarding the first gift from the viewing user;
displaying the first gift in the video in response to an operation on the display instruction object;
A video distribution program that runs

1 Video distribution system

Claims (14)

A system that enables live playback of a moving image including animation of a character object generated based on the movement of a distribution user on a viewing user terminal used by the viewing user,
comprising one or more computer processors,
The one or more computer processors, by executing computer readable instructions,
A distribution user device that is used by the distribution user and displays the moving image during a period other than the gift display prohibition period set for the moving image in response to receiving a first display request regarding the first gift from the viewing user. to display the display instruction object,
causing the first gift to be displayed in the moving image during a period other than the gift display prohibited period in response to an operation on the display instruction object;
system. the first display request is accepted during the gift display prohibition period;
The system of claim 1. The first gift is an equipable gift associated with an equipable part of the character object,
3. A system according to claim 1 or 2. the first gift is a first wearable gift associated with a wearable part of the character object;
When the one or more processors receive a second display request regarding a second wearable gift associated with the wearing part of the character object from the viewing user or a viewing user different from the viewing user, the one or more processors display the Deactivating the display instruction object for displaying the second attached gift while the first attached gift is being displayed;
3. A system according to claim 1 or 2. The one or more processors activate the display instruction object for displaying the deactivated second attachable gift in response to completion of the display of the first attachable gift.
5. The system of claim 4. The one or more processors receive from the viewing user a third display request regarding a second gift displayed in the moving image without being associated with a specific part of the character object, and receive a period other than the gift display prohibition period. to display the second gift in the video,
6. A system according to any one of claims 1-5. The third display request is accepted during the gift display prohibition period,
The second gift is displayed in the moving image after the gift display prohibition period has passed.
7. A system according to claim 6. the display instruction object is selected by a contact operation on the distribution user device;
the first gift corresponding to the display instruction object selected by the contact operation is displayed in the moving image;
The moving image delivery system according to any one of claims 1 to 7. if the maximum number of display instruction objects are displayed in the display area of the delivery user device when the first display request is received, the maximum number of display instruction objects displayed in the display area; to display a new display instruction object corresponding to the first display request in the display area after any of the is operated;
The moving image distribution system according to any one of claims 1 to 8. The display instruction object is also displayed on the display of the supporter computer that changes the settings for generating the moving image,
By selecting the display instruction object displayed on the supporter computer, the first gift corresponding to the display instruction object is displayed in the moving image.
The moving image distribution system according to any one of claims 1 to 9. The one or more computer processors are
causing the character object to perform the motion indicated by the motion gift in response to receiving a motion gift designating the motion of the character object from the viewing user;
The moving image distribution system according to any one of claims 1 to 10. causing a distribution user device used by the distribution user to display a confirmation screen for confirming whether or not the character object can perform the movement specified by the motion gift, and responding to a display instruction operation on the distribution user device , causing the character object to perform the motion indicated by the motion gift;
The moving image distribution system according to claim 11. One or more computer processors execute computer-readable instructions to enable live playback of a moving image including animation of a character object generated based on the movement of a broadcasting user on a viewing user terminal used by the viewing user. a method,
A distribution user device that is used by the distribution user and displays the moving image during a period other than the gift display prohibition period set for the moving image in response to receiving a first display request regarding the first gift from the viewing user. a step of displaying the display instruction object on the
displaying the first gift in the moving image during a period other than the gift display prohibition period in response to an operation on the display instruction object;
How to prepare. A program for enabling live playback of a moving image including animation of a character object generated based on the movement of a distribution user by a viewing user terminal used by the viewing user,
to one or more computer processors;
A distribution user device that is used by the distribution user and displays the moving image during a period other than the gift display prohibition period set for the moving image in response to receiving a first display request regarding the first gift from the viewing user. a step of displaying the display instruction object on the
displaying the first gift in the moving image during a period other than the gift display prohibition period in response to an operation on the display instruction object;
program to run.

Images