JP2020043578A - Moving image distribution system, moving image distribution method, and moving image distribution program, for distributing moving image including animation of character object generated on the basis of movement of actor - Google Patents

Abstract

To provide a moving image distribution system for distributing a moving image including an animation of a character object generated on the basis of a movement of an actor.SOLUTION: The moving image distribution system for distributing a moving image including an animation of a character object generated on the basis of a movement of an actor, includes one or more computer processors. The one or more computer processors execute computer readable instructions to display a decorative object on the moving image on the basis of a first display request from a viewing user viewing the moving image and display the first object on the moving image on the basis of a second display request from the viewing user.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to a moving image distribution system, a moving image distribution method, and a moving image distribution program that distribute a moving image including an animation of a character object generated based on the movement of an actor.

  2. Description of the Related Art A moving image distribution system that generates an animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object has been known. Such a moving image distribution system is disclosed, for example, in Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1).

  There is also known a content distribution system that displays a gift object corresponding to an item purchased by a viewing user on a display screen in response to a request from a viewing user viewing the content. For example, in the moving image distribution system disclosed in Japanese Patent Application Laid-Open No. 2012-120098 (Patent Document 2), a viewing user purchases a gift item and gives the purchased gift item to a performer (content distributor). Can be provided as According to the publication, it is desirable that the gift object be displayed in the background area of the distribution screen so as not to interfere with the moving image.

JP 2015-184689 A JP 2012-120098 A

  Displaying the gift object overlapping with the moving image may lead to a deterioration in the viewing experience of the viewing user. For example, if the main part of the moving image is hidden by the gift object, the viewer may feel obstructed from watching the moving image. In particular, if a large number of gift objects are displayed overlapping with the moving image, such a problem may be exacerbated. Therefore, in Patent Literature 2, the gift object is not displayed in the content display area where the moving image is displayed, but is displayed in the background area outside the content display area.

  It is an object of the present disclosure to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above. One of more specific objects of the present disclosure is to provide a moving image distribution system, a moving image distribution method, and a moving image distribution program that can display a gift object overlapping a moving image without deteriorating the viewing experience of the viewing user. is there.

  A video distribution system according to an aspect is a video distribution system that distributes a video including an animation of a character object generated based on the movement of an actor, and includes one or a plurality of computer processors. The one or more computer processors execute a computer-readable instruction to display the decorative object in the moving image based on a first display request from a viewing user viewing the moving image, The first object is displayed on the moving image based on a second display request from the user.

  In one aspect, the first object is a normal object displayed on the moving image so as not to contact the character object.

  In one aspect, the decorative object is displayed in the moving image in association with a specific part of the character object, while the first object is not associated with a specific part of the character object.

  In one aspect, the decorative object is associated with the character object and moved and displayed according to the motion of the character object, while the first object is displayed at a specified display position.

  In one aspect, the selection of the decorative object is made by a supporter supporting distribution of the moving image.

  In one aspect, the selection of the decorative object is made by a supporter supporting distribution of the moving image.

  In one aspect, the selection of the decorative object is made by the actor.

  In one aspect, the one or more computer processors respond to a second display request for requesting display of a first object different from the decorative object from a viewing user viewing the moving image, and The first object is displayed.

  In one aspect, the first object is displayed on the moving image so as not to contact the character object.

  In one aspect, the second display request includes a display position specification parameter that specifies a display position of the first object, and the first object is specified by the display position specification parameter in the moving image. Will be displayed at the position

  In one aspect, the second display request includes a moving direction parameter that specifies a moving direction of the first object, and the first object includes, in the moving image, a direction specified by the moving direction parameter. It is displayed to move to.

  In one aspect, the second display request includes a trajectory parameter specifying a trajectory of the first object, and the first object moves on a trajectory specified by the trajectory parameter in the moving image. Will be displayed.

In one aspect, an object display prohibition period is set within the distribution period of the moving image,
The first object and the decoration object are displayed on the moving image at a timing other than the object display prohibition period during the distribution period of the moving image.

  In one aspect, when the second display request is received during the object display prohibition period, the first object is displayed on the moving image after the elapse of the object display prohibition period.

  In one aspect, the one or more computer processors receive a purchase request to purchase the decorative object from the viewing user, perform a payment process in accordance with the purchase request, and the decorative object is processed until the end of the distribution of the moving image. If not selected, the payment processing is canceled.

  In one aspect, the one or more computer processors receive a purchase request to purchase the decorative object from the viewing user, perform a payment process in accordance with the purchase request, and the decorative object is processed until the end of the distribution of the moving image. Is not selected, points are given to the viewing user.

  In one aspect, the one or more computer processors receive a purchase request to purchase the decorative object from the viewing user, and display the decoration in a holding list that is a list of objects held by the viewing user in response to the purchase request. Adding an object, deleting the decorative object from the holding list in response to receiving the first display request for displaying the decorative object from the viewing user, and terminating the distribution of the moving image. If not selected by time, add the decorative object to the holding list.

  In one aspect, the one or more computer processors provide the viewing user with purchase information for purchasing a purchasable gift object in association with the video, wherein the gift object includes the decorative object; The gift object includes a unique gift object that can be purchased only in the video and a common gift object that can be purchased in a video other than the video.

  One embodiment relates to a moving image distribution method that distributes a moving image including a character object animation and a gift object generated based on the movement of an actor by executing computer-readable instructions by one or more computer processors. The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object. The moving image distribution method includes a step of displaying the decoration object in the moving image based on a first display request from a viewing user who views the moving image, and a step of displaying the first object based on a second display request from the viewing user. Is displayed on the moving image.

  One aspect relates to a moving image distribution program that distributes a moving image including a character object animation and a gift object generated based on the movement of an actor. The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object. The distribution program displays the decoration object in the moving image based on a first display request from a viewing user who views the moving image, and displays the first object based on a second display request from the viewing user. And displaying the moving image.

  According to the embodiment of the present invention, the gift object can be displayed overlapping with the moving image without deteriorating the viewing experience of the viewing user.

FIG. 1 is a block diagram illustrating a moving image distribution system according to an embodiment. FIG. 2 is a schematic diagram schematically showing facilities of a studio for producing a moving image distributed by the moving image distribution system of FIG. 1. FIG. 2 is a diagram illustrating a holding list stored in the moving image distribution system of FIG. 1. FIG. 2 is a diagram illustrating a candidate list stored in the moving image distribution system of FIG. 1. FIG. 6 is a diagram illustrating an example of a moving image displayed on the client device 10a in one embodiment. FIG. 5 includes an animation of the character object. FIG. 6 is a diagram illustrating an example of a moving image displayed on the client device 10a in one embodiment. FIG. 6 includes a normal object. FIG. 6 is a diagram illustrating an example of a moving image displayed on the client device 10a in one embodiment. FIG. 7 includes a decorative object. It is a schematic diagram which shows the example of the decoration object selection screen for selecting the desired selection decoration object from the decoration objects contained in the candidate list. It is a flowchart which shows the flow of a moving image distribution process in one Embodiment. FIG. 7 is a flowchart illustrating a flow of a process of displaying a normal object in one embodiment. It is a flowchart which shows the flow of a process which displays a decoration object in one Embodiment. FIG. 2 is a diagram for explaining an object display prohibition period set for a moving image distributed in the moving image distribution system of FIG. 1.

  Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. The same reference numerals are given to the same or similar components in a plurality of drawings.

  A moving image distribution system according to an embodiment will be described with reference to FIGS. FIG. 1 is a block diagram illustrating a moving image distribution system 1 according to an embodiment, and FIG. 2 is a schematic diagram schematically illustrating facilities of a studio in which a moving image distributed by the moving image distribution system 1 is produced. FIGS. 3 and 4 are diagrams for explaining information stored in the moving image distribution system 1. FIG.

  The moving image distribution system 1 includes client devices 10a to 10c, a server device 20, a studio unit 30, and a storage 60. The client devices 10a to 10c, the server device 20, and the storage 60 are communicably connected to each other via a network 50. The server device 20 is configured to distribute a moving image including a character animation, as described later. The character included in this moving image may be motion-controlled in the virtual space.

  This moving image can be distributed from the server device 20 to each of the client devices 10a to 10c. A first viewing user who is a user of the client device 10a, a second viewing user who is a user of the client device 10b, and a third viewing user who is a user of the client device 10c view the distributed moving image with each client device. be able to. The moving image distribution system 1 may include less than three client devices, or may include more than three client devices.

  The client devices 10a to 10c are information processing devices such as smartphones. The client devices 10a to 10c may be a mobile phone, a tablet terminal, a personal computer, an electronic book reader, a wearable computer, a game console, and various other information processing devices capable of reproducing moving images in addition to a smartphone. Each of the client devices 10a to 10c includes a computer processor, a memory, a communication I / F, a display, a sensor unit including various sensors such as a gyro sensor, a microphone and other sound collecting devices, and a storage for storing various information. Is also good.

  In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication I / F 22, and a storage 23.

  The computer processor 21 is an arithmetic device that loads an operating system and various programs for realizing various functions from a storage 23 or another storage into a memory, and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, and an MCU. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a set of a plurality of physically separate computer processors. In the present specification, a program described as being executed by the computer processor 21 or instructions included in the program may be executed by a single computer processor, or may be executed in a distributed manner by a plurality of computer processors. Is also good. Further, the program executed by the computer processor 21 or the instructions included in the program may be executed by a plurality of virtual computer processors.

  The communication I / F 22 is implemented as hardware, firmware, communication software such as a TCP / IP driver or a PPP driver, or a combination thereof. The server device 20 can transmit and receive data to and from another device via the communication I / F 22.

  The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices capable of storing data. Various programs can be stored in the storage 23. At least a part of the programs and various data that can be stored in the storage 23 may be stored in a storage physically separate from the server device 20 (for example, the storage 60).

  Many of the components of the studio unit 30 are arranged, for example, in the studio room R shown in FIG. As illustrated, in the studio room R, actors A1 and A2 are performing. The studio unit 30 is configured to detect the movement and expression of the actors A1 and A2 and output the detected information to the server device 20.

  Each of the actors A1 and A2 is a target whose movement and expression are captured by a sensor group described later provided in the studio unit 30. The actors A1 and A2 are, for example, humans, animals, or moving objects performing performances. The actors A1 and A2 may be, for example, robots capable of independent movement. The number of actors in the studio room R may be one, or may be three or more.

  The studio unit 30 includes six motion sensors 31a to 31f mounted on the actor A1, a controller 33a held on the left hand of the actor A1, a controller 33b held on the right hand of the actor A1, and a mounting tool 37b. And a camera 37a attached to the head of the actor A1 via the camera 37a. The studio unit 30 also includes six motion sensors 32a to 32f mounted on the actor A2, a controller 34a held on the left hand of the actor A2, a controller 34b held on the right hand of the actor A2, and a mounting tool 38b. And a camera 38a attached to the head of the actor A2 via the camera 38a. A microphone for acquiring audio data may be attached to each of the mounting tool 37b and the mounting tool 38b. This microphone can acquire the utterances of the actors A1 and A2 as audio data. The microphone may be a mounted microphone that is mounted on the actor A1 and the actor A2 via the mounting device 37b and the mounting device 38b, and may be a mounted microphone that is installed on the floor, wall, or ceiling of the studio room R. It may be. The studio unit 30 has a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39, in addition to the above components. A supporter computer 40 is installed in an adjacent room separated by a glass window from the studio room R. The server device 20 may be installed in the same room where the supporter computer 40 is installed.

  The motion sensors 31a to 31f and the motion sensors 32a to 32f detect their positions and orientations in cooperation with the base stations 35a and 35b. In one embodiment, base station 35a and base station 35b are multi-axis laser emitters. After emitting the flashing light for synchronization, the base station 35a scans the laser light, for example, around the vertical axis. The base station 35b scans the laser light, for example, around a horizontal axis. Each of the motion sensors 31a to 31f and the motion sensors 32a to 32f may include a plurality of optical sensors for detecting the incidence of blinking light and laser light from the base station 35a and the base station 35b, respectively. The motion sensors 31a to 31f and the motion sensors 32a to 32f respectively include a time difference between the timing of the flashing light and the timing of the laser light, the light receiving time at each optical sensor, the incident angle of the laser light detected by each optical sensor, and If necessary, the own position and orientation may be detected based on other information. The motion sensors 31a to 31f and the motion sensors 32a to 32f may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station 35a and the base station 35b may be, for example, base stations provided by HTC CORPORATION.

  The detection information indicating the position and the direction of each motion sensor calculated by each of the motion sensors 31a to 31f and the motion sensors 32a to 32f is transmitted to the server device 20. This detection information may be wirelessly transmitted to the server device 20 from each of the motion sensors 31a to 31f and the motion sensors 32a to 32f. Since the base station 35a and the base station 35b emit the blinking light and scan the laser light at fixed intervals, the detection information of each motion sensor is updated at each interval.

  In the illustrated embodiment, the actor A1 is equipped with six motion sensors 31a to 31f. The motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are respectively mounted on the left wrist, the right wrist, the left instep, the right instep, the waist, and the top of the actor A1. The motion sensors 31a to 31f may be mounted on the actor A1 via a mounting tool. Actor A2 is equipped with six motion sensors 32a to 32f. The motion sensors 32a to 32f can be attached to the actor A2 at the same positions as the motion sensors 31a to 31f. The motion sensors 31a to 31f and the motion sensors 32a to 32f shown in FIG. 2 are examples. The motion sensors 31a to 31f can be mounted on various parts of the actor A1, and the motion sensors 32a to 32f can be mounted on various parts of the actor A2. The number of motion sensors attached to the actors A1 and A2 may be 5 or less, or 7 or more. Thus, by detecting the positions and orientations of the motion sensors 31a to 31f and the motion sensors 32a to 32f attached to each part of the body of the actor A1 and the actor A2, the movement of the body of the actor A1 and the actor A2 is detected. be able to.

  In one embodiment, a large number of infrared LEDs are mounted on each of a plurality of motion sensors attached to the actor A1 and the actor A2, and light from the infrared LEDs is provided on the floor or wall of the studio room R. The position and the direction of each of the motion sensors may be detected by detecting with the infrared camera. A position and orientation of each motion sensor may be detected by using a visible light LED instead of the infrared LED and detecting light from the visible light LED with a visible light camera. As described above, a light emitting unit (for example, an infrared LED or a visible light LED) is provided in each of the plurality of motion sensors mounted on the actor, and light from the light emitting unit is received by the light receiving unit ( For example, the position and the direction of each of the motion sensors may be detected by detecting with an infrared camera or a visible light camera).

  In one embodiment, a plurality of reflective markers can be used instead of the motion sensors 31a to 31f and the motion sensors 32a to 32f. The reflection marker is attached to each of the actors A1 and A2 with an adhesive tape or the like. By photographing the actor A1 and the actor A2 to which the reflection marker is attached as described above to generate photographing data, and performing image processing on the photographing data, the position and the direction of the reflection marker can be detected.

  The controller 33a and the controller 33b output a control signal corresponding to the operation of the actor A1 to the server device 20. Similarly, the controller 34a and the controller 34b output a control signal corresponding to the operation of the actor A2 to the server device 20.

  The tracking sensor 36a and the tracking sensor 36b generate tracking information for determining setting information of a virtual camera for constructing a virtual space included in a moving image. The tracking information of the tracking sensor 36a and the tracking sensor 36b is calculated as a position in each three-dimensional orthogonal coordinate system and an angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to the operation of the operator. The tracking sensor 36a transmits tracking information indicating the position and the direction to the tracking information server device 20. Similarly, the position and the direction of the tracking sensor 36b are set according to the operation of the operator. The tracking sensor 36b transmits tracking information indicating the position and orientation to the tracking information server device 20.

  The camera 37a is attached to the head of the actor A1, as described above. For example, the camera 37a is arranged so that the face of the actor A1 can be imaged. The camera 37a continuously captures an image of the face of the actor A1, and acquires image data of the face of the actor A1. Similarly, camera 38a is attached to the head of actor A2. The camera 38a is arranged so as to be able to image the face of the actor A2, continuously images the face of the actor A2, and acquires image data of the face of the actor A2. The camera 37a transmits image data of the face of the actor A1 to the server device 20, and the camera 38a transmits image data of the face of the actor A1 to the server device 20. The cameras 37a and 38a may be 3D cameras capable of detecting the depth of a person's face.

  The display 39 is configured to display information received from the support computer 40. The information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other information. The display 39 is arranged at a position visible by the actors A1 and A2.

  In the illustrated embodiment, the supporter computer 40 is installed in a room adjacent to the studio room R. Since the room in which the supporter computer 40 is installed is separated from the studio room R by a glass window, the operator of the supporter computer 40 (hereinafter, sometimes referred to as “supporter” in the present specification) has actors A1 and A2. Can be visually recognized. In the illustrated embodiment, supporters B1 and B2 are present as operators of the supporter computer 40.

  The supporter computer 40 may be configured to be able to change the settings of the components of the studio unit 30 according to the operation of the supporters B1 and B2. The supporter computer 40 can set, for example, a scanning interval by the base station 35a and the base station 35b, a position or an orientation of the tracking sensor 36a and the tracking sensor 36b, and change various settings of various devices other than these. . At least one of the supporters B1 and B2 can input a message to the supporter computer 40 and display the input message on the display 39.

  The components and functions of the studio unit 30 shown in FIG. 2 are exemplary. The studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector. The projector can project a moving image distributed to the client device 10a or another client device on the screen S.

  Next, information stored in the storage 23 in one embodiment will be described. In the illustrated embodiment, the storage 23 stores the model data 23a, the object data 23b, the holding list 23c, the candidate list 23d, and various other information necessary for generating and distributing other distribution moving images.

  The model data 23a is model data for generating a character animation. The model data 23a may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 23a includes, for example, rig data (sometimes called “skeleton data”) indicating the skeleton of the character, and surface data indicating the shape and texture of the surface of the character. The model data 23a can include a plurality of different model data. The plurality of model data may have different rig data, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data. In the illustrated embodiment, the model data 23a has at least two different types of model data to generate a character object corresponding to the actor A1 and a character object corresponding to the actor A2. The model data for the character object corresponding to the actor A1 and the model data for the character object corresponding to the actor A2 have, for example, the same rig data, but may have different surface data.

  The object data 23b includes asset data for constructing a virtual space forming a moving image. The object data 23b includes data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and data for drawing various objects displayed in the moving image other than these. Contains data. The object data 23a may include object position information indicating the position of the object in the virtual space.

  In addition to the above, the object data 23b may include a gift object displayed in a moving image based on a display request from a viewing user of the client devices 10a to 10c. The gift object may include an effect object, a normal object, and a decoration object. The viewing user can purchase a desired gift object.

  The effect object is an object that affects the impression of the entire viewing screen of the distribution moving image, and is, for example, an object imitating confetti. An object imitating a confetti may be displayed on the entire viewing screen, thereby changing the impression of the entire viewing screen before and after the display. The effect object may be displayed so as to overlap the character object, but is different from the decorative object in that the display associated with a specific part of the character object is not performed.

  The normal object is an object serving as a digital gift from the viewing user to the actor (for example, the actor A1 or the actor A2), for example, an object imitating a stuffed animal or a bouquet. In one aspect, the normal object is displayed on the moving image display screen so as not to contact the character object. In one aspect, the normal object is displayed on the display screen of the moving image so as not to overlap with the character object. The normal object may be displayed so as to overlap with an object other than the character object in the virtual space. The normal object may be displayed so as to overlap with the character object, but is different from the decorative object in that a display associated with a specific part of the character object is not performed. In one aspect, when the normal object is displayed so as to overlap with the character object, the normal object overlaps with a part other than the head including the face of the character object, and does not overlap with the head of the character object. Is displayed as follows.

  The decoration object is an object displayed on the display screen in association with a specific part of the character object. In one aspect, the decorative object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the decorative object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to cover part or all of the specific part of the character object. The specific part may be specified by three-dimensional position information indicating a position in the three-dimensional coordinate space, or may be associated with position information in the three-dimensional coordinate space. For example, in the head of the character, the specific part is a unit of front left side, front right side, rear left side, rear right side, center front side, center rear side, left eye, right eye, left ear, right ear, and the whole hair. It may be determined.

  The decorative object is, for example, an accessory (such as a headband, a necklace, or an earring) to be attached to the character object, clothing (such as a T-shirt), a costume, or any other object that can be attached to a character object. The object data 23b corresponding to the decoration object may include mounting position information indicating to which part of the character object the decoration object is associated. The mounting position information of a certain decoration object can indicate to which part of the character object the decoration object is mounted. For example, when the decoration object is a headband, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “head” of the character object. When the mounting position information on which the decorative object is mounted is specified as a position in the three-dimensional coordinate space, the mounting position information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, the mounting position information indicating the position at which the decorative object indicating “headband” is mounted may be associated with two portions of the character object, “head left left” and “head right right”. That is, the decorative object indicating “headband” may be attached to both the “back left side” and the “back right side”. When the decoration object is a T-shirt, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “body” of the character object.

  A display time according to the type of each gift object may be set. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

  The holding list 23c is a list indicating the gift objects held by the user viewing the moving image. FIG. 3 shows an example of the holding list 23c. As illustrated, the holding list 23c stores an object ID that specifies a gift object held by the viewing user in association with the account information of the viewing user (for example, the user ID of the viewing user). The viewing users include, for example, first to third viewing users of the client devices 10a to 10c.

  The candidate list 23d is a list of decorative objects for which a display request has been made by the viewing user. As will be described later, the viewing user holding the decorative object can make a display request for the held decorative object. In the candidate list 23d, an object ID for specifying the decoration object is stored in association with the account information of the viewing user who made the display request of the decoration object. This candidate list 23d may be created for each distributor. The candidate list 23d may be stored, for example, in association with distributor identification information that specifies a distributor (actor A1, actor A2, supporter B1, and / or supporter B2).

  Next, functions realized by the computer processor 21 will be described more specifically. The computer processor 21 executes a computer-readable instruction included in the distribution program to execute a body motion data generation unit 21a, a face motion data generation unit 21b, an animation generation unit 21c, a moving image generation unit 21d, a moving image distribution unit 21e, It functions as a display request processing unit 21f, a decorative object selection unit 21g, and an object purchase processing unit 21h. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 21 may be realized by, for example, a computer processor mounted on the supporter computer 40.

  The body motion data generation unit 21a generates first body motion data of each part of the body of the actor A1 based on the detection information of each of the motion sensors 31a to 31f, and detects each of the motion sensors 32a to 32f. Based on the information, it generates second body motion data that is a digital representation of the position and orientation of each part of the body of actor A2. In this specification, the first body motion data and the second body motion data may be simply referred to as “body motion data”. The body motion data is generated as needed with the passage of time. For example, the body motion data may be generated at predetermined sampling time intervals. As described above, the body motion data can represent the body movements of the actors A1 and A2 in a time-series manner as digital data. In the illustrated embodiment, the motion sensors 31a to 31f and the motion sensors 32a to 32f are mounted on the left and right limbs, the waist, and the head of each of the actors A1 and A2. Based on the detection information of the motion sensors 32a to 32f, it is possible to digitally represent the position and orientation of the entire body of the actor A1 and the actor A2 with time. The body motion data can define, for example, a position and a rotation angle of a bone constituting the rig data included in the model data 23a.

  The face motion data generation unit 21b generates first face motion data, which is a digital representation of the movement of the face of the actor A1, based on the imaging data of the camera 37a, and based on the imaging data of each of the cameras 38a, Generate second face motion data that is a digital representation of the face movement of actor A2. In the present specification, the first face motion data and the second face motion data may be collectively simply referred to as “face motion data”. The face motion data is generated as needed with the passage of time. For example, face motion data may be generated at predetermined sampling time intervals. In this manner, the face motion data can digitally represent the actor A2 and the movement of the face of the actor A2 (change in facial expression) in a time-series manner.

  The animation generation unit 21c applies the body motion data generated by the body motion data generation unit 21a and the face motion data generated by the face motion data generation unit 21b to predetermined model data included in the model data 23a. Is configured to generate an animation of a character object that moves in a virtual space and changes its expression. Specifically, the animation generation unit 21c generates an animation of a character object that moves in synchronization with the movement of the body and expression of the actor A1, based on the first body motion data and the first face motion data related to the actor A1, Based on the second body motion data and the second face motion data related to the actor A2, it is possible to generate an animation of the character object that moves in synchronization with the movement of the body and expression of the actor A2. In this specification, a character object generated based on the movement and expression of actor A1 is referred to as a “first character object”, and a character object generated based on the movement and expression of actor A2 is referred to as a “second character object”. "

  The moving image generation unit 21d constructs a virtual space using the object data 23b, and generates the virtual space, the animation of the first character object corresponding to the actor A1, and the animation of the second character object corresponding to the actor A2. Generate a video that includes The first character object is arranged in the virtual space so as to match the position of the actor A1 with respect to the tracking sensor 36a, and the second character object is arranged in the virtual space so as to match the position of the actor A2 with respect to the tracking sensor 36a. Is done. Therefore, by changing the position or the direction of the tracking sensor 36a, the position and the direction of the first character object and the second character object in the virtual space can be changed.

  In one aspect, the moving image generation unit 21d constructs a virtual space based on tracking information of the tracking sensor 36a. For example, the moving image generation unit 21d determines setting information (a position in a virtual space, a gaze position, a gaze direction, and an angle of view) of a virtual camera based on tracking information of the tracking sensor 36a, and based on the setting information of the virtual camera. To define a drawing area in the entire virtual space, and generate moving image information for displaying the drawing area in the virtual space.

  The moving image generation unit 21d replaces the tracking information of the tracking sensor 36a, or in addition to the tracking information of the tracking sensor 36a, based on the tracking information of the tracking sensor 36b, based on the tracking information of the tracking sensor 36b. It may be configured to determine the position and orientation of the object and the setting information of the virtual camera.

  The moving image generation unit 21d can synthesize the generated moving image with the sounds of the actors A1 and A2 acquired from the microphone of the studio unit 30.

  As described above, the moving image generation unit 21d performs the animation of the first character object that moves in synchronization with the movement of the body and expression of the actor A1, and the second character that moves in synchronization with the movement of the body and expression of the actor A2 An animation of the object is generated, and a moving image for distribution in which the sounds of the actors A1 and A2 are synthesized with the animation can be generated.

  The moving image distribution unit 21e distributes the moving image generated by the moving image generation unit 21d. This moving image is distributed to the client devices 10a to 10c and the other client devices via the network 50. The received moving image is reproduced in the client devices 10a to 10c.

  This moving image may be distributed to a client device (not shown) installed in the studio room R, and may be projected from the client device to the screen S via the short focus projector. This moving image may be distributed to the supporter computer 40. Thereby, the supporters B1 and B2 can check the viewing screen of the distributed moving image.

  FIG. 5 shows a display example of a moving image distributed from the server device 20 to the client device 10a and reproduced on the client device 10a. As illustrated, the display image 70 of the moving image distributed from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes a character object 71A corresponding to the actor A1, a character object 71B corresponding to the actor A2, and an object 72 indicating a table in the virtual space. I have. The object 72 is not a gift object but one of the objects for constructing the virtual space included in the object data 23b. The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The motion of the character object 71A is controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. The motion of the character object 71B is controlled based on the second body motion data and the second face motion data. Therefore, the character object 71A is controlled to move on the screen in synchronization with the movement of the body and expression of the actor A1, and the character object 71B moves on the screen in synchronization with the movement of the body and expression of the actor A2. Is controlled.

  As described above, the distribution moving image from the server device 20 may be distributed to the supporter computer 40. The moving image distributed to the supporter computer 40 is displayed on the supporter computer 40 in the same manner as in FIG. The supporter B1 and the supporter B2 can change the settings of the components of the studio unit 30 while watching the moving image being reproduced on the supporter computer 40. In one aspect, when the supporter B1 and the supporter B2 want to change the angle of the character object 71A and the character object 71B in the moving image being distributed, the supporter computer 40 sends an instruction signal for instructing a change in the direction of the tracking sensor 36a from the supporter computer 40. It can be transmitted to the sensor 36a. The direction of the tracking sensor 36a can be changed according to the instruction signal. For example, the tracking sensor 36a is rotatably attached to the stand via a rotation mechanism having a built-in actuator around its axis, and when the tracking sensor 36a receives an instruction signal for instructing a change in its direction, the tracking sensor 36a receives the instruction signal. The actuator of the rotation mechanism may be driven based on the instruction signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one embodiment, the supporter B1 and the supporter B2 transmit an instruction to use the tracking information from the tracking sensor 36b instead of the tracking information from the tracking sensor 36a from the supporter computer 40 to the tracking sensor 36a and the tracking sensor 36b. Is also good.

  In one embodiment, when the supporter B1 and the supporter B2 determine that an instruction to the actor A1 or the actor A2 is necessary by watching the moving image being played on the supporter computer 40, the supporter computer 40 sends a message indicating the instruction to the supporter computer 40. The message can be input and output to the display 39. For example, the supporters B1 and B2 can instruct the actor A1 or the actor A2 to change the standing position through the message displayed on the display 39.

  The display request processing unit 21f receives a display request for a gift object from the client device of the viewing user, and performs processing according to the display request. Each viewing user can transmit a gift object display request to the server device 20 by operating his / her client device. For example, the first viewing user can transmit a gift object display request to the server device 20 by operating the client device 10a. The display request for the gift object may include the user ID of the viewing user and identification information (object ID) for specifying the object for which display is requested.

  As described above, the gift object may include an effect object, a normal object, and a decoration object. The effect object and the normal object are examples of the first object. A display request for requesting display of an effect object or a normal object is an example of a second display request.

  In one aspect, when a display request processing unit 21f receives a display request of a specific effect object from a viewing user, the display request processing unit 21f causes the display image 70 of the moving image to display the effect object requested to be displayed based on the display request. Perform processing. For example, when a display request for an effect object corresponding to confetti is made, the display request processing unit 21f displays an effect object 73 indicating confetti based on the display request as shown in FIG. To be displayed.

  In one embodiment, when a display request processing unit 21f receives a display request for a specific normal object from a viewing user, the display request processing unit 21f performs a process for displaying the requested normal object on the moving image 70 based on the display request. . For example, when a display request for a normal object indicating a stuffed bear is made, the display request processing unit 21f displays a normal object 74 indicating a stuffed bear based on the display request as shown in FIG. 70 is displayed.

  The display request for the normal object 74 may include a display position specification parameter for specifying the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at a position designated by the display position designation parameter in the virtual space. For example, the display position of the normal object 74 can be specified on the object 72 indicating the table by the display position specification parameter. The viewing user uses the display position specification parameter to specify the position where the normal object is desired to be displayed by viewing the display of the character object 71A, the character object 71B, the gift object, and other objects included in the moving image 70. can do.

  In one aspect, the normal object 74 may be displayed so as to move within the moving image display image 70. For example, the normal object 74 may be displayed so as to fall from the top of the screen to the bottom. In this case, the normal object 74 may be displayed in the display image 70 while falling from the start of the fall to the floor of the virtual space constituting the moving image 70, and may disappear from the display image 70 after dropping on the floor. . The viewing user can see the falling normal object 74 from the start of the fall to the end of the fall. The moving direction of the normal object 74 in the screen can be set arbitrarily. For example, the normal object 74 may be displayed in the display image 70 so as to move from the left to the right, the right to the left, the upper left to the lower left, or the other direction of the moving image 70. The normal object 74 can move on various trajectories. For example, the normal object 74 can move on a linear trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or other trajectories. The viewing user specifies the moving direction parameter for specifying the moving direction of the normal object 74 and the trajectory on which the normal object 74 moves in the display request of the normal object in addition to or instead of the display position specifying parameter. At least one of the trajectory parameters can be included. In one embodiment, among the effect objects and the normal objects, objects whose size in the virtual space is smaller than the reference size (for example, a confetti sheet of the effect object 73) are assigned to the character objects 71A and 71B. Some or all of them may be displayed overlapping. In one embodiment, among the effect objects and the normal objects, those whose size in the virtual space is larger than the reference size (for example, the normal object 74 (a stuffed bear)) are displayed at positions that do not overlap with the character objects. . In one embodiment, of the effect object and the normal object, the one in which the size in the virtual space is larger than the reference size (for example, the normal object 74 (a stuffed bear)) is at least one of the character object 71A and the character object 71B. If the character object overlaps with the character object, the character object is displayed after the character object that is overlapped and displayed.

  In one aspect, when receiving a display request for a specific decorative object from a viewing user, the display request processing unit 21f adds the decorative object requested to be displayed to the candidate list 23d based on the display request. The display request of the decoration object is an example of the first display request. For example, the display request processing unit 21f stores identification information (object ID) for identifying a specific decorative object requested to be displayed by the viewing user in the candidate list 23d in association with the user ID of the viewing user. (See FIG. 4). When a plurality of decoration object display requests are made, for each of the plurality of display requests, the user ID of the viewing user who made the display request, the decoration object ID of the decoration object requested to be displayed by the viewing user, and Are stored in the candidate list 23d in association with each other.

  In one aspect, in response to selection of one or more of the decorative objects included in the candidate list 23d, the decorative object selecting unit 21g displays the selected decorative object on the moving image display image 70. Perform a process for causing In this specification, the decoration object selected from the candidate list 23d may be referred to as a “selected decoration object”.

  The selection of the decorative object from the candidate list 23d is performed, for example, by the supporter B1 and the supporter B2 operating the supporter computer 40. In one aspect, the supporter computer 40 displays a decorative object selection screen. FIG. 8 shows an example of a decorative object selection screen 80 according to one embodiment. This decorative object selection screen 80 is displayed on the display of the supporter computer 40, for example. The decoration object selection screen 80 displays each of the plurality of decoration objects included in the candidate list 23d in a table format, for example. As shown in the figure, the decorative object selection screen 80 according to one embodiment includes a first column 81 displaying the type of the decorative object, a second column 82 displaying the image of the decorative object, and a character object associated with the decorative object. And a third column 83 for displaying the part. Further, on the decoration object selection screen 80, selection buttons 84a to 84c for selecting each decoration object are displayed. In this manner, on the decoration object selection screen 80, decoration objects that are candidates for the selected decoration object are displayed.

  The supporters B1 and B2 can select one or more of the decorative objects included in the decorative object selection screen 80. For example, the supporters B1 and B2 can select a headband by selecting the selection button 84a. When the decoration object selection unit 21g detects that a headband has been selected, the display request processing unit 21f displays a selected decoration object 75 indicating the selected headband on the moving image display screen 70, as shown in FIG. Let it. The selected decoration object 75 is displayed on the display image 70 in association with a specific part of the character object. The selected decoration object 75 may be displayed so as to be in contact with the specific part of the character object. For example, since the selection / selection decoration object 75 indicating the headband is associated with the head of the character object, it is mounted on the head of the character object 71A as shown in FIG. The decorative object may be displayed on the display screen 70 so as to move in accordance with the movement of the specific part of the character object. For example, when the head of the character object 71A wearing the headband moves, as if the headband is mounted on the head of the character object 71A, the selected decorative object 75 indicating the headband also accompanies the head of the character object 71A. Move.

  As described above, the object data 23b may include mounting position information indicating which part of the character object is associated with the decorative object. In one aspect, the decoration object selection unit 21g is a decoration to be mounted on a part of the decoration objects included in the candidate list 23d that overlaps with the part indicated by the mounting position information of the decoration object already mounted on the character object. The object may not be selected as the selected decorative object 75. For example, since the headband associated with "head rear left" and "head rear right" and the hair accessory associated with "head rear left" overlap "head rear left", It cannot be installed at the same time. On the other hand, the headband associated with the “head rear left” and “head rear right”, and the earring associated with “the left ear (of the head)” and the “right ear (of the head)” Since specific parts in the character object do not overlap, they can be mounted simultaneously.

  The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71B instead of the character object 71A. The selected decoration object 75 may be displayed on the display screen 70 in association with the character objects 71A and 71B.

  In one embodiment, the decoration object selection screen 80 may be configured so as not to include information that can specify a user who holds each decoration object or a user who has requested display of each decoration object. This can prevent the selector from giving preferential treatment to a specific user when selecting the decorative object.

  In one embodiment, the decoration object selection screen 80 may display information about the user who owns each decoration object or, for each decoration object, the user who has made a display request for the decoration object. For example, for each decoration object, the number of times that the user who has requested the display of the decoration object has made the display request of the decoration object and the number of times that the user has made the selection request (for example, five times the display request of the decoration object has been made so far) Information indicating that the user has selected two times), the number of times the user has viewed at least one of the moving images of the character object 71A and the character object B, and the moving image (the character object 71A and the character (Regardless of the appearance of the object B), the number of purchases of the gift object by the user, the number of purchases of the object by the user, points available in the video distribution system 1 owned by the user, video distribution of the user system At level, and it may display various information about the user who made the request for display of the ornamental objects other than these. According to this embodiment, it is possible to select a decoration object based on the behavior and viewing history of the user who has made the display request of the decoration object in the moving image distribution system 1 so far.

In one embodiment, the display of the decorative object may be subject to constraints to eliminate duplication. For example, when a decorative object associated with the specific part is already selected with respect to the character object 71A, selection of another decorative object associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, when the headband associated with the “head” of the character object 71B has already been selected, the other decorations associated with the “head” An object (for example, a decoration object representing a "hat" associated with the head) is not displayed on the decoration object selection screen 80, or a selection button for selecting a decoration object representing the hat is displayed on the selection screen 80. May not be selectable. According to this embodiment, it is possible to prevent the decorative object from being displayed repeatedly on a specific part of the character object.

  The decorative object selection screen 80 may be displayed on another device instead of the supporter computer 40 or in addition to the supporter computer 40. For example, the decorative object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actor A1 and the actor A2 can select a desired decorative object based on the decorative object selection screen 80 displayed on the display 39 or the screen S. The selection of the decoration object by the actor A1 and the actor A2 can be performed by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b, for example.

  In one embodiment, the object purchase processing unit 21h, in response to a request from a user viewing the moving image, transmits purchase information of each of a plurality of gift objects that can be purchased in connection with the moving image to a client device of the viewing user (for example, To the client device 10a). The purchase information of each gift object includes the type of the gift object (effect object, normal object, or decoration object), the image of the gift object, the price of the gift object, and information necessary for purchasing other gift objects. May be included. The viewing user can select a gift object to be purchased based on the gift object purchase information displayed on the client device 10a. The selection of the gift object to be purchased may be performed by operating the client device 10a. When a gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 20. The object purchase processing unit 21h performs a payment process based on the purchase request. When the payment process is completed, the purchased gift object is held by the viewing user. In this case, the object ID of the purchased gift object is stored in the holding list 23c in association with the user ID of the purchased viewing user.

  The gift objects that can be purchased may be different for each moving image. The purchasable gift object may be purchasable in a plurality of videos. That is, the purchasable gift objects may include a unique gift object peculiar to each moving image and a common gift object purchasable in a plurality of moving images. For example, the effect object indicating confetti may be a common gift object that can be purchased in a plurality of moving images.

  In one aspect, when an effect object is purchased while viewing a predetermined moving image, the effect object to be purchased is added to the watching moving image in response to completion of the payment processing for purchasing the effect object. It may be displayed automatically. When a normal object is purchased while watching a predetermined moving image, similarly to the above, in response to completion of the payment processing for purchasing the normal object, the normal gift object to be purchased is changed to the moving image being viewed. May be displayed automatically.

  In another aspect, in response to the completion of the payment processing in the object purchase processing unit 21h for the effect object to be purchased, a payment completion notification is transmitted to the client device 10a, and the purchased effect object is transmitted to the client device 10a. A confirmation screen for confirming to the viewing user whether or not to make a display request of the above may be displayed. If the viewing user has selected to make a display request for the purchased effect object, a display request for displaying the purchased effect object is sent from the client device of the viewing user to the display request processing unit 21f. And the display request processing unit 21f may perform a process of displaying the effect object to be purchased on the moving image 70. Even when the purchase target is a normal object, a confirmation screen for confirming to the viewing user whether or not a display request for the purchased normal object is to be made may be displayed on the client device 10a.

  Next, a moving image distribution process according to one embodiment will be described with reference to FIGS. FIG. 9 is a flowchart illustrating a flow of a moving image distribution process according to an embodiment. FIG. 10 is a flowchart illustrating a process flow of displaying a normal object according to the embodiment. FIG. 7 is a flowchart showing a flow of a process of displaying a decoration object in FIG. In the moving image distribution process, it is assumed that actors A1 and A2 are performing in the studio R.

  First, in step S11, body motion data that is a digital representation of the body movements of the actors A1 and A2 and face motion data that is a digital representation of the face movements (expressions) of the actors A1 and A2 are generated. You. The generation of the body motion data is performed, for example, by the above-described body motion data generation unit 21a, and the generation of the face motion data is performed, for example, by the above-described face motion data generation unit 21b.

  Next, in step S12, by applying the body motion data and the face motion data of the actor A1 to the model data for the actor A1, the animation of the first character object that moves in synchronization with the movement of the body and expression of the actor A1 Is generated. Similarly, by applying the body motion data and the face motion data of the actor A2 to the model data for the actor A2, an animation of the second character object that moves in synchronization with the movement of the body and expression of the actor A2 is generated. . The generation of the animation is performed by, for example, the above-described animation generation unit 21c.

  Next, in step S13, a moving image including the animation of the first character object corresponding to the actor A1 and the animation of the second character object corresponding to the actor A2 is generated. The voice of actor A1 and actor A2 may be synthesized with this moving image. The animation of the first character object and the animation of the second character object may be arranged in a virtual space. The generation of the moving image is performed by, for example, the moving image generation unit 21d.

  Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the client devices 10a to 10c and the other client devices via the network 50. This moving image may be distributed to the supporter computer 40 and projected on the screen S in the studio room R. The moving image is continuously distributed over a predetermined distribution period. The distribution period of the moving image may be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other time.

  Next, the process proceeds to step S15, and it is determined whether or not a termination condition for terminating the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the supporter computer 40 has given an instruction to end the distribution, or other conditions. If the end condition is not satisfied, the processing of steps S11 to S14 is repeatedly executed, and the distribution of the moving image including the animation synchronized with the movement of the actors A1 and A2 is continued. If it is determined that the end condition is satisfied for the moving image, the distribution process of the moving image ends.

  Next, display processing of a normal object performed during distribution of a moving image will be described with reference to FIG. The normal object display process is performed in parallel with the moving image distribution process shown in FIG.

  During the distribution of the moving image, it is determined in step S21 whether or not a display request for a normal object has been made. For example, the first viewing user selects one or a plurality of specific normal objects from the normal objects held by the user, and issues a display request for displaying the selected normal object from the client device 10a to the server device 20. Can be sent to As described above, a display request for the predetermined normal object may be generated in response to the purchase processing or the settlement processing of the predetermined normal object being performed.

  If a display request for a normal object has been made, the display processing proceeds to step S22. In step S22, based on the display request, a process for displaying the normal object requested to be displayed on the moving image being distributed is performed. For example, when a display request for the normal object 74 is made during distribution of a predetermined moving image, as shown in FIG. 6, the requested normal object 74 is displayed on the display screen 70 of the moving image. .

  If the normal object display request has not been made, the normal object display processing ends. The display processing of the normal object shown in FIG. 10 is repeatedly performed during the moving image distribution period.

  The display processing of the effect object can be performed in the same procedure as the display processing of the normal object described above. For example, when a display request for the effect object 73 is made during distribution of a predetermined moving image, as shown in FIG. 6, the effect object 73 for which the display request has been made is displayed on the display screen 70 of the moving image. . The effect object 73 shown in FIG. 6 is an object imitating confetti. The effect object 73 imitating confetti is displayed so as to overlap (or touch) the character objects 71A and 71B, but is not associated with a specific part of the character objects 71A and 71B. Differs from decorative objects in that

  Next, a display process of a decorative object performed during distribution of a moving image will be described with reference to FIG. 11. The display processing of the decorative object is performed in parallel with the moving image distribution processing shown in FIG. Further, the display processing of the decoration object may be performed in parallel with the display processing of the normal object shown in FIG.

  During the distribution of the moving image, in step S31, it is determined whether a display request for a decorative object has been made. For example, the first viewing user selects a first decoration object from his or her own decoration object, and transmits a display request for displaying the selected first decoration object from the client device 10a to the server device 20. can do.

  If the display request for the first decoration object has been made, the display processing proceeds to step S32. In step S32, the first decoration object requested to be displayed is added to the candidate list based on the display request. The candidate list is a list of objects that are candidates for decorative objects displayed in the moving image being distributed, and is, for example, the candidate list 23d described above.

  Next, in step S33, it is determined whether a specific decoration object has been selected from the decoration objects stored in the candidate list.

  If a specific decoration object is selected, in step S34, the selected specific decoration object (“selected decoration object”) is deleted from the candidate list, and the selected decoration object is displayed on the display screen of the moving image being distributed. Processing for displaying the object is performed. For example, when a decoration object 75 is selected from the candidate list during distribution of the moving image 70 shown in FIG. 5, the selected decoration object 75 is displayed in the display image 70 as shown in FIG. Is displayed. The first decoration object for which the display request has been made in step S31 is displayed on the display image 70 if selected from the candidate list during distribution of the moving image, but is not displayed on the display image 70 if not selected.

  If no decorative object is selected from the candidate list in step S33, and if the display processing of the selected decorative object is completed in step S34, the display processing of the decorative object proceeds to step S35. In step S35, it is determined whether the distribution of the moving image being distributed has been completed. In step S35, for example, the determination may be made based on the same reference as in step S15. If it is determined in step S35 that the distribution has not been completed, the display processing of the decorative object returns to step S31, and the processing of steps S31 to S35 is repeatedly executed. If it is determined that the distribution has been completed, the display processing of the decorative object proceeds to step S36.

  In step S36, processing is performed on the decoration objects (which may be referred to as “non-selected objects” in the present specification) remaining in the candidate list at the end of moving image distribution. In this specification, the processing performed in step S36 may be referred to as non-selected object processing.

  The non-selected object is purchased by the viewing user, and has been requested to be displayed during distribution of the moving image. For this reason, the non-selected object process executed in step S36 may be a process of refunding the purchase cost of the non-selected object to the viewing user who has requested the display of the non-selected object. In another aspect, the non-selected object process may be a process for canceling a payment process for purchasing a non-selected object. In another aspect, the non-selected object process may be a process of giving a decorative object different from the non-selected object to the viewing user who has made the display request of the non-selected object.

  In another aspect, the non-selected object process may be a process of giving points that can be used in the video distribution system 1 to the user of the non-selected object, instead of refunding the purchase cost or canceling the payment process. The moving image distribution system 1 may be configured to consume points for viewing moving images. The points given to the user of the non-selected object by the non-selected object processing may be points that can be used for viewing a moving image in the moving image distribution system 1.

  In another aspect, the non-selected object process may be a process of adding the non-selected object to the holding list as an object held by the first viewing user. Thereby, the first viewing user can receive the returned non-selected object.

  In another aspect, the non-selected object process may be a process for holding a candidate list at the end of moving image distribution until the same distributor next distributes the moving image. Thereby, the distributor can take over the candidate list used at the time of the previous video distribution at the time of the next video distribution. The inherited candidate list includes decoration objects (that is, non-selected objects) that were requested to be displayed at the time of the previous moving image distribution but were not actually displayed in the moving image. Thereby, the next video distribution is performed using the candidate list including the non-selected object at the time of the previous video distribution. The non-selected object may be selected in the next moving image distribution and displayed in the moving image.

  After the processing in step S36 is completed, the display processing of the decoration object ends.

  In one embodiment, an object display prohibition section in which display of a gift object is prohibited may be provided in the moving image distribution. FIG. 12 is a diagram schematically illustrating an object display prohibited section. FIG. 12 shows that a moving image is distributed between time t1 and time t2. That is, the time t1 is the distribution start time of the moving image, and the time t2 is the distribution end time of the moving image. In the moving image distribution period, an object display prohibition period 81 is between time t3 and time t4. Even if the display request r1 of the gift object is made during the object display prohibition period 81, the gift object is not displayed in the display image of the moving image during the object display prohibition period 81. Specifically, when a display request for an effect object or a normal object among the gift objects is made in the object display prohibition period 81, the effect object or the normal object whose display is requested is being distributed in the object display prohibition period 81. Is not displayed on the moving image, and is displayed on the moving image at a point in time after the elapse of the object display prohibition period 81 (that is, after time t4). Further, when a decoration object is selected from the candidate list in the object display prohibition period 81, the selected decoration object is not displayed in the moving image being distributed in the object display prohibition period 81, and is not displayed in the object display prohibition period 81. Is displayed on the moving image at the point in time after the elapse of. The display request of the decoration object may be received within the object display prohibition period 81. That is, when a display request for a decoration object is made during the object display prohibition period 81, the decoration object for which the display request has been made may be added to the candidate list even within the object display prohibition period 81.

  According to the embodiment, the gift object includes three types of the decoration object, the normal object, and the effect object. Among them, only the decoration object is displayed in association with the character object. In a moving image in which an animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the attention of the viewing user. For example, in the moving images shown in FIGS. 5 to 7, it is considered that attention is focused on the character object 71A and the character object 71B. In the above embodiment, even if there is a display request for a decoration object displayed in association with the character object 71A and the character object 71B, the decoration object is displayed on the moving image until the decoration object is selected from the candidate list 23d. By not doing so, it is possible to prevent the decoration object from being displayed cluttered around the character object or overlapping the character object. This can prevent the viewing experience of the viewing user from deteriorating.

  In a conventional moving image distribution system, a gift object is displayed on a moving image in response to a display request for the moving image, regardless of its type. Therefore, if overlapping display of a gift object on a moving image is permitted, a large amount of gift objects will be displayed on the moving image, and the viewing experience of a user who views the moving image will be degraded. In the above embodiment, by providing the gift object with the category of the decoration object displayed in association with the character object, the display number (display amount) of the decoration object displayed in association with the character object which is a main part of the moving image is displayed. Can be suppressed.

  The normal object 74 of the gift objects is displayed on the moving image in response to a display request from the viewing user. In the above embodiment, the normal object 74 is displayed on the moving image display screen 70 so as not to touch or overlap with the character objects 71A and 71B. The effect on sex is small. According to this aspect, it is possible to prevent the viewing experience of the user from deteriorating due to the deterioration of the visibility of the character object.

  The effect object 73 and the normal object 74 among the gift objects are displayed on the moving image in response to a display request from the viewing user. In the above-described embodiment, the effect object 73 and the normal object 74 are displayed on the display screen 70 for a shorter time than the decorative object 75, so that the effect on the visibility of the character objects 71A and 71B is small. According to this aspect, it is possible to prevent the viewing experience of the user from deteriorating due to the deterioration of the visibility of the character object.

  In the above embodiment, the selection of the decoration object from the candidate list 23d is performed by a person (for example, the supporter B1, the supporter B2, the actor A1, or the actor A2) who is not the viewing user who has requested the display of the decoration object. Thus, the number of displayed decorative objects can be reduced.

  According to the above embodiment, in the object display prohibition period 81, the gift object is not displayed on the moving image. Thereby, the created moving image is viewed without being disturbed by the gift object. For example, by setting the time period during which the actor A1 and the actor A2 show a visual performance in a moving image to the object display inhibition period 81, the performance by the actor can be shown to the viewer without being disturbed by the first object and the decorative object. Can be.

  According to the above embodiment, it is considered that a viewing user who watches a moving image including a character object such as the character object 71A or the character object 71B has an attachment to the character object. Therefore, satisfaction is increased by having the character object attached to the decoration object rather than the effect object or the normal object. As described above, the decoration object to which the character object can be attached can provide the user with an incentive to repeatedly view a moving image including the character object.

  In the moving image distribution system 1 according to the above embodiment, the user can give a decoration object to the character. This makes it possible to provide a system with high uniqueness as compared with a system that cannot give such a decorative object, and to provide a service with high uniqueness by the system. As a result, more users can be attracted to the moving image distribution system 1, so that the number of times of viewing the moving images in the moving image distribution system 1 can be increased.

  Embodiments of the present invention are not limited to the above-described embodiments, and various changes can be made without departing from the spirit of the present invention. For example, a moving image to be distributed may be captured and generated outside of the studio room R. For example, shooting for generating a moving image to be distributed may be performed at the actor's or supporter's home.

  In the processing procedure described in this specification, in particular, in the processing procedure described using a flowchart, some of the steps (steps) configuring the processing procedure are omitted, and the steps configuring the processing procedure are omitted. Unspecified steps can be added and / or the order of the steps can be changed. The processing procedures in which such omissions, additions, and changes in order are made do not depart from the spirit of the present invention. Included in the scope of the invention.

Hereinafter, the inventions described in the claims at the time of filing the original application of the present application are additionally described.
[1]
A moving image distribution system that distributes a moving image including a character object animation and a gift object generated based on a movement of an actor,
Comprising one or more computer processors,
The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object.
The one or more computer processors execute computer-readable instructions,
Displaying the decorative object on the moving image based on a first display request from a viewing user viewing the moving image;
Displaying the first object in the moving image based on a second display request from the viewing user;
Video distribution system.
[2]
The first object is a normal object displayed on the moving image so as not to contact the character object.
The moving image distribution system according to [1].
[3]
While the decorative object is displayed in the moving image in association with a specific part of the character object, the first object is not associated with a specific part of the character object.
The moving image distribution system according to [1] or [2].
[4]
While the decoration object is displayed in association with the character object in accordance with the motion of the character object, the first object is displayed at a designated display position.
The moving image distribution system according to [1] or [2].
[5]
The decoration object is displayed in the moving image when the decoration object is selected by a user other than the viewing user.
The moving image distribution system according to any one of [1] to [4].
[6]
The selection of the decorative object is made by a supporter supporting distribution of the moving image.
The moving image distribution system according to [5].
[7]
The selection of the decorative object is made by the actor;
The moving image distribution system according to [5].
[8]
The second display request includes a display position specification parameter that specifies a display position of the first object,
The first object is displayed in the moving image at a position designated by the display position designation parameter.
The moving image distribution system according to any one of [1] to [7].
[9]
The second display request includes a moving direction parameter that specifies a moving direction of the first object,
The first object is displayed in the moving image so as to move in a direction specified by the moving direction parameter.
The moving image distribution system according to any one of [1] to [8].
[10]
The second display request includes a trajectory parameter specifying a trajectory of the first object,
The first object is displayed so as to move on a trajectory specified by the trajectory parameter in the moving image.
The moving image distribution system according to any one of [1] to [9].
[11]
An object display prohibition period is set within the distribution period of the video,
The first object and the decoration object are displayed on the moving image at a timing other than the object display prohibition period in the moving image distribution period,
The moving image distribution system according to any one of [1] to [10].
[12]
When the second display request is received during the object display prohibition period, the first object is displayed on the moving image after the elapse of the object display prohibition period.
The moving image distribution system according to [11].
[13]
The one or more computer processors,
Receiving a purchase request to purchase the first object from the viewing user;
Perform payment processing in response to the purchase request,
If the first object has not been selected by the end of the distribution of the moving image, cancel the settlement process;
The moving image distribution system according to any one of [1] to [12].
[14]
The one or more computer processors,
Receiving a purchase request to purchase the first object from the viewing user;
Perform payment processing in response to the purchase request,
If the first object has not been selected by the end of the distribution of the moving image, points are given to the viewing user;
The moving image distribution system according to any one of [1] to [12].
[15]
The one or more computer processors,
Receiving a purchase request for purchasing a first decorative object from the viewing user;
Adding the first decorative object to a holding list that is a list of objects held by the viewing user in response to the purchase request;
In response to receiving the first display request for requesting the display of the first decorative object from the viewing user, adding the first decorative object to the candidate list and deleting the first decorative object from the holding list. Delete
Adding the first decoration object to the holding list when the first decoration object is not selected by the end of the distribution of the moving image;
The moving image distribution system according to any one of [1] to [12].
[16]
The one or more computer processors provide the viewing user with purchase information for purchasing a purchaseable gift object in connection with the video;
The gift object includes the decoration object and the first object,
The gift object includes a unique gift object that can be purchased only in the video, and a common gift object that can be purchased in a video other than the video.
The moving image distribution system according to any one of [1] to [14].
[17]
A moving image distribution method for distributing a moving image including an animation of a character object and a gift object generated based on a movement of an actor by executing computer-readable instructions by one or a plurality of computer processors,
The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object.
Displaying the decorative object in the moving image based on a first display request from a viewing user viewing the moving image;
Displaying the first object in the moving image based on a second display request from the viewing user;
A video distribution method comprising:
[18]
A moving image distribution program that distributes a moving image including a character object animation and a gift object generated based on a movement of an actor,
The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object.
To one or more computer processors,
Displaying the decorative object in the moving image based on a first display request from a viewing user viewing the moving image;
Displaying the first object in the moving image based on a second display request from the viewing user;
A video distribution program that runs

  1. Video distribution system

Claims (18)

A moving image distribution system that distributes a moving image including a character object animation and a gift object generated based on a movement of an actor,
Comprising one or more computer processors,
The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object.
The one or more computer processors execute computer-readable instructions,
Displaying the decorative object on the moving image based on a first display request from a viewing user viewing the moving image;
A moving image distribution system that displays the first object on the moving image based on a second display request from the viewing user. The first object is a normal object displayed on the moving image so as not to contact the character object.
The moving image distribution system according to claim 1. The decorative object is associated with a specific part of the character object and displayed in the moving image, while the first object is not associated with a specific part of the character object.
The moving image distribution system according to claim 1 or 2. The decoration object is associated with the character object and moved and displayed according to the motion of the character object, while the first object is displayed at a specified display position.
The moving image distribution system according to claim 1 or 2. The decoration object is displayed in the moving image when the decoration object is selected by a user other than the viewing user.
The moving image distribution system according to any one of claims 1 to 4. The selection of the decorative object is made by a supporter supporting distribution of the moving image.
The moving image distribution system according to claim 5. The selection of the decorative object is made by the actor;
The moving image distribution system according to claim 5. The second display request includes a display position specification parameter that specifies a display position of the first object,
The first object is displayed in the moving image at a position designated by the display position designation parameter.
The moving image distribution system according to any one of claims 1 to 7. The second display request includes a moving direction parameter that specifies a moving direction of the first object,
The first object is displayed in the moving image so as to move in a direction specified by the moving direction parameter.
The moving image distribution system according to any one of claims 1 to 8. The second display request includes a trajectory parameter specifying a trajectory of the first object,
The first object is displayed so as to move on a trajectory specified by the trajectory parameter in the moving image.
The moving image distribution system according to any one of claims 1 to 9. An object display prohibition period is set within the distribution period of the video,
The first object and the decoration object are displayed on the moving image at a timing other than the object display prohibition period in the moving image distribution period,
The moving image distribution system according to any one of claims 1 to 10. When the second display request is received during the object display prohibition period, the first object is displayed on the moving image after the elapse of the object display prohibition period.
The moving image distribution system according to claim 11. The one or more computer processors,
Receiving a purchase request to purchase the first object from the viewing user;
Perform payment processing in response to the purchase request,
If the first object has not been selected by the end of the distribution of the moving image, cancel the settlement process;
The moving image distribution system according to any one of claims 1 to 12. The one or more computer processors,
Receiving a purchase request to purchase the first object from the viewing user;
Perform payment processing in response to the purchase request,
If the first object has not been selected by the end of the distribution of the moving image, points are given to the viewing user;
The moving image distribution system according to any one of claims 1 to 12. The one or more computer processors,
Receiving a purchase request for purchasing a first decorative object from the viewing user;
Adding the first decorative object to a holding list that is a list of objects held by the viewing user in response to the purchase request;
In response to receiving the first display request requesting display of the first decorative object from the viewing user, adding the first decorative object to a candidate list and deleting the first decorative object from the holding list And
Adding the first decoration object to the holding list when the first decoration object is not selected by the end of the distribution of the moving image;
The moving image distribution system according to any one of claims 1 to 12. The one or more computer processors provide the viewing user with purchase information for purchasing a purchaseable gift object in connection with the video;
The gift object includes the decoration object and the first object,
The gift object includes a unique gift object that can be purchased only in the video, and a common gift object that can be purchased in a video other than the video.
The moving image distribution system according to any one of claims 1 to 14. A moving image distribution method for distributing a moving image including an animation of a character object and a gift object generated based on a movement of an actor by executing computer-readable instructions by one or a plurality of computer processors,
The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object.
Displaying the decorative object in the moving image based on a first display request from a viewing user viewing the moving image;
Displaying the first object in the moving image based on a second display request from the viewing user;
A video distribution method comprising: A moving image distribution program that distributes a moving image including a character object animation and a gift object generated based on a movement of an actor,
The gift object includes a decoration object displayed in the moving image in association with the character object, and a first object different from the decoration object.
To one or more computer processors,
Displaying the decorative object in the moving image based on a first display request from a viewing user viewing the moving image;
Displaying the first object in the moving image based on a second display request from the viewing user;
A video distribution program that runs

Images