JP2020091884A - Moving image distribution system, moving image distribution method, and moving image distribution program distributing moving image including animation of character object generated based on actor movement - Google Patents

Abstract

To provide a moving image distribution system, a moving image distribution method, and a moving image distribution program capable of displaying a gift object while duplicating with the moving image, without deteriorating viewing experience of a viewer user.SOLUTION: A moving image distribution system 1 includes one or more computer processors 21 and distributes a moving image including an animation of a character object generated based on actor movement. When an ornament object, for which a first display request is made by a viewer user viewing the moving image, is selected by a person other than the viewer user, the processors 21 cause the ornament object to appear in the moving image in relation to a part of the character object determined on the basis of loading positional information set in the ornament object, by executing a computer readable instruction.SELECTED DRAWING: Figure 1

Description

The disclosure in the present specification relates to a moving image distribution system, a moving image distribution method, and a moving image distribution program for distributing a moving image including an animation of a character object generated based on the movement of an actor.

2. Description of the Related Art Conventionally, a moving image distribution system that generates an animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object is known. Such a moving image distribution system is disclosed in, for example, Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1).

There is also known a content distribution system that displays a gift object corresponding to an item purchased by the viewing user on a display screen in response to a request from the viewing user who views the content. For example, in the moving image distribution system disclosed in Japanese Unexamined Patent Application Publication No. 2012-120098 (Patent Document 2), a viewing user purchases a gift item, and the purchased gift item is given to a performer (content distributor) as a gift. Can be provided as. According to the publication, it is desirable that the gift object is displayed in the background area of the distribution screen so as not to interfere with the moving image.

JP, 2005-184689, A JP 2012-120098 A

Displaying the gift object in duplicate with the moving image may lead to deterioration of the viewing experience of the viewing user. For example, if the main part of the video is hidden by the gift object, the viewer may feel that the viewing of the video is obstructed. In particular, when a large number of gift objects are displayed overlapping with the moving image, such a problem may be exacerbated. Therefore, in Patent Document 2, the gift object is not displayed in the content display area in which the moving image is displayed, but is displayed in the background area outside the content display area.

It is an object of the present disclosure to provide a technical improvement that solves or alleviates at least some of the above-mentioned problems of the prior art. One of the more specific objects of the present disclosure is to provide a video distribution system, a video distribution method, and a video distribution program that can display a gift object in duplicate with a video without deteriorating the viewing experience of the viewing user. is there.

A moving image distribution system according to one aspect is a moving image distribution system that distributes a moving image including an animation of a character object generated based on the movement of an actor, the system including one or more computer processors, and the one or more computer processors. Is set to the decoration object when the decoration object for which the first display request is made by the viewing user who views the video is selected by a user other than the viewing user by executing a computer-readable instruction. The decoration object is displayed in the moving image in association with the part of the character object determined based on the mounting position information.

In one aspect, selection of the decoration object is performed by a person other than the viewing user.

In one aspect, the selection of the decoration object is made by a supporter supporting the distribution of the moving image.

In one aspect, the selection of the decorative object is made by the actor.

In one aspect, the one or more computer processors display the moving image in response to receiving a second display request requesting display of a first object different from the decoration object from a viewing user who views the moving image. Display the first object.

In one aspect, the second display request includes a display position designation parameter that designates a display position of the first object, and the first object is designated by the display position designation parameter in the moving image. It is displayed in the right position.

In one aspect, a moving direction parameter that specifies a moving direction of the first object is included, and the first object is displayed in the moving image so as to move in a direction specified by the moving direction parameter. ..

In one aspect, the second display request includes a trajectory parameter designating a trajectory of the first object, and the first object moves on a trajectory designated by the trajectory parameter in the moving image. Will be displayed.

In one aspect, an object display prohibited period is set within a distribution period of the moving image, and the first object and the decoration object are displayed in the moving image at a timing other than the object display prohibited period in the distribution period of the moving image. ..

In one aspect, when the second display request is accepted during the object display prohibited period, the first object is displayed in the moving image after the object display prohibited period has elapsed.

In one aspect, the one or more computer processors accept a purchase request for purchasing the decoration object from the viewing user, perform payment processing in accordance with the purchase request, and until the decoration object finishes distribution of the moving image. If not selected, the payment process is canceled.

In one aspect, the one or more computer processors accept a purchase request for purchasing the decoration object from the viewing user, perform payment processing in accordance with the purchase request, and until the decoration object finishes distribution of the moving image. If not selected, points are given to the viewing user.

In one aspect, the one or more computer processors accept a purchase request from the viewing user to purchase the decoration object, and the decoration is added to a holding list that is a list of objects held by the viewing user in response to the purchase request. An object is added, the decoration object is deleted from the holding list in response to the first display request from the viewing user requesting the display of the decoration object, and the decoration object ends the distribution of the moving image. If the decoration object is not selected by the time, the decoration object is added to the holding list.

In one aspect, the one or more computer processors provide the viewing user with purchase information for purchasing gift objects that are purchasable in association with the video, the gift objects including the decoration objects. The gift object includes a unique gift object that can be purchased only in the moving image and a common gift object that can be purchased in moving images other than the moving image.

One aspect relates to a moving image distribution method in which one or more computer processors execute computer-readable instructions to distribute a moving image that includes an animation of a character object generated based on the movement of an actor. The moving image distribution method includes a step of receiving a first display request for requesting a display of a decoration object from a viewing user who views the moving image, and the decoration object when the decoration object is selected by a user other than the viewing user. And displaying the decorative object in the moving image in association with the part of the character object that is determined based on the mounting position information that is set to.

One aspect relates to a moving image distribution program that distributes a moving image including an animation of a character object generated based on a motion of an actor. The distribution program includes, in one or more computer processors, a step of receiving a first display request for requesting a display of a decoration object from a viewing user who views the moving image, and the decoration object is selected by a user other than the viewing user. In this case, the step of displaying the decorative object in the moving image in association with the part of the character object determined based on the mounting position information set for the decorative object is executed.

According to the embodiments of the present invention, a gift object can be displayed overlapping with a moving image without deteriorating the viewing experience of the viewing user.

FIG. 1 is a block diagram showing a moving image distribution system according to an embodiment. It is a schematic diagram which shows typically the equipment of the studio which produces the moving image delivered with the moving image delivery system of FIG. It is a figure explaining the possession list memorize|stored in the moving image distribution system of FIG. It is a figure explaining the candidate list memorize|stored in the moving image distribution system of FIG. It is a figure which shows the example of the moving image displayed on the client apparatus 10a in one Embodiment. FIG. 5 includes animation of a character object. It is a figure which shows the example of the moving image displayed on the client apparatus 10a in one Embodiment. FIG. 6 includes normal objects. It is a figure which shows the example of the moving image displayed on the client apparatus 10a in one Embodiment. FIG. 7 includes a decoration object. It is a schematic diagram which shows the example of the decoration object selection screen for selecting a desired selection decoration object from the decoration objects contained in a candidate list. It is a flow figure showing the flow of the animation distribution processing in one embodiment. It is a flow figure showing a flow of processing which displays a usual object in one embodiment. It is a flow figure showing a flow of processing which displays a decoration object in one embodiment. It is a figure for demonstrating the object display prohibition period set to the moving image delivered in the moving image delivery system of FIG.

Various embodiments of the present invention will be described below with reference to the drawings. The same or similar components are denoted by the same reference symbols in the drawings.

A moving image distribution system according to an embodiment will be described with reference to FIGS. 1 to 4. FIG. 1 is a block diagram showing a moving image distribution system 1 according to one embodiment, and FIG. 2 is a schematic diagram schematically showing equipment of a studio where a moving image distributed by the moving image distribution system 1 is produced. 3 and 4 are diagrams for explaining information stored in the moving image distribution system 1.

The moving image distribution system 1 includes client devices 10a to 10c, a server device 20, a studio unit 30, and a storage 60. The client devices 10a to 10c, the server device 20, and the storage 60 are communicably connected to each other via a network 50. The server device 20 is configured to deliver a moving image including a character animation, as described later. The characters included in this moving image may be motion-controlled in the virtual space.

This moving image can be distributed from the server device 20 to each of the client devices 10a to 10c. The first viewing user who is the user of the client device 10a, the second viewing user who is the user of the client device 10b, and the third viewing user who is the user of the client device 10c view the distributed video by each client device. be able to. The moving image distribution system 1 may include less than three client devices, and may include more than three client devices.

The client devices 10a to 10c are information processing devices such as smartphones. The client devices 10a to 10c may be mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and various types of information processing devices capable of reproducing moving images other than these, in addition to smartphones. Each of the client devices 10a to 10c includes a computer processor, a memory, a communication I/F, a display, a sensor unit including various sensors such as a gyro sensor, a sound collecting device such as a microphone, and a storage for storing various information. Good.

In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication I/F 22, and a storage 23.

The computer processor 21 is an arithmetic unit that loads an operating system and various programs that realize various functions from a storage 23 or another storage into a memory and executes an instruction included in the loaded program. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, MCU or the like. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a collection of a plurality of physically separate computer processors. In the present specification, the program described as being executed by the computer processor 21 or the instructions included in the program may be executed by a single computer processor, or may be executed by a plurality of computer processors in a distributed manner. Good. Further, the program executed by the computer processor 21 or the instruction included in the program may be executed by a plurality of virtual computer processors.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver or a PPP driver, or a combination thereof. The server device 20 can send and receive data to and from other devices via the communication I/F 22.

The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various storage devices other than the above capable of storing data. Various programs may be stored in the storage 23. At least a part of the programs and various data that can be stored in the storage 23 may be stored in a storage physically separate from the server device 20 (for example, the storage 60).

Many of the components of the studio unit 30 are arranged, for example, in the studio room R shown in FIG. As shown in the figure, in the studio room R, the actors A1 and A2 are performing. The studio unit 30 is configured to detect the movements and facial expressions of the actors A1 and A2 and output the detected information to the server device 20.

Both the actor A1 and the actor A2 are targets whose movements and facial expressions are captured by the below-described sensor group provided in the studio unit 30. The actors A1 and A2 are, for example, humans, animals, or moving objects performing a performance. The actors A1 and A2 may be, for example, robots capable of independent movement. The number of actors in the studio room R may be one, or may be three or more.

The studio unit 30 includes the six motion sensors 31a to 31f attached to the actor A1, the controller 33a held in the left hand of the actor A1, the controller 33b held in the right hand of the actor A1, and the attachment 37b. And a camera 37a attached to the head of the actor A1 through the camera. The studio unit 30 also includes six motion sensors 32a to 32f mounted on the actor A2, a controller 34a held by the left hand of the actor A2, a controller 34b held by the right hand of the actor A2, and a mounting tool 38b. And a camera 38a attached to the head of the actor A2 via the. A microphone for acquiring audio data may be attached to each of the wearing tools 37b and 38b. This microphone can acquire the utterances of the actors A1 and A2 as voice data. The microphone may be a wearable microphone that is mounted on the actor A1 and the actor A2 via the wearing tool 37b and the wearing tool 38b, and may be installed on the floor, wall, or ceiling of the studio room R. May be The studio unit 30 has a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39 in addition to the above components. A supporter computer 40 is installed in the next room, which is separated from the studio room R by a glass window. The server device 20 may be installed in the same room where the supporter computer 40 is installed.

The motion sensors 31a to 31f and the motion sensors 32a to 32f cooperate with the base station 35a and the base station 35b to detect their own positions and orientations. In one embodiment, base station 35a and base station 35b are multi-axis laser emitters. The base station 35a, for example, emits a flashing light for synchronization and then scans the laser light around, for example, a vertical axis. The base station 35b scans the laser light around a horizontal axis, for example. Each of the motion sensors 31a to 31f and the motion sensors 32a to 32f may include a plurality of optical sensors that detect the incidence of blinking light and laser light from the base station 35a and the base station 35b. The motion sensors 31a to 31f and the motion sensors 32a to 32f respectively have a time difference between an incident timing of blinking light and an incident timing of laser light, a light receiving time at each optical sensor, an incident angle of laser light detected by each optical sensor, and If necessary, the position and orientation of itself may be detected based on information other than these. The motion sensors 31a to 31f and the motion sensors 32a to 32f may be, for example, Vive Tracker provided by HTC CORPORATION. The base station 35a and the base station 35b may be base stations provided by HTC CORPORATION, for example.

The detection information indicating the position and orientation of each motion sensor calculated by each of the motion sensors 31a to 31f and the motion sensors 32a to 32f is transmitted to the server device 20. This detection information may be wirelessly transmitted to the server device 20 from each of the motion sensors 31a to 31f and the motion sensors 32a to 32f. Since the base station 35a and the base station 35b perform flashing light emission and laser light scanning at regular intervals, the detection information of each motion sensor is updated at each interval.

In the illustrated embodiment, the actor A1 is equipped with six motion sensors 31a to 31f. The motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are attached to the left wrist, right wrist, left instep, right instep, waist, and crown of the actor A1, respectively. The motion sensors 31a to 31f may be mounted on the actor A1 via a mounting tool. The actor A2 is equipped with six motion sensors 32a to 32f. The motion sensors 32a to 32f can be attached to the actor A2 at the same positions as the motion sensors 31a to 31f. The motion sensors 31a to 31f and the motion sensors 32a to 32f shown in FIG. 2 are examples. The motion sensors 31a to 31f can be attached to various parts of the actor A1, and the motion sensors 32a to 32f can be attached to various parts of the actor A2. The number of motion sensors attached to the actors A1 and A2 may be 5 or less, or 7 or more. In this way, the movements of the actors A1 and A2 are detected by detecting the positions and orientations of the motion sensors 31a to 31f and the motion sensors 32a to 32f attached to the respective parts of the bodies of the actors A1 and A2. be able to.

In one embodiment, a large number of infrared LEDs are mounted on each of the plurality of motion sensors mounted on the actor A1 and the actor A2, and the light from the infrared LEDs is provided on the floor or wall of the studio room R. The position and orientation of each motion sensor may be detected by detection with an infrared camera. A visible light LED may be used instead of the infrared LED, and light from the visible light LED may be detected by a visible light camera to detect each position and orientation of the motion sensor. As described above, each of the plurality of motion sensors mounted on the actor is provided with a light emitting unit (for example, an infrared LED or a visible light LED), and light from the light emitting unit is provided in the studio room R (a light receiving unit ( For example, the position and orientation of each motion sensor may be detected by detecting with an infrared camera or a visible light camera.

In one embodiment, a plurality of reflective markers can be used instead of the motion sensors 31a to 31f and the motion sensors 32a to 32f. The reflective marker is attached to each of the actor A1 and the actor A2 with an adhesive tape or the like. The positions and orientations of the reflective markers can be detected by imaging the actors A1 and A2 to which the reflective markers are attached in this way to generate imaging data, and subjecting the imaging data to image processing.

The controller 33a and the controller 33b output a control signal according to the operation of the actor A1 to the server device 20. Similarly, the controllers 34a and 34b output a control signal according to the operation of the actor A2 to the server device 20.

The tracking sensor 36a and the tracking sensor 36b generate tracking information for defining setting information of a virtual camera for constructing a virtual space included in a moving image. The tracking information of the tracking sensor 36a and the tracking sensor 36b is calculated as a position in each three-dimensional rectangular coordinate system and an angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to the operation of the operator. The tracking sensor 36 a transmits tracking information indicating the position and the orientation to the tracking information server device 20. Similarly, the position and orientation of the tracking sensor 36b are set according to the operation of the operator. The tracking sensor 36b transmits tracking information indicating its position and orientation to the tracking information server device 20.

The camera 37a is attached to the head of the actor A1 as described above. For example, the camera 37a is arranged so that the face of the actor A1 can be imaged. The camera 37a continuously images the face of the actor A1 and acquires the imaged data of the face of the actor A1. Similarly, the camera 38a is attached to the head of the actor A2. The camera 38a is arranged so as to be able to capture the face of the actor A2, continuously captures the face of the actor A2, and acquires the captured image data of the face of the actor A2. The camera 37a transmits the imaged data of the face of the actor A1 to the server device 20, and the camera 38a transmits the imaged data of the face of the actor A1 to the server device 20. The cameras 37a and 38a may be 3D cameras capable of detecting the depth of a person's face.

Display 39 is configured to display the information received from support computer 40. The information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other information. The display 39 is arranged at a position visible by the actors A1 and A2.

In the illustrated embodiment, the supporter computer 40 is installed in the room next to the studio room R. Since the room in which the supporter computer 40 is installed and the studio room R are separated from each other by the glass window, the operator of the supporter computer 40 (sometimes referred to as “supporter” in this specification) uses the actors A1 and A2. Can be seen. In the illustrated embodiment, a supporter B1 and a supporter B2 are present in the room as operators of the supporter computer 40.

The supporter computer 40 may be configured to be able to change the setting of the components of the studio unit 30 in accordance with the operation of the supporter B1 and the supporter B2. The supporter computer 40 can, for example, set the scanning interval by the base station 35a and the base station 35b, set the position or orientation of the tracking sensor 36a and the tracking sensor 36b, and change various settings of various devices other than these. .. At least one of the supporter B1 and the supporter B2 can input a message to the supporter computer 40 and display the input message on the display 39.

The components and functions of the studio unit 30 shown in FIG. 2 are exemplary. The studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector. The projector can project a moving image delivered to the client device 10a or another client device on the screen S.

Next, in one aspect, the information stored in the storage 23 will be described. In the illustrated embodiment, the storage 23 stores the model data 23a, the object data 23b, the possession list 23c, the candidate list 23d, and various information necessary for generating and distributing a distribution moving image other than the above.

The model data 23a is model data for generating a character animation. The model data 23a may be three-dimensional model data for generating a three-dimensional animation, or may be two-dimensional model data for generating a two-dimensional model data. The model data 23a includes, for example, rig data (also referred to as “skeleton data”) indicating the skeleton of the character, and surface data indicating the shape and texture of the surface of the character. The model data 23a can include a plurality of different model data. The plurality of model data may have different rig data, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data. In the illustrated embodiment, the model data 23a has at least two different types of model data in order to generate a character object corresponding to the actor A1 and a character object corresponding to the actor A2. The model data for the character object corresponding to the actor A1 and the model data for the character object corresponding to the actor A2 have, for example, the same rig data, but may have different surface data.

The object data 23b includes asset data for constructing a virtual space that constitutes a moving image. The object data 23b is data for drawing the background of the virtual space forming the moving image, data for drawing various objects displayed in the moving image, and for drawing various objects displayed in the moving image other than these. Contains data. The object data 23a may include object position information indicating the position of the object in the virtual space.

In addition to the above, the object data 23b may include a gift object displayed in a moving image based on a display request from a viewing user of the client devices 10a to 10c. The gift object may include an effect object, a normal object, and a decoration object. The viewing user can purchase the desired gift object.

The effect object is an object that affects the impression of the entire viewing screen of the distribution video, and is an object that imitates confetti, for example. The object imitating confetti may be displayed on the entire viewing screen, which can change the impression of the entire viewing screen before and after the display. The effect object may be displayed so as to overlap the character object, but is different from the decoration object in that the effect object is not displayed in association with a specific part of the character object.

The normal object is an object that is a digital gift from the viewing user to the actor (for example, the actor A1 or the actor A2), and is, for example, an object imitating a stuffed animal or a bouquet. In one aspect, the normal object is displayed on the display screen of the moving image so as not to contact the character object. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character object. The normal object may be displayed so as to overlap an object other than the character object in the virtual space. The normal object may be displayed so as to overlap the character object, but is different from the decoration object in that it is not displayed in association with a specific part of the character object. In one aspect, when the normal object is displayed overlapping with the character object, the normal object overlaps with a portion other than the head including the face of the character object, and does not overlap with the head of the character object. Is displayed.

The decoration object is an object displayed on the display screen in association with a specific part of the character object. In one aspect, the decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object. The specific part may be specified by the three-dimensional position information indicating the position in the three-dimensional coordinate space, or may be associated with the position information in the three-dimensional coordinate space. For example, in the head of the character, the specific parts are the front left side, front right side, rear left side, rear right side, center front side, center back side, left eye, right eye, left ear, right ear, and whole hair. May be set.

The decoration objects are, for example, accessories (headbands, necklaces, earrings, etc.) attached to character objects, clothes (T-shirts, etc.), costumes, and objects that can be attached to other character objects. The object data 23b corresponding to the decoration object may include mounting position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decoration object can indicate which part of the character object the decoration object is mounted. For example, when the decoration object is a headband, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “head” of the character object. When the mounting position information on which the decorative object is mounted is specified as the position in the three-dimensional coordinate space, the mounting position information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, the mounting position information indicating the position where the decorative object indicating the “headband” is mounted may be associated with two parts of the character object, namely, the “back side of the head” and the “right side of the head”. That is, the decorative object indicating the "headband" may be attached to both the "head rear left side" and the "head rear right side". When the decoration object is a T-shirt, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “body” of the character object.

A display time may be set for each gift object according to its type. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

The possession list 23c is a list showing the gift objects possessed by the user who views the moving image. An example of the holding list 23c is shown in FIG. As illustrated, the holding list 23c stores an object ID that identifies a gift object held by the viewing user in association with the viewing user account information (for example, the viewing user's user ID). The viewing users include, for example, first to third viewing users of the client device 10a to client device 10c.

The candidate list 23d is a list of decoration objects that the viewing user has requested to display. As described later, the viewing user who owns the decoration object can make a display request for the decoration object that he holds. In the candidate list 23d, the object ID for identifying the decoration object is stored in association with the account information of the viewing user who has issued the display request for the decoration object. The candidate list 23d may be created for each distributor. The candidate list 23d may be stored, for example, in association with distributor identification information that specifies a distributor (actor A1, actor A2, supporter B1, and/or supporter B2).

Next, the function realized by the computer processor 21 will be described more specifically. The computer processor 21 executes a computer-readable instruction included in the distribution program to generate a body motion data generation unit 21a, a face motion data generation unit 21b, an animation generation unit 21c, a moving image generation unit 21d, a moving image delivery unit 21e, It functions as a display request processing unit 21f, a decoration object selection unit 21g, and an object purchase processing unit 21h. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the moving image distribution system 1. At least a part of the functions implemented by the computer processor 21 may be implemented by a computer processor installed in the supporter computer 40, for example.

The body motion data generation unit 21a generates the first body motion data of each part of the body of the actor A1 based on the detection information of each of the motion sensors 31a to 31f, and also detects each of the motion sensors 32a to 32f. Based on the information, second body motion data, which is a digital representation of the position and orientation of each part of the body of actor A2, is generated. In this specification, the first body motion data and the second body motion data may be collectively referred to simply as “body motion data”. Body motion data is generated as needed over time. For example, the body motion data may be generated every predetermined sampling time interval. In this way, the body motion data can represent the body movements of the actors A1 and A2 in time series as digital data. In the illustrated embodiment, the motion sensors 31a to 31f and the motion sensors 32a to 32f are attached to the left and right limbs, the waist, and the head of each of the actors A1 and A2, and thus the motion sensors 31a to 31f and Based on the detection information of the motion sensors 32a to 32f, it is possible to digitally represent the positions and orientations of the actor A1 and the actor A2 substantially over the whole body with time. The body motion data can define, for example, the position and rotation angle of the bone that constitutes the rig data included in the model data 23a.

The face motion data generation unit 21b generates first face motion data, which is a digital expression of the movement of the face of the actor A1 based on the imaged data of the camera 37a, and based on the imaged data of each of the cameras 38a, Second face motion data, which is a digital representation of the movement of the face of actor A2, is generated. In this specification, the first face motion data and the second face motion data may be collectively referred to simply as “face motion data”. Face motion data is generated as needed over time. For example, the face motion data may be generated every predetermined sampling time interval. In this way, the face motion data can digitally represent the actor A2 and the movement of the face of the actor A2 (change in facial expression) in time series.

The animation generation unit 21c applies the body motion data generated by the body motion data generation unit 21a and the face motion data generated by the face motion data generation unit 21b to predetermined model data included in the model data 23a. , Is configured to generate an animation of a character object that moves in a virtual space and whose expression changes. Specifically, the animation generation unit 21c generates an animation of a character object that moves in synchronization with the movement of the body and facial expression of the actor A1 based on the first body motion data and the first face motion data regarding the actor A1, Based on the second body motion data and the second face motion data regarding the actor A2, it is possible to generate an animation of a character object that moves in synchronization with the movement of the body and facial expression of the actor A2. In the present specification, the character object generated based on the movement and facial expression of the actor A1 is referred to as “first character object”, and the character object generated based on the movement and facial expression of the actor A2 is referred to as “second character object”. There is a thing.

The moving image generation unit 21d constructs a virtual space by using the object data 23b, and the virtual space, the animation of the first character object corresponding to the actor A1 and the animation of the second character object corresponding to the actor A2. Generate a video containing. The first character object is arranged in the virtual space so as to match the position of the actor A1 with respect to the tracking sensor 36a, and the second character object is arranged in the virtual space so as to match the position of the actor A2 with respect to the tracking sensor 36a. To be done. Therefore, by changing the position or orientation of the tracking sensor 36a, the positions and orientations of the first character object and the second character object in the virtual space can be changed.

In one aspect, the moving image generation unit 21d builds a virtual space based on the tracking information of the tracking sensor 36a. For example, the moving image generation unit 21d determines virtual camera setting information (position in virtual space, gaze position, gaze direction, and angle of view) based on the tracking information of the tracking sensor 36a, and based on the virtual camera setting information. Then, a drawing area in the entire virtual space is determined, and moving image information for displaying the drawing area in the virtual space is generated.

The moving image generation unit 21d uses the tracking information of the tracking sensor 36b instead of the tracking information of the tracking sensor 36a or in addition to the tracking information of the tracking sensor 36a, and the first character object and the second character in the virtual space. It may be configured to define the position and orientation of the object and the setting information of the virtual camera.

The moving image generating unit 21d can synthesize the generated moving images with the sounds of the actors A1 and A2 acquired from the microphone of the studio unit 30.

As described above, the moving image generation unit 21d uses the animation of the first character object that moves in synchronization with the movement of the body and facial expression of the actor A1 and the second character that moves in synchronization with the movement of the body and facial expression of the actor A2. It is possible to generate an animation of an object and generate a moving image for distribution in which the sounds of the actors A1 and A2 are synthesized with this animation.

The moving image distribution unit 21e distributes the moving image generated by the moving image generation unit 21d. This moving image is distributed via the network 50 to the client devices 10a to 10c and other client devices. The received moving image is reproduced on the client devices 10a to 10c.

This moving image may be delivered to a client device (not shown) installed in the studio room R and projected from the client device on the screen S via the short focus projector. Further, this moving image may be distributed to the supporter computer 40. Thereby, the supporter B1 and the supporter B2 can confirm the viewing screen of the distributed video.

FIG. 5 shows a display example of a moving image distributed from the server device 20 to the client device 10a and being reproduced by the client device 10a. As illustrated, the display image 70 of the moving image distributed from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes a character object 71A corresponding to the actor A1, a character object 71B corresponding to the actor A2, and an object 72 indicating a table in the virtual space. There is. The object 72 is not a gift object but one of the objects for constructing the virtual space included in the object data 23b. The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The motion of the character object 71A is controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. The motion of the character object 71B is controlled based on the second body motion data and the second face motion data. Therefore, the character object 71A is controlled to move on the screen in synchronization with the movement of the body and facial expression of the actor A1, and the character object 71B moves on the screen in synchronization with the movement of the body and facial expression of the actor A2. Controlled by.

As described above, the distribution moving image from the server device 20 may be distributed to the supporter computer 40. The moving image distributed to the supporter computer 40 is displayed on the supporter computer 40 as in FIG. The supporter B1 and the supporter B2 can change the setting of the components of the studio unit 30 by watching the moving image reproduced on the supporter computer 40. In one aspect, when the supporter B1 and the supporter B2 want to change the angles of the character object 71A and the character object 71B in the moving image being distributed, the supporter computer 40 tracks an instruction signal instructing to change the orientation of the tracking sensor 36a. It can be sent to the sensor 36a. The tracking sensor 36a can change its direction according to the instruction signal. For example, the tracking sensor 36a is rotatably attached to a stand via a rotation mechanism having an actuator built in about its axis, and when the tracking sensor 36a receives an instruction signal instructing to change its orientation, The actuator of the rotation mechanism may be driven based on the instruction signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one aspect, the supporter B1 and the supporter B2 send an instruction to use the tracking information from the tracking sensor 36b, instead of the tracking information from the tracking sensor 36a, from the supporter computer 40 to the tracking sensor 36a and the tracking sensor 36b. Good.

In one aspect, when the supporter B1 and the supporter B2 see the video being played on the supporter computer 40 and determine that an instruction to the actor A1 or the actor A2 is necessary, a message indicating the instruction is sent to the supporter computer 40. It can be input and this message can be output to the display 39. For example, the supporter B1 and the supporter B2 can instruct the actor A1 or the actor A2 to change the standing position through a message displayed on the display 39.

The display request processing unit 21f receives a gift object display request from the viewing user's client device, and performs processing according to the display request. Each viewing user can transmit a gift object display request to the server device 20 by operating his or her own client device. For example, the first viewing user can transmit a gift object display request to the server device 20 by operating the client device 10a. The gift object display request may include the user ID of the viewing user and identification information (object ID) that identifies the object for which the display request is made.

As described above, the gift object may include an effect object, a normal object, and a decoration object. The effect object and the normal object are examples of the first object. The display request for requesting the display of the effect object or the normal object is an example of the second display request.

In one aspect, when the display request processing unit 21f receives a display request for a specific effect object from the viewing user, the display request processing unit 21f displays the effect object requested to be displayed on the moving image display image 70 based on the display request. Perform processing. For example, when a display request for an effect object corresponding to confetti is made, the display request processing unit 21f displays the effect object 73 indicating confetti based on the display request as shown in FIG. To display.

In one aspect, when the display request processing unit 21f receives a display request for a specific normal object from the viewing user, the display request processing unit 21f performs a process for displaying the normal object requested to be displayed on the moving image 70 based on the display request. .. For example, when the display request of the normal object indicating the teddy bear is made, the display request processing unit 21f displays the normal object 74 indicating the teddy bear based on the display request as shown in FIG. 70 is displayed.

The display request for the normal object 74 may include a display position specifying parameter that specifies the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at the position designated by the display position designation parameter in the virtual space. For example, the display position specifying parameter can specify the position above the object 72 indicating the table as the display position of the normal object 74. The viewing user uses the display position designation parameter to view the display of the character object 71A, the character object 71B, the gift object, and other objects included in the moving image 70, and designates the position where the normal object is desired to be displayed. can do.

In one aspect, the normal object 74 may be displayed so as to move within the moving image display image 70. For example, the normal object 74 may be displayed so as to drop from the top of the screen to the bottom. In this case, the normal object 74 may be displayed in the display image 70 during the fall from the start of falling to the floor of the virtual space forming the moving image 70, and may disappear from the display image 70 after falling on the floor. .. The viewing user can see the falling normal object 74 from the start of falling to the end of falling. The moving direction of the normal object 74 on the screen can be set arbitrarily. For example, the normal object 74 may be displayed in the display image 70 so as to move from the left to the right of the moving image 70, from the right to the left, from the upper left to the lower left, or in other directions. The normal object 74 can move on various trajectories. For example, the normal object 74 can move on a linear trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or a trajectory other than these. In addition to the display position designation parameter or in place of the display position designation parameter, the viewing user specifies a movement direction parameter that designates the movement direction of the normal object 74 and a trajectory along which the normal object 74 moves, in addition to the display position designation parameter. At least one of the orbital parameters can be included. In one embodiment, an effect object or a normal object having a size smaller than the reference size in the virtual space (for example, a confetti piece of the effect object 73) is stored in the character object 71A and the character object 71B. Some or all of them may be overlapped and displayed. In one embodiment, an effect object and a normal object whose size in the virtual space is larger than the reference size (for example, the normal object 74 (a teddy bear)) are displayed at positions that do not overlap with the character object. .. In one embodiment, at least one of the character object 71A and the character object 71B is an effect object or a normal object whose size in the virtual space is larger than the reference size (for example, the normal object 74 (plush bear)). When the character object overlaps with the character object, the character object is displayed behind the character object displayed in the overlap.

In one aspect, when the display request processing unit 21f receives a display request for a specific decoration object from the viewing user, the display request processing unit 21f adds the display-requested decoration object to the candidate list 23d based on the display request. The display request for the decoration object is an example of the first display request. For example, the display request processing unit 21f stores, in the candidate list 23d, the identification information (object ID) for identifying the specific decorative object requested to be displayed by the viewing user, in association with the user ID of the viewing user. (See FIG. 4). When a plurality of display requests for the decoration object are made, the user ID of the viewing user who has made the display request and the decoration object ID of the decoration object requested to be displayed by the viewing user for each of the plurality of display requests. Are stored in association with each other in the candidate list 23d.

In one aspect, the decoration object selection unit 21g displays the selected decoration object on the moving image display image 70 in response to the selection of one or more of the decoration objects included in the candidate list 23d. Perform processing to cause it. In this specification, the decoration object selected from the candidate list 23d may be referred to as a “selected decoration object”.

The selection of the decorative object from the candidate list 23d is performed by the supporter B1 and the supporter B2 operating the supporter computer 40, for example. In one aspect, the supporter computer 40 displays a decorative object selection screen. FIG. 8 shows an example of the decorative object selection screen 80 in one aspect. The decoration object selection screen 80 is displayed on the display of the supporter computer 40, for example. The decoration object selection screen 80 displays each of the plurality of decoration objects included in the candidate list 23d in a table format, for example. As shown in the figure, the decoration object selection screen 80 in one aspect includes a first column 81 for displaying the type of the decoration object, a second column 82 for displaying an image of the decoration object, and a character object associated with the decoration object. And a third column 83 that displays the part of the. Further, on the decoration object selection screen 80, selection buttons 84a to 84c for selecting each decoration object are displayed. In this way, the decoration object that is a candidate for the selected decoration object is displayed on the decoration object selection screen 80.

The supporter B1 and the supporter B2 can select one or more of the decoration objects included in the decoration object selection screen 80. For example, the supporter B1 and the supporter B2 can select the headband by selecting the selection button 84a. When the decoration object selecting unit 21g detects that the headband is selected, the display request processing unit 21f displays the selected decoration object 75 indicating the selected headband on the moving image display screen 70, as shown in FIG. Let The selected decoration object 75 is displayed in the display image 70 in association with a specific part of the character object. The selected decoration object 75 may be displayed so as to be in contact with the specific part of the character object. For example, since the selected decoration object 75 indicating the headband is associated with the head of the character object, it is attached to the head of the character object 71A as shown in FIG. The decoration object may be displayed on the display screen 70 so as to move in association with the movement of the specific part of the character object. For example, when the head of the character object 71A wearing the headband moves, the selected decoration object 75 showing the headband also attaches to the head of the character object 71A as if the headband of the character object 71A were mounted on the head of the character object 71A. Move.

As described above, the object data 23b may include the mounting position information indicating which part of the character object the decoration object is associated with. In one aspect, the decoration object selection unit 21g, the decoration object included in the candidate list 23d, the decoration to be attached to the portion that overlaps with the portion indicated by the attachment position information of the decoration object already attached to the character object. The object may not be selected as the selected decoration object 75. For example, because the headband associated with "head rear left" and "head rear right" and the hair accessory associated with "head rear left" are "head rear left" overlapping, It cannot be installed at the same time. On the other hand, the headband associated with the “back of the head left side” and the “right of the head behind” and the earrings associated with “the left ear (of the head)” and “the right ear of the head” are Since the specific parts of the character object do not overlap, they can be worn at the same time.

The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71B instead of the character object 71A. The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71A and the character object 71B.

In one embodiment, the decoration object selection screen 80 may be configured not to include information that can identify the user who holds each decoration object or the user who has issued a display request for each decoration object. Accordingly, it is possible to prevent the selector from giving preferential treatment to a specific user when selecting the decorative object.

In one embodiment, the decoration object selection screen 80 may display information regarding a user who owns each decoration object or a user who has made a display request for the decoration object for each decoration object. For example, for each decoration object, the number of times the user who has made a display request for the decoration object has made a display request for the decoration object and the selected number of times (for example, five display requests for the decoration object have been made so far). Information indicating that the user has selected at least two times), the number of times the user has watched a video of at least one of the character object 71A and the character object B, and the video of the user in the video distribution system 1 (the character object 71A and the character). Number of viewings (regardless of whether or not Object B appears), purchase amount of gift object by the user, number of purchases of object by the user, points that can be used in the video distribution system 1 owned by the user, video distribution of the user Various information regarding the level in the system 1 and the user who has made a display request for each decorative object other than these may be displayed. According to the embodiment, the decoration object can be selected based on the behavior and the viewing history of the user who has issued the display request for the decoration object in the moving image distribution system 1 so far.

In one embodiment, the display of the decorative object may be constrained to eliminate duplicates. For example, in the case of the character object 71A, when the decoration object associated with the specific part is already selected, selection of another decoration object associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, when the headband associated with the “head” of the character object 71B is already selected, other decorations associated with the “head” are added. An object (for example, a decoration object representing “hat” associated with the head) is not displayed on the decoration object selection screen 80, or a selection button for selecting the decoration object representing the hat is displayed on the selection screen 80. May not be selectable. According to the embodiment, it is possible to prevent the decorative object from being displayed in duplicate on a specific part of the character object.

The decoration object selection screen 80 may be displayed on another device instead of the supporter computer 40 or in addition to the supporter computer 40. For example, the decorative object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actors A1 and A2 can select a desired decoration object based on the decoration object selection screen 80 displayed on the display 39 or the screen S. The selection of the decorative object by the actor A1 and the actor A2 can be performed by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b, for example.

In one aspect, the object purchase processing unit 21h receives, in response to a request from a user who views a video, purchase information about each of a plurality of gift objects that can be purchased in association with the video, and the client device of the view user (for example, To the client device 10a). The purchase information of each gift object includes the type of the gift object (effect object, normal object, or decoration object), the image of the gift object, the price of the gift object, and information necessary for purchasing other gift objects. Can be included. The viewing user can select the gift object to purchase based on the purchase information of the gift object displayed on the client device 10a. The selection of the gift object to be purchased may be performed by operating the client device 10a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 20. The object purchase processing unit 21h performs settlement processing based on the purchase request. Upon completion of this payment process, the purchased gift object is held by the viewing user. In this case, the object ID of the purchased gift object is stored in the holding list 23c in association with the user ID of the purchased viewing user.

The gift objects that can be purchased may be different for each video. The purchasable gift object may be purchasable in multiple videos. That is, the gift object that can be purchased may include a unique gift object that is unique to each moving image and a common gift object that can be purchased in a plurality of moving images. For example, the effect object indicating confetti may be a common gift object that can be purchased in multiple videos.

In one aspect, when an effect object is purchased while watching a predetermined moving image, the effect object to be purchased is changed to the moving image being watched in response to completion of payment processing for purchasing the effect object. It may be displayed automatically. When a normal object is purchased while watching a predetermined video, the normal gift object of the purchase target is watching the video that is being watched, in the same manner as above, in response to the completion of the payment process for purchasing the normal object. May be automatically displayed in.

In another aspect, a payment completion notification is transmitted to the client device 10a in response to the completion of the payment process in the object purchase processing unit 21h for the effect object to be purchased, and the effect object purchased in the client device 10a. A confirmation screen for confirming with the viewing user whether or not to perform the display request may be displayed. When the viewing user selects to make a display request for the purchased effect object, a display request for displaying the purchased effect object is sent from the client device of the viewing user to the display request processing unit 21f. The display request processing unit 21f may perform processing of displaying the effect object to be purchased on the moving image 70. Even when the purchase target is a normal object, a confirmation screen for confirming with the viewing user whether or not to make a display request for the purchased normal object may be displayed on the client device 10a, similarly to the above.

Next, with reference to FIGS. 9 to 11, a moving image distribution process according to one aspect will be described. FIG. 9 is a flow diagram showing a flow of a moving image distribution process in one embodiment, FIG. 10 is a flow diagram showing a flow of a process of displaying a normal object in one embodiment, and FIG. 11 is one embodiment. It is a flow diagram showing a flow of processing for displaying a decoration object in. In the moving image distribution process, it is assumed that the actors A1 and A2 are performing in the studio room R.

First, in step S11, body motion data that is a digital expression of body movements of the actors A1 and A2 and face motion data that is a digital expression of facial movements (expressions) of the actors A1 and A2 are generated. It The body motion data is generated, for example, by the body motion data generation unit 21a, and the face motion data is generated, for example, by the face motion data generation unit 21b.

Next, in step S12, by applying the body motion data and face motion data of the actor A1 to the model data for the actor A1, the animation of the first character object that moves in synchronization with the movement of the body and facial expression of the actor A1. Is generated. Similarly, by applying the body motion data and face motion data of the actor A2 to the model data for the actor A2, the animation of the second character object that moves in synchronization with the movement of the body and facial expression of the actor A2 is generated. .. The generation of this animation is performed, for example, by the animation generation unit 21c.

Next, in step S13, a moving image including the animation of the first character object corresponding to the actor A1 and the animation of the second character object corresponding to the actor A2 is generated. The voices of the actors A1 and A2 may be synthesized with this moving image. The animation of the first character object and the animation of the second character object may be arranged in the virtual space. The generation of this moving image is performed by, for example, the moving image generation unit 21d.

Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed via the network 50 to the client devices 10a to 10c and other client devices. This moving image may be distributed to the supporter computer 40 or may be projected on the screen S in the studio room R. The moving image is continuously distributed for a predetermined distribution period. The distribution period of the moving image can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any time other than these.

Next, in step S15, it is determined whether or not an end condition for ending the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the supporter computer 40 has instructed to end the distribution, or any other condition. If the ending condition is not satisfied, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the moving image including the animation synchronized with the movements of the actors A1 and A2 is continued. When it is determined that the ending condition is satisfied for the moving image, the distribution process of the moving image is ended.

Next, with further reference to FIG. 10, the display processing of the normal object performed during the distribution of the moving image will be described. The normal object display process is performed in parallel with the moving image distribution process shown in FIG.

During the distribution of the moving image, in step S21, it is determined whether or not a display request for the normal object is made. For example, the first viewing user selects one or a plurality of specific normal objects from the normal objects held by the first viewing user, and issues a display request for displaying the selected normal objects from the client device 10a to the server device 20. Can be sent to. As described above, the display request for the predetermined normal object may be generated in response to the purchase process or the payment process for the predetermined normal object.

When the display request for the normal object is made, the display process proceeds to step S22. In step S22, based on the display request, processing for displaying the normal object requested to be displayed in the moving image being distributed is performed. For example, if a display request for the normal object 74 is made during distribution of a predetermined moving image, the normal object 74 for which the display request is made is displayed in the display screen 70 of the moving image, as shown in FIG. ..

If the normal object display request has not been made, the normal object display processing ends. The normal object display processing shown in FIG. 10 is repeatedly performed during the moving image distribution period.

The effect object display process may be performed in the same procedure as the above-described normal object display process. For example, when a display request for the effect object 73 is made during distribution of a predetermined moving image, the effect object 73 for which the display request is made is displayed in the display screen 70 of the moving image, as shown in FIG. .. The effect object 73 shown in FIG. 6 is an object imitating confetti. The effect object 73 imitating confetti is displayed so as to overlap (or contact) the character object 71A and the character object 71B, but is not associated with a specific part of the character object 71A and the character object 71B. It differs from decorative objects in points.

Next, with further reference to FIG. 11, the display processing of the decoration object performed during the distribution of the moving image will be described. The display process of the decoration object is performed in parallel with the distribution process of the moving image shown in FIG. Further, the display processing of the decoration object may be performed in parallel with the display processing of the normal object shown in FIG.

During the distribution of the moving image, in step S31, it is determined whether or not a display request for the decorative object is made. For example, the first viewing user selects the first decoration object from the decoration objects of its own, and transmits a display request for displaying the selected first decoration object from the client device 10a to the server device 20. can do.

When the display request for the first decoration object is made, the display process proceeds to step S32. In step S32, the first decoration object requested to be displayed is added to the candidate list based on the display request. The candidate list is a list of objects that are candidates for the decoration object displayed in the moving image being distributed, and is, for example, the above-mentioned candidate list 23d.

Next, in step S33, it is determined whether or not a specific decoration object is selected from the decoration objects stored in the candidate list.

When a specific decoration object is selected, in step S34, the selected specific decoration object (“selected decoration object”) is deleted from the candidate list, and the selected decoration is displayed on the display screen of the moving image being delivered. Processing for displaying the object is performed. For example, when the decoration object 75 is selected from the candidate list during the distribution of the moving image 70 shown in FIG. 5, as shown in FIG. 7, the selected decoration object 75 is displayed in the display image 70. Is displayed. The first decoration object requested to be displayed in step S31 is displayed on the display image 70 if it is selected from the candidate list during distribution of the moving image, but is not displayed on the display image 70 if it is not selected.

In step S33, when the decoration object is not selected from the candidate list, and when the display processing of the selected decoration object is completed in step S34, the decoration object display processing proceeds to step S35. In step S35, it is determined whether or not the distribution of the moving image being distributed has ended. In this step S35, for example, the determination may be made based on the same criteria as in step S15. If it is determined in step S35 that the distribution has not ended, the display process of the decoration object returns to step S31, and the processes of steps S31 to S35 are repeatedly executed. If it is determined that the distribution is completed, the display process of the decoration object proceeds to step S36.

In step S36, processing is performed on the decoration object (which may be referred to as "non-selected object" in this specification) left in the candidate list at the end of distribution of the moving image. In this specification, the process performed in step S36 may be referred to as a non-selected object process.

The non-selected object has been purchased by the viewing user and has been requested to be displayed during distribution of the moving image. Therefore, the non-selected object process executed in step S36 may be a process of refunding the purchase cost of the non-selected object to the viewing user who has issued the display request for the non-selected object. In another aspect, the non-selected object process may be a process for canceling the payment process for purchasing the non-selected object. In another aspect, the non-selected object process may be a process of giving a decorative object different from the non-selected object to the viewing user who has made a display request for the non-selected object.

In another aspect, the non-selected object process may be a process of giving points that can be used in the video distribution system 1 to the user of the non-selected object, instead of refunding the purchase cost or canceling the settlement process. The video distribution system 1 may be configured to consume points for viewing the video. The points given to the user of the non-selected object processing by the non-selected object processing may be points that can be used for viewing the moving image in the moving image distribution system 1.

In another aspect, the non-selected object process may be a process of adding the non-selected object as an object held by the first viewing user in the holding list. As a result, the first viewing user can receive the return of the non-selected object.

In another aspect, the non-selected object process may be a process for holding the candidate list at the end of distribution of the moving image until the same distributor distributes the moving image next time. As a result, the distributor can take over the candidate list used at the time of the previous video distribution at the time of the next video distribution. The inherited candidate list includes decoration objects (that is, non-selected objects) that were requested to be displayed at the time of the previous video distribution but were not actually displayed in the video. As a result, the next video distribution is performed using the candidate list including the non-selected objects at the time of the previous video distribution. This non-selected object may be selected in the next video distribution and displayed in the video.

After the processing in step S36 is completed, the decoration object display processing ends.

In one embodiment, an object display prohibited section may be provided in the moving image distribution in which the display of the gift object is prohibited. FIG. 12 is a diagram schematically illustrating the object display prohibited section. FIG. 12 shows that a moving image is distributed between time t1 and time t2. That is, time t1 is the distribution start time of the moving image, and time t2 is the distribution end time of the moving image. In the distribution period of the moving image, the object display prohibition period 81 is between time t3 and time t4. Even if the gift object display request r1 is made in the object display prohibition period 81, the gift object is not displayed in the display image of the moving image in the object display prohibition period 81. Specifically, when a display request for an effect object or a normal object among gift objects is made in the object display prohibition period 81, the effect object or normal object requested to be displayed is being delivered in the object display prohibition period 81. No, it is displayed in the moving image after the object display prohibition period 81 has elapsed (that is, after the time t4). When a decoration object is selected from the candidate list in the object display prohibition period 81, the selected decoration object is not displayed in the moving image being delivered in the object display prohibition period 81, and the object display prohibition period 81 is not displayed. Is displayed in the moving image at a time point after the passage of. The display request for the decoration object may be accepted within the object display prohibition period 81. That is, when a display request for a decoration object is made during the object display prohibition period 81, the decoration object for which the display request is made may be added to the candidate list even within the object display prohibition period 81.

According to the above embodiment, the gift object includes three types, a decoration object, a normal object, and an effect object. Of these, only the decoration object is displayed in association with the character object. In a moving image in which the animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the attention of the viewing user. For example, in the moving images shown in FIGS. 5 to 7, it is considered that the character objects 71A and 71B are focused. In the above-described one embodiment, even if there is a display request for the decoration object displayed in association with the character object 71A and the character object 71B, the decoration object is displayed in the moving image until the decoration object is selected from the candidate list 23d. By not doing so, it is possible to prevent the decoration object from being displayed disorderly around the character object or overlapping the character object. As a result, the viewing experience of the viewing user can be prevented from deteriorating.

In the conventional moving image distribution system, the gift object is displayed in the moving image regardless of its type in response to a request to display the moving image. Therefore, if the gift object is allowed to be displayed in duplicate on the video, a large number of gift objects are displayed on the video, and the viewing experience of the user who views the video is deteriorated. In the above embodiment, the gift object is provided with the category of decoration objects displayed in association with the character object, so that the number of display (display amount) of the decoration objects displayed in association with the character object, which is the main part of the moving image. Can be suppressed.

The normal object 74 of the gift objects is displayed in a moving image in response to a display request from the viewing user. In the above-described embodiment, the normal object 74 is displayed on the moving image display screen 70 so as not to come into contact with or overlap with the character objects 71A and 71B, so that the character objects 71A and 71B are visually recognized. Has little effect on sex. According to this aspect, it is possible to prevent the user's viewing experience from being deteriorated due to the deterioration of the visibility of the character object.

The effect object 73 and the normal object 74 of the gift objects are displayed in a moving image in response to a display request from the viewing user. In the above-described embodiment, the effect object 73 and the normal object 74 are displayed on the display screen 70 for a shorter time than the decorative object 75, and therefore the effect on the visibility of the character objects 71A and 71B is small. According to this aspect, it is possible to prevent the user's viewing experience from being deteriorated due to the deterioration of the visibility of the character object.

In the above-described embodiment, the decoration object is selected from the candidate list 23d by a person who is not the viewing user who has issued the display request for the decoration object (for example, the supporter B1, the supporter B2, the actor A1, or the actor A2). It is possible to suppress the number of displayed decorative objects.

According to the above embodiment, the gift object is not displayed in the moving image during the object display prohibited period 81. This allows the created moving image to be viewed without being disturbed by the gift object. For example, by setting the object display prohibition period 81 to a time period in which the actors A1 and A2 perform a visual performance in a moving image, the performance of the actors can be shown to the viewer without being disturbed by the first object and the decoration object. You can

According to the above-described embodiment, a viewing user who views a moving image including a character object such as the character object 71A or the character object 71B is considered to be attached to the character object. Therefore, the character object is attached with the decoration object more than the effect object or the normal object, so that the satisfaction degree is increased. In this way, the decoration object to which the character object can be attached can provide the user with an incentive to repeatedly view the moving image including the character object.

In the moving image distribution system 1 according to the above embodiment, the user can give a decoration object to the character. As a result, it is possible to provide a highly unique system as compared with a system that cannot give such a decorative object, and it is possible to provide a highly unique service to the system. As a result, more users can be attracted to the moving picture distribution system 1, so that the number of times of watching a moving picture in the moving picture distribution system 1 can be increased.

The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the invention. For example, the distributed moving image may be captured and generated in a room other than the studio room R. For example, the shooting for generating the distributed moving image may be performed at the home of the actor or supporter.

In the processing procedure described in this specification, particularly in the processing procedure described with reference to the flowcharts, some of the steps (steps) constituting the processing procedure are omitted, It is possible to add steps that are not explicitly shown and/or change the order of the steps, and a processing procedure in which such omissions, additions, and changes in order are made without departing from the spirit of the present invention. It is included in the scope of the invention.

1 Video distribution system

Claims (1)

A video distribution system for distributing a video including an animation of a character object generated based on the movement of an actor,
Comprises one or more computer processors,
The one or more computer processors,
Distribute the video to the client device of the viewing user,
Accepting a display request from the viewing user requesting display of an object in the video,
Displaying viewing user information regarding the viewing user who has made the display request, to a supporter or an actor that supports distribution of the moving image during distribution of the moving image,
Displaying the decorative object in the moving image when the decorative object is selected by the supporter or the actor,
Video distribution system.