JP2023109850A - Video distribution system for distributing video including message from viewing user - Google Patents

Abstract

To provide a video distribution system which can improve a mode of displaying a posted message, in which a part of a display screen of a video is allocated as a display region, a video reproducing method, and a video reproducing program.SOLUTION: A video distribution system 1 includes a server device comprising: a storage for storing a first posted message posted by a first user included in a first user group, a second posted message posted by a second user included in a second user group, and an object provided by at least one of the first and second users; and at least one computer processor. The video distribution system distributes a video including a first display region in which the first and second posted messages can be displayed and a second display region in which the second posted message can be displayed while the first posted message cannot be displayed. The second user is a user whose parameter related to the object satisfies a predetermined condition.SELECTED DRAWING: Figure 1

Description

The disclosure in this specification relates to a moving image distribution system that distributes moving images including messages from viewing users. More specifically, the disclosure in this specification relates to a moving image distribution system that distributes moving images including animations of character objects generated based on movements of actors and messages from viewing users.

2. Description of the Related Art Conventionally, there has been known a video distribution system that generates animation of a character object based on the motion of an actor and distributes a video containing the animation of the character object. Such a moving image delivery system is disclosed, for example, in Japanese Patent Laying-Open No. 2015-184689 (Patent Document 1).

Patent Literature 1 discloses that a chat function can be implemented in the video distribution system. In such a chat function, a message is posted by a viewing user viewing a moving image. The actor can see this posted post message. When an actor reacts to a message, the reaction is reflected in the video. This chat function enables interaction between viewing users and interaction between viewing users and actors.

JP 2015-184689 A

Conventionally, a partial area of a video display screen is allocated as a posted message display area. Due to space restrictions on the display screen, the display area of the posted message may overlap with the character object. In this case, the posted message and the character object are displayed in duplicate, which may degrade the viewing experience of the viewing user. For example, if the main part of the character object is hidden by the posted message, the viewer may feel that the viewing of the moving image is disturbed.

By securing a display area for displaying posted messages in a certain area of the display screen and performing display control so that the character object is not displayed in this display area, it is possible to avoid overlap between the character object and the posted message. . However, the display position of the character object is limited, and this is a major constraint in moving image production.

Thus, if the display area of the posted object is limited to a certain area, it becomes difficult to provide the user with a satisfying viewing experience. There is a demand for improvements in the display mode of posted messages in moving images that include animation of character objects.

It is an object of the present disclosure to provide technical improvements that solve or alleviate at least some of the problems in the prior art discussed above.

A video distribution system according to one aspect includes: a first posted message posted by a first user included in a first user group; a second posted message posted by a second user included in a second user group; A storage for storing objects provided by at least one of a user and the second user; and one or more computer processors. The first user does not belong to the second user group, the second user does not belong to the first user group, and the second user has a predetermined parameter related to the object. A user who satisfies the conditions. The one or more computer processors execute computer-readable instructions to display a first display area capable of displaying the first posted message and the second posted message, and a display area capable of displaying the second posted message. and a second display area in which the first posted message is not displayed.

A video distribution system according to one aspect includes a storage that stores a first posted message posted by a first user included in a first user group and a second posted message posted by a second user included in a second user group. and one or more computer processors. The first user does not belong to the second user group, and the second user does not belong to the first user group. The one or more computer processors execute computer-readable instructions to display a first display area capable of displaying the first posted message and the second posted message, and a display area capable of displaying the second posted message. and a second display area in which the first posted message is not displayed. The second user is a user whose viewing status of the moving image satisfies a predetermined upper limit.

In the video distribution system according to one aspect, the second user group is composed of fewer users than the first user group.

In the video delivery system according to one aspect, the first posted message moves in the first direction in the first display area.

In the video distribution system according to one aspect, the second posted message moves in the second direction in the second display area.

In the video distribution system according to one aspect, the second direction changes according to the first command included in the second posted message.

In the video distribution system according to one aspect, an initial display position of the second posted message in the second display area changes according to a second command included in the second posted message.

In the moving image distribution system according to one aspect, the moving speed of the second posted message in the second display area is slower than the moving speed of the first posted message in the first display area.

In the video distribution system according to one aspect, the display time during which the second posted message is displayed in the second display area is longer than the display time during which the first posted message is displayed in the first display area.

In the video distribution system according to one aspect, information other than the first posted message is also displayed in the first display area.

In the video distribution system according to one aspect, the storage stores objects provided by at least one of the first user and the second user.

In the video distribution system according to one aspect, the information other than the first posted message includes a notification indicating that the object has been provided.

In the moving image distribution system according to one aspect, the second user is a user whose parameter regarding the object satisfies a predetermined condition.

In the video distribution system according to one aspect, the second user is a user whose viewing count of the video has exceeded a predetermined number of times.

In the video distribution system according to one aspect, the first user leaves the first user group and is included in the second user group when the number of posts of the first posted messages exceeds a predetermined number.

In the moving image delivery system according to one aspect, the moving image includes animation of a character object generated based on the movement of an actor.

In the moving image delivery system according to one aspect, at least part of the second display area is arranged behind the character object.

In the moving image delivery system according to one aspect, when the first display area and the character object are displayed in an overlapping manner, the character object is arranged behind the first display area.

A video distribution system according to one aspect further includes a plurality of cameras, and includes images of a virtual space configured based on tracking information of active sensors selected from the plurality of cameras.

In one aspect of the video distribution system, the second display area is provided on a display object in the virtual space, and the position of the second display area in the virtual space depends on the position and orientation of the active sensor. Be changed.

In one aspect of the video distribution system, the second display area is provided in the virtual space, and the size of the second display area in the virtual space is changed according to the position and orientation of the active sensor. .

In the moving image distribution system according to one aspect, at least part of the one or more computer processors is provided in a server device, and the information other than the first posted message includes a notification from the server device.

In the video distribution system according to one aspect, the first posted message and the second posted message are displayed in the first display area.

In the video distribution system according to one aspect, the first user posts a first posted message using a client device, and the client device does not post the first posted message during the second delivery period. configured to

In the video distribution system according to one aspect, an electronic gift is displayed as a gift object in the virtual space, and the second display area is provided on the gift object in the virtual space.

A video distribution method according to one aspect is performed by one or more computer processors executing computer readable instructions. The moving image distribution method includes the step of storing a first posted message posted by a first user included in a first user group, and storing a second posted message posted by a second user included in a second user group. storing an object provided by at least one of the first user and the second user; a first display area capable of displaying the first posted message and the second posted message; and a second display area in which two posted messages can be displayed while the first posted message is not displayed. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, the second user does not belong to the A user whose object-related parameter satisfies a predetermined condition.

A video distribution method according to one aspect comprises the steps of: storing a first posted message posted by a first user included in a first user group; and storing a second posted message posted by a second user included in a second user group. a first display area capable of displaying the first posted message and the second posted message; and a second display capable of displaying the second posted message but not displaying the first posted message. and a step of distributing the video containing the area. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, the second user does not belong to the This is a user whose video viewing status satisfies a predetermined condition.

A program according to one aspect is a program to be executed by one or more computer processors, wherein a first posted message posted by a first user included in a first user group is stored in the one or more computer processors. storing a second posted message posted by a second user included in a second user group; and storing an object provided by at least one of the first user and the second user. , a first display area capable of displaying the first posted message and the second posted message, and a second display area capable of displaying the second posted message but not displaying the first posted message. and a step of distributing moving images. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, the second user does not belong to the A user whose object-related parameter satisfies a predetermined condition.

A program according to one aspect is a program to be executed by one or more computer processors, wherein a first posted message posted by a first user included in a first user group is stored in the one or more computer processors. storing a second posted message posted by a second user included in a second user group; a first display area capable of displaying the first posted message and the second posted message; and a second display area in which a second posted message is displayable while the first posted message is not displayed. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, the second user does not belong to the This is a user whose video viewing status satisfies a predetermined condition.

According to the embodiment, it is possible to display a posted message from a video viewing user in a display area corresponding to a user group to which the viewing user belongs.

1 is a block diagram illustrating a video distribution system according to one embodiment; FIG. FIG. 2 is a schematic diagram schematically showing facilities of a studio for producing moving images distributed by the moving image distribution system of FIG. 1; FIG. 2 is a diagram for explaining a holding list stored in the moving image distribution system of FIG. 1; FIG. 2 is a diagram explaining a candidate list stored in the moving image delivery system of FIG. 1; FIG. FIG. 2 is a diagram illustrating post data stored in the moving image delivery system of FIG. 1; FIG. 2 is a diagram for explaining viewing management data stored in the moving image delivery system of FIG. 1; FIG. FIG. 4 is a diagram showing an example of a moving image displayed on the client device 10a in one embodiment; FIG. 7 includes an animation of a character object. FIG. 4 is a diagram showing an example of a moving image displayed on the client device 10a in one embodiment; FIG. 8 contains normal objects. FIG. 4 is a diagram showing an example of a moving image displayed on the client device 10a in one embodiment; FIG. 9 includes decoration objects. FIG. 11 is a schematic diagram showing an example of a decoration object selection screen for selecting a desired selection decoration object from decoration objects included in the candidate list; FIG. 10 is a diagram showing an example of a moving image including a first posted message displayed on the client device 10a in one embodiment; FIG. FIG. 10 is a diagram showing an example of a moving image including a first posted message displayed on the client device 10a in one embodiment; FIG. FIG. 10 is a diagram showing an example of a moving image including a second posted message displayed on the client device 10a in one embodiment; FIG. FIG. 10 is a diagram showing an example of a moving image including a second posted message displayed on the client device 10a in one embodiment; FIG. FIG. 4 is a flow diagram showing the flow of video distribution processing in one embodiment. FIG. 2 is a diagram for explaining division of distribution periods of moving images distributed in the moving image distribution system of FIG. 1; FIG. 13 is a diagram showing an example of a moving image including a first posted message displayed on the client device 10a in another embodiment; FIG. FIG. 11 is a flow chart showing the flow of posted message display processing in another embodiment;

Various embodiments of the present invention will now be described with appropriate reference to the drawings. Identical or similar components are provided with the same reference numerals in several drawings.

A video distribution system according to an embodiment will be described with reference to FIGS. 1 to 6. FIG. FIG. 1 is a block diagram showing a video distribution system 1 according to one embodiment, and FIG. 2 is a schematic diagram schematically showing facilities of a studio where videos distributed by the video distribution system 1 are produced. 3 to 6 are diagrams for explaining information stored in the moving image distribution system 1. FIG.

The moving image distribution system 1 includes client devices 10 a to 10 c, a server device 20 , a studio unit 30 and a storage 60 . The client devices 10a to 10c, the server device 20, and the storage 60 are connected via a network 50 so as to be able to communicate with each other. The server device 20 is configured to distribute moving images including character animation, as will be described later. A character included in this animation may be motion-controlled in the virtual space.

This moving image can be distributed from the server device 20 to each of the client devices 10a to 10c. A first viewing user who is the user of the client device 10a, a second viewing user who is the user of the client device 10b, and a third viewing user who is the user of the client device 10c view the distributed video using each client device. be able to. The moving image distribution system 1 may have less than three client devices, or more than three client devices.

The client devices 10a to 10c are information processing devices such as smart phones. The client devices 10a to 10c may be mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and other various information processing devices capable of reproducing moving images, in addition to smartphones. Each of the client devices 10a to 10c includes a computer processor, a memory, a communication I/F, a display, a sensor unit including various sensors such as a gyro sensor, a sound collecting device such as a microphone, and a storage for storing various information. good too.

The displays of the client devices 10a to 10c each have a display panel and a touch panel. The touch panel is configured to be able to detect a player's touch operation (contact operation). The touch panel can detect various touch operations such as tapping, double tapping, and dragging by the player. The touch panel may include a capacitive proximity sensor and be configured to detect non-contact operations by the player.

A viewing user can input a message regarding the delivered moving image or other messages via the touch panels of the client devices 10a to 10c. The message may be, for example, a text message, a still image message, a moving image message, or any other electronic message. Each of the client devices 10a-10c can be configured to post (send) messages entered by viewing users to the server device 20. FIG. In this specification, a message sent to the server device 20 from the client devices 10a to 10c and/or other client devices for viewing distributed moving images may be referred to as a posted message. For example, regarding a moving image distributed to the client device 10a of the first viewing user, the first viewing user inputs the message to the client device 10a, and the posting message transmitted from the client device 10a to the server device 20 is This is the message posted by the viewing user.

In the illustrated embodiment, the server device 20 comprises a computer processor 21 , a communication I/F 22 and a storage 23 .

The computer processor 21 is an arithmetic device that loads an operating system and various programs that implement various functions from the storage 23 or other storage into its memory, and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as ASIC, PLD, FPGA, MCU. Although computer processor 21 is illustrated as a single component in FIG. 1, computer processor 21 may be a collection of a plurality of physically separate computer processors. In this specification, a program or instructions included in the program described as being executed by the computer processor 21 may be executed by a single computer processor, or may be executed by a plurality of computer processors in a distributed manner. good too. Also, the program executed by the computer processor 21 or the instructions contained in the program may be executed by multiple virtual computer processors.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver or PPP driver, or a combination thereof. Server device 20 can transmit and receive data to and from other devices via communication I/F 22 .

Storage 23 is a storage device accessed by computer processor 21 . The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices capable of storing data. Various programs can be stored in the storage 23 . At least part of the programs and various data that can be stored in the storage 23 may be stored in a storage that is physically separate from the server device 20 (for example, the storage 60).

Many of the components of studio unit 30 are located, for example, in studio room R shown in FIG. As shown, in studio room R, actor A1 and actor A2 are performing. The studio unit 30 is configured to detect movements and facial expressions of the actors A1 and A2 and output the detected information to the server device 20 .

Both the actor A1 and the actor A2 are subjects whose movements and facial expressions are captured by a group of sensors provided in the studio unit 30, which will be described later. In the illustrated embodiment, Actor A1 and Actor A2 are human beings who conduct talks, performances, and other actions to facilitate programs delivered as video. Actors A1 and A2 may be animals or any other moving objects (non-living objects) other than humans. Actor A1 and actor A2 may be robots capable of autonomous movement, for example. The number of actors in the studio room R may be one, or three or more.

The studio unit 30 includes six motion sensors 31a to 31f attached to the actor A1, a controller 33a held in the left hand of the actor A1, a controller 33b held in the right hand of the actor A1, and a mounting tool 37b. and a camera 37a attached to the head of actor A1 via the camera 37a. The studio unit 30 also includes six motion sensors 32a-32f attached to actor A2, a controller 34a held in the left hand of actor A2, a controller 34b held in the right hand of actor A2, and a mounting fixture 38b. and a camera 38a attached to the head of actor A2 via . A microphone for acquiring audio data may be attached to each of the wearing tool 37b and the wearing tool 38b. This microphone can acquire speech data of actors A1 and A2 as audio data. The microphone may be a wearable microphone that is attached to the actors A1 and A2 via the attachment 37b and the attachment 38b, or an installation type that is installed on the floor, wall, or ceiling of the studio room R. may be The studio unit 30 has a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39 in addition to the components described above. A supporter computer 40 is installed in an adjacent room separated from the studio room R by a glass window. The server device 20 may be installed in the same room as the room where the supporter computer 40 is installed.

Motion sensors 31a-31f and motion sensors 32a-32f cooperate with base station 35a and base station 35b to detect their position and orientation. In one embodiment, base station 35a and base station 35b are multi-axis laser emitters. After emitting blinking light for synchronization, the base station 35a scans the laser light, for example, around the vertical axis. The base station 35b scans laser light, for example, around the horizontal axis. Each of the motion sensors 31a-31f and the motion sensors 32a-32f may comprise a plurality of optical sensors that detect the incidence of flashing light and laser light from the base station 35a and base station 35b. The motion sensors 31a to 31f and the motion sensors 32a to 32f respectively detect the time difference between the incident timing of the blinking light and the incident timing of the laser light, the light receiving time at each optical sensor, the incident angle of the laser light detected by each optical sensor, and If necessary, it may detect its own position and orientation based on information other than these. Motion sensors 31a-31f and motion sensors 32a-32f may be, for example, Vive Tracker provided by HTC CORPORATION. Base station 35a and base station 35b may be, for example, base stations provided by HTC CORPORATION.

Detection information indicating the position and orientation of each motion sensor calculated in each of the motion sensors 31 a to 31 f and the motion sensors 32 a to 32 f is transmitted to the server device 20 . This detection information may be wirelessly transmitted to the server device 20 from each of the motion sensors 31a to 31f and the motion sensors 32a to 32f. Since the base station 35a and the base station 35b emit blinking light and scan with laser light at regular intervals, the detection information of each motion sensor is updated at each interval. Note that the number of base stations may be three or more. The position of the base station may be changed as appropriate. For example, in addition to or instead of the base stations arranged in the upper corners of the space to be detected by the tracking sensors shown in FIG. A deployed base station may be provided. For example, there may be four base stations. In the illustrated embodiment, actor A1 is equipped with six motion sensors 31a-31f. Motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are attached to the left wrist, right wrist, left instep, right instep, waist, and top of the head, respectively, of actor A1. The motion sensors 31a-31f may be attached to the actor A1 via attachments. Actor A2 is equipped with six motion sensors 32a-32f. Motion sensors 32a-32f may be mounted on actor A2 at similar locations as motion sensors 31a-31f. The motion sensors 31a-31f and motion sensors 32a-32f shown in FIG. 2 are exemplary. Motion sensors 31a-31f may be attached to various parts of actor A1, and motion sensors 32a-32f may be attached to various parts of actor A2. The number of motion sensors attached to actor A1 and actor A2 may be five or less, or may be seven or more. By detecting the positions and orientations of the motion sensors 31a to 31f and the motion sensors 32a to 32f attached to each part of the bodies of the actors A1 and A2, the movements of the bodies of the actors A1 and A2 are detected. be able to.

In one embodiment, multiple infrared LEDs are mounted on each of the plurality of motion sensors attached to the actor A1 and the actor A2, and the light from the infrared LEDs is projected onto the floor and walls of the studio room R. Sensing with an infrared camera may detect the position and orientation of each of the motion sensors. A visible light LED may be used instead of the infrared LED, and the position and orientation of each motion sensor may be detected by detecting light from the visible light LED with a visible light camera. In this way, each of the plurality of motion sensors attached to the actor is provided with a light emitting unit (for example, an infrared LED or a visible light LED), and the light from the light emitting unit is received by a light receiving unit ( For example, an infrared camera or a visible light camera) may detect the position and orientation of each of the motion sensors.

In one embodiment, a plurality of reflective markers can be used in place of motion sensors 31a-31f and motion sensors 32a-32f. A reflective marker is attached to each of the actors A1 and A2 with an adhesive tape or the like. By imaging the actors A1 and A2 to which the reflective markers are affixed in this manner to generate imaging data, and performing image processing on the imaging data, the positions and orientations of the reflective markers can be detected.

The controllers 33a and 33b output control signals to the server device 20 according to the operation of the actor A1. Similarly, the controllers 34a and 34b output control signals to the server device 20 according to the operation of the actor A2.

The tracking sensor 36a and the tracking sensor 36b generate tracking information for determining virtual camera setting information for constructing the virtual space included in the moving image. The tracking information of the tracking sensor 36a and the tracking sensor 36b is calculated as the position in each three-dimensional orthogonal coordinate system and the angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to the operator's operation. The tracking sensor 36 a transmits tracking information indicating its position and orientation to the tracking information server device 20 . Similarly, the position and orientation of the tracking sensor 36b are set according to the operator's operation. The tracking sensor 36 b transmits tracking information indicating its position and orientation to the tracking information server device 20 . In the illustrated embodiment, the tracking sensor 36a is provided to the left front of the actor A1. The tracking sensor 36b is provided in front of the actors A1 and A2 and at a position approximately midway between the actors A1 and A2.

Camera 37a is attached to the head of actor A1 as described above. For example, the camera 37a is arranged so as to capture the face of the actor A1. The camera 37a continuously images the face of the actor A1 and acquires the imaged data of the face of the actor A1. Similarly, a camera 38a is attached to the head of actor A2. The camera 38a is arranged so as to be able to image the face of the actor A2, continuously images the face of the actor A2, and obtains the imaged data of the face of the actor A2. The camera 37 a transmits face image data of the actor A<b>1 to the server device 20 , and the camera 38 a transmits face image data of the actor A<b>1 to the server device 20 . The cameras 37a and 38a may be 3D cameras capable of detecting the depth of a person's face.

Display 39 is configured to display information received from support computer 40 . Information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other information. The display 39 is placed at a position that can be viewed by actors A1 and A2.

In the illustrated embodiment, the supporter computer 40 is installed in the room next to the studio room R. Since the room in which the supporter computer 40 is installed and the studio room R are separated by a glass window, the operator of the supporter computer 40 (also referred to as "supporter" in this specification) can control actors A1 and A2. can be seen. In the illustrated embodiment, a supporter B1 and a supporter B2 are in the room as operators of the supporter computer 40 .

The supporter computer 40 may be configured to change the settings of the components of the studio unit 30 according to the operations of the supporter B1 and the supporter B2. The supporter computer 40 can, for example, set scanning intervals by the base station 35a and base station 35b, set the positions or orientations of the tracking sensors 36a and 36b, and change various settings of other devices. . Switching of the active sensors, which will be described later, can be executed based on the operation of the supporter computer 40 by the supporter B1 and the supporter B2. At least one of the supporter B1 and the supporter B2 can input a message to the supporter computer 40 and display the input message on the display 39 .

The components and functions of studio unit 30 shown in FIG. 2 are exemplary. A studio unit 30 applicable to the present invention may comprise various components not shown. For example, studio unit 30 may include a projector. The projector can project on the screen S a moving image distributed to the client device 10a or other client devices.

Next, in one aspect, the information stored in storage 23 will be described. In the illustrated embodiment, the storage 23 contains model data 23a, object data 23b, possession list 23c, candidate list 23d, post data 23e, viewing management data 23f, and other data necessary for generating and distributing distribution moving images. Various information is stored.

The model data 23a is model data for generating character animation. The model data 23a may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 23a includes, for example, rig data (sometimes referred to as "skeleton data") indicating the skeleton of the character, and surface data indicating the shape and texture of the surface of the character. The model data 23a can include a plurality of different model data. The plurality of model data may have rig data different from each other, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data. In the illustrated embodiment, the model data 23a has at least two different types of model data to generate a character object corresponding to actor A1 and a character object corresponding to actor A2. The model data for the character object corresponding to the actor A1 and the model data for the character object corresponding to the actor A2 have, for example, the same rig data, but may have different surface data.

The object data 23b includes asset data for constructing a virtual space that constitutes a moving image. The object data 23b includes data for drawing the background of the virtual space that constitutes the moving image, data for drawing various objects displayed in the moving image, and data for drawing various objects displayed in the moving image. Contains data. The object data 23a may include object position information indicating the position of the object in the virtual space.

In addition to the above, the object data 23b may include gift objects displayed in moving images based on display requests from the viewing users of the client devices 10a to 10c. Gift objects can include effect objects, normal objects, and decoration objects. A viewing user can purchase a desired gift object.

The effect object is an object that affects the impression of the entire viewing screen of the distributed moving image, and is an object that imitates confetti, for example. The confetti-like object may be displayed on the entire viewing screen, thereby changing the impression of the entire viewing screen before and after the display. Effect objects may be displayed so as to overlap with character objects, but differ from decoration objects in that they are not displayed in association with specific parts of character objects.

A normal object is an object that is a digital gift from a viewing user to an actor (for example, actor A1 or actor A2), such as a stuffed toy or a bouquet of flowers. In one aspect, the normal object is displayed on the moving image display screen so as not to come in contact with the character object. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character object. A normal object may be displayed so as to overlap an object other than the character object in the virtual space. A normal object may be displayed so as to overlap with a character object, but differs from a decoration object in that it is not displayed in association with a specific part of the character object. In one aspect, when the normal object is displayed so as to overlap with the character object, the normal object overlaps a portion of the character object other than the head including the face, and does not overlap the head of the character object. is displayed.

A decoration object is an object displayed on the display screen in association with a specific part of the character object. In one aspect, the decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the decoration object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover part or all of the specific part of the character object.

Decoration objects are, for example, accessories (headbands, necklaces, earrings, etc.), clothes (T-shirts, etc.), costumes, and other objects that character objects can wear. The object data 23b corresponding to the decoration object may include attachment position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decoration object can indicate on which part of the character object the decoration object is mounted. For example, when the decoration object is a headband, the attachment position information of the decoration object may indicate that the decoration object is attached to the "head" of the character object. When the decoration object is a T-shirt, the attachment position information of the decoration object may indicate that the decoration object is attached to the "torso" of the character object.

A display time corresponding to the type of gift object may be set for each gift object. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

The possessed list 23c is a list indicating the gift objects possessed by the viewing user of the moving image. An example of holding list 23c is shown in FIG. As shown, in the holding list 23c, an object ID that specifies a gift object owned by the viewing user is stored in association with the viewing user's account information (for example, the viewing user's user ID). The viewing users include, for example, first to third viewing users of the client devices 10a to 10c.

The candidate list 23d is a list of decoration objects requested to be displayed by the viewing user. As will be described later, a viewing user who owns a decoration object can make a display request for the owned decoration object. In the candidate list 23d, an object ID specifying the decoration object is stored in association with the account information of the viewing user who requested the display of the decoration object. This candidate list 23d may be created for each distributor. The candidate list 23d may be stored in association with, for example, distributor identification information that identifies distributors (actor A1, actor A2, supporter B1, and/or supporter B2).

The posted data 23e is data indicating a posted message posted by a viewing user. The posted data 23e includes account information of the viewing user who posted the posted message, group information indicating the user group to which the viewing user belongs, and the posted message posted by the viewing user. In this way, the storage 23 can store group information related to the user group to which the viewing user belongs, and posted messages posted by the viewing user, in association with the account information of the viewing user. The posted data 23 e is the time when each posted message was posted (for example, the time when the posted message sent from the client device was received by the server device 20 , or the time when the posted message received by the server device 20 was stored in the storage 23 . ) may be stored.

The viewing user's account information is, for example, user identification information (user ID) of the viewing user.

The group information is group identification information (group ID) that identifies the group to which the viewing user belongs. Groups to which viewing users belong include, for example, a first user group and a second user group. For example, the first user group is a general user group to which general users belong, and the second user group is a premium user group to which premium users different from general users belong.

Various criteria can be adopted as classification criteria for the first user group and the second user group. Of the viewing users, users who have viewed the video less than a predetermined number of times may be classified as general users, and users who have viewed the video a predetermined number of times or more may be classified as premium users. Of the viewing users, users who have watched videos for less than a predetermined time may be classified as general users, and users who have watched videos for a predetermined time or longer may be classified as premium users. Users who have purchased gift objects for less than a predetermined amount may be classified as general users, and users who have purchased gift objects for a predetermined amount or more may be classified as premium users. Users who have purchased less than a predetermined amount of gift objects may be classified as general users, and users who have purchased more than a predetermined amount of gift objects may be classified as premium users. Of the viewing users, users who have posted fewer than a predetermined number of posted messages may be classified as general users, and users who have posted a predetermined number or more of posted messages may be classified as premium users. The number of views, the viewing time, the purchase amount of gift objects, the amount of gift objects purchased, and the number of posts of posted messages may be cumulative values from the start of use of the video distribution system 1, and aggregate values aggregated over a predetermined period. may be

In one aspect, the second group of users consists of fewer users than the first group of users. A viewing user is classified into a first user group when performing usage registration for the moving image distribution system 1 . A viewing user, after starting to use the moving picture distribution system 1 , leaves the first user group and belongs to the second user group when he meets the criteria for being classified into the second user group. In this way, the user group to which the viewing user belongs may be changed depending on how the video distribution system 1 is used. The user group belonging to the viewing user may be changed from the second user group to the first user group when the viewing user no longer satisfies the criteria for being classified into the second user group.

In one aspect, even if the user group classification criteria are dynamically adjusted such that the number of viewing users belonging to the first user group is kept smaller than the number of viewing users belonging to the second user group good. For example, the server device 20 monitors the number of viewing users belonging to the first user group and the number of viewing users belonging to the second user group. The criteria for being classified as 2 may be stricter. For example, initially, when viewing users who have viewed videos using the video distribution system 1 for 10 hours or more are classified into the second user group, the number of users belonging to the second user group and the number of users belonging to the first user group When the difference from the number of viewing users belonging to the group becomes smaller than a predetermined value, the viewing users who have watched videos using the video distribution system 1 for 20 hours or more are classified into the second user group. may be changed.

The classification of viewing users is not limited to those specifically described herein. Viewing users may be classified into three or more groups. Also, the classification criteria for determining which group each viewing user belongs to can be determined arbitrarily.

A posted message is a message posted by a viewing user via a client device. Messages posted by viewing users include, for example, text format messages, still image format messages, moving image format messages, and messages in various formats other than these. In this specification, a posted message posted by a viewing user belonging to the first user group is referred to as a first posted message, and a posted message posted by a viewing user belonging to the second user group is referred to as a second posted message. There is

The viewing management data 23f is data for managing viewing of moving images by viewing users. The viewing management data 23f includes account information of the viewing user, moving image information related to the moving image distributed by the moving image distribution system 1, and moving image viewing information related to viewing of the moving image. In this way, the storage 23 can store moving image information related to the moving image viewed by the viewing user and moving image viewing information related to viewing of the moving image in association with the account information of the viewing user. The moving image information is, for example, moving image identification information (moving image ID) that identifies a moving image. The video viewing information may include the viewing time of the video viewed by the viewing user, the number of views, and various other data related to viewing of the video.

Next, functions realized by the computer processor 21 will be described more specifically. By executing computer-readable instructions included in the distribution program, the computer processor 21 generates a body motion data generation unit 21a, a face motion data generation unit 21b, an animation generation unit 21c, a video generation unit 21d, a video distribution unit 21e, It functions as a display request processing unit 21f, a decoration object selection unit 21g, an object purchase processing unit 21h, and a post message processing unit 21i. At least part of the functions implemented by the computer processor 21 may be implemented by a computer processor other than the computer processor 21 of the video distribution system 1 . At least part of the functions implemented by the computer processor 21 may be implemented by a computer processor installed in the supporter computer 40, for example.

The body motion data generator 21a generates first body motion data for each part of the body of the actor A1 based on the information detected by each of the motion sensors 31a to 31f, and also detects each of the motion sensors 32a to 32f. Based on the information, second body motion data is generated that is a digital representation of the position and orientation of each part of actor A2's body. In this specification, the first body motion data and the second body motion data may be collectively referred to simply as "body motion data". Body motion data is generated as needed over time. For example, body motion data may be generated every predetermined sampling time interval. In this way, the body motion data can represent the body motions of actors A1 and A2 in time series as digital data. In the illustrated embodiment, the motion sensors 31a-31f and the motion sensors 32a-32f are attached to the left and right limbs, waist, and head of each of the actors A1 and A2. Based on the information detected by the motion sensors 32a-32f, it is possible to digitally represent the position and orientation of the entire body of the actor A1 and the actor A2 over time. The body motion data can define, for example, the positions and rotation angles of the bones that make up the rig data included in the model data 23a.

The face motion data generation unit 21b generates first face motion data, which is a digital representation of the movement of the face of the actor A1, based on the imaging data of the camera 37a, and based on the imaging data of each camera 38a, Generate second face motion data that is a digital representation of the facial movements of actor A2. In this specification, the first face motion data and the second face motion data may be collectively referred to simply as "face motion data". Face motion data is generated as needed over time. For example, face motion data may be generated every predetermined sampling time interval. In this way, the face motion data can digitally express the movement of the actor A2 and the face of the actor A2 (change in facial expression) in chronological order.

The animation generator 21c applies the body motion data generated by the body motion data generator 21a and the face motion data generated by the face motion data generator 21b to predetermined model data included in the model data 23a. , is configured to generate an animation of a character object that moves in a virtual space and whose facial expression changes. Specifically, based on the first body motion data and the first face motion data relating to actor A1, the animation generation unit 21c generates animation of the character object that moves in synchronization with the movement of the body and facial expression of actor A1, Based on the second body motion data and the second face motion data relating to actor A2, animation of a character object that moves in synchronization with the movement of the body and facial expression of actor A2 can be generated. In this specification, the character object generated based on the movement and expression of actor A1 will be referred to as a "first character object", and the character object generated based on the movement and expression of actor A2 will be referred to as a "second character object". It is called an object.

The moving image generation unit 21d constructs a virtual space using the object data 23b, and generates the virtual space, the animation of the first character object corresponding to the actor A1, and the animation of the second character object corresponding to the actor A2. Generate a video containing The first character object is placed in virtual space to match the position of actor A1 with respect to tracking sensor 36a, and the second character object is placed in virtual space to match the position of actor A2 with respect to tracking sensor 36a. be done. Therefore, by changing the position or orientation of the tracking sensor 36a, the positions and orientations of the first character object and the second character object in the virtual space can be changed.

In one aspect, the video generator 21d builds a virtual space based on tracking information from the tracking sensor 36a. For example, the moving image generation unit 21d determines virtual camera setting information (position in the virtual space, gaze position, gaze direction, and angle of view) based on the tracking information of the tracking sensor 36a, and uses this virtual camera setting information. Based on this, a drawing area in the entire virtual space is determined, and moving image information for displaying the drawing area of the virtual space is generated.

Instead of the tracking information of the tracking sensor 36a, or in addition to the tracking information of the tracking sensor 36a, the moving image generation unit 21d generates the first character object and the second character in the virtual space based on the tracking information of the tracking sensor 36b. It may be configured to define the position and orientation of the object, as well as setting information for the virtual camera. The moving image generation unit 21d determines the setting information of the virtual camera based on the tracking information of the sensor selected from the tracking sensor 36a and the tracking sensor 36b (in this specification, may be referred to as "active sensor"). It may be configured as

The moving image generator 21d can synthesize the voices of the actors A1 and A2 acquired from the microphones of the studio unit 30 with the generated moving image.

As described above, the animation generation unit 21d generates animation of the first character object that moves in synchronization with the movement of the body and facial expression of actor A1, and animation of the second character object that moves in synchronization with the movement of the body and facial expression of actor A2. Animation for distribution can be generated by generating an animation of an object and synthesizing the voices of actors A1 and A2 with this animation.

The moving image distribution unit 21e distributes the moving image generated by the moving image generating unit 21d. This moving image is distributed to the client devices 10a to 10c and other client devices via the network 50. FIG. The received moving images are reproduced on the client devices 10a to 10c.

This moving image may be distributed to a client device (not shown) installed in the studio room R and projected onto the screen S from this client device via a short-focus projector. Also, this moving image may be distributed to the supporter computer 40 . As a result, the supporter B1 and the supporter B2 can confirm the viewing screen of the distributed video.

FIG. 7 shows a display example of a moving image distributed from the server device 20 to the client device 10a and reproduced in the client device 10a. As shown in the drawing, a moving image display image 70 distributed from the server device 20 is displayed on the display of the client device 10a. A display image 70 displayed on the client device 10a includes a character object 71A corresponding to an actor A1, a character object 71B corresponding to an actor A2, a character object 71A and a character object 71B in a virtual space modeled after a studio. a floor object 72c corresponding to the studio floor on which the floor object 72c stands, a table object 72a representing the table placed on this floor object 72c, and a studio set object 72b representing the studio set placed on the floor object 72c. ing.

The table object 72a, the studio set object 72b, and the floor object 72c are not gift objects, but objects for constructing the virtual space included in the object data 23b. In the illustrated embodiment, the virtual space included in the delivered moving image is a space modeled after a stage where the character objects 71A and 71B perform. Floor object 72c corresponds to the floor of this stage. The floor object 72c extends horizontally in the virtual space. Studio set object 72b corresponds to the stage set in this stage. In the illustrated embodiment, the studio set object 72b extends in an arc in plan view and defines the outer edge of the floor.

The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The character object 71A is motion-controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. The character object 71B is motion-controlled based on the second body motion data and the second face motion data. Therefore, the character object 71A is controlled to move within the screen in synchronization with the movement of the body and facial expression of the actor A1, and the character object 71B is controlled to move within the screen in synchronization with the movement of the body and facial expression of the actor A2. controlled by

As described above, the distribution video from the server device 20 may be distributed to the supporter computer 40 . The video delivered to the supporter computer 40 is displayed on the supporter computer 40 in the same manner as in FIG. The supporter B1 and the supporter B2 can change the settings of the components of the studio unit 30 by viewing the moving image being reproduced on the supporter computer 40 . In one aspect, when the supporter B1 and the supporter B2 want to change the angle of the character object 71A and the character object 71B in the moving image being distributed, the supporter computer 40 sends an instruction signal to change the direction of the tracking sensor 36a for tracking. It can be sent to sensor 36a. The tracking sensor 36a can change its orientation in accordance with the instruction signal. For example, the tracking sensor 36a is rotatably attached to the stand via a rotation mechanism that incorporates an actuator around its axis, and when the tracking sensor 36a receives an instruction signal instructing a change in orientation, the instruction An actuator of the rotation mechanism may be driven based on the signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one aspect, the supporter B1 and the supporter B2 send an instruction from the supporter computer 40 to the tracking sensor 36a and the tracking sensor 36b to use the tracking information from the tracking sensor 36b instead of the tracking information from the tracking sensor 36a. good too.

In one aspect, when the supporter B1 and the supporter B2 see the moving image being played back on the supporter computer 40 and determine that an instruction to the actor A1 or the actor A2 is necessary, they send a message indicating the instruction to the supporter computer 40. can be entered and this message can be output to the display 39 . For example, supporter B1 and supporter B2 can instruct actor A1 or actor A2 to change the standing position through a message displayed on this display 39 .

The display request processing unit 21f receives a gift object display request from the viewing user's client device, and performs processing according to the display request. Each viewing user can transmit a gift object display request to the server device 20 by operating his/her own client device. For example, the first viewing user can transmit a gift object display request to the server device 20 by operating the client device 10a. The gift object display request may include the user ID of the viewing user and identification information (object ID) that specifies the object requested to be displayed.

As described above, gift objects can include effect objects, normal objects, and decoration objects. Effect objects and normal objects are examples of first objects. A display request requesting display of an effect object or a normal object is an example of a first display request.

In one aspect, when the display request processing unit 21f receives a display request for a specific effect object from the viewing user, the display request processing unit 21f performs processing for displaying the requested effect object in the display image 70 of the moving image based on the display request. process. For example, when a request is made to display an effect object corresponding to confetti, the display request processing unit 21f displays an effect object 73 representing confetti on the display image 70 based on the display request, as shown in FIG. to display.

In one aspect, when the display request processing unit 21f receives a display request for a specific normal object from the viewing user, the display request processing unit 21f performs processing for displaying the requested normal object in the moving image 70 based on the display request. . For example, when a display request for a normal object representing a stuffed bear is made, the display request processing unit 21f displays a normal object 74 representing a stuffed bear as a display image based on the display request, as shown in FIG. 70 to display.

The display request for the normal object 74 may include a display position designation parameter that designates the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at the position designated by the display position designation parameter in the virtual space. For example, the display position of the normal object 74 can be specified on the table object 72a representing the table by the display position specification parameter. By using the display position specifying parameter, the viewing user sees the display of the character object 71A, the character object 71B, the gift object, and other objects included in the moving image 70, and specifies the position where the normal object is to be displayed. can do.

In one aspect, the regular object 74 may be displayed as moving within the animated display image 70 . For example, the normal object 74 may be displayed as falling from top to bottom of the screen. In this case, the normal object 74 may be displayed in the display image 70 while falling from the start of falling to the floor of the virtual space forming the moving image 70, and disappear from the display image 70 after falling to the floor. . The viewing user can see the falling normal object 74 from the start of falling to the end of falling. The moving direction of the normal object 74 within the screen can be arbitrarily set. For example, the normal object 74 may be displayed in the displayed image 70 moving from left to right, from right to left, from top left to bottom left, or in other directions in the animation 70 . A normal object 74 can move on various trajectories. For example, the normal object 74 may move on a linear trajectory, a circular trajectory, an elliptical trajectory, a helical trajectory, or some other trajectory. In addition to or instead of the display position designation parameter, the viewing user designates a movement direction parameter for designating the movement direction of the normal object 74 and the trajectory along which the normal object 74 moves in addition to or instead of the display position designation parameter in the display request for the normal object. At least one of the trajectory parameters can be included. In one embodiment, an effect object and a normal object whose size in the virtual space is smaller than a reference size (for example, a confetti piece of effect object 73) is assigned to character object 71A and character object 71B. A part or all of them may be overlapped and displayed. In one embodiment, an effect object and a normal object whose size in the virtual space is larger than a reference size (for example, the normal object 74 (stuffed bear)) is displayed at a position that does not overlap with the character object. . In one embodiment, among effect objects and normal objects, an object whose size in virtual space is larger than a reference size (for example, normal object 74 (stuffed bear)) is at least one of character object 71A and character object 71B. , it is displayed behind the overlapping character object.

In one aspect, when the display request processing unit 21f receives a display request for a specific decoration object from the viewing user, the display request processing unit 21f adds the decoration object requested to be displayed to the candidate list 23d based on the display request. A display request for a decoration object is an example of a second display request. For example, the display request processing unit 21f stores identification information (object ID) for identifying a specific decorative object requested by the viewing user to be associated with the user ID of the viewing user in the candidate list 23d. (See Figure 4). When a plurality of decoration object display requests are made, for each of the plurality of display requests, the user ID of the viewing user who made the display request and the decoration object ID of the decoration object requested to be displayed by the viewing user. are associated with each other and stored in the candidate list 23d.

In one aspect, when one or more of the decoration objects included in the candidate list 23d are selected, the decoration object selection unit 21g displays the selected decoration objects in the moving image display image 70. process to make it work. In this specification, the decoration object selected from the candidate list 23d is sometimes called "selected decoration object".

A decoration object is selected from the candidate list 23d by operating the supporter computer 40 by the supporter B1 and the supporter B2, for example. In one aspect, the supporter computer 40 displays a decoration object selection screen. FIG. 10 shows an example of a decoration object selection screen 80 in one aspect. This decoration object selection screen 80 is displayed on the display of the supporter computer 40, for example. The decoration object selection screen 80 displays each of the plurality of decoration objects included in the candidate list 23d in tabular form, for example. As shown, the decoration object selection screen 80 in one aspect includes a first column 81 displaying the type of decoration object, a second column 82 displaying the image of the decoration object, and a character object associated with the decoration object. and a third column 83 displaying the parts of the . The decoration object selection screen 80 also displays selection buttons 84a to 84c for selecting each decoration object. In this way, the decoration object selection screen 80 displays decoration objects that are candidates for the selection decoration object.

The supporter B1 and the supporter B2 can select one or more decoration objects included in the decoration object selection screen 80. FIG. For example, the supporter B1 and the supporter B2 can select headbands by selecting the selection button 84a. When the decoration object selection unit 21g detects that a headband has been selected, the display request processing unit 21f displays a selected decoration object 75 representing the selected headband on the moving image display screen 70, as shown in FIG. Let The selected decoration object 75 is displayed on the display image 70 in association with a specific part of the character object. The selected decoration object 75 may be displayed so as to be in contact with the specific portion of the character object. For example, the selection 75 indicating a headband is associated with the head of the character object, so it is worn on the head of the character object 71A as shown in FIG. The decoration object may be displayed on the display screen 70 so as to move along with the movement of the specific part of the character object. For example, when the head of the character object 71A wearing the headband moves, the selected decoration object 75 representing the headband is attached to the head of the character object 71A as if the headband were worn on the head of the character object 71A. move.

The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71B instead of the character object 71A. The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71A and the character object 71B.

The decoration object selection screen 80 may be configured so as not to include information that can identify the user who owns each decoration object or the user who has requested the display of each decoration object. This prevents the selector from giving preferential treatment to a particular user when selecting a decoration object.

In one embodiment, the decoration object selection screen 80 may display information about the user who owns each decoration object or the user who has requested the display of each decoration object. For example, for each decoration object, the number of times the decoration object has been requested to be displayed and the number of times the decoration object has been selected by the user who requested the display of the decoration object (for example, display requests for the decoration object have been made five times) information indicating that two of them have been selected), the number of times the user has viewed the video of at least one of the character object 71A and the character object B, the number of times the user has viewed the video in the video distribution system 1 (the character object 71A and the character (regardless of whether or not object B appears), the amount of gift objects purchased by the user, the number of times the object was purchased by the user, the points that can be used in the video distribution system 1 owned by the user, and the user's video distribution Various information related to the level in the system 1 and the user who requested the display of each decorative object other than these may be displayed. According to this embodiment, it is possible to select a decoration object based on the past actions and viewing history in the moving image distribution system 1 of the user who requested the display of the decoration object.

In one embodiment, the display of decoration objects may be constrained to eliminate duplication. For example, regarding the character object 71A, if a decoration object associated with a specific part has already been selected, selection of other decoration objects associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, if the headband associated with the "head" of the character object 71B has already been selected, other decorations associated with the "head" The object (for example, a decoration object representing a “hat” associated with the head) is not displayed on the decoration object selection screen 80, or the selection button for selecting the decoration object representing the hat is not displayed on the selection screen 80. may be disabled. According to this embodiment, it is possible to prevent the decoration object from being displayed in duplicate on a specific part of the character object.

The decoration object selection screen 80 may be displayed on another device instead of the supporter computer 40 or in addition to the supporter computer 40 . For example, the decoration object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actor A1 and the actor A2 can select a desired decoration object based on the decoration object selection screen 80 displayed on the display 39 or screen S. The selection of decoration objects by the actors A1 and A2 can be made by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b, for example.

In one aspect, the object purchase processing unit 21h sends purchase information for each of a plurality of gift objects purchasable in relation to the moving image in response to a request from the viewing user of the moving image. Send to the client device 10a). The purchase information of each gift object includes the type of the gift object (effect object, normal object, or decoration object), the image of the gift object, the price of the gift object, and other information necessary for purchasing the gift object. can be included. The viewing user can select a gift object to purchase based on the purchase information of the gift object displayed on the client device 10a. The selection of the gift object to be purchased may be performed by operating the client device 10a. When a gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to server device 20 . The object purchase processing unit 21h performs settlement processing based on the purchase request. When this payment processing is completed, the purchased gift object is owned by the viewing user. In this case, the object ID of the purchased gift object is stored in the possession list 23c in association with the user ID of the viewing user who made the purchase.

The purchasable gift object may differ from movie to movie. A purchasable gift object may be purchasable in multiple videos. That is, the purchasable gift objects may include unique gift objects specific to each animation and common gift objects purchasable in multiple animations. For example, an effect object showing confetti may be a common gift object that can be purchased in multiple videos.

In one aspect, when an effect object is purchased while watching a predetermined video, the effect object to be purchased is added to the video being watched in response to completion of payment processing for purchasing the effect object. May be displayed automatically. If a normal object is purchased while watching a predetermined video, in the same way as above, upon completion of the payment process for purchasing the normal object, the normal gift object to be purchased will be transferred to the video being watched. may be automatically displayed in

In another aspect, in response to the completion of the payment processing in the object purchase processing unit 21h for the effect object to be purchased, a payment completion notification is sent to the client device 10a, and the purchased effect object is sent to the client device 10a. A confirmation screen may be displayed for asking the viewing user whether or not to request the display of . When the viewing user selects to make a display request for the purchased effect object, the display request requesting display of the purchased effect object is transmitted from the viewing user's client device to the display request processing unit 21f. , and the display request processing unit 21f may perform processing for displaying the effect object to be purchased on the display image 70 of the moving image. Even when the purchase target is a normal object, similarly to the above, a confirmation screen may be displayed on the client device 10a for the viewing user to confirm whether or not to request display of the purchased normal object.

As described above, the client devices 10 a to 10 c and other client devices can transmit posted messages regarding distribution moving images and other posted messages to the server device 20 . The posted message processing unit 21i is configured to perform processing for displaying posted messages received from the client devices 10a to 10c and other client devices in a moving image.

A display mode of a posted message in one mode will be described with reference to FIGS. 11 to 16 . FIGS. 11 to 14 show display examples of posted messages displayed in moving images being reproduced on the client device 10a. FIG. 15 is a flow diagram showing the flow of moving image distribution processing in one embodiment, and FIG. 16 is a schematic diagram for explaining a first distribution period and a second distribution period in distributed moving images. The first display area 76 is included in the moving image during the first distribution period, and the second display area 77 is included in the moving image during the second distribution period.

As shown in FIG. 16, in one embodiment, the server device 20 distributes moving images between time t1 and time t2. The time t1 is the video distribution start time, and the time t2 is the video distribution end time. In the illustrated embodiment, the first distribution period is between time t1 and time t3 and between time t4 and time t2, and the period between time t3 and time t4 is the first distribution period. 2 delivery period. After the delivery start time t1 of the moving image, the first delivery period 161 continues until time t3, at time t3 the first delivery period 161 is switched to the second delivery period 162, and then at time t4 the second delivery period. 162 is switched to the first distribution period 163, and the first distribution period 163 continues until the distribution end time t2. The order, length, number of appearances of the first distribution period and the second distribution period, and other settings related to the first distribution period and the second distribution period can be determined arbitrarily.

In one embodiment, the first delivery period and the second delivery period may be switched when a predetermined time arrives. For example, in the illustrated embodiment, the first delivery period 161 is switched to the second delivery period 162 at time t3, and then the second delivery period 162 is switched to the first delivery period 163 at time t4. In one embodiment, the switching from the first distribution period to the second distribution period and the switching from the second distribution period to the first distribution period may be performed according to the operation of the controller 33a or the controller 33b by the actor A1. , in response to the operation of controller 34a or controller 34b by actor A2. In one embodiment, the switching from the first distribution period to the second distribution period and the switching from the second distribution period to the first distribution period may be performed according to the operation of the supporter computer 40 by the supporter B1 or B2. good. Switching between the first delivery period and the second delivery period may occur in ways not explicitly described herein.

11 and 12 show the display image 70 of the delivered moving image in the first delivery period. The display image 70 of the delivered moving image shown in FIG. 11 includes an image of the virtual space seen from a viewpoint determined based on the tracking information of the tracking sensor 36b in front of the actors A1 and A2. In other words, the display image 70 is an image of a virtual space constructed with the position of the tracking sensor 36b in front of the actors A1 and A2 as a virtual viewpoint. Therefore, the character object 71A and the character object 71B face the front in the display image 70 .

In the illustrated embodiment, the played video (or the displayed image 70 thereof) includes a first display area 76 .

In one aspect, the first display area 76 is a display area superimposed on the moving image generated by the moving image generating section 21d. In one aspect, the first display area 76 is a two-dimensional display area.

In one aspect, the first display area 76 is not an object that constitutes the virtual space generated by the moving image generator 21d. In this case, the first display area 76 displays the display image 70 of the moving image regardless of the setting information (position, orientation, and angle of view) of the virtual camera for constructing the virtual space generated by the moving image generation unit 21d. Displayed in a predetermined area. The first display area 76 may be displayed at a position that does not change before and after the switching even if the active sensor is switched. In the illustrated embodiment, the first display area 76 occupies a certain range in the lower left corner of the display image 70 . The position of the first display area 76 is not limited to the positions specifically described in this specification. As illustrated, the first display area 76 may be provided in an area overlapping at least one of the character object 71A and the character object 71B. In the illustrated embodiment, the first display area 76 overlaps a portion of the character object 71B. In the area where the first display area 76 and the character object 71B overlap, the first display area 76 and the posted message included therein may be displayed in front of the character object 71B on the screen. In this case, part of the character object 71B is hidden behind the first display area 76 or the posted message displayed there, and cannot be visually recognized by the viewing user.

In one aspect, the posted message processing unit 21i displays a posted message posted by a viewing user via the client devices 10a to 10c and other client devices in a display area corresponding to the user group to which the viewing user belongs. configured as Since the posted message posted by the viewing user is stored in the storage 23 as the posted data 23e, the posted message processing unit 21i reads the posted message from the storage 23 and displays the read posted message in the first display area 76. Alternatively, it can be displayed in a second display area 77 which will be described later. Posted messages may be read in order of posting time.

In the embodiment shown in FIG. 11, the first display area 76 displays four posted messages 76a-76d. The posted messages 76a to 76d may be posted messages (first posted messages) from viewing users belonging to the first user group, or posted messages (second posted messages) from viewing users belonging to the second user group. ). For example, posted message 76a, posted message 76b, posted message 76c, and posted message 76d are read from storage 23 in this order, and each read first posted message is displayed in first display area 76 in the read order. to be displayed. An example of a specific display procedure is as follows. When the first posted message 76 a is read, the posted message 76 a is displayed at the top of the first display area 76 . Next, when the posted message 76b is read, the posted message 76a moves downward from the initial display position, and the posted message 76b is displayed in the space vacated by this movement. Similarly, when a new posted message is displayed, the displayed posted message is moved downward, and the new posted message is displayed in the space vacated by the movement.

When displaying a new posted message after the posted message 76 a reaches the lower limit of the first display area 76 , the posted message 76 a that has reached the lower limit is no longer displayed in the first display area 76 . In the display image 70 of FIG. 11, it is assumed that the posted message 76a has reached the lower limit of the first display area 76. As shown in FIG. At this point, when new posted message 76e is read from storage 23 for display in first display area 76, posted message 76a is no longer displayed in first display area 76, as shown in FIG. , and after the remaining posted messages (first posted messages 76b to 76d) move downward, a posted message 76e is displayed in the space vacated by this movement. Thus, the posted message displayed in the first display area 76 continues to be displayed in the first display area 76 until the end of the first display area 76 in the moving direction is reached.

In the first display area 76, not only the first posted message posted by the viewing user but also various notifications from the server device 20 may be displayed. For example, if the first viewing user requests to display a gift, a message to that effect may be displayed in the first display area 76 as a message from the system. Notifications from server device 20 that may be displayed in first display area 76 may include various types of notifications. The notification from the server apparatus 20 may be, for example, a message for notifying that a viewing user has started viewing a moving image when the viewing user has started viewing the moving image.

As described above, the posted message processing unit 21i performs processing for displaying posted messages of users belonging to the first user group or the second user group in the first display area 76 . In the first display area 76, the first posted message moves in a predetermined movement direction to make room for displaying the new posted message. In the embodiment shown in Figures 11 and 12, the first posted message moves from top to bottom. The moving direction of the first posted message in the first display area 76 is not limited to top to bottom. The moving direction of the first posted message in the first display area 76 may be bottom to top, left to right, right to left, or any other direction.

Next, with reference to FIGS. 13 and 14, moving images distributed during the second distribution period will be described. 13 and 14 show an example of the display image 130 of the delivered moving image in the second delivery period. In the embodiment shown in FIGS. 13 and 14, it is assumed that during the second distribution period, animations in which the character objects 71A and 71B perform on stage are distributed. The display image 130 of the delivered moving image shown in FIG. 13 includes an image of the virtual space seen from the viewpoint determined based on the tracking information of the tracking sensor 36b in front of the actors A1 and A2. In other words, this display image 130 is an image of a virtual space constructed with the position of the tracking sensor 36b in front of the actor A1 and the actor A2 as a virtual viewpoint. Therefore, the character object 71A and the character object 71B face the front in the display image 130 . FIG. 14 shows a moving image display image 130 generated based on the tracking information of the tracking sensor 36a. Since the tracking sensor 36a is located in front left of the actors A1 and A2, the character objects 71A and 71B in the display image 130 face a direction other than the front (front right).

The second display area 77 is an area corresponding to part or all of the surface of one or more objects included in the virtual space generated by the moving image generation unit 21d. In the illustrated embodiment, the entire front surface of the screen-shaped screen object 131 serves as the second display area 77 . In this specification, an object in which the second display area 77 is provided, such as the screen object 131, may be called a "display object" or a "message display object." Any object in the virtual space included in the distributed moving image can be used as the display object. In one aspect, the gift object may be the display object.

In the embodiment of FIG. 13, the second display area 77 displays posted messages (second posted messages) from viewing users belonging to the second user group. In the illustrated example, the second display area 77 displays five second posted messages 77a to 77e. The second posted messages 77a-77e are sometimes simply referred to herein as "second posted messages" when they need not be distinguished from each other. As shown in FIG. 13, second posted message 77a, second posted message 77b, second posted message 77c, second posted message 77d, and second posted message 77e are read from storage 23 in this order, Each read second posted message is displayed in the second display area 77 in the order in which it was read. Posted messages (first posted messages) from viewing users belonging to the first user group are not displayed in the second display area 77 . During the second distribution period, the viewing users belonging to the first user group cannot post messages due to the functions implemented in the client devices, or even if they can post messages, the messages are posted in the second distribution period. It is not displayed in the display area 77.

The second posted message displayed in second display area 77 may move in a predetermined direction in second display area 77 . In the embodiment of FIG. 13, each second posted message moves from top to bottom of second display area 77 . Since the screen object 131 (second display area 77) is arranged behind the character object 71A and the character object 71B in the virtual space, the second posted message displayed in the second display area 77 is the second posted message. A portion of each of the posted messages 77a-77d is hidden behind the character object 71A and the character object 71B. When the second posted message moves to the end of the second display area 77 in the moving direction, it is no longer displayed on the display image 70 . In one embodiment, a display object such as the screen object 131 is arranged behind the character object in the virtual space. This prevents the character object from being hidden behind the display object and the second posted message displayed on the display object. As described above, it is assumed that the character object will perform during the second delivery period. Therefore, by arranging the display object behind the character object, the user can see the performance of the character object without being disturbed by other objects. This can prevent the user's viewing experience from deteriorating.

The moving direction of the second posted message in the second display area 77 is not limited to the top to bottom direction. The moving direction of the second posted message in the second display area 77 may be from left to right, from bottom to top, from right to left, or any other direction. The moving direction of the posted message in the second display area 77 may be different from the moving direction of the first posted message in the first display area 76 .

In one aspect, the moving direction of the posted message in the second display area 77 may be determined according to the first command included in the posted message. For example, when a viewing user creates a posted message via a client device, the posted message can include a first command designating a movement direction. This first command may be, for example, the text "L, R" to specify movement from left to right. This first command may be added, for example, after the body of the posted message (the message displayed in the second display area 77). The message body and the first command may be separated by an at mark (“@”), a comma (“,”), a semicolon (“;”), a colon (“:”), or the like. In this way, the viewing user can create a posted message so as to include the first command specifying the moving direction of the message in second display area 77 and transmit the posted message to server device 20 . The first command may be stored in the storage 23 as part of the posted data 23e. When the posted message is read from the storage 23, and if the posted message is posted by the second user group, the posted message processing unit 21i causes the posted message to move in the direction specified by the first command. Alternatively, the posted message may be displayed in the second display area 77 . The description format of the first command described above can be arbitrarily changed.

In one aspect, the initial display position of the posted message in the second display area 77 may be determined according to the second command included in the posted message. For example, when the viewing user creates a posted message via the client device, the posted message can include a second command specifying an initial display position in the second display area 77 . This second command is, for example, the text "@L" when the initial display position is the left end of the second display area, and the text "@R" when the initial display position is the right end of the second display area. , and if the initial display position is the center of the second display area, the text may be "@C". The viewing user can create a posted message to include the second command, and transmit the posted message to server device 20 . The posted message may include the first command in addition to the second command. The second command may be stored in the storage 23 as part of the posted data 23e. When the posted message processing unit 21i reads out the posted message from the storage 23, if the posted message is posted by the second user group, the posted message processing unit 21i displays the posted message at the initial display position specified by the second command. View posted messages. When the posted message also includes the first command, the posted message processing unit 21i causes the posted message to be displayed at the initial display position specified by the second command, and then displayed in the direction specified by the first command. may be configured to move to The description format of the second command described above can be arbitrarily changed.

In one aspect, the posted message processing unit 21i moves each posted message such that the moving speed of the second posted message in the second display area 77 is slower than the moving speed of the first posted message in the first display area 76. Speed can be adjusted.

In one aspect, the posted message processing unit 21i performs the second display time during which the second posted message is displayed in the second display area 77 before the first display time during which the first posted message is displayed in the first display area 76 . The moving speed of each posted message can be adjusted so that the display time is longer. When the length of the first display area 76 in the moving direction of the first posted message and the length of the second display area 77 in the moving direction of the second posted message are the same, the moving speed of the second posted message is as described above. is slower than the moving speed of the first posted message, the display time of the second posted message can be made longer than the display time of the first posted message. If the moving speeds of the first posted message and the second posted message are the same, the length of the second display area 73 in the moving direction of the second posted message is equal to the length of the first display area 76 in the moving direction of the first posted message. By making it longer than the length, the display time of the second posted message can be made longer than the display time of the first posted message.

In one aspect, it is possible to change the display of the distribution video by camerawork. As described above, the display image 130 of the distributed moving image shown in FIG. 13 is generated based on the tracking information of the tracking sensor 36b in front of the actors A1 and A2. In other words, the display image 130 is generated when the tracking sensor 36b is the active sensor. Therefore, in the display image 130 of FIG. 13, the character object 71A and the character object 71B face the front. By switching the active sensor from the tracking sensor 36b to the tracking sensor 36a, a moving image including the virtual space generated based on the tracking information of the tracking sensor 36a is generated. FIG. 14 shows an example of a moving image display image generated based on the tracking information of the tracking sensor 36a. Since the tracking sensor 36a is located in front left of the actors A1 and A2, the character objects 71A and 71B in the display image 130 face a direction other than the front (front right). In addition, the screen object 131, the second display area 77 provided on the surface of the screen object 131, and the second posted message displayed in the second display area 77 are also tilted. Thus, the position and orientation in virtual space of the second display area 77 (or screen object 131) is determined by which tracking sensor is used as the active sensor. Further, when the position or orientation of the active sensor is changed, the position or orientation of the second display area 77 (or screen object 131) in virtual space is also changed accordingly. The second display area 77 (or screen object 131) in the display image 130 when the tracking sensor 36a shown in FIG. 14 is the active sensor is the same as the display when the tracking sensor 36a shown in FIG. 13 is the active sensor. It is displayed smaller than the second display area 77 (or the screen object 131) in the display image 130 in the image as viewed from the oblique direction.

When the active sensor is switched from the tracking sensor 36b to the tracking sensor 36a, the position (viewpoint position) of the virtual camera in the virtual space is also changed, so the position and orientation of the second display area 77 in the virtual space are also changed. For example, in the display image of FIG. 13 in which the tracking sensor 36b is the active sensor, the positions of the second posted messages 77a to 77d are hidden behind the character object 71A or the character object 71B, but the tracking sensor 36a is the active sensor, only the second posted message 77c is hidden behind the character object. It is not hidden behind objects, and its entirety is visible. In this way, by moving the viewpoint in the virtual space by switching the active sensor, it is possible to make it easier to see the second posted message hidden behind the character object.

Next, with reference to FIG. 15, a video distribution process according to one aspect will be described. FIG. 15 is a flowchart showing the flow of moving image distribution processing in one embodiment. In the moving image distribution process, it is assumed that actors A1 and A2 are present in the studio room R.

First, in step S11, body motion data, which is a digital representation of the body movements of the actors A1 and A2, and face motion data, which is a digital representation of the facial movements (expressions) of the actors A1 and A2, are generated. be. The body motion data is generated by, for example, the body motion data generating section 21a, and the face motion data is generated by, for example, the face motion data generating section 21b.

Next, in step S12, by applying the body motion data and face motion data of actor A1 to the model data for actor A1, the animation of the first character object that moves in synchronization with the movement of the body and facial expression of actor A1 is performed. is generated. Similarly, by applying the body motion data and face motion data of actor A2 to the model data for actor A2, animation of a second character object that moves in synchronization with the movement of the body and facial expression of actor A2 is generated. . This animation is generated by, for example, the animation generation unit 21c.

Next, in step S13, a moving image including an image of the virtual space, animation of the first character object corresponding to actor A1, and animation of the second character object corresponding to actor A2 is generated. The voices of actor A1 and actor A2 may be synthesized in this moving image. The animation of the first character object and the animation of the second character object may be arranged in the virtual space. This moving image is generated by, for example, the moving image generation unit 21d.

Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the client devices 10a to 10c and other client devices via the network 50. FIG. This moving image is distributed to the supporter computer 40 and may be projected on the screen S in the studio room R. The moving images are distributed continuously over a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any time other than these.

Next, proceeding to step S15, it is determined whether or not the end condition for ending the distribution of the moving image is satisfied. The end condition is, for example, that the delivery end time has been reached, that the supporter computer 40 has issued an instruction to end the delivery, or other conditions. If the termination condition is not satisfied, the processes of steps S11 to S14 are repeatedly executed, and the distribution of moving images including animation synchronized with the movements of actors A1 and A2 is continued. When it is determined that the termination condition is satisfied for the moving image, the distribution processing for the moving image is terminated.

Next, another embodiment of the present invention will be described with reference to FIGS. 17 and 18. FIG. FIG. 17 shows a display example of a posted message displayed on a moving image being played on the client device 10a in another embodiment of the present invention, and FIG. 18 shows the flow of posted message display processing in this other embodiment. FIG. 2 is a flow diagram showing;

Display image 170 shown in FIG. 17 includes first display area 176 and second display area 177 . First posted messages 176 a to 176 d are displayed in first display area 176 , and second posted message 177 a is displayed in second display area 177 . In the embodiment shown in FIG. 17, the posted message processing unit 21i displays posted messages (first posted messages) from viewing users belonging to the first user group in the first display area 76, and displays posted messages from the viewing users belonging to the first user group. A process for displaying a posted message (second posted message) from a viewing user belonging to the group in the second display area 177 is performed.

In the display processing of the posted message shown in FIG. 18, it is assumed that the posted message for the moving image is posted from the client device to the server device 20 that distributes the moving image while the moving image is being distributed. The posted message display processing is performed in parallel with the moving image distribution processing shown in FIG. 15 . The posted message received by server device 20 is stored in storage 23 as posted data 23e.

In step S21, the posted message stored in storage 23 is read. Posted messages are read out in order of posting, for example.

Next, in step S22, it is determined to which user group the viewing user who posted the posted message read out from the storage 23 belongs. In the posted data 23e, the posted message is stored in association with the account information of the viewing user who posted the posted message and the group information indicating the user group to which the viewing user belongs. , the user group to which the user who posted the posted message belongs.

When it is determined that the viewing user who posted the posted message belongs to the first user group, the display process proceeds to step S23, and when it is determined that the viewing user who posted the posted message belongs to the second user group. The display process proceeds to step S24.

In step S23, the posted message read out in step S21 is displayed in the first display area (eg, first display area 76).

In step S24, the posted message read in step S21 is displayed in the second display area (eg, second display area 77).

As described above, the posted message read out from the storage 23 is displayed in the display area corresponding to the user group to which the user who posted the posted message belongs.

According to one embodiment described above, it includes a first display area 76 in which the first posted message is displayed, and a second display area 77 in which the second posted message is displayed but the first posted message is not displayed. Video is delivered. Thereby, the display area of the posted message can be allocated according to the user group to which the user who posted the posted message belongs. Conventionally, since only one display area for posted messages is provided in a predetermined area of the display screen, posted messages from users of various user groups are displayed in the same display area. In contrast, according to the above-described embodiment, display processing of the posted message is performed according to the user group to which the user who posted the posted message belongs. This makes it possible to diversify the display mode of the posted message.

In one embodiment, part of the second display area 77 is arranged behind the character object 71A and the character object 71B. This allows the second posted message to be displayed in an area that more easily attracts the attention of other users.

In one embodiment, the second display area 77 is included in the animation during the second distribution period during which actor A1 and actor A2 perform. Since the second display area 77 is displayed behind the character objects 71A and 71B whose motions are controlled according to the performances of the actors A1 and A2, it is easier to attract the attention of other users. Also, since the second display area 77 is arranged behind the character object 71A and the character object 71B, it is less likely to interfere with viewing of the performance of the character object 71A and the character object 71B.

In one embodiment, the character object is placed behind the first display area 76 when the first display area 76 and at least one of the character objects 71A and 71B are displayed in an overlapping manner. As a result, the posted message is displayed without being hidden behind the character object during the distribution period when the display of the posted message by the viewing user and the actors A1 and A2 is more important.

As described above, according to the above embodiment, it is possible to change the display mode of the posted message according to the content of the moving image (for example, whether the actor is performing a performance or not). Therefore, it is possible to diversify the display mode of the posted message without degrading the video viewing experience of the viewing user.

In the above embodiment, the viewing users belonging to the second user group can receive preferential services or better functions than the viewing users belonging to the first user group in terms of displaying posted messages.

For example, a viewing user belonging to the second user group can use the first command to specify the moving direction of the second posted message, and can use the second command to specify the display start position of the second posted message. . As a result, the viewing users belonging to the second user group can move their posted message in a direction that attracts more attention or display it in a position that attracts more attention. On the other hand, the viewing users belonging to the first user group cannot specify the moving direction of the posted message or the initial display position.

In the above embodiment, display control of the posted message is performed such that the moving speed of the second posted message in the second display area 77 is slower than the moving speed of the first posted message in the first display area 76. . This allows the viewing users belonging to the second user group to display their posted messages on the display screen longer than the viewing users belonging to the first user group.

In one embodiment described above, viewing users belonging to the second user group can post messages during any of the first distribution periods 161 , 163 and the second distribution period 162 . On the other hand, users belonging to the first user group can post messages only during the first delivery periods 161,163.

Embodiments of the present invention are not limited to the embodiments described above, and various modifications are possible without departing from the scope of the invention. For example, the video to be distributed may be shot and generated outside the studio room R. For example, filming for generating moving images to be distributed may be performed at the actor's or supporter's home.

Posted messages posted by viewing users may not be stored in the storage 23 . In this case, the posted message processing unit 21i analyzes the posted message received from the client device, identifies the user group to which the user who posted the posted message belongs, and displays the posted message in the display area corresponding to the identified user group. Messages can be displayed.

In the processing procedures described in this specification, especially in the processing procedures described using flow diagrams, some of the steps that make up the processing procedure are omitted, and as a step that makes up the processing procedure It is possible to add steps that are not specified and/or change the order of the steps, and the processing procedures in which such omissions, additions, and order changes do not deviate from the spirit of the present invention. Included within the scope of the invention.

The invention described in the scope of claims as originally filed in the original application of the present application will be additionally described below.
[1]
A first posted message posted by a first user included in a first user group among a plurality of viewing users and a second posted message posted by a second user included in a second user group among the plurality of viewing users and one or more computer processors,
The one or more computer processors, by executing computer readable instructions,
Animation of a character object generated to move in a virtual space based on movement of an actor, the first posted message, the second posted message, and a display request from the first user or the second user a gift object representing an electronic gift; and
The gift objects include a first gift object that is displayed in association with a specific part of the character object, and a second gift object that is displayed without being associated with the specific part of the character object,
the display request for the second gift object includes a movement direction parameter;
the second gift object moves in the movement direction specified by the movement direction parameter in the moving image;
video playback system.
[2]
The first gift object is displayed in the animation so as to follow the movement of the character object.
The moving image reproduction system according to [1].
[3]
The display request for the second gift object includes a display position specification parameter,
the second gift object is displayed at the position designated by the display position designation parameter;
The moving image reproduction system according to [1] or [2].
[4]
the second gift object is displayed at a position that does not overlap with the character object;
The moving image reproduction system according to any one of [1] to [3].
[5]
when the size of the second gift object in the virtual space is larger than a reference size, the second gift object is placed at a position that does not overlap with the character object;
The moving image reproduction system according to [4].
[6]
the second gift object is displayed behind the character object;
The moving image reproduction system according to any one of [1] to [5].
[7]
The moving image reproducing system according to [6], wherein the second gift object is displayed behind the character object when the size of the second gift object in the virtual space is larger than a reference size.
[8]
When the size of the second gift object in the virtual space is smaller than a reference size, at least part of the second gift object is arranged at a position overlapping the character object.
The moving image reproduction system according to any one of [1] to [7].
[9]
the first gift object is displayed for a longer period of time than the second gift object;
The moving image reproduction system according to any one of [1] to [8].
[10]
The virtual space is constructed based on tracking information of active sensors selected from among a plurality of cameras,
When the first camera of the plurality of cameras is selected as the active sensor, the second posted message is displayed behind the character object,
When a second camera among the plurality of cameras is selected as the active sensor, the second posted message is displayed so as not to overlap with the character object.
The moving image reproduction system according to any one of [1] to [9].
[11]
The virtual space is constructed based on tracking information of active sensors selected from among a plurality of cameras,
The first posted message is sent when a first camera among the plurality of cameras is selected as the active sensor and when a second camera among the plurality of cameras is selected as the active sensor. displayed in the same position,
The moving image reproduction system according to any one of [1] to [10].
[12]
at least one of the first posted message and the second posted message is displayed on the gift object;
The moving image reproduction system according to any one of [1] to [11].
[13]
1. A method of playing a video performed by one or more computer processors executing computer readable instructions, comprising:
an animation of a character object generated to move in a virtual space based on the movement of an actor; a first posted message posted by a first user included in a first user group among the plurality of viewing users; a second posted message posted by a second user included in a second user group among the viewing users; and a gift object representing an electronic gift requested to be displayed by the first user or the second user. comprising the step of playing back the video on a client terminal used by each of the plurality of viewing users;
The gift objects include a first gift object that is displayed in association with a specific part of the character object, and a second gift object that is displayed without being associated with the specific part of the character object,
the second gift object moves in a movement direction specified by a movement direction parameter included in the second gift object display request;
Video playback method.
[14]
A program executed by one or more computer processors,
to the one or more computer processors;
an animation of a character object generated to move in a virtual space based on the movement of an actor; a first posted message posted by a first user included in a first user group among the plurality of viewing users; a second posted message posted by a second user included in a second user group among the viewing users; and a gift object representing an electronic gift requested to be displayed by the first user or the second user. causing a client terminal used by each of the plurality of viewing users to reproduce the moving image;
The gift objects include a first gift object that is displayed in association with a specific part of the character object, and a second gift object that is displayed without being associated with the specific part of the character object,
the second gift object moves in a movement direction specified by a movement direction parameter included in the second gift object display request;
Video player program.

Code description

1 Video distribution system

Claims (11)

a storage for storing posted messages posted by users; and one or more computer processors,
The one or more computer processors, by executing computer readable instructions,
distributing a moving image including an animation of a character object generated to move in a virtual space based on the movement of an actor and the posted message;
The posted message is displayed in different display modes in a first distribution section and a second distribution section different from the first distribution section,
The posted message includes a first posted message posted by a first user included in a first user group and a second posted message posted by a second user included in a second user group,
The first posted message is displayed in the first distribution section,
the second posted message is displayed in the second distribution section,
the display time during which the second posted message is displayed is longer than the display time during which the first posted message is displayed;
video distribution system. The second distribution section is a distribution section for the character object to perform a performance.
The moving picture delivery system according to claim 1. Transition from the first distribution section to the second distribution section according to an instruction from the actor or a supporter who supports the distribution of the video;
3. The moving picture delivery system according to claim 1 or 2. the first posted message is displayed in duplicate on the character object;
The moving image distribution system according to any one of claims 1 to 3. the first posted message is displayed to move in a first direction;
The moving image distribution system according to any one of claims 1 to 4. the second posted message is displayed to move in a second direction;
The moving image distribution system according to any one of claims 1 to 5. 7. The moving picture distribution system according to claim 1, wherein the moving speed of the second posted message is slower than the moving speed of the first posted message. The second user group consists of fewer users than the first user group,
The moving image distribution system according to any one of claims 1 to 7. the animation further includes a gift object representing an electronic gift requested by the first user or the second user for display;
The moving image distribution system according to any one of claims 1 to 8. A video distribution method performed by one or more computer processors executing computer readable instructions, comprising:
a step of distributing a moving image including an animation of a character object generated to move in a virtual space based on the movement of an actor and a posted message posted by a user;
The posted message is displayed in different display modes in a first distribution section and a second distribution section different from the first distribution section, and the posted message is a first user posted by a first user included in a first user group. including a posted message and a second posted message posted by a second user included in a second user group;
The first posted message is displayed in the first distribution section,
the second posted message is displayed in the second distribution section,
the display time during which the second posted message is displayed is longer than the display time during which the first posted message is displayed;
video delivery method. A program executed by one or more computer processors,
to the one or more computer processors;
A moving image distribution program for executing a step of distributing a moving image including an animation of a character object generated to move in a virtual space based on the movement of an actor and a posted message posted by a user,
The posted message is displayed in different display modes in a first distribution section and a second distribution section different from the first distribution section,
The posted message includes a first posted message posted by a first user included in a first user group and a second posted message posted by a second user included in a second user group,
The first posted message is displayed in the first distribution section,
the second posted message is displayed in the second distribution section,
the display time during which the second posted message is displayed is longer than the display time during which the first posted message is displayed;
video distribution program.