JP2020017981A - Moving image distribution system distributing moving image including message from viewer user - Google Patents

Abstract

To provide a moving image distribution system improving the display mode of contribution message assigned with a partial region of the moving image as a display space.SOLUTION: A moving image distribution system 1 includes a storage for storing a first contribution message posted by a first user included in a first user group, a second contribution message posted by a second user included in a second user group, and an object provided by at least one of the first and second users, and one or more computer processors. A moving image including a first display space capable of displaying the first and second contribution messages, and a second display space capable of displaying the second contribution message but not displaying the first contribution message is distributed.SELECTED DRAWING: Figure 1

Description

    The disclosure herein relates to a moving image distribution system that distributes a moving image including a message from a viewing user. More specifically, the disclosure herein relates to a moving image distribution system that distributes a moving image including an animation of a character object generated based on the movement of an actor and a message from a viewing user.

    2. Description of the Related Art A moving image distribution system that generates an animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object has been known. Such a moving image distribution system is disclosed, for example, in Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1).

    Patent Document 1 discloses that the chat function can be implemented in the moving image distribution system. In such a chat function, a message is posted from a viewing user who views a moving image. The actor can see this posted message. When the actor reacts to the message, the reaction is reflected in the video. With this chat function, the interaction between the viewing users and the interaction between the viewing user and the actor are realized.

JP 2015-184689 A

    Conventionally, a partial area of a display screen of a moving image is allocated as a display area of a posted message. Due to space restrictions on the display screen, the display area of the posted message may overlap the character object. In this case, the posting message and the character object may be displayed in an overlapping manner, which may deteriorate the viewing experience of the viewing user. For example, if the main part of the character object is hidden by the posted message, the viewer may feel that the viewing of the moving image has been hindered.

    If a display area for displaying the posted message is secured in a certain area of the display screen and display control is performed to prevent the character object from being displayed in this display area, the overlap between the character object and the posted message can be avoided. . However, the display position of the character object is limited, and this point is a great restriction in producing a moving image.

    Thus, if the display area of the posted object is limited to a certain area, it is difficult to provide a satisfactory viewing experience to the user. There is a need for an improvement in the display mode of a posted message in a moving image including an animation of a character object.

    It is an object of the present disclosure to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above.

    The video distribution system according to an aspect includes a first posted message posted by a first user included in a first user group, a second posted message posted by a second user included in a second user group, and the first posted message. A storage for storing an object provided by at least one of a user and the second user; and one or more computer processors. The first user does not belong to the second user group, the second user does not belong to the first user group, and the second user has a predetermined parameter related to the object. A user who meets the conditions. The one or more computer processors execute a computer-readable instruction, so that the first display area that can display the first posted message and the second posted message, and the second posted message can be displayed. On the other hand, a moving image including a second display area in which the first posted message is not displayed is delivered.

  A moving image distribution system according to one aspect includes a storage that stores a first posted message posted by a first user included in a first user group and a second posted message posted by a second user included in a second user group. And one or more computer processors. The first user does not belong to the second user group, and the second user does not belong to the first user group. The one or more computer processors execute a computer-readable instruction, so that the first display area that can display the first posted message and the second posted message, and the second posted message can be displayed. On the other hand, a moving image including a second display area in which the first posted message is not displayed is delivered. The second user is a user whose viewing condition of the moving image satisfies a predetermined upper surface.

    In the moving image distribution system according to one aspect, the second user group includes a smaller number of users than the first user group.

    In the moving image distribution system according to one aspect, the first posted message moves in a first direction in the first display area.

    In the moving image distribution system according to an aspect, the second posted message moves in a second direction in the second display area.

    In the moving image distribution system according to one aspect, the second direction changes according to a first command included in the second posted message.

    In the moving image distribution system according to one aspect, an initial display position of the second posted message in the second display area changes according to a second command included in the second posted message.

    In the moving image distribution system according to one aspect, a moving speed of the second posted message in the second display area is lower than a moving speed of the first posted message in the first display area.

    In the moving image distribution system according to one aspect, a display time in which the second posted message is displayed in the second display area is longer than a display time in which the first posted message is displayed in the first display area.

    In the moving image distribution system according to one aspect, information other than the first posted message is also displayed in the first display area.

    In the moving image distribution system according to an aspect, the storage stores an object provided by at least one of the first user and the second user.

    In the moving image distribution system according to one aspect, the information other than the first posted message includes a notification indicating that the object has been provided.

    In the moving image distribution system according to one aspect, the second user is a user whose parameters regarding the object satisfy predetermined conditions.

    In the moving image distribution system according to one aspect, the second user is a user whose number of times the moving image has been viewed exceeds a predetermined number.

    In the moving image distribution system according to one aspect, when the number of posts of the first posted message exceeds a predetermined number, the first user leaves the first user group and is included in the second user group.

    In the moving image distribution system according to an aspect, the moving image includes an animation of a character object generated based on a movement of an actor.

    In the moving image distribution system according to one aspect, at least a part of the second display area is arranged behind the character object.

    In the moving image distribution system according to an aspect, when the first display area and the character object are displayed overlapping, the character object is arranged behind the first display area.

    A moving image distribution system according to an aspect further includes a plurality of cameras, and includes an image of a virtual space configured based on tracking information of an active sensor selected from the plurality of cameras.

    In the moving image distribution system according to an aspect, the second display area is provided in a display object in the virtual space, and a position of the second display area in the virtual space is determined according to a position and an orientation of the active sensor. Be changed.

    In the moving image distribution system according to an aspect, the second display area is provided in the virtual space, and a size of the second display area in the virtual space is changed according to a position and an orientation of the active sensor. .

    In the moving image distribution system according to an aspect, at least a part of the one or more computer processors is provided in a server device, and information other than the first posted message includes a notification from the server device.

    In the moving image distribution system according to one aspect, the first display area displays the first posted message and the second posted message.

  In the moving image distribution system according to an aspect, the first user posts a first posted message using a client device, and during the second distribution period, the client device does not post the first posted message. It is composed of

  In the moving image distribution system according to an aspect, an electronic gift is displayed as a gift object in the virtual space, and the second display area is provided on the gift object in the virtual space.

    A moving image distribution method according to an aspect is executed when one or more computer processors execute computer-readable instructions. The moving image distribution method includes a step of storing a first posted message posted by a first user included in a first user group, and a step of storing a second posted message posted by a second user included in a second user group. Performing an operation, storing an object provided by at least one of the first user and the second user, a first display area capable of displaying the first posted message and the second posted message, And a second display area in which the first posted message is not displayed while the second posted message can be displayed. In this embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user A user whose parameters relating to the object satisfy predetermined conditions.

  A moving image distribution method according to an aspect includes a step of storing a first posted message posted by a first user included in a first user group, and a second posted message posted by a second user included in a second user group. , A first display area in which the first posted message and the second posted message can be displayed, and a second display in which the second posted message can be displayed while the first posted message is not displayed. And a step of delivering a moving image including the region. In this embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user A user whose viewing status of a moving image satisfies a predetermined condition.

    A program according to an aspect is a program executed by one or more computer processors, and stores a first posted message posted by a first user included in a first user group in the one or more computer processors. And storing a second posted message posted by a second user included in a second user group, and storing an object provided by at least one of the first user and the second user. A first display area in which the first posted message and the second posted message can be displayed, and a second display area in which the second posted message can be displayed but the first posted message is not displayed. And delivering the moving image. In this embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user A user whose parameters relating to the object satisfy predetermined conditions.

    A program according to an aspect is a program executed by one or more computer processors, and stores a first posted message posted by a first user included in a first user group in the one or more computer processors. Performing, storing a second posted message posted by a second user included in a second user group, a first display area capable of displaying the first posted message and the second posted message, Distributing a moving image including a second display area in which the second posted message can be displayed while the first posted message is not displayed. In this embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user A user whose viewing status of a moving image satisfies a predetermined condition.

    According to the embodiment, a posting message from a user viewing a moving image can be displayed in a display area corresponding to a user group to which the viewing user belongs.

FIG. 1 is a block diagram illustrating a moving image distribution system according to an embodiment. FIG. 2 is a schematic diagram schematically showing facilities of a studio for producing a moving image distributed by the moving image distribution system of FIG. 1. FIG. 2 is a diagram illustrating a holding list stored in the moving image distribution system of FIG. 1. FIG. 2 is a diagram illustrating a candidate list stored in the moving image distribution system of FIG. 1. FIG. 2 is a diagram illustrating posted data stored in the video distribution system of FIG. 1. FIG. 2 is a diagram illustrating viewing management data stored in the moving image distribution system of FIG. 1. FIG. 6 is a diagram illustrating an example of a moving image displayed on the client device 10a in one embodiment. FIG. 7 includes an animation of the character object. FIG. 6 is a diagram illustrating an example of a moving image displayed on the client device 10a in one embodiment. FIG. 8 includes a normal object. FIG. 6 is a diagram illustrating an example of a moving image displayed on the client device 10a in one embodiment. FIG. 9 includes a decorative object. It is a schematic diagram which shows the example of the decoration object selection screen for selecting the desired selection decoration object from the decoration objects contained in the candidate list. FIG. 9 is a diagram illustrating an example of a moving image including a first posted message displayed on the client device 10a in one embodiment. FIG. 9 is a diagram illustrating an example of a moving image including a first posted message displayed on the client device 10a in one embodiment. FIG. 9 is a diagram illustrating an example of a moving image including a second posted message displayed on the client device 10a according to one embodiment. FIG. 9 is a diagram illustrating an example of a moving image including a second posted message displayed on the client device 10a according to one embodiment. It is a flowchart which shows the flow of a moving image distribution process in one Embodiment. FIG. 2 is a diagram for explaining division of a distribution period of a moving image distributed in the moving image distribution system of FIG. 1. FIG. 14 is a diagram illustrating an example of a moving image including a first posted message displayed on a client device 10a in another embodiment. It is a flowchart which shows the flow of the posted message display processing in another embodiment.

    Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. The same reference numerals are given to the same or similar components in a plurality of drawings.

    A moving image distribution system according to an embodiment will be described with reference to FIGS. FIG. 1 is a block diagram illustrating a moving image distribution system 1 according to an embodiment, and FIG. 2 is a schematic diagram schematically illustrating facilities of a studio in which a moving image distributed by the moving image distribution system 1 is produced. 3 to 6 are diagrams for explaining information stored in the moving image distribution system 1. FIG.

    The moving image distribution system 1 includes client devices 10a to 10c, a server device 20, a studio unit 30, and a storage 60. The client devices 10a to 10c, the server device 20, and the storage 60 are communicably connected to each other via a network 50. The server device 20 is configured to distribute a moving image including a character animation, as described later. The character included in this moving image may be motion-controlled in the virtual space.

    This moving image can be distributed from the server device 20 to each of the client devices 10a to 10c. A first viewing user who is a user of the client device 10a, a second viewing user who is a user of the client device 10b, and a third viewing user who is a user of the client device 10c view the distributed moving image with each client device. be able to. The moving image distribution system 1 may include less than three client devices, or may include more than three client devices.

    The client devices 10a to 10c are information processing devices such as smartphones. The client devices 10a to 10c may be a mobile phone, a tablet terminal, a personal computer, an electronic book reader, a wearable computer, a game console, and various other information processing devices capable of reproducing moving images in addition to a smartphone. Each of the client devices 10a to 10c includes a computer processor, a memory, a communication I / F, a display, a sensor unit including various sensors such as a gyro sensor, a microphone and other sound collecting devices, and a storage for storing various information. Is also good.

    The display of each of the client devices 10a to 10c has a display panel and a touch panel. The touch panel is configured to detect a player's touch operation (contact operation). The touch panel can detect various touch operations such as tap, double tap, and drag of the player. The touch panel may include a proximity sensor of a capacitance type, and may be configured to be able to detect a non-contact operation of the player.

    The viewing user can input a message related to the distributed moving image or other messages via the touch panel of the client devices 10a to 10c. This message may be, for example, a text message, a still image message, a moving image message, or an electronic message of any other format. Each of the client devices 10a to 10c can be configured to post (transmit) a message input by the viewing user to the server device 20. In the present specification, a message transmitted to the server device 20 from the client devices 10a to 10c and / or other client devices for viewing the distributed moving image may be referred to as a posted message. For example, regarding the moving image distributed to the client device 10a of the first viewing user, the first viewing user inputs the moving image to the client device 10a, and the posting message transmitted from the client device 10a to the server device 20 is the first message. This is a posting message of the viewing user.

    In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication I / F 22, and a storage 23.

    The computer processor 21 is an arithmetic device that loads an operating system and various programs for realizing various functions from a storage 23 or another storage into a memory, and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, and an MCU. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a set of a plurality of physically separate computer processors. In the present specification, a program described as being executed by the computer processor 21 or instructions included in the program may be executed by a single computer processor, or may be executed in a distributed manner by a plurality of computer processors. Is also good. Further, the program executed by the computer processor 21 or the instructions included in the program may be executed by a plurality of virtual computer processors.

    The communication I / F 22 is implemented as hardware, firmware, communication software such as a TCP / IP driver or a PPP driver, or a combination thereof. The server device 20 can transmit and receive data to and from another device via the communication I / F 22.

    The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices capable of storing data. Various programs can be stored in the storage 23. At least a part of the programs and various data that can be stored in the storage 23 may be stored in a storage physically separate from the server device 20 (for example, the storage 60).

    Many of the components of the studio unit 30 are arranged, for example, in the studio room R shown in FIG. As illustrated, in the studio room R, actors A1 and A2 are performing. The studio unit 30 is configured to detect the movement and expression of the actors A1 and A2 and output the detected information to the server device 20.

    Each of the actors A1 and A2 is a target whose movement and expression are captured by a sensor group described later provided in the studio unit 30. In the illustrated embodiment, actors A1 and A2 are persons who perform talks, performances, and other actions to advance programs distributed as moving images. The actor A1 and the actor A2 may be animals or any other moving objects (non-living objects) other than humans. The actors A1 and A2 may be, for example, robots capable of independent movement. The number of actors in the studio room R may be one, or may be three or more.

    The studio unit 30 includes six motion sensors 31a to 31f mounted on the actor A1, a controller 33a held on the left hand of the actor A1, a controller 33b held on the right hand of the actor A1, and a mounting tool 37b. And a camera 37a attached to the head of the actor A1 via the camera 37a. The studio unit 30 also includes six motion sensors 32a to 32f mounted on the actor A2, a controller 34a held on the left hand of the actor A2, a controller 34b held on the right hand of the actor A2, and a mounting tool 38b. And a camera 38a attached to the head of the actor A2 via the camera 38a. A microphone for acquiring audio data may be attached to each of the mounting tool 37b and the mounting tool 38b. This microphone can acquire the utterances of the actors A1 and A2 as audio data. The microphone may be a mounted microphone that is mounted on the actor A1 and the actor A2 via the mounting device 37b and the mounting device 38b, and may be a mounted microphone that is installed on the floor, wall, or ceiling of the studio room R. It may be. The studio unit 30 has a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39, in addition to the above components. A supporter computer 40 is installed in an adjacent room separated by a glass window from the studio room R. The server device 20 may be installed in the same room where the supporter computer 40 is installed.

    The motion sensors 31a to 31f and the motion sensors 32a to 32f detect their positions and orientations in cooperation with the base stations 35a and 35b. In one embodiment, base station 35a and base station 35b are multi-axis laser emitters. After emitting the flashing light for synchronization, the base station 35a scans the laser light, for example, around the vertical axis. The base station 35b scans the laser light, for example, around a horizontal axis. Each of the motion sensors 31a to 31f and the motion sensors 32a to 32f may include a plurality of optical sensors for detecting the incidence of blinking light and laser light from the base station 35a and the base station 35b, respectively. The motion sensors 31a to 31f and the motion sensors 32a to 32f respectively include a time difference between the timing of the flashing light and the timing of the laser light, the light receiving time at each optical sensor, the incident angle of the laser light detected by each optical sensor, and If necessary, the own position and orientation may be detected based on other information. The motion sensors 31a to 31f and the motion sensors 32a to 32f may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station 35a and the base station 35b may be, for example, base stations provided by HTC CORPORATION.

The detection information indicating the position and the direction of each motion sensor calculated by each of the motion sensors 31a to 31f and the motion sensors 32a to 32f is transmitted to the server device 20. This detection information may be wirelessly transmitted to the server device 20 from each of the motion sensors 31a to 31f and the motion sensors 32a to 32f. Since the base station 35a and the base station 35b emit the blinking light and scan the laser light at fixed intervals, the detection information of each motion sensor is updated at each interval. The number of base stations may be three or more. The position of the base station may be changed as appropriate. For example, in addition to or in place of a base station arranged at the upper corner of the space to be detected by the tracking sensor shown in FIG. 2, a pair is formed in an upper position and a lower position near the floor. An arranged base station may be provided. For example, there may be four base stations. In the illustrated embodiment, actor A1 is equipped with six motion sensors 31a-31f. The motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are mounted on the left wrist, right wrist, left instep, right instep, waist, and top of actor A1, respectively. The motion sensors 31a to 31f may be mounted on the actor A1 via a mounting tool. Actor A2 is equipped with six motion sensors 32a to 32f. The motion sensors 32a to 32f can be attached to the actor A2 at the same positions as the motion sensors 31a to 31f. The motion sensors 31a to 31f and the motion sensors 32a to 32f shown in FIG. 2 are examples. The motion sensors 31a to 31f can be mounted on various parts of the actor A1, and the motion sensors 32a to 32f can be mounted on various parts of the actor A2. The number of motion sensors mounted on the actors A1 and A2 may be 5 or less, or 7 or more. Thus, by detecting the positions and orientations of the motion sensors 31a to 31f and the motion sensors 32a to 32f attached to each part of the body of the actor A1 and the actor A2, the movement of the body of the actor A1 and the actor A2 is detected. be able to.

    In one embodiment, a large number of infrared LEDs are mounted on each of a plurality of motion sensors attached to the actor A1 and the actor A2, and light from the infrared LEDs is provided on the floor or wall of the studio room R. The position and the direction of each of the motion sensors may be detected by detecting with the infrared camera. A position and orientation of each motion sensor may be detected by using a visible light LED instead of the infrared LED and detecting light from the visible light LED with a visible light camera. As described above, a light emitting unit (for example, an infrared LED or a visible light LED) is provided in each of the plurality of motion sensors mounted on the actor, and light from the light emitting unit is received by the light receiving unit ( For example, the position and the direction of each of the motion sensors may be detected by detecting with an infrared camera or a visible light camera).

    In one embodiment, a plurality of reflective markers can be used instead of the motion sensors 31a to 31f and the motion sensors 32a to 32f. The reflection marker is attached to each of the actors A1 and A2 with an adhesive tape or the like. By photographing the actor A1 and the actor A2 to which the reflection marker is attached as described above to generate photographing data, and performing image processing on the photographing data, the position and the direction of the reflection marker can be detected.

    The controller 33a and the controller 33b output a control signal corresponding to the operation of the actor A1 to the server device 20. Similarly, the controller 34a and the controller 34b output a control signal corresponding to the operation of the actor A2 to the server device 20.

    The tracking sensor 36a and the tracking sensor 36b generate tracking information for determining setting information of a virtual camera for constructing a virtual space included in a moving image. The tracking information of the tracking sensor 36a and the tracking sensor 36b is calculated as a position in each three-dimensional orthogonal coordinate system and an angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to the operation of the operator. The tracking sensor 36a transmits tracking information indicating the position and the direction to the tracking information server device 20. Similarly, the position and the direction of the tracking sensor 36b are set according to the operation of the operator. The tracking sensor 36b transmits tracking information indicating the position and orientation to the tracking information server device 20. In the illustrated embodiment, the tracking sensor 36a is provided at the front left of the actor A1. The tracking sensor 36b is provided at a position in front of the actors A1 and A2 and substantially in the middle between the actors A1 and A2.

    The camera 37a is attached to the head of the actor A1, as described above. For example, the camera 37a is arranged so that the face of the actor A1 can be imaged. The camera 37a continuously captures an image of the face of the actor A1, and acquires image data of the face of the actor A1. Similarly, camera 38a is attached to the head of actor A2. The camera 38a is arranged so as to be able to image the face of the actor A2, continuously images the face of the actor A2, and acquires image data of the face of the actor A2. The camera 37a transmits image data of the face of the actor A1 to the server device 20, and the camera 38a transmits image data of the face of the actor A1 to the server device 20. The cameras 37a and 38a may be 3D cameras capable of detecting the depth of a person's face.

    The display 39 is configured to display information received from the support computer 40. The information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other information. The display 39 is arranged at a position visible by the actors A1 and A2.

    In the illustrated embodiment, the supporter computer 40 is installed in a room adjacent to the studio room R. Since the room in which the supporter computer 40 is installed is separated from the studio room R by a glass window, the operator of the supporter computer 40 (hereinafter, sometimes referred to as “supporter” in the present specification) has actors A1 and A2. Can be visually recognized. In the illustrated embodiment, supporters B1 and B2 are present as operators of the supporter computer 40.

    The supporter computer 40 may be configured to be able to change the settings of the components of the studio unit 30 according to the operation of the supporters B1 and B2. The supporter computer 40 can set, for example, a scanning interval by the base station 35a and the base station 35b, a position or an orientation of the tracking sensor 36a and the tracking sensor 36b, and change various settings of various devices other than these. . The switching of the active sensor described later can be executed based on the operation of the supporter computer 40 by the supporters B1 and B2. At least one of the supporters B1 and B2 can input a message to the supporter computer 40 and display the input message on the display 39.

    The components and functions of the studio unit 30 shown in FIG. 2 are exemplary. The studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector. The projector can project a moving image distributed to the client device 10a or another client device on the screen S.

    Next, information stored in the storage 23 in one embodiment will be described. In the illustrated embodiment, the storage 23 includes model data 23a, object data 23b, holding list 23c, candidate list 23d, posting data 23e, viewing management data 23f, and other necessary moving images for generation and distribution. Various information is stored.

    The model data 23a is model data for generating a character animation. The model data 23a may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 23a includes, for example, rig data (sometimes called “skeleton data”) indicating the skeleton of the character, and surface data indicating the shape and texture of the surface of the character. The model data 23a can include a plurality of different model data. The plurality of model data may have different rig data, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data. In the illustrated embodiment, the model data 23a has at least two different types of model data to generate a character object corresponding to the actor A1 and a character object corresponding to the actor A2. The model data for the character object corresponding to the actor A1 and the model data for the character object corresponding to the actor A2 have, for example, the same rig data, but may have different surface data.

    The object data 23b includes asset data for constructing a virtual space forming a moving image. The object data 23b includes data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and data for drawing various objects displayed in the moving image other than these. Contains data. The object data 23a may include object position information indicating the position of the object in the virtual space.

    In addition to the above, the object data 23b may include a gift object displayed in a moving image based on a display request from a viewing user of the client devices 10a to 10c. The gift object may include an effect object, a normal object, and a decoration object. The viewing user can purchase a desired gift object.

    The effect object is an object that affects the impression of the entire viewing screen of the distribution moving image, and is, for example, an object imitating confetti. An object imitating a confetti may be displayed on the entire viewing screen, thereby changing the impression of the entire viewing screen before and after the display. The effect object may be displayed so as to overlap the character object, but is different from the decorative object in that the display associated with a specific part of the character object is not performed.

    The normal object is an object serving as a digital gift from the viewing user to the actor (for example, the actor A1 or the actor A2), for example, an object imitating a stuffed animal or a bouquet. In one aspect, the normal object is displayed on the moving image display screen so as not to contact the character object. In one aspect, the normal object is displayed on the display screen of the moving image so as not to overlap with the character object. The normal object may be displayed so as to overlap with an object other than the character object in the virtual space. The normal object may be displayed so as to overlap with the character object, but is different from the decorative object in that a display associated with a specific part of the character object is not performed. In one aspect, when the normal object is displayed so as to overlap with the character object, the normal object overlaps with a part other than the head including the face of the character object, and does not overlap with the head of the character object. Is displayed as follows.

    The decoration object is an object displayed on the display screen in association with a specific part of the character object. In one aspect, the decorative object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the decorative object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to cover part or all of the specific part of the character object.

    The decorative object is, for example, an accessory (a headband, a necklace, an earring, or the like), a clothing (a T-shirt, or the like), a costume, or any other object to which a character object can be mounted. The object data 23b corresponding to the decoration object may include mounting position information indicating to which part of the character object the decoration object is associated. The mounting position information of a certain decoration object can indicate to which part of the character object the decoration object is mounted. For example, when the decoration object is a headband, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “head” of the character object. When the decoration object is a T-shirt, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “body” of the character object.

    A display time according to the type of each gift object may be set. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

    The holding list 23c is a list indicating the gift objects held by the user viewing the moving image. FIG. 3 shows an example of the holding list 23c. As illustrated, the holding list 23c stores an object ID that specifies a gift object held by the viewing user in association with the account information of the viewing user (for example, the user ID of the viewing user). The viewing users include, for example, first to third viewing users of the client devices 10a to 10c.

    The candidate list 23d is a list of decorative objects for which a display request has been made by the viewing user. As will be described later, the viewing user holding the decorative object can make a display request for the held decorative object. In the candidate list 23d, an object ID for specifying the decoration object is stored in association with the account information of the viewing user who made the display request of the decoration object. This candidate list 23d may be created for each distributor. The candidate list 23d may be stored, for example, in association with distributor identification information that specifies a distributor (actor A1, actor A2, supporter B1, and / or supporter B2).

    The posted data 23e is data indicating a posted message posted by the viewing user. Post data 23e includes account information of the viewing user who posted the posting message, group information indicating a user group to which the viewing user belongs, and a posting message posted by the viewing user. As described above, the storage 23 can store the group information on the user group to which the viewing user belongs and the posted message posted by the viewing user in association with the account information of the viewing user. The posting data 23e indicates the time at which each posting message was posted (for example, the time at which the posting message transmitted from the client device was received by the server device 20 or the time at which the posting message received by the server device 20 was stored in the storage 23). May be stored in the storage area.

    The account information of the viewing user is, for example, user identification information (user ID) of the viewing user.

    The group information is group identification information (group ID) for identifying a group to which the viewing user belongs. The group to which the viewing user belongs includes, for example, a first user group and a second user group. For example, the first user group is a general user group to which a general user belongs, and the second user group is a premium user group to which a premium user different from the general user belongs.

    Various criteria can be adopted as the classification criteria for the first user group and the second user group. Of the viewing users, users who have viewed the video less than a predetermined number of times may be classified as general users, and users whose viewing times are equal to or more than a predetermined number of times may be classified as premium users. Of the viewing users, users who have watched a video for less than a predetermined time may be classified as general users, and users whose viewing time is not less than a predetermined time may be classified as premium users. A user whose purchase amount of the gift object is smaller than the predetermined amount may be classified as a general user, and a user whose purchase amount of the gift object is equal to or more than the predetermined amount may be classified as a premium user. A user whose purchase amount of a gift object is smaller than a predetermined amount may be classified as a general user, and a user whose purchase amount of a gift object is equal to or more than a predetermined amount may be classified as a premium user. Of the viewing users, the users who posted less than a predetermined number of posted messages may be classified as general users, and the users who posted more than a predetermined number of posted messages may be classified as premium users. The number of times of viewing, the viewing time, the purchase amount of the gift object, the purchase amount of the gift object, and the number of posts of the posted message may be a cumulative value from the start of use of the moving image distribution system 1, and may be a total value calculated in a predetermined period It may be.

    In one aspect, the second user group is composed of a smaller number of users than the first user group. Viewing users are classified into a first user group when registering use of the moving image distribution system 1. If the viewing user satisfies the criteria for being classified into the second user group after starting to use the video distribution system 1, the viewing user leaves the first user group and belongs to the second user group. As described above, the user group to which the viewing user belongs may be changed according to the use mode of the moving image distribution system 1. When the viewing user no longer satisfies the criteria for being classified into the second user group, the user group belonging to the first user group may be changed from the second user group.

    In one aspect, even if the classification criteria for the user groups are dynamically adjusted so that the state in which the number of viewing users belonging to the first user group is smaller than the number of viewing users belonging to the second user group is maintained. Good. For example, the server device 20 monitors the number of viewing users belonging to the first user group and the number of viewing users belonging to the second user group, and when the difference is smaller than a predetermined number, the second user group The criteria for classification into may be strict. For example, initially, when the viewing users who watch the video using the video distribution system 1 for 10 hours or more are classified into the second user group, if the number of users belonging to the second user group and the first user group If the difference from the number of viewing users belonging to the video distribution system becomes smaller than a predetermined value, a reference is made to classify the viewing users who use the video distribution system 1 for a viewing time of 20 hours or more into the second user group. May be changed.

    The classification of the viewing users is not limited to those specifically described in this specification. The viewing users may be classified into three or more groups. Further, the classification criteria for determining which group each viewing user belongs to can be arbitrarily determined.

    The posted message is a message posted from the viewing user via the client device. The message posted by the viewing user includes, for example, a text message, a still image message, a moving image message, and various other messages. In this specification, a posted message posted from a viewing user belonging to a first user group is referred to as a first posted message, and a posted message posted from a viewing user belonging to a second user group is referred to as a second posted message. There is.

    The viewing management data 23f is data for managing viewing of a moving image by a viewing user. The viewing management data 23f includes account information of the viewing user, moving image information on moving images distributed by the moving image distribution system 1, and moving image viewing information on viewing of the moving images. In this manner, the storage 23 can store, in association with the account information of the viewing user, the moving image information on the moving image viewed by the viewing user and the moving image viewing information on the viewing of the moving image. The moving image information is, for example, moving image identification information (moving image ID) for identifying a moving image. The moving picture viewing information may include viewing time of the moving picture viewed by the viewing user, the number of times of viewing, and various data related to viewing of the other moving pictures.

    Next, functions realized by the computer processor 21 will be described more specifically. The computer processor 21 executes a computer-readable instruction included in the distribution program to execute a body motion data generation unit 21a, a face motion data generation unit 21b, an animation generation unit 21c, a moving image generation unit 21d, a moving image distribution unit 21e, It functions as a display request processing unit 21f, a decoration object selection unit 21g, an object purchase processing unit 21h, and a posted message processing unit 21i. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 21 may be realized by, for example, a computer processor mounted on the supporter computer 40.

    The body motion data generation unit 21a generates first body motion data of each part of the body of the actor A1 based on the detection information of each of the motion sensors 31a to 31f, and detects each of the motion sensors 32a to 32f. Based on the information, it generates second body motion data that is a digital representation of the position and orientation of each part of the body of actor A2. In this specification, the first body motion data and the second body motion data may be simply referred to as “body motion data”. The body motion data is generated as needed with the passage of time. For example, the body motion data may be generated at predetermined sampling time intervals. As described above, the body motion data can represent the body movements of the actors A1 and A2 in a time-series manner as digital data. In the illustrated embodiment, the motion sensors 31a to 31f and the motion sensors 32a to 32f are mounted on the left and right limbs, the waist, and the head of each of the actors A1 and A2. Based on the detection information of the motion sensors 32a to 32f, it is possible to digitally represent the position and orientation of the entire body of the actor A1 and the actor A2 with time. The body motion data can define, for example, a position and a rotation angle of a bone constituting the rig data included in the model data 23a.

    The face motion data generation unit 21b generates first face motion data, which is a digital representation of the movement of the face of the actor A1, based on the imaging data of the camera 37a, and based on the imaging data of each of the cameras 38a, Generate second face motion data that is a digital representation of the face movement of actor A2. In the present specification, the first face motion data and the second face motion data may be collectively simply referred to as “face motion data”. The face motion data is generated as needed with the passage of time. For example, face motion data may be generated at predetermined sampling time intervals. In this manner, the face motion data can digitally represent the actor A2 and the movement of the face of the actor A2 (change in facial expression) in a time-series manner.

    The animation generation unit 21c applies the body motion data generated by the body motion data generation unit 21a and the face motion data generated by the face motion data generation unit 21b to predetermined model data included in the model data 23a. Is configured to generate an animation of a character object that moves in a virtual space and changes its expression. Specifically, the animation generation unit 21c generates an animation of a character object that moves in synchronization with the movement of the body and expression of the actor A1, based on the first body motion data and the first face motion data related to the actor A1, Based on the second body motion data and the second face motion data related to the actor A2, it is possible to generate an animation of the character object that moves in synchronization with the movement of the body and expression of the actor A2. In the present specification, a character object generated based on the movement and expression of actor A1 is referred to as a “first character object”, and a character object badly generated based on the movement and expression of actor A2 is referred to as “second character object”. Object ".

    The moving image generation unit 21d constructs a virtual space using the object data 23b, and generates the virtual space, the animation of the first character object corresponding to the actor A1, and the animation of the second character object corresponding to the actor A2. Generate a video that includes The first character object is arranged in the virtual space so as to match the position of the actor A1 with respect to the tracking sensor 36a, and the second character object is arranged in the virtual space so as to match the position of the actor A2 with respect to the tracking sensor 36a. Is done. Therefore, by changing the position or the direction of the tracking sensor 36a, the position and the direction of the first character object and the second character object in the virtual space can be changed.

    In one aspect, the moving image generation unit 21d constructs a virtual space based on tracking information of the tracking sensor 36a. For example, the moving image generation unit 21d determines setting information (a position in a virtual space, a gaze position, a gaze direction, and an angle of view) of the virtual camera based on tracking information of the tracking sensor 36a, and Based on this, a drawing area of the entire virtual space is determined, and moving image information for displaying the drawing area in the virtual space is generated.

    The moving image generation unit 21d replaces the tracking information of the tracking sensor 36a, or in addition to the tracking information of the tracking sensor 36a, based on the tracking information of the tracking sensor 36b, based on the tracking information of the tracking sensor 36b. It may be configured to determine the position and orientation of the object and the setting information of the virtual camera. The moving image generation unit 21d determines the setting information of the virtual camera based on the tracking information of a sensor selected from the tracking sensor 36a and the tracking sensor 36b (which may be referred to as an “active sensor” in this specification). It may be configured as follows.

    The moving image generation unit 21d can synthesize the generated moving image with the sounds of the actors A1 and A2 acquired from the microphone of the studio unit 30.

    As described above, the moving image generation unit 21d performs the animation of the first character object that moves in synchronization with the movement of the body and expression of the actor A1, and the second character that moves in synchronization with the movement of the body and expression of the actor A2 An animation of the object is generated, and a moving image for distribution in which the sounds of the actors A1 and A2 are synthesized with the animation can be generated.

    The moving image distribution unit 21e distributes the moving image generated by the moving image generation unit 21d. This moving image is distributed to the client devices 10a to 10c and the other client devices via the network 50. The received moving image is reproduced in the client devices 10a to 10c.

    This moving image may be distributed to a client device (not shown) installed in the studio room R, and may be projected from the client device to the screen S via the short focus projector. This moving image may be distributed to the supporter computer 40. Thereby, the supporters B1 and B2 can check the viewing screen of the distributed moving image.

    FIG. 7 shows a display example of a moving image distributed from the server device 20 to the client device 10a and reproduced on the client device 10a. As illustrated, the display image 70 of the moving image distributed from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes a character object 71A corresponding to the actor A1, a character object 71B corresponding to the actor A2, and a character object 71A and a character object 71B in a virtual space simulating a studio. A floor object 72c corresponding to the studio floor on which the object stands, a table object 72a indicating a table placed on the floor object 72c, and a studio set object 72b indicating a studio set placed on the floor object 72c are included. ing.

    The table object 72a, the studio set object 72b, and the floor object 72c are objects for constructing a virtual space included in the object data 23b instead of a gift object. In the illustrated embodiment, the virtual space included in the distribution moving image is a space imitating a stage on which the character objects 71A and 71B perform. The floor object 72c corresponds to the floor of this stage. The floor object 72c extends in the horizontal direction in the virtual space. The studio set object 72b corresponds to a stage set in this stage. In the illustrated embodiment, the studio set object 72b extends in an arc shape in a plan view, and defines the outer edge of the floor.

    The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The motion of the character object 71A is controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. The motion of the character object 71B is controlled based on the second body motion data and the second face motion data. Therefore, the character object 71A is controlled to move on the screen in synchronization with the movement of the body and expression of the actor A1, and the character object 71B moves on the screen in synchronization with the movement of the body and expression of the actor A2. Is controlled.

    As described above, the distribution moving image from the server device 20 may be distributed to the supporter computer 40. The moving image distributed to the supporter computer 40 is displayed on the supporter computer 40 in the same manner as in FIG. The supporter B1 and the supporter B2 can change the settings of the components of the studio unit 30 while watching the moving image being reproduced on the supporter computer 40. In one aspect, when the supporter B1 and the supporter B2 want to change the angle of the character object 71A and the character object 71B in the moving image being distributed, the supporter computer 40 sends an instruction signal for instructing a change in the direction of the tracking sensor 36a from the supporter computer 40. It can be transmitted to the sensor 36a. The tracking sensor 36a can change the direction according to the instruction signal. For example, the tracking sensor 36a is rotatably attached to the stand via a rotating mechanism having a built-in actuator around its axis. When the tracking sensor 36a receives an instruction signal for instructing a change in direction, the tracking sensor 36a receives the instruction signal. The actuator of the rotation mechanism may be driven based on the signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one embodiment, the supporter B1 and the supporter B2 transmit an instruction to use the tracking information from the tracking sensor 36b instead of the tracking information from the tracking sensor 36a from the supporter computer 40 to the tracking sensor 36a and the tracking sensor 36b. Is also good.

    In one embodiment, when the supporter B1 and the supporter B2 determine that an instruction to the actor A1 or the actor A2 is necessary by watching the moving image being played on the supporter computer 40, the supporter computer 40 sends a message indicating the instruction to the supporter computer 40. The message can be input and output to the display 39. For example, the supporters B1 and B2 can instruct the actor A1 or the actor A2 to change the standing position through the message displayed on the display 39.

    The display request processing unit 21f receives a display request for a gift object from the client device of the viewing user, and performs processing according to the display request. Each viewing user can transmit a gift object display request to the server device 20 by operating his / her client device. For example, the first viewing user can transmit a gift object display request to the server device 20 by operating the client device 10a. The display request for the gift object may include the user ID of the viewing user and identification information (object ID) for specifying the object for which display is requested.

    As described above, the gift object may include an effect object, a normal object, and a decoration object. The effect object and the normal object are examples of the first object. A display request for requesting display of an effect object or a normal object is an example of a first display request.

    In one aspect, when a display request processing unit 21f receives a display request of a specific effect object from a viewing user, the display request processing unit 21f causes the display image 70 of the moving image to display the effect object requested to be displayed based on the display request. Perform processing. For example, when a display request for an effect object corresponding to confetti is made, the display request processing unit 21f displays an effect object 73 indicating confetti based on the display request as shown in FIG. To be displayed.

    In one embodiment, when a display request processing unit 21f receives a display request for a specific normal object from a viewing user, the display request processing unit 21f performs a process for displaying the requested normal object on the moving image 70 based on the display request. . For example, when a display request of a normal object indicating a stuffed bear is made, the display request processing unit 21f displays a normal object 74 indicating a stuffed bear based on the display request as shown in FIG. 70 is displayed.

    The display request for the normal object 74 may include a display position specification parameter for specifying the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at a position designated by the display position designation parameter in the virtual space. For example, the display position of the normal object 74 can be specified on the table object 72a indicating the table by the display position specification parameter. The viewing user uses the display position specification parameter to specify the position where the normal object is desired to be displayed by viewing the display of the character object 71A, the character object 71B, the gift object, and other objects included in the moving image 70. can do.

    In one aspect, the normal object 74 may be displayed so as to move within the moving image display image 70. For example, the normal object 74 may be displayed so as to fall from the top of the screen to the bottom. In this case, the normal object 74 may be displayed in the display image 70 while falling from the start of the fall to the floor of the virtual space constituting the moving image 70, and may disappear from the display image 70 after dropping on the floor. . The viewing user can see the falling normal object 74 from the start of the fall to the end of the fall. The moving direction of the normal object 74 in the screen can be set arbitrarily. For example, the normal object 74 may be displayed in the display image 70 so as to move from the left to the right, the right to the left, the upper left to the lower left, or the other direction of the moving image 70. The normal object 74 can move on various trajectories. For example, the normal object 74 can move on a linear trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or other trajectories. The viewing user specifies the moving direction parameter for specifying the moving direction of the normal object 74 and the trajectory on which the normal object 74 moves in the display request of the normal object in addition to or instead of the display position specifying parameter. At least one of the trajectory parameters can be included. In one embodiment, among the effect objects and the normal objects, objects whose size in the virtual space is smaller than the reference size (for example, a confetti sheet of the effect object 73) are assigned to the character objects 71A and 71B. Some or all of them may be displayed overlapping. In one embodiment, of the effect object and the normal object, those having a size in the virtual space larger than the reference size (for example, the normal object 74 (a stuffed bear)) are displayed at positions that do not overlap with the character object. . In one embodiment, of the effect object and the normal object, the one in which the size in the virtual space is larger than the reference size (for example, the normal object 74 (a stuffed bear)) is at least one of the character object 71A and the character object 71B. If the character object overlaps with the character object, the character object is displayed after the character object that is overlapped and displayed.

    In one aspect, when receiving a display request for a specific decorative object from a viewing user, the display request processing unit 21f adds the decorative object requested to be displayed to the candidate list 23d based on the display request. The display request of the decoration object is an example of the second display request. For example, the display request processing unit 21f stores identification information (object ID) for identifying a specific decorative object requested to be displayed by the viewing user in the candidate list 23d in association with the user ID of the viewing user. (See FIG. 4). When a plurality of decoration object display requests are made, for each of the plurality of display requests, the user ID of the viewing user who made the display request, the decoration object ID of the decoration object requested to be displayed by the viewing user, and Are stored in the candidate list 23d in association with each other.

    In one aspect, in response to selection of one or more of the decorative objects included in the candidate list 23d, the decorative object selecting unit 21g displays the selected decorative object on the moving image display image 70. Perform a process for causing In this specification, the decoration object selected from the candidate list 23d may be referred to as a “selected decoration object”.

    The selection of the decorative object from the candidate list 23d is performed, for example, by the supporter B1 and the supporter B2 operating the supporter computer 40. In one aspect, the supporter computer 40 displays a decorative object selection screen. FIG. 10 shows an example of a decorative object selection screen 80 according to one embodiment. This decorative object selection screen 80 is displayed on the display of the supporter computer 40, for example. The decoration object selection screen 80 displays each of the plurality of decoration objects included in the candidate list 23d in a table format, for example. As shown in the figure, the decorative object selection screen 80 according to one embodiment includes a first column 81 displaying the type of the decorative object, a second column 82 displaying the image of the decorative object, and a character object associated with the decorative object. And a third column 83 for displaying the part. Further, on the decoration object selection screen 80, selection buttons 84a to 84c for selecting each decoration object are displayed. In this manner, on the decoration object selection screen 80, decoration objects that are candidates for the selected decoration object are displayed.

    The supporters B1 and B2 can select one or more of the decorative objects included in the decorative object selection screen 80. For example, the supporters B1 and B2 can select a headband by selecting the selection button 84a. When the decoration object selection unit 21g detects that a headband has been selected, the display request processing unit 21f displays a selected decoration object 75 indicating the selected headband on the moving image display screen 70, as shown in FIG. Let it. The selected decoration object 75 is displayed on the display image 70 in association with a specific part of the character object. The selected decoration object 75 may be displayed so as to be in contact with the specific part of the character object. For example, since the selection 75 indicating the headband is associated with the head of the character object, the selection 75 is attached to the head of the character object 71A as shown in FIG. The decorative object may be displayed on the display screen 70 so as to move in accordance with the movement of the specific part of the character object. For example, when the head of the character object 71A wearing the headband moves, the selection decoration object 75 indicating the headband also accompanies the head of the character object 71A as if the headband were mounted on the head of the character object 71A. Move.

    The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71B instead of the character object 71A. The selected decoration object 75 may be displayed on the display screen 70 in association with the character objects 71A and 71B.

The decoration object selection screen 80 may be configured so as not to include information capable of specifying a user who holds each decoration object or a user who has requested display of each decoration object. This can prevent the selector from giving preferential treatment to a specific user when selecting the decorative object.

    In one embodiment, the decoration object selection screen 80 may display information about the user who owns each decoration object or, for each decoration object, the user who has made a display request for the decoration object. For example, for each decoration object, the number of times that the user who has requested the display of the decoration object has made the display request of the decoration object and the number of times that the user has made the selection request (for example, five times the display request of the decoration object has been made so far) Information indicating that the user has selected two times), the number of times the user has viewed at least one of the moving images of the character object 71A and the character object B, and the moving image (the character object 71A and the character (Regardless of the appearance of the object B), the number of purchases of the gift object by the user, the number of purchases of the object by the user, points available in the video distribution system 1 owned by the user, video distribution of the user system At level, and it may display various information about the user who made the request for display of the ornamental objects other than these. According to this embodiment, it is possible to select a decoration object based on the behavior and viewing history of the user who has made the display request of the decoration object in the moving image distribution system 1 so far.

In one embodiment, the display of the decorative object may be subject to constraints to eliminate duplication. For example, when a decorative object associated with the specific part is already selected with respect to the character object 71A, selection of another decorative object associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, when the headband associated with the “head” of the character object 71B has already been selected, the other decorations associated with the “head” An object (for example, a decoration object representing a "hat" associated with the head) is not displayed on the decoration object selection screen 80, or a selection button for selecting a decoration object representing the hat is displayed on the selection screen 80. May not be selectable. According to this embodiment, it is possible to prevent the decorative object from being displayed repeatedly on a specific part of the character object.

    The decorative object selection screen 80 may be displayed on another device instead of the supporter computer 40 or in addition to the supporter computer 40. For example, the decorative object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actor A1 and the actor A2 can select a desired decorative object based on the decorative object selection screen 80 displayed on the display 39 or the screen S. The selection of the decoration object by the actor A1 and the actor A2 can be performed by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b, for example.

    In one embodiment, the object purchase processing unit 21h, in response to a request from a user viewing the moving image, transmits purchase information of each of a plurality of gift objects that can be purchased in connection with the moving image to a client device of the viewing user (for example, To the client device 10a). The purchase information of each gift object includes the type of the gift object (effect object, normal object, or decoration object), the image of the gift object, the price of the gift object, and information necessary for purchasing other gift objects. May be included. The viewing user can select a gift object to be purchased based on the gift object purchase information displayed on the client device 10a. The selection of the gift object to be purchased may be performed by operating the client device 10a. When a gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 20. The object purchase processing unit 21h performs a payment process based on the purchase request. When the payment process is completed, the purchased gift object is held by the viewing user. In this case, the object ID of the purchased gift object is stored in the holding list 23c in association with the user ID of the purchased viewing user.

    The gift objects that can be purchased may be different for each moving image. The purchasable gift object may be purchasable in a plurality of videos. That is, the purchasable gift objects may include a unique gift object peculiar to each moving image and a common gift object purchasable in a plurality of moving images. For example, the effect object indicating confetti may be a common gift object that can be purchased in a plurality of moving images.

    In one aspect, when an effect object is purchased while viewing a predetermined moving image, the effect object to be purchased is added to the watching moving image in response to completion of the payment processing for purchasing the effect object. It may be displayed automatically. When a normal object is purchased while watching a predetermined moving image, similarly to the above, in response to completion of the payment processing for purchasing the normal object, the normal gift object to be purchased is changed to the moving image being viewed. May be displayed automatically.

    In another aspect, in response to the completion of the payment processing in the object purchase processing unit 21h for the effect object to be purchased, a payment completion notification is transmitted to the client device 10a, and the purchased effect object is transmitted to the client device 10a. A confirmation screen for confirming to the viewing user whether or not to make a display request of the above may be displayed. If the viewing user has selected to make a display request for the purchased effect object, a display request for displaying the purchased effect object is sent from the client device of the viewing user to the display request processing unit 21f. The display request processing unit 21f may perform a process of displaying the effect object to be purchased on the display image 70 of the moving image. Even when the purchase target is a normal object, a confirmation screen for confirming to the viewing user whether or not a display request for the purchased normal object is to be made may be displayed on the client device 10a.

    As described above, the client devices 10a to 10c and other client devices can transmit the posted message relating to the distribution moving image and other posted messages to the server device 20. The posted message processing unit 21i is configured to perform a process for displaying posted messages received from the client devices 10a to 10c and other client devices in a moving image.

    A display mode of a posted message in one embodiment will be described with reference to FIGS. 11 to 14 show display examples of a posted message displayed on a moving image being reproduced on the client device 10a. FIG. 15 is a flowchart showing the flow of the moving image distribution process in one embodiment, and FIG. 16 is a schematic diagram for explaining a first distribution period and a second distribution period in a distribution moving image. In the first distribution period, the first display area 76 is included in the moving image, and in the second distribution period, the second display area 77 is included in the moving image.

    As shown in FIG. 16, in one embodiment, the server device 20 distributes a moving image between time t1 and time t2. Time t1 is a moving image distribution start time, and time t2 is a moving image distribution end time. In the illustrated embodiment, of the entire distribution period of the moving image, the first distribution period is between time t1 and time t3 and between time t4 and time t2, and the first distribution period is between time t3 and time t4. Two delivery periods. After the distribution start time t1 of the moving image, the first distribution period 161 continues until time t3, the first distribution period 161 is switched from the first distribution period 161 to the second distribution period 162 at time t3, and then the second distribution period is switched at time t4. 162 is switched to the first distribution period 163, and the first distribution period 163 continues until the distribution end time t2. The order, length and number of appearances of the first distribution period and the second distribution period, and other settings relating to the first distribution period and the second distribution period can be arbitrarily determined.

    In one embodiment, the first distribution period and the second distribution period may be switched when a predetermined time has arrived. For example, in the illustrated embodiment, at time t3, the first distribution period 161 is switched to the second distribution period 162, and then at time t4, the second distribution period 162 is switched to the first distribution period 163. In one embodiment, the switching from the first distribution period to the second distribution period and the switching from the second distribution period to the first distribution period may be performed according to an operation of the controller 33a or the controller 33b by the actor A1. May be performed in response to the operation of the controller 34a or 34b by the actor A2. In one embodiment, the switching from the first distribution period to the second distribution period and the switching from the second distribution period to the first distribution period may be performed according to the operation of the supporter computer 40 by the supporter B1 or the supporter B2. Good. Switching between the first distribution period and the second distribution period may be performed in a manner not explicitly described in the present specification.

    FIG. 11 and FIG. 12 show a display image 70 of the distribution moving image in the first distribution period. The display image 70 of the distribution moving image illustrated in FIG. 11 includes an image of a virtual space viewed from a viewpoint determined based on tracking information of the tracking sensor 36b in front of the actor A1 and the actor A2. That is, the display image 70 is an image of a virtual space constructed using the position of the tracking sensor 36b in front of the actor A1 and the actor A2 as a virtual viewpoint. Therefore, the character object 71A and the character object 71B face the front in the display image 70.

    In the illustrated embodiment, the reproduced moving image (or its display image 70) includes the first display area 76.

    In one aspect, the first display area 76 is a display area that is superimposed on the moving image generated by the moving image generation unit 21d. In one aspect, the first display area 76 is a two-dimensional display area.

    In one aspect, the first display area 76 is not an object forming the virtual space generated by the moving image generation unit 21d. In this case, the first display area 76 displays the display image 70 of the moving image regardless of the setting information (position, orientation, and angle of view) of the virtual camera for constructing the virtual space generated by the moving image generating unit 21d. It is displayed in a predetermined area. Even if the active sensor is switched, the first display area 76 may be displayed at a position that does not change before and after the switching. In the illustrated embodiment, an area occupying a certain range at the lower left of the display image 70 is the first display area 76. The position of the first display area 76 is not limited to the position specifically described in this specification. As illustrated, the first display area 76 may be provided in an area overlapping at least one of the character object 71A and the character object 71B. In the illustrated embodiment, the first display area 76 overlaps a part of the character object 71B. In an area where the first display area 76 and the character object 71B overlap, the first display area 76 and the posted message included therein may be displayed on the front of the screen than the character object 71B. In this case, a part of the character object 71B is hidden behind the first display area 76 or the posted message displayed there, and cannot be visually recognized by the viewing user.

    In one aspect, the posted message processing unit 21i displays a posted message posted from a viewing user via the client devices 10a to 10c and other client devices in a display area corresponding to a user group to which the viewing user belongs. It is configured as follows. Since the posted message posted by the viewing user is stored in the storage 23 as the posted data 23e, the posted message processing unit 21i reads the posted message from the storage 23 and displays the read posted message in the first display area 76. Alternatively, it can be displayed in a second display area 77 described later. The posted message may be read in order of earlier posting time.

    In the embodiment shown in FIG. 11, the first display area 76 displays four posted messages 76a to 76d. The posted messages 76a to 76d may be posted messages (first posted messages) from viewing users belonging to the first user group, or may be posted messages (second posted messages) from viewing users belonging to the second user group. ). For example, the posted message 76a, the posted message 76b, the posted message 76c, and the posted message 76d are read from the storage 23 in this order, and each of the read first posted messages is displayed in the first display area 76 in the order in which they were read. Will be displayed. An example of a specific display procedure is as follows. When the first posted message 76a is read, the posted message 76a is displayed at the top of the first display area 76. Next, when the posted message 76b is read, the posted message 76a moves downward from the initial display position, and the posted message 76b is displayed in a space vacated by this movement. Hereinafter, similarly, when a new posted message is displayed, the displayed posted message is moved downward, and the new posted message is displayed in a space vacated by the movement.

    When a new posted message is displayed after the posted message 76a reaches the lower limit of the first display area 76, the posted message 76a that has reached the lower limit is not displayed in the first display area 76. In the display image 70 of FIG. 11, it is assumed that the posted message 76a has reached the lower limit of the first display area 76. At this point, when a new posted message 76e is read from the storage 23 for display in the first display area 76, the posted message 76a is no longer displayed in the first display area 76 as shown in FIG. After the remaining posted messages (the first posted messages 76b to 76d) have moved downward, the posted message 76e is displayed in the space vacated by this movement. As described above, the posted message displayed in the first display area 76 is continuously displayed in the first display area 76 until the post message reaches the end of the movement direction of the first display area 76.

    In the first display area 76, not only the first posted message posted by the viewing user, but also various notifications from the server device 20 may be displayed. For example, when there is a display request for a gift from the first viewing user, that effect may be displayed in the first display area 76 as a message from the system. Notifications from the server device 20 that can be displayed in the first display area 76 can include various types of notifications. The notification from the server device 20 may be, for example, a message for notifying that the viewing user has started viewing the moving image when a certain viewing user starts viewing the moving image.

    As described above, the posted message processing unit 21i performs a process of displaying a posted message of a user belonging to the first user group or the second user group in the first display area 76. In the first display area 76, the first posted message moves in a predetermined moving direction to create a space for displaying a new posted message. In the embodiment shown in FIGS. 11 and 12, the first posted message moves from top to bottom. The moving direction of the first posted message in the first display area 76 is not limited to the direction from top to bottom. The moving direction of the first posted message in the first display area 76 may be from bottom to top, left to right, right to left, or any other direction.

    Subsequently, a moving image distributed in the second distribution period will be described with reference to FIGS. FIGS. 13 and 14 show examples of the display image 130 of the distribution moving image in the second distribution period. In the embodiment shown in FIGS. 13 and 14, it is assumed that a moving image in which the character objects 71A and 71B perform on the stage is distributed in the second distribution period. The display image 130 of the distribution moving image illustrated in FIG. 13 includes an image of the virtual space viewed from a viewpoint determined based on the tracking information of the tracking sensor 36b in front of the actor A1 and the actor A2. That is, the display image 130 is an image of a virtual space constructed using the position of the tracking sensor 36b in front of the actor A1 and the actor A2 as a virtual viewpoint. Therefore, the character object 71A and the character object 71B face the front in the display image 130. FIG. 14 shows a moving image display image 130 generated based on the tracking information of the tracking sensor 36a. Since the tracking sensor 36a is located on the left front of the actors A1 and A2, the character objects 71A and 71B in the display image 130 are oriented in directions other than the front (front right).

    The second display area 77 is an area corresponding to a part or all of the surface of one or a plurality of objects included in the virtual space generated by the moving image generation unit 21d. In the illustrated embodiment, the entire front surface of the screen-shaped screen object 131 is the second display area 77. In this specification, an object in which the second display area 77 is provided, such as the screen object 131, may be referred to as a “display object” or a “message display object”. Any object in the virtual space included in the distribution moving image can be used as a display object. In one embodiment, the gift object may be the display object.

    In the embodiment of FIG. 13, the second display area 77 displays a posted message (second posted message) from a viewing user belonging to the second user group. In the illustrated example, five second posted messages of second posted messages 77a to 77e are displayed in the second display area 77. In the present specification, the second posted messages 77a to 77e may be simply referred to as “second posted messages” if they do not need to be distinguished from each other. As shown in FIG. 13, the second posted message 77a, the second posted message 77b, the second posted message 77c, the second posted message 77d, and the second posted message 77e are read from the storage 23 in this order, The read second posted messages are displayed in the second display area 77 in the order in which they were read. In the second display area 77, a posted message (first posted message) from a viewing user belonging to the first user group is not displayed. In the second distribution period, the viewing user belonging to the first user group cannot post a message due to a function implemented in the client device or can post a message, but the message remains in the second user group. It is not displayed in the display area 77.

    The second posted message displayed in the second display area 77 may move in a predetermined direction in the second display area 77. In the embodiment of FIG. 13, each second posted message moves from the top to the bottom of the second display area 77. Since the screen object 131 (the second display area 77) is arranged behind the character object 71A and the character object 71B in the virtual space, the second posted message among the second posted messages displayed in the second display area 77 is displayed. A part of each of the posted messages 77a to 77d is hidden behind the character objects 71A and 71B. When the second posted message moves to the end in the moving direction of the second display area 77, it is no longer displayed on the display image 70. In one embodiment, display objects such as the screen object 131 are arranged behind the character object in the virtual space. This prevents the character object from being hidden behind the display object and the second posted message displayed on the display object. As described above, it is assumed that the character object performs in the second distribution period. Therefore, by arranging the display object behind the character object, the user can see the performance of the character object without being disturbed by other objects. This can prevent the user's viewing experience from deteriorating.

    The moving direction of the second posted message in the second display area 77 is not limited to the direction from top to bottom. The moving direction of the second posted message in the second display area 77 may be left to right, bottom to top, right to left, or any other direction. The moving direction of the posted message in the second display area 77 may be different from the moving direction of the first posted message in the first display area 76.

    In one aspect, the moving direction of the posted message in the second display area 77 may be determined according to a first command included in the posted message. For example, when creating a posted message via the client device, the viewing user can include a first command specifying the moving direction in the posted message. This first command may be, for example, text “L, R” when specifying movement from left to right. The first command may be added, for example, after the main body of the posted message (the message displayed in the second display area 77). The message body and the first command may be separated by an at mark (“＠”), a comma (“,”), a semicolon (“;”), a colon (“:”), or the like. As described above, the viewing user can create a posted message so as to include the first command for specifying the moving direction of the message in the second display area 77, and transmit the posted message to the server device 20. The first command may be stored in the storage 23 as a part of the post data 23e. When the posted message is read from the storage 23, if the posted message is posted from the second user group, the posted message processing unit 21i moves in the direction specified by the first command. Alternatively, the posted message may be displayed in the second display area 77. The description format of the first command described above can be arbitrarily changed.

    In one aspect, the initial display position of the posted message in second display area 77 may be determined according to a second command included in the posted message. For example, when the viewing user creates a posted message via the client device, the posted message can include a second command specifying the initial display position in the second display area 77. The second command is, for example, text "@L" when the initial display position is at the left end of the second display area, and "@R" when the initial display position is at the right end of the second display area. ", And may be the text" $ C "when the initial display position is at the center of the second display area. The viewing user can create a posted message so as to include the second command, and transmit the posted message to the server device 20. The posted message may include the first command in addition to the second command. The second command may be stored in the storage 23 as a part of the post data 23e. When the posted message processing unit 21i reads the posted message from the storage 23 and finds that the posted message has been posted from the second user group, the posted message processing unit 21i moves the post message to the initial display position specified by the second command. Display post messages. When the posted message also includes the first command, the posted message processing unit 21i causes the posted message to be displayed at the initial display position specified by the second command, and then displays the post message in the direction specified by the first command. May be configured to be moved. The description format of the above-mentioned second command can be arbitrarily changed.

    In one aspect, the posted message processing unit 21i moves each posted message such that the moving speed of the second posted message in the second display area 77 is lower than the moving speed of the first posted message in the first display area 76. Speed can be adjusted.

    In one aspect, the posted message processing unit 21i determines that the second posted message is displayed in the second display area 77 longer than the first display time in which the first posted message is displayed in the first display area 76. The moving speed of each posted message can be adjusted so that the display time becomes longer. When the length of the first display area 76 in the moving direction of the first posted message is the same as the length of the second display area 77 in the moving direction of the second posted message, as described above, the moving speed of the second posted message Is made slower than the moving speed of the first posted message, the display time of the second posted message can be made longer than the display time of the first posted message. When the moving speed of the first posted message is the same as the moving speed of the second posted message, the length of the second display area 73 in the moving direction of the second posted message is changed to the length of the first display area 76 in the moving direction of the first posted message. By making the display time longer, the display time of the second posted message can be made longer than the display time of the first posted message.

    In one aspect, the display of the distribution moving image can be changed by camerawork. As described above, the display image 130 of the distribution moving image shown in FIG. 13 is generated based on the tracking information of the tracking sensor 36b in front of the actors A1 and A2. That is, the display image 130 is generated when the tracking sensor 36b is an active sensor. For this reason, in the display image 130 of FIG. 13, the character object 71A and the character object 71B face the front. By switching the active sensor from the tracking sensor 36b to the tracking sensor 36a, a moving image including the virtual space generated based on the tracking information of the tracking sensor 36a is generated. FIG. 14 shows an example of a display image of a moving image generated based on the tracking information of the tracking sensor 36a. Since the tracking sensor 36a is located on the left front of the actors A1 and A2, the character objects 71A and 71B in the display image 130 are oriented in directions other than the front (front right). In addition, the screen object 131, the second display area 77 provided on the surface of the screen object 131, and the second posted message displayed in the second display area 77 are also displayed at an angle. As described above, the position and the orientation of the second display area 77 (or the screen object 131) in the virtual space are determined by which tracking sensor is used as the active sensor. Further, when the position or the direction of the active sensor is changed, the position or the direction of the second display area 77 (or the screen object 131) in the virtual space is changed accordingly. The second display area 77 (or the screen object 131) in the display image 130 when the tracking sensor 36a shown in FIG. 14 is the active sensor is a display when the tracking sensor 36a shown in FIG. 13 is the active sensor. The image is displayed smaller than the second display area 77 (or the screen object 131) in the display image 130 in the image by an amount viewed from an oblique direction.

    When the active sensor is switched from the tracking sensor 36b to the tracking sensor 36a, the position (viewpoint position) of the virtual camera in the virtual space is also changed, so that the position and orientation of the second display area 77 in the virtual space are also changed. For example, in the display image of FIG. 13 in which the tracking sensor 36b is an active sensor, the position of each of the second posted messages 77a to 77d is hidden behind the character object 71A or the character object 71B. In the display image 130 of FIG. 14 in which is the active sensor, only the second posted message 77c is hidden behind the character object, and the second posted messages 77a, 77b, and 77d become The whole object is not visible behind the object. As described above, by moving the viewpoint in the virtual space by switching the active sensor, the second posted message hidden behind the character object can be easily recognized.

    Next, a moving image distribution process according to one embodiment will be described with reference to FIG. FIG. 15 is a flowchart illustrating the flow of the moving image distribution process according to the embodiment. In the moving image distribution process, it is assumed that actor A1 and actor A2 are present in studio R.

    First, in step S11, body motion data that is a digital representation of the body movements of the actors A1 and A2 and face motion data that is a digital representation of the face movements (expressions) of the actors A1 and A2 are generated. You. The generation of the body motion data is performed, for example, by the above-described body motion data generation unit 21a, and the generation of the face motion data is performed, for example, by the above-described face motion data generation unit 21b.

    Next, in step S12, by applying the body motion data and the face motion data of the actor A1 to the model data for the actor A1, the animation of the first character object that moves in synchronization with the movement of the body and expression of the actor A1 Is generated. Similarly, by applying the body motion data and the face motion data of the actor A2 to the model data for the actor A2, an animation of the second character object that moves in synchronization with the movement of the body and expression of the actor A2 is generated. . The generation of the animation is performed by, for example, the above-described animation generation unit 21c.

    Next, in step S13, a moving image including an image of the virtual space, animation of the first character object corresponding to actor A1, and animation of the second character object corresponding to actor A2 is generated. The voice of actor A1 and actor A2 may be synthesized with this moving image. The animation of the first character object and the animation of the second character object may be arranged in a virtual space. The generation of the moving image is performed by, for example, the moving image generation unit 21d.

    Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the client devices 10a to 10c and the other client devices via the network 50. This moving image may be distributed to the supporter computer 40 and projected on the screen S in the studio room R. The moving image is continuously distributed over a predetermined distribution period. The distribution period of the moving image may be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other time.

    Next, the process proceeds to step S15, and it is determined whether or not a termination condition for terminating the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the supporter computer 40 has given an instruction to end the distribution, or other conditions. If the end condition is not satisfied, the processing of steps S11 to S14 is repeatedly executed, and the distribution of the moving image including the animation synchronized with the movement of the actors A1 and A2 is continued. If it is determined that the end condition is satisfied for the moving image, the distribution process of the moving image ends.

    Next, another embodiment of the present invention will be described with reference to FIGS. FIG. 17 shows a display example of a posted message displayed on a moving image being reproduced on the client device 10a in another embodiment of the present invention. FIG. 18 shows a flow of a posted message display process in the other embodiment. It is a flowchart which shows.

    The display image 170 shown in FIG. 17 includes a first display area 176 and a second display area 177. In the first display area 176, first posted messages 176a to 176d are displayed, and in the second display area 177, the second posted message 177a is displayed. In the embodiment shown in FIG. 17, the posted message processing unit 21i displays a posted message (first posted message) from a viewing user belonging to the first user group in the first display area 76, and the second user A process for displaying a posted message (second posted message) from a viewing user belonging to the group in the second display area 177 is performed.

    In the posted message display process shown in FIG. 18, it is assumed that a posted message for the moving image is posted from the client device to the server device 20 that distributes the moving image during distribution of the moving image. The posted message display process is performed in parallel with the moving image distribution process shown in FIG. The posted message received by server device 20 is stored in storage 23 as posted data 23e.

    In step S21, the posted message stored in storage 23 is read. Post messages are read, for example, in the order of posting.

Next, in step S22, it is determined to which user group the viewing user who posted the posted message read from the storage 23 belongs. In the posted data 23e, since the posted message is stored in association with the account information of the viewing user who posted the posted message and the group information indicating the user group to which the viewed user belongs, the posted data 23e is referred to. The user group to which the user who posted the posted message belongs can be specified.

    If it is determined that the viewing user who posted the posted message belongs to the first user group, the display process proceeds to step S23, and if it is determined that the viewing user who posted the posted message belongs to the second user group, The display process proceeds to step S24.

    In step S23, the posted message read in step S21 is displayed in a first display area (for example, first display area 76).

    In step S24, the posted message read in step S21 is displayed in the second display area (for example, second display area 77).

    As described above, the posted message read from the storage 23 is displayed in the display area corresponding to the user group to which the user who posted the posted message belongs.

    According to the above embodiment, the display device includes the first display area 76 where the first posted message is displayed, and the second display area 77 where the second posted message is displayed but the first posted message is not displayed. Video is delivered. Thereby, the display area of the posted message can be allocated according to the user group to which the user who posted the posted message belongs. Conventionally, since only one display area for a posted message is provided in a predetermined area of the display screen, posted messages from users of various user groups are displayed in the same display area. On the other hand, according to the above embodiment, display processing of the posted message is performed according to the user group to which the user who posted the posted message belongs. Thereby, the display mode of the posted message can be diversified.

    In one embodiment, a part of the second display area 77 is arranged behind the character objects 71A and 71B. Thereby, the second posted message can be displayed in an area where it is easier to attract the attention of another user.

In one embodiment, the second display area 77 is included in the moving image during the second distribution period during which the actors A1 and A2 perform. Since the second display area 77 is displayed behind the character objects 71A and 71B that are motion-controlled in accordance with the performance of the actors A1 and A2, it is easier to attract the attention of other users. Further, since the second display area 77 is disposed behind the character objects 71A and 71B, it is difficult to hinder the viewing of the performance of the character objects 71A and 71B.

    In one embodiment, when the first display area 76 and at least one of the character object 71A and the character object 71B are displayed in an overlapping manner, the character object is arranged behind the first display area 76. Thereby, in the distribution period in which the display of the posted message by the viewing user or the actors A1 and A2 is more important, the posted message is displayed without being hidden behind the character object.

    As described above, according to the embodiment, the display mode of the posted message can be changed according to the content of the moving image (for example, whether or not the actor is performing the performance). Therefore, the display mode of the posted message can be diversified without deteriorating the viewing experience of the video by the viewing user.

    In the above embodiment, the viewing user belonging to the second user group can receive a service or a superior function which is more preferential than the viewing user belonging to the first user group with respect to the display of the posted message.

    For example, the viewing user belonging to the second user group can specify the moving direction of the second posted message using the first command, and can specify the display start position of the second posted message using the second command. . This allows the viewing user belonging to the second user group to move his or her posted message in a direction that more easily attracts attention, or to display the message at a position where attention is more easily gathered. On the other hand, the viewing user belonging to the first user group cannot specify the moving direction of the posted message or the initial display position.

    In the above embodiment, the display control of the posted message is performed such that the moving speed of the second posted message in the second display area 77 is lower than the moving speed of the first posted message in the first display area 76. . Thereby, the viewing users belonging to the second user group can display their own posted messages on the display screen longer than the viewing users belonging to the first user group.

  In the above embodiment, the viewing user belonging to the second user group can post a message in any of the first distribution periods 161 and 163 and the second distribution period 162. On the other hand, a user belonging to the first user group can post a message only in the first distribution periods 161 and 163.

    Embodiments of the present invention are not limited to the above-described embodiments, and various changes can be made without departing from the spirit of the present invention. For example, a moving image to be distributed may be captured and generated outside of the studio room R. For example, shooting for generating a moving image to be distributed may be performed at the actor's or supporter's home.

    The posted message posted by the viewing user may not be stored in the storage 23. In this case, the posted message processing unit 21i analyzes the posted message received from the client device, specifies the user group to which the user who posted the posted message belongs, and displays the posted message in a display area corresponding to the specified user group. Messages can be displayed.

    In the processing procedure described in this specification, in particular, in the processing procedure described using a flowchart, some of the steps (steps) configuring the processing procedure are omitted, and the steps configuring the processing procedure are omitted. Unspecified steps can be added and / or the order of the steps can be changed. The processing procedures in which such omissions, additions, and changes in order are made do not depart from the spirit of the present invention. Included in the scope of the invention.

Hereinafter, the inventions described in the claims at the time of filing the original application of the present application are additionally described.
[1]
A first posted message posted by a first user classified into a first user group according to the adjustable classification criteria and a second posted message posted by a second user classified into a second user group according to the classified criteria Comprising storage for storing, one or more computer processors,
The one or more computer processors execute computer-readable instructions,
A moving image including a first display area capable of displaying the first posted message and the second posted message, and a second display area capable of displaying the second posted message but not displaying the first posted message. To deliver the
Video distribution system.
[2]
The one or more computer processors adjust the classification criterion such that the number of first viewing users belonging to the first user group is less than the number of second viewing users belonging to the second user group.
The moving image distribution system according to [1].
[3]
The one or more computer processors, when a difference between the number of second viewing users belonging to the second user group and the number of first viewing users belonging to the first user group is smaller than a predetermined number, Adjusting the classification criteria,
The moving image distribution system according to [1] or [2].
[4]
The one or more computer processors classify the viewing user into one of the first user group or the second user group based on the viewing time of the video by the viewing user and the classification criterion,
The moving image distribution system according to any one of [1] to [3].
[5]
The one or more computer processors classify the viewing user into one of the first user group or the second user group based on the number of times the video is viewed by the viewing user and the classification criterion,
The moving image distribution system according to any one of [1] to [4].
[6]
The one or more computer processors classify the viewing user into either the first user group or the second user group based on the purchase amount or purchase amount of the electronic gift by the viewing user and the classification criterion. Do
The moving image distribution system according to any one of [1] to [5].
[7]
The one or more computer processors classify the viewing user into one of the first user group or the second user group based on the number of posted messages posted by the viewing user and the classification criterion. ,
The moving image distribution system according to any one of [1] to [6].
[8]
A video distribution method for distributing a video executed by one or more computer processors executing computer-readable instructions,
Storing a first posted message posted by a first user classified into a first user group according to an adjustable classification criterion;
Storing a second posted message posted by a second user classified into a second user group according to the classification criteria;
A moving image including a first display area capable of displaying the first posted message and the second posted message, and a second display area capable of displaying the second posted message but not displaying the first posted message. Delivering the
A video distribution method comprising:
[9]
A program for delivering a moving image executed to one or more computer processors,
The one or more computer processors,
Storing a first posted message posted by a first user classified into a first user group according to an adjustable classification criterion;
Storing a second posted message posted by a second user classified into a second user group according to the classification criteria;
A first display area in which the first posted message and the second posted message can be displayed, and a second display area in which the second posted message can be displayed, but the first posted message is not displayed. The process of delivering the video,
A video distribution program that runs

Explanation of sign

    1. Video distribution system

Claims (27)

A storage for storing a posted message posted by the user, and one or more computer processors,
The one or more computer processors execute computer-readable instructions,
An animation of a character object generated to move in the virtual space based on the movement of the actor, and the posted message, and deliver a moving image including
The post message is displayed in different display modes in a first distribution section and a second distribution section different from the first distribution section,
Video distribution system. In the second distribution section, the posted message is displayed in a display area corresponding to a part or all of the display objects arranged in the virtual space.
The moving image distribution system according to claim 1. The display object is displayed behind the character object in the video.
The moving image distribution system according to claim 2. In the first section, the posted message is displayed by being superimposed on the video.
The moving image distribution system according to claim 1. The second distribution section is a distribution section in which the character object performs a performance.
The moving picture distribution system according to claim 1. Transition from the first distribution section to the second distribution section according to an instruction from the actor or a supporter supporting distribution of the moving image;
The moving image distribution system according to claim 1. The posted message includes a first posted message posted by a first user included in a first user group, and a second posted message posted by a second user included in a second user group,
In the first distribution section, the first posted message is displayed,
In the second distribution section, the second posted message is displayed.
The moving image distribution system according to claim 1. The first post message is displayed overlapping with the character object,
The moving image distribution system according to claim 7. The first posted message is displayed so as to move in a first direction.
The moving image distribution system according to claim 7. The second posted message is displayed in the second display area so as to move in a second direction,
The moving image distribution system according to any one of claims 7 to 9. The moving image distribution system according to claim 9, wherein the moving speed of the second posted message is lower than the moving speed of the first posted message. The display time in which the second posted message is displayed in the second display area is longer than the display time in which the first posted message is displayed in the first display area,
The moving image distribution system according to claim 1. The virtual space is constructed based on tracking information of an active sensor selected from a plurality of cameras,
When a first camera of the plurality of cameras is selected as the active sensor, the second posted message is displayed behind the character object, while a second camera of the plurality of cameras is displayed. Is selected as the active sensor, the second posted message is displayed so as not to overlap with the character object,
The moving image distribution system according to any one of claims 7 to 13. The virtual space is constructed based on tracking information of an active sensor selected from a plurality of cameras,
The first posted message is generated when the first camera of the plurality of cameras is selected as the active sensor and when the second camera of the plurality of cameras is selected as the active sensor. Displayed in the same position,
The moving image distribution system according to any one of claims 1 to 13. The moving image further includes a gift object representing an electronic gift requested to be displayed by the first user or the second user,
Video distribution system. The gift object includes: a first gift object displayed in association with a specific part of the character object; and a second gift object displayed without being associated with a specific part of the character object.
The moving image distribution system according to claim 15. The first gift object is displayed in the moving image so as to move following the movement of the character object.
The moving image distribution system according to claim 16. The display request for the second gift object includes a display position designation parameter,
The second gift object is displayed at a position specified by the display position specification parameter.
The moving image distribution system according to claim 16. The display request of the second gift object includes a moving direction parameter,
The second gift object moves in the moving direction specified by the moving direction parameter in the moving image;
The moving image distribution system according to any one of claims 16 to 18. The second gift object is displayed at a position that does not overlap with the character object.
The moving image distribution system according to any one of claims 16 to 19. When the size of the second gift object in the virtual space is larger than a reference size, the second gift object is arranged at a position that does not overlap with the character object.
The moving image distribution system according to any one of claims 16 to 20. The second gift object is displayed behind the character object;
The moving image distribution system according to any one of claims 16 to 21.   23. The video distribution system according to claim 22, wherein when the size of the second gift object in the virtual space is larger than a reference size, the second gift object is displayed behind the character object. When the size of the second gift object in the virtual space is smaller than a reference size, at least a part of the second gift object is arranged at a position overlapping the character object.
The moving image distribution system according to any one of claims 16 to 23. In the second distribution section, the posted message is displayed in a display area corresponding to a part or all of display objects arranged in the virtual space,
The gift object includes the display object.
The moving image distribution system according to any one of claims 2 to 24. A moving image distribution method executed by one or more computer processors executing computer-readable instructions,
Comprising a step of delivering a video including an animation of a character object generated to move in the virtual space based on the movement of the actor, and a posted message posted by the user,
The post message is displayed in different display modes in a first distribution section and a second distribution section different from the first distribution section,
Video distribution method. A program executed by one or more computer processors,
The one or more computer processors,
An animation of a character object generated to move in the virtual space based on the movement of the actor, and a posted message posted by the user, and a video distribution program that executes a step of distributing a video including the
The moving image distribution program, wherein the posted message is displayed in different display modes in a first distribution section and a second distribution section different from the first distribution section.

Images