JP6498832B1 - Video distribution system that distributes video including messages from viewing users - Google Patents

Abstract

The moving image distribution system according to one aspect includes a first posted message posted by a first user included in a first user group, a second posted message posted by a second user included in a second user group, and the first A storage for storing an object provided by at least one of the user and the second user; and one or more computer processors. The first user does not belong to the second user group, and the second user does not belong to the first user group. The second user is a user whose parameters related to the object satisfy a predetermined condition. A moving image including: a first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. Is delivered.
[Selection] Figure 1

Description

    The disclosure in this specification relates to a moving image distribution system that distributes a moving image including a message from a viewing user. More specifically, the disclosure in the present specification relates to a moving image distribution system that distributes a moving image including an animation of a character object generated based on an actor's movement and a message from a viewing user.

    2. Description of the Related Art Conventionally, a moving image distribution system that generates animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object is known. Such a moving image distribution system is disclosed in, for example, Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1).

    Patent Document 1 discloses that a chat function can be implemented in the moving image distribution system. In such a chat function, a message is posted from a viewing user who views a moving image. The actor can see this posted message. When an actor reacts to a message, the reaction is reflected in the video. This chat function realizes exchange between viewing users and exchange between viewing users and actors.

Japanese Patent Laying-Open No. 2015-18489

    Conventionally, a partial area of a moving image display screen is allocated as a display area for a posted message. Due to space restrictions on the display screen, the posted message display area may overlap with the character object. In this case, the posted message and the character object are displayed in an overlapping manner, so that the viewing experience of the viewing user may be deteriorated. For example, if the main part of the character object is hidden by a posted message, the viewer may feel that viewing of the moving image has been hindered.

    If a display area for displaying posted messages is secured in a certain area of the display screen and display control is performed so that character objects are not displayed in this display area, duplication of character objects and posted messages can be avoided. . However, the display position of the character object is limited, and this is a major limitation in moving image production.

    Thus, if the display area of the posting object is limited to a certain area, it is difficult to provide a satisfactory viewing experience for the user. There is a need for improvement in the display mode of posted messages in moving images including animation of character objects.

    The purpose of the present disclosure is to provide technical improvements that solve or mitigate at least some of the problems of the prior art described above.

    The moving image distribution system according to one aspect includes a first posted message posted by a first user included in a first user group, a second posted message posted by a second user included in a second user group, and the first A storage for storing an object provided by at least one of the user and the second user; and one or more computer processors. The first user does not belong to the second user group, the second user does not belong to the first user group, and the second user has a predetermined parameter related to the object A user who satisfies the conditions. The one or more computer processors execute a computer-readable instruction to display the first posted message and the second posted message, and the second posted message can be displayed. On the other hand, the moving image including the second display area in which the first posted message is not displayed is distributed.

  The moving image distribution system according to one aspect stores a first posted message posted by a first user included in the first user group and a second posted message posted by a second user included in the second user group. And one or more computer processors. The first user does not belong to the second user group, and the second user does not belong to the first user group. The one or more computer processors execute a computer-readable instruction to display the first posted message and the second posted message, and the second posted message can be displayed. On the other hand, the moving image including the second display area in which the first posted message is not displayed is distributed. The second user is a user whose viewing situation of the moving image satisfies a predetermined upper surface.

    In the moving image distribution system according to an aspect, the second user group is configured by a smaller number of users than the first user group.

    In the moving image distribution system according to one aspect, the first posted message moves in the first direction in the first display area.

    In the moving image distribution system according to one aspect, the second posted message moves in the second direction in the second display area.

    In the moving image distribution system according to one aspect, the second direction changes according to a first command included in the second posted message.

    In the moving image distribution system according to one aspect, an initial display position of the second posted message in the second display area changes according to a second command included in the second posted message.

    In the moving image distribution system according to one aspect, the moving speed of the second posted message in the second display area is slower than the moving speed of the first posted message in the first display area.

    In the moving image distribution system according to one aspect, the display time during which the second posted message is displayed in the second display area is longer than the display time during which the first posted message is displayed in the first display area.

    In the moving image distribution system according to an aspect, information other than the first posted message is also displayed in the first display area.

    In the video delivery system according to one aspect, the storage stores an object provided by at least one of the first user and the second user.

    In the moving image distribution system according to one aspect, the information other than the first posted message includes a notification indicating that the object has been provided.

    In the moving image distribution system according to one aspect, the second user is a user whose parameters related to the object satisfy a predetermined condition.

    In the moving image distribution system according to one aspect, the second user is a user whose number of viewing of the moving image exceeds a predetermined number.

    In the moving image distribution system according to one aspect, the first user leaves the first user group and is included in the second user group when the number of postings of the first posted message exceeds a predetermined number.

    In the moving image distribution system according to one aspect, the moving image includes an animation of a character object generated based on an actor's movement.

    In the moving image distribution system according to one aspect, at least a part of the second display area is arranged behind the character object.

    In the moving image distribution system according to an aspect, when the first display area and the character object are displayed in an overlapping manner, the character object is arranged behind the first display area.

    The moving image distribution system according to an aspect further includes a plurality of cameras, and includes a virtual space image configured based on tracking information of an active sensor selected from the plurality of cameras.

    In the moving image distribution system according to one aspect, the second display area is provided in a display object in the virtual space, and the position of the second display area in the virtual space depends on the position and orientation of the active sensor. Be changed.

    In the moving image distribution system according to one aspect, the second display area is provided in the virtual space, and the size of the second display area in the virtual space is changed according to the position and orientation of the active sensor. .

    In the moving image distribution system according to one aspect, at least a part of the one or more computer processors is provided in a server device, and information other than the first posted message includes a notification from the server device.

    In the moving image distribution system according to one aspect, the first posted message and the second posted message are displayed in the first display area.

  In the moving image distribution system according to one aspect, the first user posts a first posted message using a client device, and the client device does not post the first posted message during the second distribution period. Configured.

  In the moving image distribution system according to one aspect, an electronic gift is displayed as a gift object in the virtual space, and the second display area is provided in the gift object in the virtual space.

    The moving image delivery method according to one aspect is executed by one or more computer processors executing computer-readable instructions. The moving image distribution method stores a first posted message posted by a first user included in a first user group and a second posted message posted by a second user included in a second user group. A step of storing an object provided by at least one of the first user and the second user, a first display area capable of displaying the first posted message and the second posted message, and the first And a second display area in which the first posted message is not displayed while allowing two posted messages to be displayed. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user It is a user whose parameters related to the object satisfy a predetermined condition.

  The moving image distribution method according to one aspect includes a step of storing a first posted message posted by a first user included in a first user group, and a second posted message posted by a second user included in a second user group. A first display area in which the first posted message and the second posted message can be displayed, and a second display in which the second posted message can be displayed while the first posted message is not displayed. And a step of delivering a moving image including the region. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user It is a user whose viewing situation of a movie satisfies a predetermined condition.

    A program according to an aspect is a program executed by one or more computer processors, and stores a first posted message posted by a first user included in a first user group in the one or more computer processors. A step of storing, a step of storing a second posted message posted by a second user included in the second user group, a step of storing an object provided by at least one of the first user and the second user, A first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. And a step of delivering a video. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user It is a user whose parameters related to the object satisfy a predetermined condition.

    A program according to an aspect is a program executed by one or more computer processors, and stores a first posted message posted by a first user included in a first user group in the one or more computer processors. A step of storing, a step of storing a second posted message posted by a second user included in a second user group, a first display area capable of displaying the first posted message and the second posted message, A step of delivering a moving image including a second display area in which the second posted message can be displayed while the first posted message is not displayed. In the embodiment, the first user does not belong to the second user group, the second user does not belong to the first user group, and the second user It is a user whose viewing situation of a movie satisfies a predetermined condition.

    According to the embodiment, a post message from a moving image viewing user can be displayed in a display area corresponding to a user group to which the viewing user belongs.

It is a block diagram which shows the moving image delivery system by one Embodiment. It is a schematic diagram which shows typically the installation of the studio which produces the moving image delivered with the moving image delivery system of FIG. It is a figure explaining the possession list memorize | stored in the moving image delivery system of FIG. It is a figure explaining the candidate list memorize | stored in the moving image delivery system of FIG. It is a figure explaining the posting data memorize | stored in the moving image delivery system of FIG. It is a figure explaining the viewing management data memorize | stored in the moving image delivery system of FIG. It is a figure which shows the example of the moving image displayed on the client apparatus 10a in one Embodiment. FIG. 7 includes animation of a character object. It is a figure which shows the example of the moving image displayed on the client apparatus 10a in one Embodiment. FIG. 8 includes a normal object. It is a figure which shows the example of the moving image displayed on the client apparatus 10a in one Embodiment. FIG. 9 includes decoration objects. It is a schematic diagram which shows the example of the decoration object selection screen for selecting a desired selection decoration object from the decoration objects contained in the candidate list. It is a figure which shows the example of the moving image containing the 1st contribution message displayed on the client apparatus 10a in one Embodiment. It is a figure which shows the example of the moving image containing the 1st contribution message displayed on the client apparatus 10a in one Embodiment. It is a figure which shows the example of the moving image containing the 2nd posting message displayed on the client apparatus 10a in one Embodiment. It is a figure which shows the example of the moving image containing the 2nd posting message displayed on the client apparatus 10a in one Embodiment. It is a flowchart which shows the flow of the moving image delivery process in one Embodiment. It is a figure for demonstrating the division | segmentation of the delivery period of the moving image delivered in the moving image delivery system of FIG. It is a figure which shows the example of the moving image containing the 1st contribution message displayed on the client apparatus 10a in another embodiment. It is a flowchart which shows the flow of the posting message display process in another embodiment.

    Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. In the drawings, the same or similar components are denoted by the same reference numerals.

    With reference to FIGS. 1 to 6, a moving image distribution system according to an embodiment will be described. FIG. 1 is a block diagram showing a video distribution system 1 according to an embodiment, and FIG. 2 is a schematic diagram schematically showing facilities of a studio where a video distributed by the video distribution system 1 is produced. 3 to 6 are diagrams for explaining information stored in the moving image distribution system 1.

    The moving image distribution system 1 includes client devices 10a to 10c, a server device 20, a studio unit 30, and a storage 60. The client devices 10 a to 10 c, the server device 20, and the storage 60 are connected via a network 50 so that they can communicate with each other. As will be described later, the server device 20 is configured to distribute a moving image including animation of a character. The characters included in the moving image may be motion controlled in the virtual space.

    This moving image can be distributed from the server device 20 to each of the client devices 10a to 10c. The first viewing user who is the user of the client device 10a, the second viewing user who is the user of the client device 10b, and the third viewing user who is the user of the client device 10c view the distributed video by each client device. be able to. The moving image distribution system 1 may include a smaller number of client devices than three or may include a larger number of client devices than three.

    The client devices 10a to 10c are information processing devices such as smartphones. In addition to the smartphone, the client devices 10a to 10c may be mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and various information processing devices that can reproduce moving images. Each of the client devices 10a to 10c includes a computer processor, a memory, a communication I / F, a sensor unit including various sensors such as a display and a gyro sensor, a sound collecting device such as a microphone, and a storage for storing various information. Also good.

    The displays of the client devices 10a to 10c have a display panel and a touch panel. The touch panel is configured to detect a player's touch operation (contact operation). The touch panel can detect various touch operations such as a player's tap, double tap, and drag. The touch panel may include a capacitive proximity sensor and be configured to detect a non-contact operation of the player.

    The viewing user can input a message related to the distributed video or other messages via the touch panel of the client devices 10a to 10c. This message may be, for example, a text message, a still image message, a moving image message, and an electronic message of any other format. Each of the client devices 10a to 10c may be configured to post (send) a message input by the viewing user to the server device 20. In this specification, a message transmitted to the server device 20 from the client devices 10a to 10c and / or other client devices for viewing the distributed moving image may be referred to as a posted message. For example, regarding the moving image distributed to the client device 10a of the first viewing user, the posted message transmitted from the client device 10a to the server device 20 by the first viewing user is input to the client device 10a. This is a posted message of the viewing user.

    In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication I / F 22, and a storage 23.

    The computer processor 21 is an arithmetic device that loads an operating system and various programs for realizing various functions from the storage 23 or other storages into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. In FIG. 1, the computer processor 21 is illustrated as a single component, but the computer processor 21 may be a collection of a plurality of physically separate computer processors. In this specification, the program described as being executed by the computer processor 21 or the instructions included in the program may be executed by a single computer processor or distributedly executed by a plurality of computer processors. Also good. Further, a program executed by the computer processor 21 or an instruction included in the program may be executed by a plurality of virtual computer processors.

    The communication I / F 22 is implemented as hardware, firmware, communication software such as a TCP / IP driver or a PPP driver, or a combination thereof. The server device 20 can transmit / receive data to / from other devices via the communication I / F 22.

    The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices that can store data. Various programs can be stored in the storage 23. At least a part of the programs and various data that can be stored in the storage 23 may be stored in a storage physically separate from the server device 20 (for example, the storage 60).

    Many of the components of the studio unit 30 are, for example, arranged in the studio room R shown in FIG. As shown in the drawing, in the studio room R, the actor A1 and the actor A2 perform. The studio unit 30 is configured to detect the movements and facial expressions of the actor A1 and the actor A2, and output the detected information to the server device 20.

    Both the actor A1 and the actor A2 are objects whose movements and facial expressions are captured by a later-described sensor group provided in the studio unit 30. In the illustrated embodiment, the actor A1 and the actor A2 are humans who perform actions for proceeding with a program that is distributed as a talk, performance, and other moving images. The actor A1 and the actor A2 may be an animal or any other moving object (non-living) other than a human. The actor A1 and the actor A2 may be, for example, robots that can move independently. The number of actors in the studio room R may be 1 or 3 or more.

    The studio unit 30 includes six motion sensors 31a to 31f attached to the actor A1, a controller 33a held by the left hand of the actor A1, a controller 33b held by the right hand of the actor A1, and a wearing tool 37b. And a camera 37a attached to the head of the actor A1. The studio unit 30 also includes six motion sensors 32a to 32f attached to the actor A2, a controller 34a held by the left hand of the actor A2, a controller 34b held by the right hand of the actor A2, and a mounting tool 38b. And a camera 38a attached to the head of the actor A2. A microphone for acquiring audio data may be attached to each of the mounting tool 37b and the mounting tool 38b. This microphone can acquire the speech of actor A1 and actor A2 as voice data. The microphone may be a mounting type microphone that is mounted on the actor A1 and the actor A2 via the mounting tool 37b and the mounting tool 38b. The microphone may be installed on the floor, wall, or ceiling of the studio room R. It may be. The studio unit 30 includes a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39 in addition to the above-described components. A supporter computer 40 is installed in a room adjacent to the studio room R and the glass window. The server device 20 may be installed in the same room as the room in which the supporter computer 40 is installed.

    The motion sensors 31a to 31f and the motion sensors 32a to 32f detect their positions and orientations in cooperation with the base station 35a and the base station 35b. In one embodiment, base station 35a and base station 35b are multi-axis laser emitters. The base station 35a scans the laser beam, for example, around the vertical axis after emitting the flashing light for synchronization. The base station 35b scans the laser beam around a horizontal axis, for example. Each of the motion sensors 31a to 31f and the motion sensors 32a to 32f may include a plurality of optical sensors that detect incident flashing light and laser light from the base station 35a and the base station 35b. Each of the motion sensors 31a to 31f and the motion sensors 32a to 32f has a time difference between the incident timing of the flashing light and the incident timing of the laser light, the light reception time of each optical sensor, the incident angle of the laser light detected by each optical sensor, and If necessary, its position and orientation may be detected based on information other than these. The motion sensors 31a to 31f and the motion sensors 32a to 32f may be, for example, a Vive Tracker provided by HTC Corporation. The base station 35a and the base station 35b may be, for example, a base station provided by HTC Corporation.

Detection information indicating the position and orientation of each motion sensor calculated in each of the motion sensors 31 a to 31 f and the motion sensors 32 a to 32 f is transmitted to the server device 20. This detection information may be wirelessly transmitted to the server device 20 from each of the motion sensors 31a to 31f and the motion sensors 32a to 32f. Since the base station 35a and the base station 35b emit flashing light and scan with laser light at regular intervals, the detection information of each motion sensor is updated at each interval. Note that the number of base stations may be three or more. The position of the base station may be changed as appropriate. For example, in addition to or instead of the base station arranged in the upper corner of the space to be detected by the tracking sensor shown in FIG. 2, a pair is formed at an upper position and a lower position near the floor. A deployed base station may be provided. For example, the number of base stations may be four. In the illustrated embodiment, the actor A1 is equipped with six motion sensors 31a to 31f. The motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are mounted on the left wrist, right wrist, left instep, right instep, waist, and top of the actor A1, respectively. The motion sensors 31a to 31f may be mounted on the actor A1 via a mounting tool. The actor A2 is equipped with six motion sensors 32a to 32f. The motion sensors 32a to 32f can be attached to the actor A2 at the same positions as the motion sensors 31a to 31f. The motion sensors 31a to 31f and the motion sensors 32a to 32f shown in FIG. 2 are examples. The motion sensors 31a to 31f can be attached to various parts of the actor A1, and the motion sensors 32a to 32f can be attached to various parts of the actor A2. The number of motion sensors attached to the actor A1 and the actor A2 may be 5 or less, or 7 or more. As described above, the movements of the bodies of the actors A1 and A2 are detected by detecting the positions and orientations of the motion sensors 31a to 31f and the motion sensors 32a to 32f attached to the parts of the bodies of the actors A1 and A2. be able to.

    In one embodiment, each of the plurality of motion sensors attached to the actor A1 and the actor A2 includes a large number of infrared LEDs, and light from the infrared LEDs is provided on the floor or wall of the studio room R. You may detect each position and direction of the said motion sensor by detecting with an infrared camera. Instead of the infrared LED, a visible light LED may be used, and the position and orientation of each motion sensor may be detected by detecting light from the visible light LED with a visible light camera. In this way, each of the plurality of motion sensors attached to the actor is provided with a light emitting unit (for example, an infrared LED or a visible light LED), and light from this light emitting unit is provided in the studio room R ( For example, the position and orientation of each motion sensor may be detected by detecting with an infrared camera or visible light camera.

    In one embodiment, a plurality of reflective markers can be used instead of the motion sensors 31a to 31f and the motion sensors 32a to 32f. The reflective marker is attached to each of the actor A1 and the actor A2 with an adhesive tape or the like. Thus, the actor A1 and the actor A2 to which the reflective marker is attached are photographed to generate photographing data, and the photographing data is subjected to image processing, whereby the position and orientation of the reflective marker can be detected.

    The controller 33a and the controller 33b output a control signal corresponding to the operation of the actor A1 to the server device 20. Similarly, the controller 34a and the controller 34b output a control signal corresponding to the operation of the actor A2 to the server device 20.

    The tracking sensor 36a and the tracking sensor 36b generate tracking information for determining virtual camera setting information for constructing a virtual space included in the moving image. The tracking information of the tracking sensor 36a and the tracking sensor 36b is calculated as a position in each three-dimensional orthogonal coordinate system and an angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to the operation of the operator. The tracking sensor 36 a transmits tracking information indicating its position and orientation to the tracking information server device 20. Similarly, the position and orientation of the tracking sensor 36b are set according to the operation of the operator. The tracking sensor 36b transmits tracking information indicating the position and orientation to the tracking information server device 20. In the illustrated embodiment, the tracking sensor 36a is provided on the left front side of the actor A1. The tracking sensor 36b is provided in front of the actor A1 and the actor A2 and at a substantially middle position between the actor A1 and the actor A2.

    The camera 37a is attached to the head of the actor A1 as described above. For example, the camera 37a is arranged so as to capture the face of the actor A1. The camera 37a continuously captures the face of the actor A1 and acquires image data of the face of the actor A1. Similarly, the camera 38a is attached to the head of the actor A2. The camera 38a is arranged so as to be able to image the face of the actor A2, and continuously captures the face of the actor A2, and acquires the imaging data of the face of the actor A2. The camera 37a transmits imaging data of the face of the actor A1 to the server apparatus 20, and the camera 38a transmits imaging data of the face of the actor A1 to the server apparatus 20. The camera 37a and the camera 38a may be 3D cameras capable of detecting the depth of a human face.

    The display 39 is configured to display information received from the support computer 40. The information transmitted from the support computer 40 to the display 39 can include, for example, text information, image information, and various other information. The display 39 is disposed at a position that can be viewed by the actor A1 and the actor A2.

    In the illustrated embodiment, the supporter computer 40 is installed in a room adjacent to the studio room R. Since the room in which the supporter computer 40 is installed and the studio room R are separated by a glass window, the operator of the supporter computer 40 (sometimes referred to as “supporter” in this specification) acts as an actor A1 and an actor A2. Can be visually recognized. In the illustrated embodiment, a supporter B1 and a supporter B2 are present as operators of the supporter computer 40.

    The supporter computer 40 may be configured to be able to change the setting of the components of the studio unit 30 in accordance with the operation of the supporter B1 and the supporter B2. The supporter computer 40 can change, for example, the setting of the scanning interval by the base station 35a and the base station 35b, the setting of the position or orientation of the tracking sensor 36a and the tracking sensor 36b, and various settings of various other devices. . Switching of the active sensor described later can be executed based on the operation of the supporter computer 40 by the supporter B1 and the supporter B2. At least one of the supporter B1 and the supporter B2 can input a message to the supporter computer 40 and display the input message on the display 39.

    The components and functions of the studio unit 30 shown in FIG. 2 are exemplary. The studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector. The projector can project a moving image distributed to the client device 10a or another client device on the screen S.

    Next, in one aspect, information stored in the storage 23 will be described. In the illustrated embodiment, the storage 23 is required for generating and distributing model data 23a, object data 23b, possession list 23c, candidate list 23d, post data 23e, viewing management data 23f, and other distribution videos. Various information is stored.

    The model data 23a is model data for generating a character animation. The model data 23a may be 3D model data for generating a 3D animation, or may be 2D model data for generating 2D model data. The model data 23a includes, for example, rig data indicating the character's skeleton (sometimes referred to as “skeleton data”) and surface data indicating the surface shape and texture of the character. The model data 23a can include a plurality of different model data. The plurality of model data may have different rig data, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data. In the illustrated embodiment, in order to generate a character object corresponding to the actor A1 and a character object corresponding to the actor A2, the model data 23a includes at least two types of model data different from each other. The model data for the character object corresponding to the actor A1 and the model data for the character object corresponding to the actor A2 have, for example, the same rig data, but may have different surface data.

    The object data 23b includes asset data for constructing a virtual space that constitutes a moving image. The object data 23b is data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and for drawing various objects displayed in other moving images. Contains data. The object data 23a may include object position information indicating the position of the object in the virtual space.

    In addition to the above, the object data 23b may include gift objects that are displayed on a moving image based on display requests from viewing users of the client devices 10a to 10c. The gift object can include an effect object, a normal object, and a decoration object. The viewing user can purchase a desired gift object.

    The effect object is an object that affects the impression of the entire viewing screen of the distribution video, for example, an object that imitates a confetti. An object that imitates a confetti may be displayed on the entire viewing screen, thereby changing the impression of the entire viewing screen before and after display. Although the effect object may be displayed so as to overlap the character object, the effect object is different from the decoration object in that it is not displayed in association with a specific part of the character object.

    The normal object is an object that becomes a digital gift from the viewing user to the actor (for example, the actor A1 or the actor A2), for example, an object that imitates a stuffed animal or a bouquet. In one aspect, the normal object is displayed on the moving image display screen so as not to contact the character object. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character object. The normal object may be displayed so as to overlap with an object other than the character object in the virtual space. The normal object may be displayed so as to overlap with the character object, but is different from the decoration object in that it is not displayed in association with a specific part of the character object. In one aspect, when a normal object is displayed overlapping with a character object, the normal object overlaps with a portion other than the head including the face of the character object, and does not overlap with the head of the character object. Is displayed.

    The decoration object is an object displayed on the display screen in association with a specific part of the character object. In one aspect, the decoration object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the decoration object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object.

    The decoration object is an object on which an accessory (headband, necklace, earring, etc.), clothes (T-shirt, etc.), a costume, and other character objects other than these can be attached to the character object. The object data 23b corresponding to the decoration object may include mounting position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decorative object can indicate to which part of the character object the decorative object is mounted. For example, when the decoration object is a headband, the attachment position information of the decoration object may indicate that the decoration object is attached to the “head” of the character object. When the decoration object is a T-shirt, the attachment position information of the decoration object may indicate that the decoration object is attached to the “body” of the character object.

    A display time corresponding to the type of each gift object may be set. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

    The possession list 23c is a list indicating gift objects possessed by the viewing user of the moving image. An example of the possession list 23c is shown in FIG. As illustrated, in the possession list 23c, an object ID for specifying a gift object possessed by the viewing user is stored in association with the viewing user's account information (for example, the viewing user's user ID). The viewing users include, for example, the first viewing user to the third viewing user of the client device 10a to the client device 10c.

    The candidate list 23d is a list of decoration objects requested to be displayed by the viewing user. As will be described later, a viewing user who owns a decoration object can make a display request for the decoration object held. In the candidate list 23d, an object ID for specifying the decoration object is stored in association with the account information of the viewing user who has requested display of the decoration object. This candidate list 23d may be created for each distributor. The candidate list 23d may be stored in association with distributor identification information that identifies a distributor (actor A1, actor A2, supporter B1, and / or supporter B2), for example.

    The posted data 23e is data indicating a posted message posted by the viewing user. The posted data 23e includes account information of the viewing user who posted the posted message, group information indicating a user group to which the viewing user belongs, and a posted message posted by the viewing user. Thus, the storage 23 can store the group information related to the user group to which the viewing user belongs and the posted message posted by the viewing user in association with the viewing user's account information. The post data 23e includes the time when each post message is posted (for example, the time when the post message transmitted from the client device is received by the server device 20 or the post message received by the server device 20 is stored in the storage 23 (The time of writing in the storage area) may be stored.

    The viewing user account information is, for example, user identification information (user ID) of the viewing user.

    The group information is group identification information (group ID) that identifies a group to which the viewing user belongs. The group to which the viewing user belongs includes, for example, a first user group and a second user group. For example, the first user group is a general user group to which a general user belongs, and the second user group is a premium user group to which a premium user different from the general user belongs.

    Various criteria can be adopted as classification criteria for the first user group and the second user group. Of the viewing users, a user who has less than the predetermined number of times of viewing the moving image may be classified as a general user, and a user whose number of viewing times is a predetermined number or more may be classified as a premium user. Among viewing users, a user whose viewing time of a moving image is shorter than a predetermined time may be classified as a general user, and a user whose viewing time is longer than a predetermined time may be classified as a premium user. A user with a gift object purchase amount less than a predetermined amount may be classified as a general user, and a user with a gift object purchase amount greater than or equal to a predetermined amount may be classified as a premium user. A user whose purchase amount of gift objects is less than a predetermined amount may be classified as a general user, and a user whose purchase amount of gift objects is a predetermined amount or more may be classified as a premium user. Of the viewing users, a user who has less than a predetermined number of posted messages may be classified as a general user, and a user who has a predetermined number of posted messages or more may be classified as a premium user. The number of viewing times, viewing time, gift object purchase amount, gift object purchase amount, and number of posted messages may be cumulative values from the start of use of the video distribution system 1, and are aggregated values for a predetermined period. It may be.

    In one aspect, the second user group is composed of a smaller number of users than the first user group. The viewing user is classified into the first user group when performing use registration in the moving image distribution system 1. The viewing user leaves the first user group and belongs to the second user group if the criteria for classification into the second user group are satisfied after the use of the video distribution system 1 is started. As described above, the user group to which the viewing user belongs may be changed depending on the usage mode of the video distribution system 1. When the viewing user does not satisfy the criteria for classification into the second user group, the user group belonging to the first user group may be changed from the second user group.

    In one aspect, even if the classification criteria for the user group is dynamically adjusted so that the number of viewing users belonging to the first user group is maintained smaller than the number of viewing users belonging to the second user group. Good. For example, the server device 20 monitors the number of viewing users belonging to the first user group and the number of viewing users belonging to the second user group, and if the difference becomes smaller than a predetermined number, the second user group The criteria for categorizing can be strict. For example, initially, when viewing users who use the moving image distribution system 1 for viewing videos of 10 hours or more are classified into the second user group, the number of users belonging to the second user group and the first user group When the difference from the number of viewing users belonging to the video data becomes smaller than a predetermined value, the standard is set so that viewing users who use the moving image distribution system 1 for a viewing time of 20 hours or more are classified into the second user group. May be changed.

    The classification of viewing users is not limited to what is specifically described in this specification. The viewing user may be classified into three or more groups. Further, a classification criterion for determining which group each viewing user belongs to may be arbitrarily determined.

    The posted message is a message posted from the viewing user via the client device. The message posted by the viewing user includes, for example, a text message, a still image message, a moving image message, and various other messages. In this specification, a posted message posted from a viewing user belonging to the first user group is referred to as a first posted message, and a posted message posted from a viewing user belonging to the second user group is referred to as a second posted message. There is.

    The viewing management data 23f is data for managing viewing of moving images by viewing users. The viewing management data 23f includes viewing user account information, moving image information related to a moving image distributed by the moving image distribution system 1, and moving image viewing information related to viewing the moving image. As described above, the storage 23 can store the video information regarding the video viewed by the viewing user and the video viewing information regarding the viewing of the video in association with the account information of the viewing user. The moving image information is, for example, moving image identification information (moving image ID) for identifying a moving image. The moving image viewing information may include various data relating to the viewing time of the moving image viewed by the viewing user, the number of times of viewing, and viewing of other moving images.

    Next, functions implemented by the computer processor 21 will be described more specifically. The computer processor 21 executes a computer-readable instruction included in the distribution program, whereby a body motion data generation unit 21a, a face motion data generation unit 21b, an animation generation unit 21c, a moving image generation unit 21d, a moving image distribution unit 21e, It functions as a display request processing unit 21f, a decorative object selection unit 21g, an object purchase processing unit 21h, and a posted message processing unit 21i. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor mounted on the supporter computer 40, for example.

    The body motion data generation unit 21a generates first body motion data of each part of the body of the actor A1 based on the detection information of each of the motion sensors 31a to 31f, and detects each of the motion sensors 32a to 32f. Based on the information, second body motion data that is a digital representation of the position and orientation of each part of the body of the actor A2 is generated. In the present specification, the first body motion data and the second body motion data may be simply referred to as “body motion data”. The body motion data is generated as needed over time. For example, the body motion data may be generated every predetermined sampling time interval. As described above, the body motion data can represent the body movements of the actors A1 and A2 as digital data in time series. In the illustrated embodiment, since the motion sensors 31a to 31f and the motion sensors 32a to 32f are attached to the left and right limbs, waist, and head of each of the actor A1 and the actor A2, the motion sensors 31a to 31f and Based on the detection information of the motion sensors 32a to 32f, it is possible to digitally represent the positions and orientations of the whole body of the actor A1 and the actor A2 over time. The body motion data can define, for example, the positions and rotation angles of bones that constitute the rig data included in the model data 23a.

    The face motion data generation unit 21b generates first face motion data that is a digital representation of the movement of the face of the actor A1 based on the imaging data of the camera 37a, and based on the imaging data of each camera 38a, Second face motion data, which is a digital representation of the movement of the face of actor A2, is generated. In the present specification, the first face motion data and the second face motion data may be collectively referred to simply as “face motion data”. The face motion data is generated as needed over time. For example, the face motion data may be generated every predetermined sampling time interval. As described above, the face motion data can digitally represent the actor A2 and the movement of the face of the actor A2 (change in facial expression) in time series.

    The animation generation unit 21c applies the body motion data generated by the body motion data generation unit 21a and the face motion data generated by the face motion data generation unit 21b to predetermined model data included in the model data 23a. And an animation of a character object that moves in the virtual space and changes its facial expression. Specifically, the animation generation unit 21c generates an animation of a character object that moves in synchronization with the movement of the body and facial expression of the actor A1, based on the first body motion data and the first face motion data regarding the actor A1, Based on the second body motion data and the second face motion data related to the actor A2, an animation of a character object that moves in synchronization with the movement of the body and expression of the actor A2 can be generated. In this specification, the character object generated based on the movement and expression of the actor A1 is referred to as “first character object”, and the character object generated based on the movement and expression of the actor A2 is referred to as “second character. Sometimes called an "object."

    The moving image generating unit 21d constructs a virtual space using the object data 23b, and includes the virtual space, the animation of the first character object corresponding to the actor A1, and the animation of the second character object corresponding to the actor A2. Generate a video that contains it. The first character object is arranged in the virtual space so as to match the position of the actor A1 with respect to the tracking sensor 36a, and the second character object is arranged in the virtual space so as to match the position of the actor A2 with respect to the tracking sensor 36a. Is done. Therefore, the position and orientation of the first character object and the second character object in the virtual space can be changed by changing the position or orientation of the tracking sensor 36a.

    In one aspect, the moving image generating unit 21d constructs a virtual space based on the tracking information of the tracking sensor 36a. For example, the moving image generating unit 21d determines virtual camera setting information (position in the virtual space, gaze position, gaze direction, and angle of view) based on the tracking information of the tracking sensor 36a, and uses the virtual camera setting information as the virtual camera setting information. Based on this, a drawing area in the entire virtual space is determined, and moving image information for displaying the drawing area of the virtual space is generated.

    The moving image generating unit 21d replaces the tracking information of the tracking sensor 36a or, in addition to the tracking information of the tracking sensor 36a, based on the tracking information of the tracking sensor 36b, the first character object and the second character in the virtual space. It may be configured to determine the position and orientation of the object and the setting information of the virtual camera. The moving image generation unit 21d determines virtual camera setting information based on tracking information of a sensor selected from the tracking sensor 36a and the tracking sensor 36b (sometimes referred to as an “active sensor” in this specification). It may be configured as follows.

    The moving image generation unit 21d can synthesize the voices of the actor A1 and the actor A2 acquired from the microphone of the studio unit 30 with the generated moving image.

    As described above, the moving image generating unit 21d performs the animation of the first character object that moves in synchronization with the movement of the body and expression of the actor A1, and the second character that moves in synchronization with the movement of the body and expression of the actor A2. An animation of the object can be generated, and a moving image for distribution in which the voices of the actor A1 and the actor A2 are synthesized can be generated.

    The moving image distribution unit 21e distributes the moving image generated by the moving image generation unit 21d. This moving image is distributed via the network 50 to the client devices 10a to 10c and other client devices. The received moving image is reproduced in the client device 10a to the client device 10c.

    This moving image may be distributed to a client device (not shown) installed in the studio room R, and projected from the client device onto the screen S via a short focus projector. The moving image may be distributed to the supporter computer 40. Thereby, supporter B1 and supporter B2 can confirm the viewing-and-listening screen of the moving image currently delivered.

    A display example of a moving image distributed from the server device 20 to the client device 10a and reproduced on the client device 10a is shown in FIG. As illustrated, the display image 70 of the moving image distributed from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes a character object 71A corresponding to the actor A1, a character object 71B corresponding to the actor A2, a character object 71A and a character object 71B in a virtual space imitating a studio. A floor object 72c corresponding to the studio floor on which the player stands, a table object 72a indicating a table placed on the floor object 72c, and a studio set object 72b indicating a studio set placed on the floor object 72c. ing.

    The table object 72a, the studio set object 72b, and the floor object 72c are not gift objects, but are objects for constructing a virtual space included in the object data 23b. In the illustrated embodiment, the virtual space included in the distribution video is a space imitating a stage on which the character object 71A and the character object 71B perform. The floor object 72c corresponds to the floor of this stage. The floor object 72c extends in the horizontal direction in the virtual space. The studio set object 72b corresponds to the stage set in this stage. In the illustrated embodiment, the studio set object 72b extends in an arc shape in plan view, and defines the outer edge of the floor.

    The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The character object 71A is motion-controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. The character object 71B is motion-controlled based on the second body motion data and the second face motion data. Therefore, the character object 71A is controlled to move in the screen in synchronization with the movement of the body and expression of the actor A1, and the character object 71B is moved in the screen in synchronization with the movement of the body and expression of the actor A2. Controlled.

    As described above, the distribution video from the server device 20 may be distributed to the supporter computer 40. The moving image distributed to the supporter computer 40 is displayed on the supporter computer 40 as in FIG. The supporter B1 and the supporter B2 can change the settings of the components of the studio unit 30 by watching the moving image being played back on the supporter computer 40. In one aspect, the supporter B1 and the supporter B2 track the instruction signal for instructing the change of the direction of the tracking sensor 36a from the supporter computer 40 when the angle of the character object 71A and the character object 71B is to be changed in the moving image being distributed. It can be transmitted to the sensor 36a. The tracking sensor 36a can change the direction according to the instruction signal. For example, the tracking sensor 36a is rotatably attached to the stand via a turning mechanism having an actuator built around its axis. When the tracking sensor 36a receives an instruction signal for instructing a change in direction, The actuator of the rotation mechanism may be driven based on the signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one aspect, the supporter B1 and the supporter B2 transmit an instruction to use the tracking information from the tracking sensor 36b to the tracking sensor 36a and the tracking sensor 36b instead of the tracking information from the tracking sensor 36a. Also good.

    In one aspect, when the supporter B1 and the supporter B2 determine that an instruction to the actor A1 or the actor A2 is necessary by watching the moving image reproduced on the supporter computer 40, a message indicating the instruction is sent to the supporter computer 40. This message can be input and output to the display 39. For example, the supporter B1 and the supporter B2 can instruct the actor A1 or the actor A2 to change the standing position through a message displayed on the display 39.

    The display request processing unit 21f receives a gift object display request from the viewing user's client device, and performs a process according to the display request. Each viewing user can transmit a gift object display request to the server device 20 by operating his client device. For example, the first viewing user can transmit a gift object display request to the server device 20 by operating the client device 10a. The display request for the gift object may include the user ID of the viewing user and identification information (object ID) that identifies the object for which display is requested.

    As described above, the gift object can include an effect object, a normal object, and a decoration object. The effect object and the normal object are examples of the first object. A display request for requesting display of an effect object or a normal object is an example of a first display request.

    In one aspect, when the display request processing unit 21f receives a display request for a specific effect object from the viewing user, the display request processing unit 21f displays the effect object requested to be displayed on the moving image display image 70 based on the display request. Process. For example, when a display request for an effect object corresponding to confetti is made, the display request processing unit 21f displays an effect object 73 indicating confetti based on the display request as shown in FIG. To display.

    In one aspect, when receiving a display request for a specific normal object from the viewing user, the display request processing unit 21f performs a process for causing the moving image 70 to display the normal object requested to be displayed based on the display request. . For example, when a display request for a normal object indicating a teddy bear is made, the display request processing unit 21f displays a normal object 74 indicating a stuffed bear based on the display request as shown in FIG. 70.

    The display request for the normal object 74 may include a display position specifying parameter for specifying the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at the position specified by the display position specifying parameter in the virtual space. For example, the display position specifying parameter can specify the display position of the normal object 74 above the table object 72a indicating the table. The viewing user uses the display position specifying parameter to specify the position where the normal object is to be displayed by looking at the display of the character object 71A, the character object 71B, the gift object, and other objects included in the moving image 70. can do.

    In one embodiment, the normal object 74 may be displayed so as to move within the moving image display image 70. For example, the normal object 74 may be displayed so as to drop from the top to the bottom of the screen. In this case, the normal object 74 may be displayed in the display image 70 while falling from the start of falling to the floor of the virtual space constituting the moving image 70 and disappear from the display image 70 after falling on the floor. . The viewing user can view the falling normal object 74 from the start of the fall to the end of the fall. The moving direction of the normal object 74 in the screen can be arbitrarily set. For example, the normal object 74 may be displayed on the display image 70 so as to move from the left to the right of the moving image 70, from right to left, from the upper left to the lower left, or in other directions. The normal object 74 can move on various trajectories. For example, the normal object 74 can move on a linear trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or other trajectories. The viewing user specifies a movement direction parameter for specifying the movement direction of the normal object 74 and a trajectory along which the normal object 74 moves in addition to or instead of the display position specification parameter in the display request for the normal object. At least one of the trajectory parameters can be included. In one embodiment, an effect object and a normal object whose size in the virtual space is smaller than a reference size (for example, a piece of confetti of the effect object 73) are transferred to the character object 71A and the character object 71B. A part or all of them may be displayed overlapping each other. In one embodiment, an effect object and a normal object whose size in the virtual space is larger than a reference size (for example, the normal object 74 (a bear stuffed animal)) are displayed at positions that do not overlap with the character object. . In one embodiment, among the effect object and the normal object, the object whose size in the virtual space is larger than the reference size (for example, the normal object 74 (the stuffed bear)) is at least one of the character object 71A and the character object 71B. Is displayed behind the character object displayed in duplicate.

    In one aspect, when receiving a display request for a specific decoration object from the viewing user, the display request processing unit 21f adds the decoration object requested to be displayed to the candidate list 23d based on the display request. The display request for the decoration object is an example of a second display request. For example, the display request processing unit 21f stores identification information (object ID) identifying a specific decoration object requested to be displayed by the viewing user in the candidate list 23d in association with the user ID of the viewing user. (See FIG. 4). When a plurality of decoration object display requests are made, for each of the plurality of display requests, the user ID of the viewing user who made the display request, and the decoration object ID of the decoration object requested to be displayed by the viewing user, Are stored in the candidate list 23d in association with each other.

    In one aspect, the decoration object selection unit 21g displays the selected decoration object on the moving image display image 70 in response to selection of one or more decoration objects included in the candidate list 23d. To perform the process. In this specification, a decoration object selected from the candidate list 23d may be referred to as a “selected decoration object”.

    The decoration object is selected from the candidate list 23d by, for example, operating the supporter computer 40 by the supporter B1 and the supporter B2. In one aspect, a decoration object selection screen is displayed on the supporter computer 40. FIG. 10 shows an example of the decoration object selection screen 80 in one aspect. This decoration object selection screen 80 is displayed on the display of the supporter computer 40, for example. The decoration object selection screen 80 displays, for example, each of a plurality of decoration objects included in the candidate list 23d in a table format. As illustrated, the decoration object selection screen 80 according to one aspect includes a first column 81 that displays the type of the decoration object, a second column 82 that displays an image of the decoration object, and a character object associated with the decoration object. And a third column 83 for displaying the part. The decoration object selection screen 80 displays selection buttons 84a to 84c for selecting each decoration object. As described above, the decoration object that is a candidate for the selected decoration object is displayed on the decoration object selection screen 80.

    The supporter B1 and the supporter B2 can select one or a plurality of decoration objects included in the decoration object selection screen 80. For example, the supporter B1 and the supporter B2 can select the headband by selecting the selection button 84a. When the decoration object selection unit 21g detects that the headband has been selected, the display request processing unit 21f displays the selected decoration object 75 indicating the selected headband on the moving image display screen 70, as shown in FIG. Let The selected decoration object 75 is displayed on the display image 70 in association with a specific part of the character object. The selected decoration object 75 may be displayed so as to contact the specific part of the character object. For example, since the selection 75 indicating the headband is associated with the head of the character object, it is attached to the head of the character object 71A as shown in FIG. The decoration object may be displayed on the display screen 70 so as to move accompanying the movement of the specific part of the character object. For example, when the head of the character object 71A wearing the headband moves, the selected decoration object 75 indicating the headband is attached to the head of the character object 71A as if the headband is attached to the head of the character object 71A. Move.

    The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71B instead of the character object 71A. The selected decoration object 75 may be displayed on the display screen 70 in association with the character object 71A and the character object 71B.

The decoration object selection screen 80 may be configured not to include information that can identify a user who owns each decoration object or a user who has requested display of each decoration object. Thereby, it is possible to prevent the selector from preferentially treating a specific user when selecting a decoration object.

    In one embodiment, the decoration object selection screen 80 may display information about a user who owns each decoration object or a user who has requested display of the decoration object for each decoration object. For example, for each decoration object, the number of times the user who has made a display request for the decoration object has made a display request for the decoration object so far and the number of times it has been selected (for example, display requests for the decoration object have been made five times so far) Information indicating that it has been selected twice), the number of times the user has viewed at least one of the moving images of the character object 71A and the character object B, and the moving image (the character object 71A and the character in the moving image distribution system 1). The number of times the object B appears or not), the purchase amount of the gift object by the user, the number of purchases of the object by the user, the points that can be used in the video distribution system 1 owned by the user, the video distribution of the user system At level, and it may display various information about the user who made the request for display of the ornamental objects other than these. According to the embodiment, the decoration object can be selected based on the behavior and viewing history of the user who has requested display of the decoration object in the moving image distribution system 1 so far.

    In one embodiment, restrictions may be imposed on the display of decoration objects to eliminate duplication. For example, regarding the character object 71A, when a decoration object associated with the specific part has already been selected, selection of another decoration object associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, when the headband associated with the “head” of the character object 71 </ b> B has already been selected, other decorations associated with the “head” An object (for example, a decoration object representing “hat” associated with the head) is not displayed on the decoration object selection screen 80 or a selection button for selecting a decoration object representing the hat is selected on the selection screen 80. In this case, the selection may be disabled. According to the embodiment, it is possible to prevent the decoration object from being displayed on a specific part of the character object.

    The decoration object selection screen 80 may be displayed on another device instead of the supporter computer 40 or in addition to the supporter computer 40. For example, the decoration object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actor A1 and the actor A2 can select a desired decoration object based on the decoration object selection screen 80 displayed on the display 39 or the screen S. The selection of the decoration object by the actor A1 and the actor A2 can be performed by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b, for example.

    In one aspect, in response to a request from a video viewing user, the object purchase processing unit 21h sends purchase information of each of a plurality of gift objects that can be purchased in relation to the video to the client device of the viewing user (for example, To the client device 10a). The purchase information of each gift object includes the type of the gift object (effect object, normal object, or decoration object), the image of the gift object, the price of the gift object, and information necessary for purchasing other gift objects. Can be included. The viewing user can select a gift object to purchase based on the purchase information of the gift object displayed on the client device 10a. Selection of a gift object to be purchased may be performed by operating the client device 10a. When a gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 20. The object purchase processing unit 21h performs a settlement process based on the purchase request. When this settlement process is completed, the purchased gift object is held by the viewing user. In this case, the object ID of the purchased gift object is stored in the possession list 23c in association with the user ID of the purchased viewing user.

    Gift objects that can be purchased may be different for each video. Purchaseable gift objects may be available for purchase in multiple videos. In other words, the gift object that can be purchased may include a unique gift object unique to each moving image and a common gift object that can be purchased in a plurality of moving images. For example, the effect object indicating the confetti may be a common gift object that can be purchased in a plurality of moving images.

    In one aspect, when an effect object is purchased while viewing a predetermined video, the effect object to be purchased is changed to the currently viewed video in response to the completion of the payment process for purchasing the effect object. It may be displayed automatically. When a normal object is purchased while viewing a predetermined video, the video that the normal gift object to be purchased is being viewed in response to the completion of the payment process for purchasing the normal object, as described above. May be automatically displayed.

    In another aspect, a payment completion notification is transmitted to the client device 10a in response to the completion of the payment processing in the object purchase processing unit 21h for the effect object to be purchased, and the effect object purchased in the client device 10a. A confirmation screen for confirming with the viewing user whether or not to make a display request may be displayed. When the viewing user selects to display the purchased effect object, a display request for displaying the purchased effect object is sent from the viewing user's client device to the display request processing unit 21f. In the display request processing unit 21f, processing for displaying the effect object to be purchased on the moving image display image 70 may be performed. Even when the purchase target is a normal object, a confirmation screen for confirming with the viewing user whether or not to make a display request for the purchased normal object may be displayed on the client device 10a as described above.

    As described above, the client devices 10 a to 10 c and other client devices can transmit a posted message related to the distribution video and other posted messages to the server device 20. The posted message processing unit 21i is configured to perform processing for displaying posted messages received from the client devices 10a to 10c and other client devices on a moving image.

    The display mode of the posted message in one mode will be described with reference to FIGS. FIGS. 11 to 14 show display examples of posted messages displayed on the moving image being played back on the client device 10a. FIG. 15 is a flowchart showing the flow of the moving image distribution process in one embodiment, and FIG. 16 is a schematic diagram for explaining the first distribution period and the second distribution period in the distributed moving image. In the first distribution period, the first display area 76 is included in the moving image, and in the second distribution period, the second display area 77 is included in the moving image.

    As illustrated in FIG. 16, in one embodiment, the server device 20 delivers a moving image between time t1 and time t2. Time t1 is a moving image distribution start time, and time t2 is a moving image distribution end time. In the illustrated embodiment, of all the video distribution periods, the period between time t1 and time t3 and the period between time t4 and time t2 is the first distribution period, and the period between time t3 and time t4 is the first. 2 delivery period. After the distribution start time t1 of the moving image, the first distribution period 161 continues until time t3, the first distribution period 161 is switched to the second distribution period 162 at time t3, and then the second distribution period at time t4. 162 is switched to the first distribution period 163, and the first distribution period 163 continues until the distribution end time t2. The order of the first distribution period and the second distribution period, the length, the number of appearances, and other settings related to the first distribution period and the second distribution period can be arbitrarily determined.

    In one embodiment, the first distribution period and the second distribution period may be switched when a predetermined time arrives. For example, in the illustrated embodiment, the first distribution period 161 is switched to the second distribution period 162 at time t3, and then the second distribution period 162 is switched to the first distribution period 163 at time t4. In one embodiment, switching from the first distribution period to the second distribution period and switching from the second distribution period to the first distribution period may be performed according to an operation of the controller 33a or the controller 33b by the actor A1. The operation may be performed in accordance with the operation of the controller 34a or the controller 34b by the actor A2. In one embodiment, switching from the first distribution period to the second distribution period and switching from the second distribution period to the first distribution period may be performed according to the operation of the supporter computer 40 by the supporter B1 or the supporter B2. Good. Switching between the first distribution period and the second distribution period may be performed in a manner not explicitly described in the present specification.

    11 and 12 show a display image 70 of a distribution video during the first distribution period. The distribution moving image display image 70 shown in FIG. 11 includes a virtual space image viewed from a viewpoint determined based on the tracking information of the tracking sensor 36b in front of the actor A1 and the actor A2. In other words, the display image 70 is an image of a virtual space constructed with the position of the tracking sensor 36b in front of the actor A1 and the actor A2 as a virtual viewpoint. For this reason, the character object 71A and the character object 71B face the front in the display image 70.

    In the illustrated embodiment, the reproduced moving image (or its display image 70) includes a first display area 76.

    In one aspect, the first display area 76 is a display area that is superimposed on the moving image generated by the moving image generating unit 21d. In one aspect, the first display area 76 is a two-dimensional display area.

    In one aspect, the first display area 76 is not an object constituting the virtual space generated by the moving image generating unit 21d. In this case, the first display area 76 does not depend on the setting information (position, orientation, and angle of view) of the virtual camera for constructing the virtual space generated by the moving image generating unit 21d. It is displayed in a predetermined area. Even if the active sensor is switched, the first display area 76 may be displayed at a position that does not change before and after the switching. In the illustrated embodiment, a region occupying a certain range at the lower left of the display image 70 is a first display region 76. The position of the first display area 76 is not limited to the position specifically described in this specification. As illustrated, the first display area 76 may be provided in an area overlapping with at least one of the character object 71A and the character object 71B. In the illustrated embodiment, the first display area 76 overlaps a part of the character object 71B. In the area where the first display area 76 and the character object 71B overlap, the first display area 76 and the posted message included therein may be displayed in front of the screen than the character object 71B. In this case, a part of the character object 71B is hidden behind the first display area 76 or the posted message displayed there and cannot be viewed by the viewing user.

    In one aspect, the posted message processing unit 21i displays a posted message posted from the viewing user via the client devices 10a to 10c and other client devices in a display area corresponding to the user group to which the viewing user belongs. Configured as follows. Since the posted message posted by the viewing user is stored as the posted data 23e in the storage 23, the posted message processing unit 21i reads the posted message from the storage 23 and displays the read posted message in the first display area 76. Or it can display on the 2nd display area 77 mentioned later. The posted messages may be read in order of the posting time.

    In the embodiment shown in FIG. 11, four posted messages 76 a to 76 d are displayed in the first display area 76. The posted messages 76a to 76d may be posted messages (first posted messages) from viewing users belonging to the first user group, or posted messages (second posted messages) from viewing users belonging to the second user group. ). For example, a posted message 76a, a posted message 76b, a posted message 76c, and a posted message 76d are read from the storage 23 in this order, and each read first posted message is read in the first display area 76 in the order of reading. Is displayed. A specific example of the display procedure is as follows. When the first posted message 76a is read, the posted message 76a is displayed at the top of the first display area 76. Next, when the posted message 76b is read, the posted message 76a moves downward from the initial display position, and the posted message 76b is displayed in a space vacated by this movement. Hereinafter, similarly, when a new posted message is displayed, the displayed posted message is moved downward, and the new posted message is displayed in a space vacated by the movement.

    When a new posted message is displayed after the posted message 76 a reaches the lower limit of the first display area 76, the posted message 76 a that has reached the lower limit is not displayed in the first display area 76. In the display image 70 of FIG. 11, it is assumed that the posted message 76 a has reached the lower limit of the first display area 76. At this point, when a new posted message 76e is read out from the storage 23 for display in the first display area 76, the posted message 76a is not displayed in the first display area 76, as shown in FIG. After the remaining posted messages (first posted messages 76b to 76d) move downward, the posted message 76e is displayed in a space freed by this movement. Thus, the posted message displayed in the first display area 76 continues to be displayed in the first display area 76 until the end of the movement direction of the first display area 76 is reached.

    In the first display area 76, not only the first posted message posted by the viewing user but also various notifications from the server device 20 may be displayed. For example, when there is a gift display request from the first viewing user, a message to that effect may be displayed in the first display area 76. The notification from the server device 20 that can be displayed in the first display area 76 can include various types of notifications. The notification from the server device 20 may be, for example, a message for notifying that the viewing user has started viewing the moving image when a certain viewing user starts viewing the moving image.

    As described above, the posted message processing unit 21 i performs a process of displaying the posted messages of users belonging to the first user group or the second user group in the first display area 76. In the first display area 76, the first posted message moves in a predetermined moving direction in order to create a space for displaying a new posted message. In the embodiment shown in FIGS. 11 and 12, the first posted message moves from top to bottom. The moving direction of the first posted message in the first display area 76 is not limited from top to bottom. The moving direction of the first posted message in the first display area 76 may be from bottom to top, left to right, right to left, and any other direction.

    Subsequently, with reference to FIG. 13 and FIG. 14, a moving image distributed in the second distribution period will be described. 13 and 14 show an example of a display image 130 of a distribution video during the second distribution period. In the embodiment shown in FIGS. 13 and 14, it is assumed that a moving image in which the character object 71A and the character object 71B perform on the stage is distributed in the second distribution period. The distribution moving image display image 130 shown in FIG. 13 includes an image of the virtual space viewed from the viewpoint determined based on the tracking information of the tracking sensor 36b in front of the actor A1 and the actor A2. That is, this display image 130 is an image of a virtual space constructed with the position of the tracking sensor 36b in front of the actor A1 and the actor A2 as a virtual viewpoint. For this reason, the character object 71A and the character object 71B face the front in the display image 130. FIG. 14 shows a moving image display image 130 generated based on the tracking information of the tracking sensor 36a. Since the tracking sensor 36a is on the left front of the actor A1 and the actor A2, in the display image 130, the character object 71A and the character object 71B face in directions other than the front (front right).

    The second display area 77 is an area corresponding to part or all of the surface of one or more objects included in the virtual space generated by the moving image generating unit 21d. In the illustrated embodiment, the entire front surface of the screen-like screen object 131 is the second display area 77. In the present specification, an object provided with the second display area 77, such as the screen object 131, may be referred to as a “display object” or a “message display object”. Any object in the virtual space included in the distribution video can be used as a display object. In one aspect, the gift object may be a display object.

    In the embodiment of FIG. 13, a posted message (second posted message) from a viewing user belonging to the second user group is displayed in the second display area 77. In the illustrated example, the second display area 77 displays five second posted messages of the second posted messages 77a to 77e. In the present specification, the second posted messages 77a to 77e may be simply referred to as “second posted messages” when it is not necessary to distinguish them from each other. As shown in FIG. 13, the second posted message 77a, the second posted message 77b, the second posted message 77c, the second posted message 77d, and the second posted message 77e are read from the storage 23 in this order, The read second posted messages are displayed in the second display area 77 in the order of reading. In the second display area 77, posted messages (first posted messages) from viewing users belonging to the first user group are not displayed. In the second distribution period, even if a viewing user belonging to the first user group cannot post a message or can post a message by the function implemented in the client device, It is not displayed in the display area 77.

    The second posted message displayed in the second display area 77 may move in a predetermined direction in the second display area 77. In the embodiment of FIG. 13, each second posted message moves from the top to the bottom of the second display area 77. Since the screen object 131 (second display area 77) is arranged behind the character object 71A and the character object 71B in the virtual space, the second posted message displayed in the second display area 77 is the second post message. A part of each of the posted messages 77a to 77d is hidden behind the character object 71A and the character object 71B. When the second posted message moves to the end in the moving direction of the second display area 77, it is not displayed on the display image 70 thereafter. In one embodiment, the display object such as the screen object 131 is arranged behind the character object in the virtual space. Accordingly, the character object is not hidden behind the display object and the second posted message displayed on the display object. As described above, it is assumed that the character object performs performance in the second distribution period. Therefore, by arranging the display object behind the character object, the user can see the performance of the character object without being disturbed by other objects. Thereby, deterioration of a user's viewing experience can be prevented.

    The moving direction of the second posted message in the second display area 77 is not limited to the top to bottom direction. The moving direction of the second posted message in the second display area 77 may be left to right, bottom to top, right to left, and any other direction. The moving direction of the posted message in the second display area 77 may be different from the moving direction of the first posted message in the first display area 76.

    In one aspect, the moving direction of the posted message in the second display area 77 may be determined according to the first command included in the posted message. For example, when a viewing user creates a posted message via a client device, the viewing user can include a first command for designating a moving direction in the posted message. This first command may be, for example, the text “L, R” when designating the movement from left to right. This first command may be added after the main body of the posted message (message displayed in the second display area 77), for example. The message body and the first command may be separated by an at sign (“@”), a comma (“,”), a semicolon (“;”), a colon (“:”), or the like. In this manner, the viewing user can create a posted message so as to include the first command for designating the moving direction of the message in the second display area 77, and can transmit the posted message to the server device 20. The first command may be stored in the storage 23 as part of the post data 23e. When the posted message processing unit 21i reads the posted message from the storage 23 and the posted message is posted from the second user group, the posted message processing unit 21i moves in the direction specified by the first command. In addition, the posted message may be displayed in the second display area 77. The description format of the first command described above can be arbitrarily changed.

    In one aspect, the initial display position of the posted message in the second display area 77 may be determined according to the second command included in the posted message. For example, when creating a posted message via the client device, the viewing user can include a second command for designating an initial display position in the second display area 77 in the posted message. This second command is, for example, the text “@L” when the initial display position is the left end of the second display area, and “@R when the initial display position is the right end of the second display area. ”And the text“ @C ”may be used when the initial display position is the center of the second display area. The viewing user can create a posted message so as to include the second command and transmit the posted message to the server device 20. The posted message may include the first command in addition to the second command. The second command may be stored in the storage 23 as part of the posted data 23e. When the posted message processing unit 21i reads the posted message from the storage 23 and the posted message is posted from the second user group, the posted message processing unit 21i displays the posted message at the initial display position designated by the second command. Display a posted message. When the posted message also includes the first command, the posted message processing unit 21i displays the posted message at the initial display position specified by the second command, and then the direction specified by the first command. You may be comprised so that it may move. The description format of the second command described above can be arbitrarily changed.

    In one aspect, the posted message processing unit 21i moves each posted message so that the moving speed of the second posted message in the second display area 77 is slower than the moving speed of the first posted message in the first display area 76. The speed can be adjusted.

    In one aspect, the posted message processing unit 21 i is configured such that the second posted message is displayed in the second display area 77 than the first display time in which the first posted message is displayed in the first display area 76. The moving speed of each posted message can be adjusted so that the display time becomes longer. When the length of the first display area 76 in the moving direction of the first posted message is the same as the length of the second display area 77 in the moving direction of the second posted message, the moving speed of the second posted message is as described above. Is slower than the moving speed of the first posted message, the display time of the second posted message can be made longer than the display time of the first posted message. When the moving speeds of the first posted message and the second posted message are the same, the length of the second display area 73 in the moving direction of the second posted message is set to the length of the first displayed area 76 in the moving direction of the first posted message. By making it longer than this, the display time of the second posted message can be made longer than the display time of the first posted message.

    In one mode, display of a distribution animation can be changed by camera work. As described above, the distribution moving image display image 130 illustrated in FIG. 13 is generated based on the tracking information of the tracking sensor 36b in front of the actor A1 and the actor A2. That is, the display image 130 is generated when the tracking sensor 36b is an active sensor. For this reason, in the display image 130 of FIG. 13, the character object 71A and the character object 71B are facing the front. By switching the active sensor from the tracking sensor 36b to the tracking sensor 36a, a moving image including the virtual space generated based on the tracking information of the tracking sensor 36a is generated. An example of a moving image display image generated based on the tracking information of the tracking sensor 36a is shown in FIG. Since the tracking sensor 36a is on the left front of the actor A1 and the actor A2, in the display image 130, the character object 71A and the character object 71B face in directions other than the front (front right). Further, the screen object 131, the second display area 77 provided on the surface of the screen object 131, and the second posted message displayed in the second display area 77 are also tilted and displayed. As described above, the position and orientation of the second display region 77 (or the screen object 131) in the virtual space are determined depending on which tracking sensor is used as the active sensor. Further, when the position or orientation of the active sensor is changed, the position or orientation of the second display area 77 (or screen object 131) in the virtual space is also changed accordingly. The second display region 77 (or screen object 131) in the display image 130 when the tracking sensor 36a shown in FIG. 14 is an active sensor is displayed when the tracking sensor 36a shown in FIG. 13 is an active sensor. The image is displayed smaller than the second display area 77 (or the screen object 131) in the display image 130 by an amount viewed from an oblique direction.

    When the active sensor is switched from the tracking sensor 36b to the tracking sensor 36a, the position (viewpoint position) of the virtual camera in the virtual space is also changed, so the position and orientation of the second display area 77 in the virtual space are also changed. For example, in the display image of FIG. 13 in which the tracking sensor 36b is an active sensor, the positions of the second posted messages 77a to 77d are hidden behind the character object 71A or the character object 71B. 14, only the second posted message 77c is hidden behind the character object, and the second posted messages 77a, 77b, and 77d are displayed as characters by moving the viewpoint. The entire object is visible without being hidden behind the object. In this way, by moving the viewpoint in the virtual space by switching the active sensor, it is possible to make the second posted message hidden behind the character object easily visible.

    Next, with reference to FIG. 15, a moving image distribution process according to an aspect will be described. FIG. 15 is a flowchart showing the flow of the moving image distribution process in the embodiment. In the moving image distribution process, it is assumed that the actor A1 and the actor A2 are present in the studio room R.

    First, in step S11, body motion data that is a digital representation of the body movements of the actors A1 and A2 and face motion data that is a digital representation of the facial movements (expressions) of the actors A1 and A2 are generated. The For example, the body motion data is generated by the body motion data generation unit 21a, and the face motion data is generated by the face motion data generation unit 21b.

    Next, in step S12, by applying the body motion data and face motion data of the actor A1 to the model data for the actor A1, the animation of the first character object that moves in synchronization with the movement of the body and expression of the actor A1. Is generated. Similarly, by applying the body motion data and face motion data of the actor A2 to the model data for the actor A2, an animation of the second character object that moves in synchronization with the movement of the body and expression of the actor A2 is generated. . For example, the animation generation unit 21c generates the animation.

    Next, in step S13, a moving image including a virtual space image, an animation of the first character object corresponding to the actor A1, and an animation of the second character object corresponding to the actor A2 is generated. The voices of the actor A1 and the actor A2 may be synthesized with this moving image. The animation of the first character object and the animation of the second character object may be arranged in the virtual space. For example, the moving image generation unit 21d generates the moving image.

    Next, it transfers to step S14 and the moving image produced | generated in step S13 is delivered. This moving image is distributed via the network 50 to the client devices 10a to 10c and other client devices. This moving image may be distributed to the supporter computer 40 and projected onto the screen S in the studio room R. The moving image is continuously distributed over a predetermined distribution period. The distribution period of the moving image can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes and any other time.

    Next, it progresses to step S15 and it is determined whether the completion | finish conditions for ending the delivery of a moving image were fulfilled. The end condition is, for example, that the end time of distribution has been reached, that the support computer 40 has instructed to end the distribution, or other conditions. If the end condition is not fulfilled, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the moving image including the animation synchronized with the movement of the actor A1 and the actor A2 is continued. When it is determined that the end condition is satisfied for the moving image, the moving image distribution process is ended.

    Next, another embodiment of the present invention will be described with reference to FIGS. 17 and 18. FIG. 17 shows a display example of a posted message displayed on a moving image being played back on the client device 10a in another embodiment of the present invention, and FIG. 18 shows a flow of posted message display processing in the other embodiment. FIG.

    A display image 170 shown in FIG. 17 includes a first display area 176 and a second display area 177. First posted messages 176a to 176d are displayed in the first display area 176, and second posted messages 177a are displayed in the second display area 177. In the embodiment shown in FIG. 17, the posted message processing unit 21i displays a posted message (first posted message) from a viewing user belonging to the first user group in the first display area 76, and the second user. Processing for displaying a posted message (second posted message) from a viewing user belonging to the group in the second display area 177 is performed.

    In the posted message display process shown in FIG. 18, it is assumed that a posted message for the moving image is posted from the client device to the server device 20 that distributes the moving image during distribution of the moving image. The posted message display process is performed in parallel with the moving image distribution process shown in FIG. The posted message received by the server device 20 is stored in the storage 23 as posted data 23e.

    In step S21, the posted message stored in the storage 23 is read. The posted messages are read out in the order of posting, for example.

Next, in step S22, it is determined to which user group the viewing user who has posted the posted message read from the storage 23 belongs. In the posted data 23e, since the posted message is stored in association with the account information of the viewing user who posted the posted message and the group information indicating the user group to which the viewing user belongs, by referring to the posted data 23e The user group to which the user who posted the posted message belongs can be specified.

    When it is determined that the viewing user who posted the posted message belongs to the first user group, the display process proceeds to step S23, and when it is determined that the viewing user who posted the posted message belongs to the second user group. The display process proceeds to step S24.

    In step S23, the posted message read in step S21 is displayed in the first display area (for example, the first display area 76).

    In step S24, the posted message read in step S21 is displayed in the second display area (for example, second display area 77).

    As described above, the posted message read from the storage 23 is displayed in the display area corresponding to the user group to which the user who posted the posted message belongs.

    According to the above embodiment, the first display area 76 in which the first posted message is displayed and the second display area 77 in which the second posted message is displayed but the first posted message is not displayed are included. A video is delivered. Thereby, according to the user group to which the user who posted the posted message belongs, the display area of the posted message can be allocated. Conventionally, since only one display area for posted messages is provided in a predetermined area of the display screen, posted messages from users in various user groups are displayed in the same display area. On the other hand, according to said embodiment, the display process of the said posting message is performed according to the user group to which the user who posted the posting message belongs. Thereby, the display mode of a contribution message can be diversified.

    In one embodiment, a part of the second display area 77 is arranged behind the character object 71A and the character object 71B. As a result, the second posted message can be displayed in an area where it is easier to collect the attention of other users.

In one embodiment, the second display area 77 is included in the moving image during the second distribution period in which the actor A1 and the actor A2 perform. Since the second display area 77 is displayed behind the character object 71A and the character object 71B that are motion-controlled according to the performance of the actor A1 and the actor A2, it is easier to attract the attention of other users. In addition, since the second display area 77 is arranged behind the character object 71A and the character object 71B, it is difficult to prevent the performance of the character object 71A and the character object 71B from being viewed.

    In one embodiment, when the first display area 76 and at least one of the character object 71 </ b> A and the character object 71 </ b> B are displayed overlappingly, the character object is arranged behind the first display area 76. Thereby, in the distribution period in which display of posted messages by the viewing user or actor A1 and actor A2 is more important, the posted message is displayed without being hidden behind the character object.

    Thus, according to the above embodiment, the display mode of the posted message can be changed according to the content of the moving image (for example, whether or not the actor is performing a performance). Therefore, the display mode of the posted message can be diversified without deteriorating the viewing experience of the moving image by the viewing user.

    In the above-described embodiment, the viewing user belonging to the second user group can receive a preferential service or a superior function than the viewing user belonging to the first user group regarding the display of the posted message.

    For example, a viewing user belonging to the second user group can specify the moving direction of the second posted message using the first command, or can specify the display start position of the second posted message using the second command. . Thereby, the viewing user belonging to the second user group can move his / her post message in a direction in which attention is more easily collected or displayed at a position where attention is more easily collected. On the other hand, viewing users belonging to the first user group cannot specify the moving direction of the posted message or the initial display position.

    In the above embodiment, posted message display control is performed so that the moving speed of the second posted message in the second display area 77 is slower than the moving speed of the first posted message in the first display area 76. . Thereby, the viewing user belonging to the second user group can display his / her post message on the display screen longer than the viewing user belonging to the first user group.

  In the above embodiment, a viewing user belonging to the second user group can post a message in any of the first distribution periods 161 and 163 and the second distribution period 162. On the other hand, users belonging to the first user group can post messages only during the first distribution periods 161 and 163.

    The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the scope of the invention. For example, the distributed video may be shot and generated outside the studio room R. For example, shooting for generating a moving image to be distributed may be performed at the home of an actor or supporter.

    The posted message posted by the viewing user may not be stored in the storage 23. In this case, the posted message processing unit 21i analyzes the posted message received from the client device, identifies the user group to which the user who posted the posted message belongs, and displays the posted message in the display area corresponding to the identified user group. A message can be displayed.

    In the processing procedure described in this specification, particularly in the processing procedure described with reference to the flowchart, a part of the steps (steps) constituting the processing procedure is omitted, and the steps constituting the processing procedure are as follows. It is possible to add a process that is not explicitly specified and / or change the order of the process, and the processing procedure in which such omission, addition, or change of the order is made does not depart from the spirit of the present invention. It is included in the scope of the invention.

[1]
A storage for storing a first posted message posted by a first user included in the first user group and a second posted message posted by a second user included in the second user group; and one or more computer processors; With
The one or more computer processors execute computer-readable instructions,
Distributing a moving image including a first display area in which the first posted message is displayed and a second display area in which the second posted message is displayed but the first posted message is not displayed.
Video distribution system.

[2]
The second user group is composed of a smaller number of users than the first user group.
The moving image distribution system according to [1].

[3]
The first posted message moves in the first direction in the first display area.
The moving image distribution system according to [1] or [2].

[4]
The second posted message moves in the second direction in the second display area.
The moving image distribution system according to [3].

[5]
The second direction changes according to a first command included in the second posted message.
The moving image distribution system according to [4].

[6]
The initial display position of the second posted message in the second display area changes according to a second command included in the second posted message.
The moving image distribution system according to [4] or [5].

[7]
The moving speed of the second posted message in the second display area is slower than the moving speed of the first posted message in the first display area;
The moving image distribution system according to any one of [1] to [7].

[8]
The display time during which the second posted message is displayed in the second display area is longer than the display time during which the first posted message is displayed in the first display area.
The moving image distribution system according to any one of [1] to [7].

[9]
Information other than the first posted message is also displayed in the first display area.
The moving image distribution system according to any one of [1] to [8].

[10]
The storage stores an electronic gift provided by at least one of the first user and the second user.
The moving image distribution system according to any one of [1] to [9].

[11]
Information other than the first posted message includes a notification indicating that the electronic gift has been provided.
[10] The moving picture distribution system according to [10].

[12]
The second user is a user whose parameters related to the electronic gift satisfy a predetermined condition.
The moving image distribution system according to [10] or [11].

[13]
The second user is a user who has watched the video more than a predetermined number of times.
The moving image distribution system according to any one of [1] to [12].

[14]
The first user leaves the first user group and is included in the second user group when the number of posts in the first posted message exceeds a predetermined number.
The moving image distribution system according to any one of [1] to [13].

[15]
The animation includes an animation of a character object generated based on an actor's movement.
The moving image distribution system according to any one of [1] to [14].

[16]
The moving image distribution system according to [15], wherein at least a part of the second display area is arranged behind the character object.

[17]
When the first display area and the character object are displayed in an overlapping manner, the character object is arranged behind the first display area.
The moving image distribution system according to [15] or [16].

[18]
A plurality of cameras,
Including an image of a virtual space configured based on tracking information of an active sensor selected from the plurality of cameras;
The moving image distribution system according to any one of [1] to [17].

[19]
The second display area is provided in a display object in the virtual space,
The position and orientation of the second display area in the virtual space are changed according to tracking information of the active sensor.
[18] The moving image distribution system according to [18].

[20]
The second display area is provided in the virtual space,
The size of the second display area in the virtual space is changed according to the position and orientation of the active sensor.
[18] or [19].

[21]
Any one of [1] to [20], wherein the first display area is included in the video during the first distribution period, and the second display area is included in the video during the second distribution period. The moving image distribution system according to item 1.

[22]
A video distribution method executed by one or more computer processors executing computer-readable instructions,
Storing a first posted message posted by a first user included in the first user group;
Storing a second posted message posted by a second user included in the second user group;
Delivering a moving image including a first display area in which the first posted message is displayed and a second display area in which the second posted message is displayed while the first posted message is not displayed;
A video delivery method comprising:

[23]
A program executed on one or more computer processors,
The one or more computer processors;
Storing a first posted message posted by a first user included in the first user group;
Storing a second posted message posted by a second user included in the second user group;
Delivering a moving image including a first display area in which the first posted message is displayed and a second display area in which the second posted message is displayed while the first posted message is not displayed;
, A video distribution program to execute.

1 Video distribution system

Claims (26)

A first posted message posted by a first user included in the first user group, a second posted message posted by a second user included in the second user group, and at least one of the first user and the second user A storage for storing an object provided by one and one or more computer processors;
The first user does not belong to the second user group,
The second user does not belong to the first user group,
The second user is a user whose parameters related to the object satisfy a predetermined condition,
The one or more computer processors execute computer-readable instructions,
A moving image including: a first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. Deliver,
Video distribution system. A storage for storing a first posted message posted by a first user included in the first user group and a second posted message posted by a second user included in the second user group; and one or more computer processors And comprising
The first user does not belong to the second user group,
The second user does not belong to the first user group,
The one or more computer processors execute computer-readable instructions,
A first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. Deliver video,
The second user is a user whose viewing condition of the moving image satisfies a predetermined condition.
Video distribution system. The second user group is composed of a smaller number of users than the first user group.
The moving image distribution system according to claim 1 or 2. The first posted message moves in the first direction in the first display area.
The moving image distribution system according to any one of claims 1 to 3. The second posted message moves in the second direction in the second display area.
The moving image distribution system according to any one of claims 1 to 4. The second direction changes according to a first command included in the second posted message.
The moving image distribution system according to claim 5. The initial display position of the second posted message in the second display area changes according to a second command included in the second posted message.
The moving image distribution system according to claim 5 or 6. The moving speed of the second posted message in the second display area is slower than the moving speed of the first posted message in the first display area;
The moving image distribution system according to any one of claims 1 to 7. The display time during which the second posted message is displayed in the second display area is longer than the display time during which the first posted message is displayed in the first display area.
The moving image distribution system according to any one of claims 1 to 8. Information other than the first posted message is also displayed in the first display area.
The moving image distribution system according to any one of claims 1 to 9. The information other than the first posted message includes a notification indicating that the object has been provided.
The moving image distribution system according to claim 1 . At least a part of the one or more computer processors is provided in a server device,
Information other than the first posted message includes a notification from the server device,
The moving image distribution system according to claim 10 or 11. The moving image distribution system according to claim 1 , wherein the object is an electronic gift. The animation includes an animation of a character object generated based on an actor's movement.
The moving image distribution system according to any one of claims 1 to 13.   The moving image distribution system according to claim 14, wherein at least a part of the second display area is arranged behind the character object. When the first display area and the character object are displayed in an overlapping manner, the character object is arranged behind the first display area.
The moving image distribution system according to claim 14 or 15. A plurality of cameras,
The moving image includes an image of a virtual space configured based on tracking information of an active sensor selected from the plurality of cameras.
The moving image distribution system according to any one of claims 1 to 16. The second display area is provided in a display object in the virtual space,
The position and orientation of the second display area in the virtual space are changed according to tracking information of the active sensor.
The moving image distribution system according to claim 17. The second display area is provided in the virtual space,
The size of the second display area in the virtual space is changed according to the position and orientation of the active sensor.
The moving image distribution system according to claim 17 or 18.   The first display area is included in the moving image during a first distribution period, and the second display area is included in the moving image during a second distribution period. The moving image distribution system according to item 1. The first user posts a first posted message using a client device,
In the second distribution period, the client device is configured not to post the first posted message.
The moving image distribution system according to claim 20 . The moving image includes an image of a virtual space,
The electronic gift is displayed as a gift object in the virtual space,
The second display area is provided in the gift object in the virtual space;
The moving image distribution system according to claim 13. A video distribution method executed by one or more computer processors executing computer-readable instructions,
Storing a first posted message posted by a first user included in the first user group;
Storing a second posted message posted by a second user included in the second user group;
Storing an object provided by at least one of the first user and the second user;
A moving image including: a first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. And the process of delivering
With
The first user does not belong to the second user group,
The second user does not belong to the first user group,
The second user is a user whose parameters related to the object satisfy a predetermined condition.
Video delivery method. A program executed on one or more computer processors,
The one or more computer processors;
Storing a first posted message posted by a first user included in the first user group;
Storing a second posted message posted by a second user included in the second user group;
Storing an object provided by at least one of the first user and the second user;
A moving image including: a first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. And the process of delivering
And execute
The first user does not belong to the second user group,
The second user does not belong to the first user group,
The second user is a user whose parameters related to the object satisfy a predetermined condition.
Video distribution program. A video distribution method executed by one or more computer processors executing computer-readable instructions,
Storing a first posted message posted by a first user included in the first user group;
Storing a second posted message posted by a second user included in the second user group;
A moving image including: a first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. And the process of delivering
With
The first user does not belong to the second user group,
The second user does not belong to the first user group,
The second user is a user whose viewing condition of the moving image satisfies a predetermined condition.
Video delivery method. A program executed on one or more computer processors,
The one or more computer processors;
Storing a first posted message posted by a first user included in the first user group;
Storing a second posted message posted by a second user included in the second user group;
A moving image including: a first display area capable of displaying the first posted message and the second posted message; and a second display area capable of displaying the second posted message but not displaying the first posted message. And the process of delivering
And execute
The first user does not belong to the second user group,
The second user does not belong to the first user group,
The second user is a user whose viewing condition of the moving image satisfies a predetermined condition.
Video distribution program.

Images