JP2020088837A - Moving picture distribution system, moving picture distribution method, and moving picture distribution program - Google Patents

Abstract

To provide a mechanism for increasing the number of opportunities for communication with a viewing user.SOLUTION: A moving picture distribution system 1 for distributing a moving picture including an animation of a character object generated on the basis of motion of an actor to a client device 10 used by a viewing user comprises a storage for storing an object associated with the viewing user to receive a display request on the object from the viewing user; on a display device disposed at a position viewable from the actor, displays a list including information on the object on which the display request is received and identification information on the viewing user performing the display request on the object; receives a submission message from the viewing user associated with any group; and displays on the display device a message display region for displaying a submission message transmitted by a viewing user belonging to a predetermined group and a message display region capable of displaying a message from a user not belonging to the predetermined group.SELECTED DRAWING: Figure 1

Description

The present invention relates to a moving picture distribution system, a moving picture distribution method, and a moving picture distribution program.

Conventionally, there is known a moving image distribution system that generates an animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object (for example, see Patent Document 1).

In this type of moving image distribution system, it has been proposed that an arbitrary object is displayed in a moving image distributed to a plurality of viewing users by an operation of the viewing user. The object displayed in the moving image by the viewing user is, for example, a gift object for a character object.

JP, 2005-184689, A

In order to increase the number of viewing users or the number of viewing times in the moving image distribution system, it is important to increase the chances of communication between the actor and the viewing user through the character object, in addition to the uniqueness of the character object itself. However, the actor must give a voice as needed while moving the character object, and must also deal with the gift object. In addition, it is difficult to increase the number of opportunities for communication with the viewing user because the number of subjects to be paid attention to increases.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a mechanism for increasing opportunities for communication with a viewing user.

A video distribution system that solves the above problems is a video distribution system that distributes a video including an animation of a character object generated based on a motion of an actor to a client device used by a viewing user, and one or more computer processors. And a storage device for storing an object associated with the viewing user, and a display device visible from the actor, wherein the one or more computer processors execute computer-readable instructions. A display request for the object is received from the viewing user, and the display device displays object information in which information on the object for which the display request is received and identification information of the viewing user who has made the display request for the object are associated with each other. From the viewing user associated with any of the plurality of groups, the posting message transmitted to the video being distributed is accepted, and the viewing user who belongs to a predetermined group of the plurality of groups is displayed on the display device. A message display area for displaying the transmitted posted message and a message display area for displaying a message from the viewing user who is not included in the predetermined group are displayed.

In the moving image distribution method for solving the above-mentioned problem, one or a plurality of computer processors execute a computer-readable instruction, and a viewing user uses a moving image including an animation of a character object generated based on the movement of an actor. A method of delivering a video to a client device, the method including: storing an object associated with the viewing user in a storage; receiving a display request for the object from the viewing user; and a position visible from the actor. A step of displaying the object information in which the information of the object that has received the display request and the identification information of the viewing user who has made the display request of the object are associated with each other on the display device arranged in A step of accepting a posting message transmitted from the viewing user associated with the above to the moving image being delivered, and a posting message transmitted to the display device by the viewing user belonging to a predetermined group of the plurality of groups. And a message display area capable of displaying a message from a viewing user who is not included in the predetermined group.

A video distribution program that solves the above problem is a video distribution program for distributing a video including an animation of a character object generated based on the movement of an actor to a client device used by a viewing user, and one or more computer processors. A step of storing an object associated with the viewing user in a storage; a step of receiving a display request for the object from the viewing user; and a display request to a display device arranged at a position visible from the actor. Is displayed, and a step of displaying object information in which the identification information of the viewing user who has made a display request for the object is displayed, and the viewing user associated with any one of a plurality of groups A step of accepting a posted message transmitted to the moving image therein, a message display area for displaying a posted message transmitted by a viewing user belonging to a predetermined group of the plurality of groups on the display device, and the predetermined And a message display area capable of displaying a message from a viewing user not included in the group.

According to the present invention, it is possible to provide a mechanism for increasing opportunities for communication with a viewing user.

1 is a schematic diagram of a moving image distribution system according to an embodiment. The schematic diagram which shows typically the equipment of the studio which produces the video delivered by the said video delivery system. The block diagram which shows a part of said video delivery system. The block diagram which shows the client apparatus which comprises the said moving image delivery system. The figure which shows the example of user management data in one Embodiment. The figure which shows the example of the holding|maintenance list in one Embodiment. The figure which shows the example of a candidate list in one Embodiment. The figure which shows the example of the posting message in one Embodiment. The figure showing the example of the animation displayed on the client device in one embodiment. The figure showing the example of the animation displayed on the client device in one embodiment. The figure showing the example of the animation displayed on the client device in one embodiment. The figure showing the example of the animation displayed on the client device in one embodiment. The figure showing the example of the screen displayed on the display which an actor visually recognizes in one embodiment. The figure showing the example of the screen displayed on the display which an actor visually recognizes in one embodiment. The figure showing the example of the screen displayed on the display which an actor visually recognizes in one embodiment. The flowchart which shows the flow of the video delivery process in one embodiment. 6 is a flowchart showing a flow of processing for receiving a decoration object according to an embodiment. 6 is a flowchart showing a flow of processing for displaying a decoration object according to an embodiment. 6 is a flowchart showing the flow of processing for displaying a posted message according to an embodiment.

Hereinafter, a moving image distribution system according to an embodiment of the present invention will be described with reference to the drawings.
As shown in FIG. 1, the moving image distribution system 1 includes a client device 10, a server 20, and a studio unit 30. The client device 10, the server 20, and the studio unit 30 are communicably connected to each other via a network 11. The network 11 includes various networks such as a local area network and the Internet.

In the moving image distribution system 1, the distributor uses the studio unit 30 to create a moving image of content including animation of a character object based on the movement of an actor. The character object is an individual such as a virtual person or an animal. The created moving image is distributed to the client device 10 used by the viewing user via the server 20. The distributor may be an actor, an operator of the studio unit 30, or another person.

An outline of the studio unit 30 will be described with reference to FIG. The studio unit 30 includes a tracking system 31, a controller 40, a main display 41, a sub display 43 (display device), a microphone 44 (see FIG. 3), and a supporter computer 45.

The tracking system 31 acquires information regarding the movement of the actor A. The actor A is, for example, a performing human, an animal, or a moving object. The actor A may be, for example, a robot capable of independent movement. The number of actors in the studio room R may be plural.

The tracking system 31 detects the position of the actor A. Further, the tracking system 31 can detect the facial expression of the actor A, the position of the virtual camera set in the virtual space, and the like. For example, the tracking system 31 includes an external sensor 32, a mounting sensor 33, and a position specifying device 35. These are outside-in systems that detect at least one of the orientation and position of the mounting sensor 33 mounted on the actor A.

The mounting sensor 33 is mounted on the actor A. There are a plurality of mounting sensors 33 mounted on the actor A. For example, the mounting sensor 33 is mounted on the left wrist, the right wrist, the left instep, the right instep, the waist and the crown of the actor A. The mounting sensor 33 may be mounted on the actor A via a mounting tool, or the actor A may wear the clothes on which the mounting sensor 33 is mounted. The mounting sensor 33 can be mounted on various parts of the actor A. For example, the mounting sensor 33 may be mounted on a finger of a hand and detect the movement of the finger. The number of the attachment sensors 33 attached to the actor A may be 5 or less, or 7 or more.

The mounting sensor 33 cooperates with the external sensor 32 to output information for specifying the orientation and position of the mounting sensor 33 to the position specifying device 35. One of the external sensors 32 in the outside-in system is, for example, a multi-axis laser emitter. The external sensor 32 emits pulsed laser light for synchronization. The mounting sensor 33 includes a sensor that detects laser light, and detects its own position and orientation while synchronizing with a synchronization pulse. As the mounting sensor 33, for example, Vive Tracker (registered trademark) and Vive Base Station provided by HTC Corporation (registered trademark) can be used. Further, in addition to or instead of the above configuration, the mounting sensor 33 may have a built-in sensor for autonomously specifying the position. For example, the mounting sensor 33 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. Further, as the mounting sensor 33, both a sensor that cooperates with the external sensor 32 and a sensor that does not cooperate with the external sensor 32 may be used. Further, the mounting sensor 33 may be one that can detect its orientation or position by itself.

The tracking system 31 also includes a viewpoint position sensor 36 and a camera 37. The viewpoint position sensor 36 is configured so that its position can be changed by the user. The viewpoint position sensor 36 has the same configuration as the mounting sensor 33. The viewpoint position sensor 36 outputs information for specifying its own orientation and position to the position specifying device 35 via wireless communication or a communication cable. The viewpoint position sensor 36 is set as the viewpoint of the virtual camera in the virtual space. The viewpoint position sensor 36 may be supported by a stand, a gimbal, or a stabilizer, for example. The gimbal may be configured in a shape that can be gripped by an actor or other person. By supporting the viewpoint position sensor 36 with a gimbal or a stabilizer, it becomes possible to suppress camera shake.

The camera 37 is arranged so that the face of the actor A can be imaged. For example, the camera 37 is attached to the head or neck of the actor A, or is arranged in front of the actor A. The camera 37 continuously images the face of the actor A, acquires the imaged data of the face of the actor A, and transmits the imaged data to the server 20. The camera 37 may be a 3D camera capable of detecting the depth of the face of a person.

The microphone 44 is arranged at a position where the sound produced by the actor A can be collected. For example, the microphone 44 is attached to the head or neck of the actor A, or is arranged in front of the actor A. The microphone 44 transmits a signal corresponding to the voice to the server 20.

The controller 40 is operated by the actor A. The controller 40 outputs a control signal according to the operation of the actor A to the server 20. Further, the controller 40 may incorporate a sensor for autonomously specifying the position. For example, the controller 40 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. The controller 40 may be configured to detect the position in cooperation with the external sensor 32 in addition to or instead of the above configuration.

The main display 41 is configured to display the moving image generated by the server 20. The main display 41 may be one unit or a plurality of units as illustrated. The moving image displayed on the main display 41 includes the animation of the character object.

The sub-display 43 is configured to display the information received from the server 20 or the supporter computer 45. The sub display 43 may be one unit or plural units. The information transmitted from the server 20 or the supporter computer 45 to the main display 41 may include, for example, text information, image information, and various other information. The main display 41 and the sub display 43 are arranged at positions that can be visually recognized by the actor A.

The supporter computer 45 is a computer used by an operator (referred to as “supporter” in this specification) adjacent to the studio room. Since the room in which the supporter computer 45 is installed and the studio room R are separated by the glass window, the supporter using the supporter computer 45 can visually recognize the actor A. In the illustrated embodiment, a supporter B1 and a supporter B2 are present in the room. The supporter computer 45 outputs various information to the sub display 43 according to the operation of the supporter. In this specification, when it is not necessary to distinguish the supporter B1 and the supporter B2 from each other, the supporter B1 and the supporter B2 may be collectively referred to as a “supporter”. The components and functions of the studio unit 30 shown in FIG. 2 are exemplary. The studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector. The projector can project a moving image delivered to the client device 10 or another client device on a screen.

The server 20 will be described with reference to FIG. The server 20 is configured to deliver a moving image including a character object animation based on the action of the actor to the viewing user. The motion of the character object included in this moving image may be controlled in the virtual space. The server 20 includes a computer processor 21, a communication I/F 22, and a storage 23 (storage medium).

The computer processor 21 is an arithmetic unit that loads an operating system and various programs that realize various functions from a storage 23 or another storage into a memory and executes an instruction included in the loaded program. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 21 may realize at least a part of the processing executed by itself by a circuit such as an ASIC, PLD, FPGA, MCU, or the like. Although the computer processor 21 is shown as a single component in FIG. 3, the computer processor 21 may be a collection of a plurality of physically separate computer processors. In the present specification, the program described as being executed by the computer processor 21 or the instructions included in the program may be executed by a single computer processor, or may be executed by a plurality of computer processors in a distributed manner. Good. Further, the program executed by the computer processor 21 or the instruction included in the program may be executed by a plurality of virtual computer processors.

The computer processor 21 executes a computer-readable instruction included in a distribution program stored in the storage 23 or another storage, thereby the motion data processing unit 21A, the moving image generation unit 21B, the moving image distribution unit 21C, and the user request. It functions as the processing unit 21D, the user information management unit 21E, and the purchase processing unit 21F. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the moving image distribution system 1. At least a part of the functions implemented by the computer processor 21 may be implemented by a computer processor included in the computer included in the studio unit 30, for example.

The motion data processing unit 21A generates body motion data based on the tracking information detected by each of the mounting sensors 33 mounted on the actor. The body motion data is a time-sequential digital representation of at least one of the position and orientation of each part of the body of the actor. Body motion data is generated as needed over time. For example, the body motion data may be generated at predetermined sampling intervals.

The motion data processing unit 21A also generates face motion data, which is a time-series digital representation of the motion of the face of the actor, based on the captured data of the camera 37 included in the studio unit 30. Face motion data is generated as needed over time. For example, the face motion data may be generated at predetermined sampling intervals.

The moving image generation unit 21B applies the body motion data and the face motion data generated by the motion data processing unit 21A to predetermined model data included in the model data 23A stored in the storage 23. Accordingly, the moving image generation unit 21B is configured to generate the animation of the character object that moves in the virtual space and whose expression changes.

Furthermore, the moving image generation unit 21B constructs a virtual space using the object data 23B stored in the storage 23, and generates a moving image including an image of this virtual space and the animation of the character object corresponding to the actor A. The moving image generation unit 21B can set the position of the viewpoint position sensor 36 as the position of the virtual camera that is the viewpoint of the moving image. Then, the relative position of the actor A with respect to the position of the virtual camera is set as the position of the character object in the virtual space. Therefore, the actor A changes the position or orientation of the viewpoint position sensor 36 to an arbitrary position or orientation, so that the character object is rich in variations such as a moving image viewed from the left side, a moving image viewed from the right side, and a moving image viewed from above. You can generate videos. Further, the moving image generation unit 21B may change the setting information (focus, angle of view, etc.) of the virtual camera based on the position of the virtual camera.

Moreover, when the viewing user is associated with the drawing data of his or her avatar, the moving image generating unit 21B may display the animation of the viewing user's avatar in addition to the animation of the character object. The avatar may be displayed so as to move in the moving image based on an instruction from the viewing user to the client device 10.

The moving image distribution unit 21C transmits the list of distributed moving images to the client device 10 and also distributes the moving images generated by the moving image generation unit 21B. The moving image delivery unit 21C may deliver a moving image shot in the studio room R in real time, or may deliver a prerecorded moving image according to a delivery schedule or the like. The moving image distribution unit 21C may be configured to be able to distribute a plurality of moving images in the same time zone. For example, the video distribution unit 21C distributes the distribution video of the "character X" played by the actor A1 and the distribution video of the "character Y" played by the actor A2 at the same distribution start time (for example, "20:00") or distribution. It may be delivered with overlapping time zones. The moving image distribution unit 21C transmits a list of distributable moving images to the client device 10 in response to a list display request from the client device 10. Upon receiving the moving image distribution request from the client device 10, the moving image distribution unit 21C transmits the selected moving image to the client device 10 based on the moving image distribution request.

The user request processing unit 21D receives a display request for an object and a display request for a posted message from the client device 10 of the viewing user, and performs processing according to the display request. The viewing user can send a display request for an object to the server 20 by operating his/her own client device 10. The objects include gift objects that viewers provide to the content. The gift object is an object that is a digital gift from a viewing user to an actor or the like. The gift object may be one that can make a display request without paying a consideration, may be one that requires a consideration, and pays a consideration when the display is made according to the display request. It may be. The gift object may be one that is continuously displayed in the virtual space or one that temporarily adds an effect to the virtual space. The gift object display request may include the user ID of the viewing user and the identification information (object ID) of the object that is the target of the display request.

Upon receiving the gift object display request from the viewing user, the user request processing unit 21D determines whether or not the gift object requires determination as to whether or not an actor or a supporter can be displayed. When the user request processing unit 21D determines that the object for which the display request is made does not require the judgment of the actor or the supporter, the user request processing unit 21D displays the object for which the display request is made in the virtual space via the moving image generation unit 21B. Let

On the other hand, when the user request processing unit 21D determines that the object for which the display request is made requires the judgment of the actor or the supporter, the user request processing unit 21D displays the gift object for which the display request is made on the sub-display 43. When the actor or supporter issues a display instruction to the gift object for which the display request has been made, the object for which the display request has been made is displayed.

In addition, the user request processing unit 21D performs processing for displaying the posted message received from the client device 10 in a moving image. The posted message includes the identification information (user ID or terminal ID) of the viewing user and the posted date and time in addition to the content of the message.

Upon receiving the posting message, the user request processing unit 21D determines whether or not the posting message can be displayed. When determining that the received posted message can be displayed, the user request processing unit 21D causes the moving image generation unit 21B to display the posted message in a predetermined area of the moving image. The user request processing unit 21D also displays the posted message and the attribute information of the posted message on the sub-display 43.

The user information management unit 21E acquires the viewing status of the viewing user and stores the viewing status in the storage 23 in association with the viewing user. The user information management unit 21E stores, as a history, the video that the viewing user is viewing in the viewing application, that is, the "room" of the actor that the viewing user "enters" the room, in association with the user ID of the viewing user. In addition, the user information management unit 21E groups the viewing users according to the viewing status of the viewing users and the like.

The purchase processing unit 21F receives a display request for a purchase medium such as a gift object related to a distribution video from the client device 10 by the operation of the viewing user. After accepting the purchase medium display request, the purchase processing unit 21F transmits the purchase medium information to the client device 10. The information about the purchase medium may include the type of purchase medium, the image of the purchase medium, the price, and various types of information necessary for purchase. The viewing user confirms the information of the purchase medium displayed on the client device 10 and selects an arbitrary purchase medium. When the purchase medium is selected by the viewing user, the client device 10 transmits a purchase medium purchase request to the server 20. The purchase processing unit 21F performs settlement processing based on the purchase request. When this settlement process is completed, the purchased purchase medium is stored in the server 20 as owned by the viewing user. In addition to the gift object, the purchase medium may be an object other than a gift object related to watching a moving image, a viewing condition such as a moving image quality, a two-dimensional image, or a three-dimensional image. The purchase medium may be the moving image itself. Sales of purchasable gift objects and other media are distributed to distributors. At this time, a part of the sales may be distributed to the operator of the studio unit 30.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver, or a combination thereof. The server 20 can send and receive data to and from other devices via the communication I/F 22.

The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various storage devices other than the above capable of storing data. Various programs may be stored in the storage 23. At least a part of the programs and various data that can be stored in the storage 23 may be stored in a storage physically separate from the server 20.

Next, the position specifying device 35 and the supporter computer 45 of the studio unit 30 will be further described. The position specifying device 35 of the studio unit 30 includes a computer processor 35A, a storage 35B (storage medium), and a communication interface (I/F) 35C. The computer processor 35A is, like the computer processor 21 of the server 20, various arithmetic devices such as a CPU. The storage 35B is, like the storage 23 of the server 20, various storage devices such as a magnetic disk. The communication interface (I/F) 35C is, like the communication interface 22 of the server 20, various drivers, software, or a combination thereof for performing communication with other devices. The computer processor 35A acquires tracking information from the external sensor 32 or the mounting sensor 33 by executing the position detection program stored in the storage 35B or another storage, and specifies the position of each mounting sensor 33. Further, the computer processor 35A acquires tracking information from the external sensor 32 or the viewpoint position sensor 36 by executing the position detection program stored in the storage 35B or another storage, and specifies the position of the viewpoint position sensor 36. To do. In addition, the position identifying device 35 transmits the identified position to the server 20.

The supporter computer 45 includes a computer processor 46, a communication I/F 47, a storage 48 (storage medium), a display 49, and an input interface 50.

The computer processor 46 is, like the computer processor 21 of the server 20, various computing devices such as a CPU. The communication I/F 47 is, like the communication I/F 22, various drivers for communicating with other devices, software, or a combination thereof. The storage 48 is, like the storage 23, various storage devices capable of storing data such as a magnetic disk. Various programs are stored in the storage 48. The display 49 is a liquid crystal display, an organic EL display, an inorganic EL display, or any display device capable of displaying an image other than these. The input interface 50 includes an arbitrary pointing device that receives an input from a supporter such as a mouse and a keyboard.

The computer processor 46 functions as a display control unit 46A and a progress management unit 46B by executing computer-readable instructions included in a program stored in the storage 48 or the like. At least a part of the functions implemented by the computer processor 46 may be implemented by a computer processor other than the computer processor 46 of the moving image distribution system 1. Further, at least a part of the functions implemented by the computer processor 46 in the present specification may be implemented by the computer processor 21 of the server 20, for example.

The display control unit 46A displays, on the main display 41 or the sub-display 43, a screen that can be viewed by the actor but cannot be viewed by the viewing user in response to various operation inputs from the supporter via the input interface 50. Alternatively, it is configured to add various additional information to the distribution moving image distributed to the viewing user.

The supporter computer 45 may be configured to be able to change the setting of the components of the studio unit 30 according to the operation of the supporter. The supporter computer 45 can, for example, set the scanning interval by the external sensor 32, set the position or orientation of the mounting sensor 33, and change various settings of various devices other than these. The supporter can input a message to the supporter computer 45 and display the input message on the main display 41.

Next, the client device will be described with reference to FIG.
The client device 10 is an information processing device such as a smartphone. The client device 10 is a smart phone, a mobile phone, a tablet terminal, a personal computer, an electronic book reader, a wearable computer including a head mounted display, a game console, and various information processing devices other than these that can reproduce moving images. Good.

The client device 10 includes a computer processor 12, a storage 13 (storage medium), an input interface (I/F) 14, a communication interface (I/F) 15, and a display 16. The computer processor 12 is, like the computer processor 21 of the server 20, various arithmetic devices such as a CPU. The storage 13 is, like the storage 23 of the server 20, various storage devices such as a magnetic disk. The storage 13 stores an application program for viewing the moving image distributed from the server 20. The input I/F 14 is an arbitrary input interface such as a touch panel that receives an input from a viewing user. The communication I/F 15 is, like the communication I/F 22, various drivers for communicating with other devices, software, or a combination thereof. The display 16 is, for example, an organic EL display integrated with a touch panel, a liquid crystal display, or any other display device capable of displaying an image other than these.

The client device 10 activates the viewing application program installed in the client device 10 by receiving the operation of the viewing user via the input I/F 14. The viewing application only needs to be at least viewable, and may have other functions. The computer processor 12 executes a readable instruction included in the viewing application program to acquire the list of distributed moving images from the server 20. The client device 10 displays the transmitted list on the display. The viewing user selects one from the videos displayed in the list. Upon accepting the selection operation of the viewing user, the client device 10 transmits to the server 20 a moving image distribution request requesting distribution of the selected moving image. Alternatively, the client device 10 activates the web browser stored in the storage 13 by accessing the server 20, and displays the web page described in a markup language such as HTML or XML on the display 16. It may be configured. A list of videos is displayed on the web page. Alternatively, the client device 10 may display the moving image list using both the viewing program and the web browser (in-app browser) stored in the storage 13 of the client device 10.

Upon receiving the moving image data from the server 20, the client device 10 displays the moving image on the display 16 based on the received data. The viewing user can input a message regarding the distributed moving image via the input I/F 14 of the client device 10 and post this message to the server 20. The message posted by each viewing user may be displayed superimposed on the moving image. Thereby, interaction between the actor and the viewing user and interaction between the viewing user can be achieved.

Next, various data stored in the storage 23 of the server 20 will be described. The storage 23 stores model data 23A, object data 23B, user management data 23C, holding list 23D, candidate list 23E, and posted message 23F. In addition, the storage 23 may store a moving image that is being distributed by the moving image distribution system 1 or a moving image that has already been distributed.

The model data 23A is model data for generating a character animation. The model data 23A may be three-dimensional model data for generating a three-dimensional animation, or may be two-dimensional model data for generating a two-dimensional model data. The model data 23A includes, for example, rig data (also referred to as “skeleton data”) indicating the skeleton of the character, and surface data indicating the shape and texture of the surface of the character. The model data 23A may include a plurality of different model data. The plurality of model data may have different rig data, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data. In the illustrated embodiment, the model data 23A has at least two types of model data different from each other in order to generate a character object corresponding to an actor.

The object data 23B includes asset data for constructing a virtual space forming a moving image. The object data 23B is data for drawing the background of the virtual space forming the moving image, data for drawing various objects displayed in the moving image, and for drawing various objects displayed in the moving image other than these. Contains data. The object data 23B may include object position information indicating the position of the object in the virtual space.

In addition to the above, the object data 23B may include a gift object displayed in a moving image based on a display request from the viewing user of the client device 10. The gift object may include an effect object, a decoration object, and a normal object. The gift objects may include those that require a consideration for the viewing user to hold and those that do not require a consideration. An upper limit may be set on the number of objects that can be purchased or the purchase price of the objects.

The effect object is an object that affects the impression of the entire viewing screen of the distribution video, and is, for example, an object imitating confetti or an object imitating fireworks. The object imitating confetti may be displayed on the entire viewing screen, which can change the impression of the entire viewing screen before and after the display. For example, the effect object may be represented by a particle system that represents an event composed of moving particles. In the particle system, the display time may be set for each particle. The effect object may be a static object or a dynamic object. The effect object may be displayed so as to overlap the character object, but is different from the decoration object in that the effect object is not displayed in association with a specific part of the character object.

The decoration object is an object displayed on the display screen in association with a specific part of the character object. The decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. The decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object.

The decoration objects are, for example, accessories (headbands, necklaces, earrings, etc.) attached to character objects, clothes (T-shirts, etc.), costumes, and objects that can be attached to other character objects. The object data 23B corresponding to the decoration object may include mounting position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decoration object can indicate which part of the character object the decoration object is mounted. For example, when the decoration object is a headband, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “head” of the character object. When the decoration object is a T-shirt, the mounting position information of the decoration object may indicate that the decoration object is mounted on the “body” of the character object.

The decoration object is attached to the character object by being selected by an actor or a supporter after being added to the list stored in the storage 23 or another storage by the server 20. The viewing user feels a sense of familiarity with the character object by mounting the decorative gift object transmitted by himself/herself on the character object. On the other hand, even if the viewing user makes a display request for the decoration object, the decoration object is not attached to the character object unless it is selected as an actor or a supporter. When the actor selects a decoration object, the actor confirms the list displayed on the sub-display 43 and uses the pointing device such as the controller 40 or selects the decoration object by an instruction to the supporter. Further, the supporter confirms the list displayed on the supporter computer 45 and selects the decoration object using the input interface 50.

The normal object is a gift object other than the decoration object arranged as an object in the virtual space, and is an object imitating a stuffed animal or a bouquet, for example. The normal object may be displayed so as to overlap the character object, but is different from the decoration object in that it is not displayed in association with a specific part of the character object. Normal objects may differ in that normal objects can change their position by an actor, whereas effect objects cannot change their position by an actor. Also, the display time may differ between the normal object and the effect object.

A display time may be set for each gift object according to its type. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object or the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

As shown in FIG. 5, the user management data 23C stores, for each content of the character object, information about a viewing user who has watched the moving image. Basically, the content is distributed multiple times. For example, the “distributor A” distributes the “contents P” whose main character is the “character P” multiple times. Further, another "distributor B" distributes the "contents Q" whose main character is the "character Q" over a plurality of times. The content is not necessarily different for each character object. For example, moving images of the same character object may have different contents if they are not related to each other. The user management data 23C stores the activity of the viewing user after the first distribution of the content is started. The activity is a viewing user's activity on the content, and may include at least one of a content viewing history, a message posting status to the content, a gift object providing status to the content, a billing status to the content, and the like. When the “viewing user C” has watched both “contents P” and “contents Q”, the activity of the “viewing user C” in the “contents P” and the activity in the “contents Q”. The activities of “viewing user C” are stored respectively.

The user management data 23C may include the identification information (user ID) of the viewing user, the group to which the viewing user belongs, the entry state of the viewing user, the ranking of the viewing user, and the billing status of the viewing user for each viewing user of the content.

The group corresponding to the content indicates the group to which the viewing user belongs in the content. There may be a plurality of groups for dividing the viewing users. The viewing users are divided into each group based on the condition regarding the activity of the content that has been viewed. The conditions for dividing the group may be set in advance by the distributor or the operator of the studio unit 30. For example, based on the conditions regarding the activity of the content, the viewing users are divided into a group of the viewing users who are enthusiastic fans of the content and a group of the viewing users who have little relation to the content, such as the first viewing user. be able to.

The condition for dividing the group may include at least one of the number of times the content is viewed, the number of posted messages posted to the content, the number of times a gift object is transmitted to the content, and the amount charged for the content. For example, when the condition for dividing the group is the number of views, the number of viewing times of the “content P” is included in the first group (eg, “VIP group”), and the number of views is predetermined. Viewing users less than the number of times are included in the second group. Further, when the condition for dividing the group is the number of times the message is posted, the viewing users who have posted the message a predetermined number of times (for example, 20 times) or more are included in the first group, and the users who have posted the message less than the predetermined number of times are included in the first group. Include in second group. When the condition for dividing the group is the number of times the gift object is provided, the viewing users who have provided the gift object a certain number of times (for example, 5 times) or more are included in the first group, and the number of times the gift object is provided is less than the predetermined number of times. The user is included in the second group. When the condition for dividing the group is the charge amount, the viewing users whose charge amount is equal to or more than the predetermined amount are included in the first group, and the view users whose charge amount is less than the predetermined amount are included in the second group. Further, grouping may be performed by combining a plurality of content viewing times, content posting message posting times, content gift object sending times, content billing amounts, and other conditions.

The conditions for grouping may be other than the above conditions. For example, the usage status of the application for viewing (the usage frequency, the number of years of use, the most recent usage date and time) and the attributes of the user (age, sex, occupation, place of residence, language used, etc.) may be used. Further, these conditions may be combined to perform grouping.

The entry state associated with the content is data indicating whether or not the content is being viewed while logged in to the video distribution system 1. When the content is distributed to the client device 10 of the viewing user, the data indicating that the entry state is “entry” is stored. If the content is not distributed to the client device 10, data indicating “leave” is stored in the entry state. It should be noted that, after the content is distributed to the client device 10, the viewing of the moving image is interrupted, and when a predetermined time has elapsed from the interruption, the data indicating “leave” may be stored. On the other hand, in the moving image being distributed, if the content is not viewed from the beginning of the distribution time, data other than “leaved” such as “unviewed” may be stored.

The ranking associated with the content is data indicating the ranking of the viewing user in the content. The operator of the studio unit 30 or the distributor can determine the method of assigning the ranking. For example, the ranking may be determined according to the number of times the content is viewed, the number of posted messages posted to the content, the number of times a gift object is transmitted to the content, the amount charged for the content, and the like. In the ranking, all the viewing users of the content may be the population, or at least one (for example, the first group) of the plurality of groups may be the population.

The ranking associated with the content is data indicating the charging status of the viewing user for the content. The charge status is data such as “charged” and “no charge”. Alternatively, the billing status may be a billing amount.

As shown in FIG. 6, the possession list 23D is a list of objects possessed by the viewing user. The possession list 23D may include identification information (object ID) of the possessed object in association with the user ID. The object owned by the viewing user may be different for each content, and the object owned by the viewing user may be common to different contents, or may include both of them. When the object is different for each content, the holding list 23D of the viewing user stores the identification information of the object for each content. The holding list 23D is continuously stored over a plurality of moving image distributions. Alternatively, the possession list 23D may be newly generated or reset each time one content is distributed.

As shown in FIG. 7, the candidate list 23E is a list of gift objects associated with the moving image. The candidate list 23E is preferably generated or reset each time the moving image is delivered. When the viewing user sends a request to display the gift object in the video, the information about the gift object is added to the candidate list 23E. The candidate list 23E includes identification information (user ID) of the viewing user who is the sender of the gift object, identification information (object ID) of the gift object, type of gift object (decoration object, effect object, normal object), and transmission of the gift object. It may include the date and time and the selection status of the gift object. The selection state of the gift object indicates whether or not the decoration object is selected by the actor or the supporter when the gift object is the decoration object. In the selected state, data indicating “selected” is stored when the decoration object is selected, and data indicating “unselected” is stored when the decoration object is not selected. If the gift object is not a decoration object, "unselected" or data other than "unselected" and "selected" is stored.

As shown in FIG. 8, the posted message 23F may include information about the message posted by the viewing user in the video. Post message 23F may include, for each content, identification information (user ID) of the viewing user, a group to which the viewing user belongs, the content of the posting message, and the posting date and time when the message is posted. Since the group to which the viewing user belongs is stored in the user management data 23C, this may be omitted. Post message 23F is newly generated or reset each time one-time content is distributed.

Next, a screen that the viewing user, the actor, and the supporter confirm will be described together with the flow of content distribution. When the viewing application program is activated by the operation of the viewing user, the client device 10 requests the server 20 for a content list. The server 20 transmits information for displaying the list of contents to the client device 10.

As shown in FIG. 9, a content list screen 100 is displayed on the display 16 of the client device 10. On the content list screen 100, a list of contents that are being distributed or will be distributed is displayed. In the list, in addition to the image 101 of the content, the delivery date and time of the content, the content name, the name of the character who appears in the content, etc. are displayed.

The viewing user selects one content from the list. The client device 10 transmits a distribution request for the selected content to the server 20.
When the server 20 receives the content distribution request from the client device 10, the server 20 distributes the target content of the distribution request to the client device 10. When the client device 10 receives the content, the client device 10 displays the moving image.

As shown in FIG. 10, a moving image viewing screen 105 is displayed on the display 16 of the client device 10. On the moving image viewing screen 105, a virtual space having the viewpoint position sensor 36 as a camera viewpoint and a character object 110 in which the motion of the actor is reflected are displayed. Further, a gift selection unit 112 and a post selection unit 113 are displayed on the moving image viewing screen 105.

When the gift selecting unit 112 of the video viewing screen 105 is selected by the viewing user, the client device 10 acquires the possession list 23D from the server 20. Alternatively, the client device 10 acquires the holding list 23D that is acquired from the server 20 and stored in the storage 13 in advance. Furthermore, the client device 10 displays the gift objects held by the viewing user as a list based on the holding list 23D.

When the viewing user selects a normal object from the list of gift objects, the client device 10 transmits a normal object display request to the server 20. The display request includes normal object identification information (object ID) and user identification information (user ID). Note that the gift object display request requires the transmission of the user identification information, so that the user is logged in to the video distribution system 1 or another user authentication system that cooperates with the video distribution system 1 before sending the display request. There is a need.

In response to the display request for the normal object, the server 20 displays the normal object 111 in the moving image distributed to the viewing user who made the display request and the other viewing users. In the illustrated embodiment, a plurality of types of normal objects 111A to 111C are displayed. The normal object 111A is a stuffed bear object and is placed at a predetermined position in the virtual space. The normal object 111A may be movable in the virtual space by contact with the character object 110, for example, when the character object 110 grips. The normal object 111B is a hanging object and is displayed at a predetermined position in the virtual space. The normal object 111C is an object that can move in the virtual space. This normal object 111C may remain displayed at the position where it finally reached after moving in the virtual space, or it may disappear from the screen.

As shown in FIG. 11, similar to the normal object display request, when the viewing user requests the effect object display, the effect object is displayed on the moving image viewing screen 105. In the illustrated embodiment, the effect object 115 corresponding to confetti is displayed.

As shown in FIG. 12, similar to the normal object display request, when the viewing user makes a display request for the decoration object, the decoration object 120 is displayed on the moving image viewing screen 105. The decoration object 120 is displayed on the moving image viewing screen 105 in association with a specific part of the character object. The decoration object 120 may be displayed so as to be in contact with a specific part of the character object. For example, the decorative object 120 simulating a cat's ear is attached to the center of the head of the character object 110 because it is associated with the center of the head of the character object. When the character object 110 moves, the decoration object 120 also moves in association with the head as if it were attached to the character object 110 while being associated with the character object 110.

When the video has a period in which a posting message can be posted, when any of the viewing users who are viewing the video posts the posting selection unit 113, a screen different from the video viewing screen 105 or a video viewing A message input screen is displayed in the screen 105. When a message is input on the input screen, the information of the posted message is transmitted to the server 20.

When the server 20 receives the posting message within the postable period, the server 20 transmits the moving image data including the posting message to the client device 10. The client device 10 displays the post message 130 in the moving image viewing screen 105. Post message 130 is displayed in a predetermined message display area 131. Post messages 130 are arranged in the order of posted dates. For example, the latest posted message 130 is displayed at the top of the message display area 131. Next, when the server 20 receives a new posted message, the posted message 130 displayed at the top is moved downward and the new posted message is displayed at the top. The posted message reaching the bottom of the message display area 131 moves further downward and is not displayed when a new posted message is added to the top. Alternatively, the message display area 131 may be capable of displaying only one posted message.

Next, a screen confirmed by the actor in the studio room R will be described.
FIG. 13 shows an example of the notification screen 200 displayed on the sub-display 43 installed in the studio room R. A notification 201 to the actor may be displayed on the notification screen 200. The data for displaying the notification screen 200 may be automatically generated by the supporter computer 45, or may be input by the supporter. In the illustrated embodiment, the notification 201 displays the remaining time, the schedule, information to notify the actor, and the like. The actor performs the performance while checking the notification screen 200. Note that the notification 201 may be displayed on the screen of the main display 41 so as to be superimposed on or side by side with the animation of the character object.

FIG. 14 shows an example of the gift list screen 210 displayed on the sub display 43. On the gift list screen 210, a list (object information) in which gift objects requested to be displayed by the viewing user are displayed in association with the viewing user is displayed. On the gift list screen 210, a list of all gifts 211, a list of gifts being worn 212 (first list), and a list of gifts not yet worn 213 (second list) are displayed.

The list of all gifts 211 includes an image of a gift object requested to be displayed by the viewing user during video distribution, the name of the gift object, and identification information of the viewing user who requested the display of the gift object (user account name). Or user ID) and wearing state. It is preferable that the whole gift list 211 includes other kinds of gift objects in addition to the decoration objects. The avatar of the viewing user may be displayed as the identification information of the viewing user. In the illustrated embodiment, the gift list 211 displays all types of gift objects including normal objects, effect objects, and decoration objects.

The “wearing state” of the all-gift list 211 indicates whether or not the character object is wearing the decorative object when the gift object displayed in the all-gift list 211 is a decorative object. If the character object is wearing a decorative object, "installing" is displayed. When the mounting of the character object is completed, "already mounted" is displayed. In the content being distributed, "attached" is displayed for the decoration object to which the character object has already been attached. In this gift list 211, the actor and the supporter can confirm the gift object requested to be displayed by the viewer from the time when the distribution of the moving image is started. In addition, since the identification information of the user is displayed in association with the gift object in the list of all gifts 211, the actor sends a message (for example, ““ Thank you, Mr. A”). As a result, the actor can increase communication with the viewing user, so that the satisfaction of the viewing user can be improved.

A display time can be set for the decorative object. The decoration object for which the display time has elapsed has a display state different from that of the decoration object for which the display time has not elapsed, in addition to the selection state of “installed” in the list 211 of all gifts. Further, the decoration object for which the display time has elapsed is hidden on the moving image.

In addition, in the video being delivered, when different viewers make a display request for the same decoration object and only one decoration object is attached by the character object, the decoration object is set as “attached” and the other The decoration object may be “not attached”. Alternatively, both decorative objects may be “already attached”.

The gift-on-wear list 212 displays decorative gift objects selected by an actor or a supporter and worn by the character object. Items in the in-wear gift list 212 are the same as those in the all-gift list. In the currently-installed gift list 212, among the decorative objects that are currently being installed, the one with the latest display request date and time, that is, the newest one is displayed at the top and the display request with the latest date and time is displayed. They are displayed in order from top to bottom. The actor and the supporter can recognize the decoration object worn by the character object by checking the wearing gift list 212. Therefore, the actor can convey a message such as an impression of the decoration object attached to the character object (for example, “this cat is my favorite,” etc.) to the viewing user by the sound of the moving image. This allows the actor to increase communication with the viewing user through the decoration object, so that not only the satisfaction of the viewing user who provided the decoration object is improved, but also the viewing users other than the viewing user can decorate the decoration object. The motivation to provide the object can be increased.

The decoration object for which the display time has elapsed is deleted from the in-wear gift list 212, or has a display mode different from that of the decoration object for which the display time has not elapsed, such as grayout.

The unattached gift list 213 displays decoration gift objects that have not been selected by the actor or supporter after the viewing user makes a display request. Items in the unattached gift list 213 are the same as those in the all gift list. In the unattached gift list 213, the earliest date and time when the display request is made, that is, the longest unattached time after the display request is displayed at the top, and the display request is made. They are displayed in order from top to bottom, in order of earliest date and time. In this way, the unattached decorative gift objects are displayed in a list, so that the actor or the supporter can grasp the decorative objects provided by the viewing user and not selected. In this way, the actor can easily confirm the decoration objects that have not been selected, and thus it is possible to efficiently select as many decoration objects as possible. Further, since the display request having the earliest date and time is displayed on the upper part, omission of selection can be suppressed.

Of the decorative gift objects, the object whose display time is limited is deleted from the moving image viewing screen 105 when the display time elapses after the attachment start to the character object. The erased decorative object is erased from the in-wear gift list 212. In this way, in the gift list 211, the selected state of the decoration object deleted from the moving image viewing screen 105 is updated to “installed”. The display time of the gift object may be displayed in the list 211 of all gifts, the list 212 of attached gifts, and the list 213 of unattached gifts.

Further, when any of the decorative gifts included in the unattached gift list 213 is selected by the actor or the supporter, the information regarding the selected decorative object is deleted from the unattached gift list 213 by the server 20 and the in-attached gift is displayed. It is newly added to the list 212. In addition, the selected decoration gift object is updated in the selection state of the entire gift list 211 from “unselected” to “mounted”.

In this way, the gift list screen 210 displays the in-wear gift list 212 and the unwear gift list 213 separately, so that even if a large number of decorative objects are provided by the viewing user, the actor or supporter can The decoration object being selected and the decoration object not selected can be grasped and the decoration object can be efficiently selected. Then, within the limited delivery time, by selecting as many decoration objects as possible and attaching them to the character object, it is possible to increase the chances of communication with the viewing user. As a result, it is possible to improve the satisfaction of the viewing user for the distributed video.

FIG. 15 is a message display screen 220 displayed on the sub display 43. The message display screen 220 may be displayed on the same sub-display 43 as the gift list screen 210, or may be displayed on a different sub-display 43 when there are a plurality of sub-displays 43. On the message display screen 220, a first message display area 221, a second message display area 222, and a room entry log 223 are displayed.

In the first message display area 221, the computer processor 21 of the server 20 reads posted messages 23F corresponding to the content being distributed from the storage 23 and lists them in order of posting date and time. The latest posted message, that is, the latest posted message may be displayed at the top of the list. When a new posted message is posted, the posted message is added to the uppermost part of the first message display area 221, and the posted message already displayed in the first message display area 221 is moved downward. The posting message may be moved in the opposite direction. The list may include identification information of the viewing user (such as the account name of the viewing user), posting time, and message content for each posted message. The avatar of the viewing user may be displayed as the identification information of the viewing user.

In the second message display area 222, the computer processor 21 of the server 20 extracts only the posted messages of the viewing users who belong to the first group (VIP group) from the posted messages 23F stored in the storage 23 and lists them. It is a thing. In the illustrated embodiment, the posted message displayed in the second message display area 222 may be displayed in the first message display area 221, or may be displayed only in the second message display area 222. The second message display area 222 may include identification information of the viewing user (account name of the viewing user, etc.), posting time, message content, and ranking. The avatar of the viewing user may be displayed as the identification information of the viewing user.

The entry log 223 is a list of viewing users who are viewing the content being distributed. The computer processor 21 of the server 20 refers to the user management data 23C corresponding to the content being distributed, and extracts the viewing user whose entry state is "entry". The entry log 223 may include identification information of the viewing user who is viewing the content, entry time, entry state, and group. The avatar of the viewing user may be displayed as the identification information of the viewing user.

Actors, by referring to the entry log 223, to the viewing user who initiated the viewing, through the voice of the video, it is possible to describe a message such as "N's, Hello". In this way, the actor can communicate with the viewing user who has started viewing, so that the viewing user can be attached to the character and the content can be more satisfied.

Further, the actor can respond to the posted message from the viewing user by confirming the first message display area 221 and the second message display area 222. At this time, by separately displaying the first message display area 221 and the second message display area 222 to which the viewing users of the first group belong, it is possible to easily grasp the tendency of the user who has transmitted the posted message. .. For example, the actor can give priority to the response to the posted message of the viewing user who belongs to the first group. As a result, it is possible to particularly enhance the satisfaction level of the viewing users belonging to the first group with the content. Further, by giving priority to the response to the posted message of the viewing user who belongs to the second group, it is possible to particularly enhance the satisfaction level of the viewing user who belongs to the second group to the content.

Next, with reference to FIG. 16, a moving image distribution process according to the embodiment will be described. In the moving image distribution process, it is assumed that the actor is performing in the studio room R. First, in step S11, the motion data processing unit 21A of the server 20 generates body motion data, which is a digital expression of the movement of the actor's body, and face motion data, which is a digital expression of the movement (expression) of the actor's face. Is generated.

Next, in step S12, the moving image generation unit 21B generates a moving image. In this step, by applying the body motion data and face motion data of the actor to the model data 23A for the actor, the animation of the character object that moves in synchronization with the movement of the body and facial expression of the actor is generated. Furthermore, a moving image using this animation is generated. The voice of the actor is synthesized with this moving image.

Next, in step S13, the moving image distribution unit 21C distributes the moving image generated in step S12. The content is distributed to the client device 10 via the network 11. This content may be distributed to the supporter computer 45 or may be projected on the main display 41 in the studio room R. The content for one time is continuously distributed over a predetermined distribution period. The distribution period of the moving image can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any time other than these.

Next, in step S14, it is determined whether or not an end condition for ending the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the supporter computer 45 has instructed the end of the distribution, or any other condition. If the ending condition is not satisfied, the processes of steps S11 to S13 are repeatedly executed, and the distribution of the moving image including the animation synchronized with the movement of the actor is continued. When it is determined that the ending condition is satisfied for the moving image, the distribution process of the moving image is ended.

Next, with reference to FIG. 17, a gift object reception process will be described. When the user request processing unit 21D of the server 20 receives the gift object display request transmitted from the client device 10, the gift object is accepted (step S20). The display request may include identification information of the viewing user, identification information of the gift object, transmission date and time, and the like.

The user request processing unit 21D adds the received gift object information to the candidate list 23E, and adds the gift object information to the all gift list 211 of the gift list screen 210 (step S21).

Next, the user request processing unit 21D determines whether or not the added gift object is a decoration object (step S22). When the gift object is not the decoration object but the effect object or the normal object (step S22: NO), the gift object reception process ends.

When the gift object is a decoration object (step S22: YES), the gift object is added to the unattached gift list 213 (step S23).
Next, the decoration object selection processing will be described with reference to FIG. When it is determined that the decoration object is selected by the operation of the actor or the supporter (step S30: YES), the user request processing unit 21D deletes the selected decoration object from the unattached gift list 213 and the in-attached gift list 212. Is displayed (step S31). In addition, the moving image generating unit 21B displays the selected decoration object on a predetermined part of the character object associated with the decoration object (step S32).

Further, it is determined whether or not the display period has ended for the decorative object displayed in the moving image (step S33). When the display period of the decoration object has not ended (step S33: NO), the display of the decoration object is continued. On the other hand, when the display time of the decoration object has expired (step S33: YES), the decoration object whose display time has ended is updated in the mounted gift list 212 (step S34). Specifically, the decoration object whose display time has ended is erased from the currently-attached gift list 212, or is grayed out, so that the decoration object has a different display mode from other decoration objects whose display time has not ended.

Next, the display processing of the posted message will be described with reference to FIG. When the identification information of the viewing user and the posted message are received, the user request processing unit 21D determines whether or not the posted message is a posted message from the viewing user belonging to the first group (step S40). ). The viewing information users are divided into groups by the user information management unit 21E at a predetermined timing.

When it is determined that the received posted message is a posted message from the viewing user who belongs to the first group (step S40: YES), the user request processing unit 21D displays the posted message in the first message display area 221 and the first message display area 221. The message is displayed in the 2 message display area 222 (step S41). On the other hand, when it is determined that the received posted message is a posted message from the user belonging to the second group (step S40: YES), the posted message is displayed only in the second message display area 222 (step S40). S42).

As described above, according to this embodiment, the following effects can be obtained.
(1) In the above embodiment, the moving image distribution system receives a display request for an object from a viewing user. Further, the list of objects for which the display request has been received is displayed on the sub-display 43 arranged at a position visible from the actor. By checking the list displayed on the sub-display 43, the actor during performance can quickly grasp the object for which the display request has been made and the viewing user who has made the display request for the object. Further, the actor can quickly send a message to the viewing user who has made the display request at a suitable timing by quickly grasping the object and the viewing user. Therefore, it is possible to increase the chances of communication with the viewing user.

(2) In the above embodiment, an object selected by a user other than the viewing user such as an actor from the gift list screen 210 is displayed in the moving image. Since the object requested to be displayed is displayed on the gift list screen 210, an actor or the like can efficiently select the object. Therefore, the effect of the list can be further exerted.

(3) In the above embodiment, since the selected object and the unselected object are displayed separately in the gift list screen 210, the object can be easily selected from the unselected object list. It can support the performance of the actor, such as can be selected.

(4) In the above embodiment, only the decorative objects are displayed in the in-wear gift list 212 and the unwear gift list 213. That is, since only the objects that need to be selected by a user other than the viewing user are displayed in the first list and the second list, the actor can easily select a desired decorative object.

(5) In the above-described embodiment, the posted messages of the viewing users belonging to the first group are displayed in a different area from the posting messages of the viewing users belonging to other groups, so the actor is the viewing users belonging to the first group. It is possible to prioritize and respond to the posted message of. Therefore, it is possible to increase the chances of communication with a specific viewing user.

Each of the above embodiments can be modified and implemented as follows. The present embodiment and the following modified examples can be implemented in combination with each other within a technically consistent range.
In the above-described embodiment, the gift list screen 210 is displayed on the sub-display 43 as a screen including the in-wear gift list 212 and the unwear gift list 213. Instead of or in addition to this, at least one of the gift list from the viewing users belonging to the first group and the gift list from the viewing users belonging to the second group may be displayed on the sub-display 43. Furthermore, the list of gifts from the viewing users belonging to the first group may be divided into an in-wear gift list and an unwear gift list. Similarly, the list of gifts from the viewing users belonging to the second group may be divided into a list of gifts being worn and a list of gifts not yet worn. According to this, the decorative gift object can be displayed separately from the viewpoint of wearing and non-wearing, and the viewpoint of the group to which the viewing user belongs, so that communication according to the group to which the viewing user belongs can be performed. it can.

In the above embodiment, the gift list screen 210 and the message display screen 220 are different screens. Instead of this, a plurality of the present gift list 212, the present gift list 213, the first message display area 221, the second message display area 222, and the entry log 223 may be displayed side by side on one screen. In addition, the actor or supporter may display any display from the list of all gifts 211, the list of gifts 212 being worn, the list of gifts not yet worn 213, the first message display area 221, the second message display area 222, and the entry log 223. It may be configured to be freely arranged on the screen.

In the above embodiment, the gift list screen 210 and the message display screen 220 may be alternately displayed on one sub-display 43. The screens may be switched when either the gift object display request or the posted message is received. For example, when the gift object display request is received, the gift list screen 210 is displayed for a predetermined time, and when the posting message is received, the message display screen 220 is displayed for a predetermined time.

In the above embodiment, the gift list screen 210 and the message display screen 220 are displayed on the sub display 43. Instead of this, at least one of the gift list screen 210 and the message display screen 220 may be displayed on the main display 41.

In the above-described embodiment, the decoration object is hidden when a predetermined display time elapses after being attached to the character object. Instead of this, the decoration object may be configured to be hidden by the operation of the actor or the supporter.

In the above embodiment, the gift list screen 210 and the message display screen 220 are displayed on the sub display 43. Instead of or in addition to this, it may be displayed on a head mounted display attached to the actor. The head mounted display may be a transmissive type or a non-transmissive type. The head mounted display may display moving images including animation of characters, and the moving images may not be displayed and only at least one of the gift list screen 210 and the message display screen 220 may be displayed.

In the above embodiment, the viewing users are divided into a plurality of groups according to the number of times the content is viewed, the number of posted messages posted to the content, the number of times a gift object is sent to the content, the amount charged for the content, and the like. .. Instead of this, the viewing user belongs to a group (eg, a second group) to which the viewing user who performs inappropriate behavior with respect to the delivered video and a group to which other viewing users belong (eg, the first group). ) And may be separated. The information that identifies the viewing user, such as the real name and address of the viewing user, is not disclosed to the distributor or other viewing users, except for necessary information such as the account name, user ID, or avatar. May take inappropriate actions in activities such as posting messages to videos and requesting to display gift objects. In order to prevent troubles, the distributor needs to quickly know that these viewing users have “entered” (logged in), posted messages, and the like. The condition for dividing the group is that an inappropriate message was transmitted in the past on the moving image, or the number of times reached a threshold value. As a method for determining an inappropriate message, for example, when the server 20 analyzes the content of the message and determines that the phrase included in the message corresponds to the inappropriate phrase, the server 20 determines that the message is inappropriate. There is. In addition, a method for the distributor or the operator to visually check the message posted on the video to determine whether the message is inappropriate, or that it is inappropriate from other viewing users There is a method to judge that it is inappropriate by receiving the report. When the distributor or the operator determines whether or not the message is inappropriate, the distributor or the operator operates the supporter computer 45 or the like to set the viewing user who has transmitted the message to, for example, the “second group”. Belong to. Alternatively, the distributor or the operator operates the supporter computer 45 or the like to update the number of times the viewing user who transmitted the message made an inappropriate statement. The server 20 receives the information from the supporter computer 45 or the like and updates the user management data. These groupings may be managed for each content as in the above embodiment, or may be managed as being common to all platforms that distribute video. Further, in the entry log 223, the group to which the viewing user belongs may be displayed together with the identification information of the viewing user. When a viewing user who belongs to the second group and needs to be monitored “enters”, the identification information of the viewing user is displayed in the entry log 223 (FIG. 15), so the distributor must forcibly leave the viewing user. Is also possible. Alternatively, the server 20 may automatically force the user to leave the room when the viewing user “enters the room”. Alternatively, even if the forced entry is not performed, only the entry of the viewing user is displayed in the entry log 223, and the distributor can take care not to disturb other viewing users.

In one embodiment, a large number of infrared LEDs are mounted on each of the actor and the plurality of attachment sensors 33 attached to the actor, and the light from the infrared LEDs is provided on the floor or wall of the studio room R. The position and orientation of each of the mounting sensors 33 may be detected by detecting with an infrared camera. A visible light LED may be used instead of the infrared LED, and the position and orientation of each of the mounting sensors 33 may be detected by detecting light from the visible light LED with a visible light camera. In this way, each of the plurality of mounting sensors 33 mounted on the actor is provided with a light emitting unit (for example, an infrared LED or a visible light LED), and the light from this light emitting unit is provided as a light receiving unit in the studio room ( For example, the position and orientation of each of the mounting sensors 33 may be detected by detecting with an infrared camera or a visible light camera. In one embodiment, a plurality of markers can be used instead of the mounting sensor 33. A marker is provided on each of the actors. Alternatively, the marker may be provided on the clothing of the actor (for example, the upper garment, the lower garment, or a suit in which these are integrated). At least one of the position and the orientation of the marker can be detected by photographing the actor provided with the marker in this way to generate photographing data and performing image processing on the photographing data. In addition, the attachment sensor 33, a sensor capable of detecting at least one of the position and orientation of an acceleration sensor, a gyro, or the like, a capacitance type sensor, or the like, can transmit/receive a signal to/from the external sensor 32 or the server 20. A sensor is attached to the actor's clothing (for example, upper garment, lower garment, or a suit in which these are integrated), and at least one of the position, orientation, and movement of the sensor is determined based on the signals transmitted from these sensors. You may make it detect a part. Further, the tracking system 31 may be one that can detect the movement of the actor only by the external sensor 32 without using the mounting sensor 33.

The methods described in the embodiments are, for example, magnetic disks (floppy (registered trademark) disks, hard disks, etc.), optical disks (CD-ROM, DVD, MO, etc.), semiconductors as programs that can be executed by a computer. It can be stored in a recording medium such as a memory (ROM, RAM, flash memory, etc.), or transmitted by a communication medium and distributed. It should be noted that the programs stored on the medium side also include setting programs for configuring software means (including not only execution programs but also tables and data structures) to be executed by the computer in the computer. The computer that realizes the present device reads the program recorded in the recording medium, constructs software means by a setting program in some cases, and executes the above-mentioned processing by controlling the operation by this software means. The recording medium referred to in this specification is not limited to distribution, but includes a storage medium such as a magnetic disk or a semiconductor memory provided inside a computer or in a device connected via a network.
Next, the technical ideas that can be understood from the above-described embodiments and other examples will be added below along with their effects.
[1] A video distribution system for distributing a video including an animation of a character object generated based on a motion of an actor to a client device used by a viewing user,
One or more computer processors,
A storage for storing objects associated with the viewing user,
A display device visible from the actor,
Equipped with
The one or more computer processors execute computer-readable instructions to:
Accepts a display request for the object from the viewing user,
On the display device, the object information in which the information of the object that has received the display request and the identification information of the viewing user who has made the display request of the object are associated is displayed.
Video distribution system.
[2] When the object information is selected by a user other than the viewing user who has made a display request for the object and the selection of the object is accepted, the object is displayed in the moving image.
The moving image distribution system according to [1].
[3] The object information includes a first list including object information regarding a selected object and a second list including object information regarding an unselected object.
The moving image distribution system according to [2].
[4] The object includes a decoration object displayed in a moving image when selected by a user other than the viewing user who has made the display request, and an object displayed in the moving image when the display request is accepted. Including,
In the first list and the second list, only the information of the decoration object is displayed.
The moving image distribution system according to [3].
[5] The computer processor is
When the viewing user's action on the video satisfies a predetermined condition, the viewing user is associated with any one of a plurality of groups,
The moving image distribution system according to any one of [1] to [4].
[6] The viewing user is associated with any of a plurality of groups,
The computer processor is
From the viewing user, accept the posted message sent to the video being delivered,
On the display device, a message display area for displaying a posted message transmitted by a viewing user belonging to a predetermined group of the plurality of groups, and a message display capable of displaying a message from a viewing user not included in the predetermined group. Area and display,
The moving image distribution system according to any one of [1] to [4].
[7] One or a plurality of computer processors execute a computer-readable instruction to deliver a moving image including animation of a character object generated based on the movement of an actor to a client device used by a viewing user. Delivery method,
Storing an object associated with the viewing user in a storage;
Receiving a display request for the object from the viewing user,
A step of displaying, on a display device arranged at a position visible from the actor, object information in which information of an object that has received the display request and identification information of a viewing user who has made a display request of the object are associated with each other. When,
Video distribution method having.
[8] A moving picture distribution program for distributing a moving picture containing an animation of a character object generated based on the movement of an actor to a client device used by a viewing user,
One or more computer processors,
Storing an object associated with the viewing user in a storage;
Receiving a display request for the object from the viewing user,
A step of displaying, on a display device arranged at a position visible from the actor, object information in which information of an object that has received the display request and identification information of a viewing user who has made a display request of the object are associated with each other. When,
A video distribution program that executes.

1... Video distribution system, 10... Client device, 20... Server.

Claims (7)

A video distribution system for distributing a video including a character object animation generated based on the movement of an actor to a client device used by a viewing user,
One or more computer processors,
A storage for storing objects associated with the viewing user,
A display device visible from the actor,
Equipped with
The one or more computer processors execute computer-readable instructions to:
Accepts a display request for the object from the viewing user,
The display device displays object information in which the information of the object that has received the display request and the identification information of the viewing user who has made the display request of the object are associated with each other,
From the viewing user associated with any of the plurality of groups, accept the posting message sent to the video being delivered,
On the display device, a message display area for displaying a posted message transmitted by a viewing user belonging to a predetermined group of the plurality of groups, and a message display capable of displaying a message from a viewing user not included in the predetermined group. Area and display,
Video distribution system. When the object information is selected by a user other than the viewing user who has made a display request for the object and the selection of the object is accepted, the object is displayed in the moving image,
The moving image distribution system according to claim 1. The object information includes a first list including object information regarding a selected object and a second list including object information regarding an unselected object.
The moving image distribution system according to claim 2. The object includes a decoration object displayed in a video by being selected by a user other than the viewing user who has made the display request, and an object displayed in the video when the display request is accepted,
In the first list and the second list, only the information of the decoration object is displayed.
The moving image distribution system according to claim 3. The computer processor is
When the viewing user's action on the video satisfies a predetermined condition, the viewing user is associated with any one of a plurality of groups,
The moving image distribution system according to claim 1. A video distribution method in which one or more computer processors execute computer-readable instructions to distribute a video containing an animation of a character object generated based on the movement of an actor to a client device used by a viewing user. There
Storing an object associated with the viewing user in a storage;
Receiving a display request for the object from the viewing user,
A step of displaying, on a display device arranged at a position visible from the actor, object information in which information of an object that has received the display request and identification information of a viewing user who has made a display request of the object are associated with each other. When,
From the viewing user associated with any one of a plurality of groups, a step of accepting a posting message transmitted to the video being distributed,
On the display device, a message display area for displaying a posted message transmitted by a viewing user belonging to a predetermined group of the plurality of groups, and a message display capable of displaying a message from a viewing user not included in the predetermined group And a step of displaying the area. A moving picture distribution program for distributing a moving picture containing an animation of a character object generated based on the movement of an actor to a client device used by a viewing user,
One or more computer processors,
Storing an object associated with the viewing user in a storage;
Receiving a display request for the object from the viewing user,
A step of displaying, on a display device arranged at a position visible from the actor, object information in which information of an object that has received the display request and identification information of a viewing user who has made a display request of the object are associated with each other. When,
From the viewing user associated with any one of a plurality of groups, a step of accepting a posting message transmitted to the video being distributed,
On the display device, a message display area for displaying a posted message transmitted by a viewing user belonging to a predetermined group of the plurality of groups, and a message display capable of displaying a message from a viewing user not included in the predetermined group A video distribution program that executes the process of displaying the area.