JP6526898B1 - Video distribution system, video distribution method, and video distribution program - Google Patents

Abstract

The present invention provides a mechanism for increasing opportunities for communication with a viewing user. The moving image distribution system 1 distributes a moving image including animation of a character object generated based on the movement of an actor to a client device 10 used by a viewing user, and stores an object associated with the viewing user. Information of the object for which the display request has been received and the identification of the viewing user who made the display request of the object on the display device provided with the storage and receiving the display request for the object from the viewing user and arranged at a position visible by the actor Display a list containing information. [Selected figure] Figure 1

Description

  The present invention relates to a video distribution system, a video distribution method, and a video distribution program.

  Conventionally, a moving image distribution system has been known which generates animation of a character object based on the movement of an actor and distributes a moving image including the animation of the character object (see, for example, Patent Document 1).

  In this type of moving image distribution system, it has been proposed to display an arbitrary object in the moving image to be distributed to a plurality of viewing users by the operation of the viewing user. An object to be displayed on a moving image by a viewing user is, for example, a gift object to a character object.

JP, 2015-184689, A

  In the video distribution system, in order to increase the number of viewing users or the number of viewing times, it is important to increase the opportunities for communication between actors and viewing users through the character object, in addition to the uniqueness of the character object itself. However, the actor has to make a voice as needed while making a motion on the character object, and also have to correspond to a gift object. Moreover, it is difficult to increase the number of targets for paying attention when increasing the opportunities for communication with the viewing user.

  The present invention has been made in view of the above-mentioned circumstances, and an object thereof is to provide a mechanism for increasing opportunities for communication with a viewing user.

  A moving image distribution system for solving the above problems is a moving image distribution system for distributing a moving image including animation of a character object generated based on the movement of an actor to a client device used by a viewing user, which is one or more computer processors And a storage for storing an object associated with the viewing user, and a display device visible from the actor, wherein the one or more computer processors execute the computer readable instructions to execute the computer readable instructions. Information of the object for which the display request has been received, and identification information of the viewing user who has made the display request for the object, to the display device arranged to receive the display request for the object from the viewing user and arranged at a position visible to the actor Of To display-object information.

  A moving image distribution method for solving the above-mentioned problems, wherein one or more computer processors use moving images including animation of a character object generated based on the movement of an actor by executing computer readable instructions. Video distribution method for distributing to a client device, the steps of storing an object associated with the viewing user in a storage, receiving a display request for the object from the viewing user, and a position visible by the actor And displaying the object information in which the information of the object for which the display request has been received and the identification information of the viewing user who made the display request for the object are associated with each other on the display device arranged in.

  A moving image distribution program for solving the above-mentioned problems is a moving image distribution program for distributing a moving image including animation of a character object generated based on the movement of an actor to a client device used by a viewing user. And storing the object associated with the viewing user in the storage, receiving the display request for the object from the viewing user, and displaying the display request on a display device arranged at a position visible from the actor. And displaying the object information in which the information of the received object and the identification information of the viewing user who made the display request of the object are associated.

  According to the present invention, it is possible to provide a mechanism for increasing the opportunity for communication with a viewing user.

BRIEF DESCRIPTION OF THE DRAWINGS The schematic of the moving image delivery system which concerns on embodiment. The schematic diagram which shows typically the installation of the studio which produces the moving image delivered by the said moving image delivery system. The block diagram which shows a part of said moving image delivery system. FIG. 2 is a block diagram showing a client device that constitutes the moving image distribution system. The figure which shows the example of the user management data in one Embodiment. The figure which shows the example of the possession list | wrist in one Embodiment. The figure which shows the example of the candidate list | wrist in one Embodiment. The figure which shows the example of the contribution message in one embodiment. The figure which shows the example of the moving image displayed on a client apparatus in one Embodiment. The figure which shows the example of the moving image displayed on a client apparatus in one Embodiment. The figure which shows the example of the moving image displayed on a client apparatus in one Embodiment. The figure which shows the example of the moving image displayed on a client apparatus in one Embodiment. The figure which shows the example of the screen displayed on the display which an actor visually recognizes in one Embodiment. The figure which shows the example of the screen displayed on the display which an actor visually recognizes in one Embodiment. The figure which shows the example of the screen displayed on the display which an actor visually recognizes in one Embodiment. 6 is a flowchart showing a flow of moving image distribution processing in one embodiment. The flowchart which shows the flow of the processing which accepts the decoration object in one execution form. The flowchart which shows the flow of the processing which displays the decoration object in one execution form. The flowchart which shows the flow of the processing which displays the contribution message in one execution form.

Hereinafter, a moving image distribution system according to an embodiment of the present invention will be described with reference to the drawings.
As shown in FIG. 1, the moving image distribution system 1 includes a client device 10, a server 20, and a studio unit 30. The client device 10, the server 20, and the studio unit 30 are communicably connected to each other via the network 11. The network 11 includes various networks such as a local area network and the Internet.

  In the video delivery system 1, the distributor uses the studio unit 30 to create a video of content including animation of a character object based on the movement of the actor. The character object is an individual such as a virtual person or an animal. The created moving image is distributed via the server 20 to the client device 10 used by the viewing user. The distributor may be an actor, an operator of the studio unit 30, or another person.

  The outline of the studio unit 30 will be described according to FIG. The studio unit 30 includes a tracking system 31, a controller 40, a main display 41, a sub display 43 (display device), a microphone 44 (see FIG. 3), and a supporter computer 45.

  The tracking system 31 obtains information on the movement of the actor A. The actor A is, for example, a person performing a performance, an animal, or a moving object. The actor A may be, for example, a robot that can move independently. The number of actors in the studio room R may be more than one.

  The tracking system 31 detects the position of the actor A. The tracking system 31 can also detect the expression of the actor A, the position of the virtual camera set in the virtual space, and the like. For example, the tracking system 31 includes an external sensor 32, an attachment sensor 33, and a position specifying device 35. These are outside-in methods and detect at least one of the direction and position of the mounting sensor 33 mounted by the actor A.

  The attachment sensor 33 is attached to the actor A. There are a plurality of attachment sensors 33 attached to the actor A. For example, the wearing sensor 33 is attached to the left wrist, the right wrist, the left instep, the right instep, the waist and the top of the actor A. The attachment sensor 33 may be attached to the actor A via the attachment tool, or the actor A may wear the clothes on which the attachment sensor 33 is attached. The attachment sensor 33 may be attached to various portions of the actor A. For example, the attachment sensor 33 may be attached to a finger of a hand to detect movement of the finger. The number of attachment sensors 33 attached to the actor A may be five or less or seven or more.

  The mounting sensor 33 cooperates with the external sensor 32 to output information for specifying its own orientation and position to the position specifying device 35. One of the external sensors 32 in the outside-in method is, for example, a multi-axis laser emitter. The external sensor 32 emits pulse laser light for synchronization. The mounting sensor 33 includes a sensor that detects a laser beam, and detects its own position and orientation while synchronizing with a synchronization pulse. As the mounting sensor 33, for example, Vive Tracker (registered trademark) and Vive Base Station provided by HTC Corporation (registered trademark) can be used. Further, in addition to or instead of the above configuration, the mounting sensor 33 may incorporate a sensor for autonomously specifying the position. For example, the mounting sensor 33 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. Also, the mounting sensor 33 may be either one that cooperates with the external sensor 32 or one that does not cooperate with the external sensor 32. Further, the mounting sensor 33 may be capable of detecting the direction or the position alone.

  The tracking system 31 also includes a viewpoint position sensor 36 and a camera 37. The viewpoint position sensor 36 is configured to be changeable by the user. The viewpoint position sensor 36 has the same configuration as the attachment sensor 33. The viewpoint position sensor 36 outputs information for specifying its own orientation and position to the position specifying device 35 via a wireless communication or communication cable. The viewpoint position sensor 36 is set as a viewpoint of a virtual camera in the virtual space. For example, the viewpoint position sensor 36 may be supported by a stand or may be supported by a gimbal or a stabilizer. The gimbal may be configured in a shape that can be gripped by an actor or other person. By supporting the viewpoint position sensor 36 with a gimbal or a stabilizer, it is possible to suppress camera shake.

  The camera 37 is arranged to be able to capture the face of the actor A. For example, the camera 37 is attached to the head or neck or the like of the actor A, or is disposed in front of the actor A. The camera 37 continuously images the face of the actor A, acquires imaging data of the face of the actor A, and transmits the imaging data to the server 20. The camera 37 may be a 3D camera capable of detecting the depth of the face of a person.

  The microphone 44 is disposed at a position where the voice emitted by the actor A can be collected. For example, the microphone 44 is attached to the head or neck or the like of the actor A, or is disposed in front of the actor A. The microphone 44 transmits a signal corresponding to the voice to the server 20.

  The controller 40 is operated by the actor A. The controller 40 outputs a control signal corresponding to the operation of the actor A to the server 20. Further, the controller 40 may incorporate a sensor for autonomously specifying the position. For example, the controller 40 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. In addition to or instead of the above configuration, the controller 40 may be configured to be able to detect the position in cooperation with the external sensor 32.

  The main display 41 is configured to display the moving image generated by the server 20. One main display 41 may be provided, or a plurality of main displays may be provided as illustrated. The animation displayed on the main display 41 includes animation of a character object.

  The sub display 43 is configured to display the information received from the server 20 or the supporter computer 45. One or more sub displays 43 may be used. The information transmitted from the server 20 or the supporter computer 45 to the main display 41 may include, for example, text information, image information, and various other information. The main display 41 and the sub display 43 are arranged at positions visible by the actor A.

  The supporter computer 45 is a computer used by an operator (herein referred to as a "supporter") next to the studio room. The room where the supporter computer 45 is installed and the studio room R are separated by the glass window, so that the supporter using the supporter computer 45 can visually recognize the actor A. In the illustrated embodiment, the supporter B1 and the supporter B2 are in the room. The supporter computer 45 outputs various information to the sub display 43 according to the operation of the supporter. In the present specification, when it is not necessary to distinguish between the supporter B1 and the supporter B2, the supporter B1 and the supporter B2 may be collectively referred to as a "supporter". The components and functions of studio unit 30 shown in FIG. 2 are exemplary. The studio unit 30 applicable to the present invention may comprise various components not shown. For example, studio unit 30 may include a projector. The projector can project the moving image delivered to the client device 10 or another client device on the screen.

  The server 20 will be described according to FIG. The server 20 is configured to deliver a moving image including animation of a character object based on an action of an actor to a viewing user. The character object included in the moving image may be motion controlled in the virtual space. The server 20 includes a computer processor 21, a communication I / F 22, and a storage 23 (storage medium).

  The computer processor 21 is an arithmetic device which loads an operating system and various programs for realizing various functions from the storage 23 or other storages into the memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic devices other than these, or a combination thereof. The computer processor 21 may realize at least a part of the processing performed by itself by circuitry such as an ASIC, a PLD, an FPGA, or an MCU. Although computer processor 21 is illustrated as a single component in FIG. 3, computer processor 21 may be a collection of a plurality of physically separate computer processors. In the present specification, a program described as being executed by the computer processor 21 or an instruction included in the program may be executed by a single computer processor or may be executed by a plurality of computer processors in a distributed manner. It is also good. Also, a program executed by the computer processor 21 or an instruction included in the program may be executed by a plurality of virtual computer processors.

  The computer processor 21 executes a computer-readable instruction included in a distribution program stored in the storage 23 or other storages to obtain a motion data processing unit 21A, a moving image generation unit 21B, a moving image distribution unit 21C, and a user request. It functions as a processing unit 21D, a user information management unit 21E, and a purchase processing unit 21F. At least a part of the functions implemented by the computer processor 21 may be implemented by a computer processor other than the computer processor 21 of the video distribution system 1. At least a part of the functions implemented by the computer processor 21 may be implemented by, for example, a computer processor included in a computer included in the studio unit 30.

  The motion data processing unit 21A generates body motion data based on the tracking information detected by each of the attachment sensors 33 attached to the actor. The body motion data is a time-series digital representation of at least one of the position and orientation of each part of the actor's body. Body motion data is generated as needed over time. For example, body motion data may be generated at predetermined sampling intervals.

  In addition, the motion data processing unit 21A generates face motion data that is a time-series digital representation of the movement of the face of the actor based on shooting data of the camera 37 that the studio unit 30 has. Face motion data is generated as needed over time. For example, face motion data may be generated at predetermined sampling intervals.

  The moving image generation unit 21B applies the body motion data and face motion data generated by the motion data processing unit 21A to predetermined model data included in the model data 23A stored in the storage 23. Thereby, the moving image generation unit 21B is configured to generate animation of a character object that moves in the virtual space and whose expression changes.

  Furthermore, the moving image generation unit 21B constructs a virtual space using the object data 23B stored in the storage 23, and generates a moving image including an image of the virtual space and an animation of a character object corresponding to the actor A. The moving image generation unit 21B can set the position of the viewpoint position sensor 36 as the position of the virtual camera that is the viewpoint of the moving image. Then, the relative position of the actor A to the position of the virtual camera is taken as the position of the character object in the virtual space. Therefore, by changing the position or orientation of the viewpoint position sensor 36 to any position or orientation, the actor A is rich in variations, such as a moving image seen from the left, a moving image seen from the right, and a blurred moving image Can generate videos. In addition, the moving image generation unit 21B may change setting information (focus, angle of view, and the like) of the virtual camera based on the position of the virtual camera.

  Also, when the viewing user is associated with the drawing data of their avatar, the moving image generation unit 21B may display the animation of the avatar of the viewing user in addition to the animation of the character object. The avatar may be displayed to move in the moving image based on an instruction to the client device 10 by the viewing user.

  The moving image distribution unit 21C transmits the list of distribution moving images to the client device 10, and distributes the moving image generated by the moving image generation unit 21B. The moving image distribution unit 21C may distribute the moving image captured in the studio room R in real time, or may distribute the moving image recorded in advance according to a distribution schedule or the like. The moving image distribution unit 21C can be configured to be able to distribute a plurality of moving images in the same time zone. For example, the moving image distribution unit 21C distributes the distribution moving image of "character X" played by the actor A1 and the distribution moving image of "character Y" played by the actor A2 at the same distribution start time (for example, "20:00") It may be delivered with overlapping time zones. In response to the list display request from the client device 10, the video distribution unit 21C transmits a list of distributable distribution videos to the client device 10. When receiving the moving image distribution request from the client device 10, the moving image distribution unit 21C transmits the selected moving image to the client device 10 based on the moving image distribution request.

  The user request processing unit 21D accepts an object display request and a post message display request from the client device 10 of the viewing user, and performs processing according to the display request. The viewing user can transmit an object display request to the server 20 by operating his / her client device 10. The objects include gift objects provided by the viewer to the content. The gift object is an object to be a digital gift from the viewing user to the actor or the like. The gift object may be able to make a display request without paying for it, or may require a price, and pays for the display when the display is made according to the display request. It may be. The gift object may be continuously displayed in the virtual space, or may temporarily add an effect to the virtual space. The display request for the gift object may include the user ID of the viewing user and identification information (object ID) of the object that is the target of the display request.

  When receiving a request for displaying a gift object from the viewing user, the user request processing unit 21D determines whether or not the gift object requires a determination as to whether or not an actor or a supporter can display it. When the user request processing unit 21D determines that the object for which the display request has been made does not require the determination of the actor or the supporter, the user request processing unit 21D displays the object for which the display request is made in the virtual space via the moving image generation unit 21B. Let

  On the other hand, when the user request processing unit 21D determines that the object for which the display request has been made requires the determination of the actor or the supporter, the sub display 43 displays the gift object for which the display request has been made. When the actor or supporter gives a display instruction to the gift object for which the display request has been made, the object for which the display request has been made is displayed.

  In addition, the user request processing unit 21D performs processing for displaying the posting message received from the client device 10 on a moving image. The post message includes identification information (user ID or terminal ID) of the viewing user, as well as the content of the message, and the post date and time.

  When receiving the posting message, the user request processing unit 21D determines whether or not the posting message can be displayed. If the user request processing unit 21D determines that the received post message can be displayed, the user request processing unit 21D causes the moving image generation unit 21B to display the post message in a predetermined area of the moving image. In addition, the user request processing unit 21D displays the post message and the attribute information of the post message on the sub display 43.

  The user information management unit 21E acquires the viewing status of the viewing user, associates the viewing status with the viewing user, and stores the viewing status in the storage 23. The user information management unit 21E stores the moving image viewed by the viewing user in the viewing application, that is, the "room" of the actor whose viewing user is "entered" in association with the user ID of the viewing user as a history. In addition, the user information management unit 21E groups the viewing users according to the viewing situation of the viewing user.

  The purchase processing unit 21F receives, from the client device 10, a display request for a purchase medium such as a gift object or the like related to the distribution moving image by the operation of the viewing user. After accepting the display request for the purchase medium, the purchase processing unit 21F transmits information on the purchase medium to the client device 10. The information of the purchase medium may include the type of the purchase medium, the image of the purchase medium, the price, and various information necessary for the purchase. The viewing user confirms the information of the purchase medium displayed on the client device 10, and selects an arbitrary purchase medium. When the purchase medium is selected by the viewing user, the client device 10 transmits a purchase medium purchase request to the server 20. The purchase processing unit 21F performs payment processing based on the purchase request. When this settlement process is completed, the purchased purchase medium is stored in the server 20 as being held by the viewing user. The purchase medium may be, besides the gift object, an object other than a gift object related to viewing of a moving image, viewing conditions such as the image quality of a moving image, a two-dimensional image or a three-dimensional image. Also, the purchase medium may be a moving image itself. Sales of purchasable gift objects and other media are distributed to distributors. At this time, a part of the sales may be distributed to the studio unit 30 operator.

  The communication I / F 22 is implemented as hardware, firmware, or communication software such as a TCP / IP driver or a combination thereof. The server 20 can transmit and receive data to and from other devices via the communication I / F 22.

  The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices capable of storing data. Various programs can be stored in the storage 23. The programs and various data that may be stored in the storage 23 may be stored in a storage physically separate from the server 20.

  Next, the position specifying device 35 of the studio unit 30 and the supporter computer 45 will be further described. The position specifying device 35 of the studio unit 30 includes a computer processor 35A, a storage 35B (storage medium), and a communication interface (I / F) 35C. The computer processor 35A is, like the computer processor 21 of the server 20, various computing devices such as a CPU. The storage 35 B is, like the storage 23 of the server 20, various storage devices such as magnetic disks. The communication interface (I / F) 35C is, like the communication interface 22 of the server 20, various drivers for communicating with other devices, software, or a combination thereof. The computer processor 35A acquires the tracking information from the external sensor 32 or the mounting sensor 33 by executing the position detection program stored in the storage 35B or the other storage, and specifies the position of each of the mounting sensor 33. In addition, the computer processor 35A acquires the tracking information from the external sensor 32 or the viewpoint position sensor 36 by executing the position detection program stored in the storage 35B or other storage, and specifies the position of the viewpoint position sensor 36. Do. Also, the position specifying device 35 transmits the specified position to the server 20.

  The supporter computer 45 includes a computer processor 46, a communication I / F 47, a storage 48 (storage medium), a display 49, and an input interface 50.

  The computer processor 46 is, like the computer processor 21 of the server 20, various computing devices such as a CPU. The communication I / F 47 is, like the communication I / F 22, various drivers, software, or a combination thereof for communicating with other devices. The storage 48 is, like the storage 23, various storage devices capable of storing data such as a magnetic disk. The storage 48 stores various programs. The display 49 is a liquid crystal display, an organic EL display, an inorganic EL display, or any other display device capable of displaying an image. The input interface 50 includes any pointing device that receives input from a supporter, such as a mouse and a keyboard.

  The computer processor 46 functions as a display control unit 46A and a progress management unit 46B by executing computer-readable instructions included in a program stored in the storage 48 or the like. At least a part of the functions implemented by the computer processor 46 may be implemented by a computer processor other than the computer processor 46 of the video distribution system 1. Also, at least a part of the functions implemented by the computer processor 46 in the present specification may be implemented by the computer processor 21 of the server 20, for example.

  The display control unit 46A displays, on the main display 41 or the sub display 43, a screen which can be viewed by the actor but can not be viewed by the viewing user, in response to various operation inputs from the supporter via the input interface 50. Or, it is configured to add various additional information to the distribution moving image to be distributed to the viewing user.

  The supporter computer 45 may be configured to be able to change the setting of the component of the studio unit 30 according to the operation of the supporter. The supporter computer 45 can change, for example, the setting of the scanning interval by the external sensor 32, the setting of the position or the orientation of the mounting sensor 33, and various settings of other various devices. The supporter can input a message to the supporter computer 45, and can display the input message on the main display 41.

Next, the client device will be described with reference to FIG.
The client device 10 is an information processing device such as a smartphone. The client device 10 is a mobile phone, a tablet terminal, a personal computer, an electronic book reader, a wearable computer including a head mounted display, a game console, and various information processing devices capable of reproducing moving images other than these, besides a smartphone. It is also good.

  The client device 10 includes a computer processor 12, a storage 13 (storage medium), an input interface (I / F) 14, a communication interface (I / F) 15, and a display 16. The computer processor 12 is, like the computer processor 21 of the server 20, various computing devices such as a CPU. The storage 13 is, like the storage 23 of the server 20, various storage devices such as magnetic disks. The storage 13 stores an application program for viewing the moving image distributed from the server 20. The input I / F 14 is an arbitrary input interface that receives an input from a viewing user such as a touch panel. The communication I / F 15 is, like the communication I / F 22, various drivers, software, or a combination thereof for performing communication with another device. The display 16 is, for example, an organic EL display integrated with a touch panel, a liquid crystal display, or any display device capable of displaying an image other than these.

  The client device 10 receives the operation of the viewing user via the input I / F 14 to start the viewing application program implemented in the client device 10. The viewing application may be at least viewable and may have other functions. The computer processor 12 executes readable instructions included in the viewing application program to obtain a list of distribution videos from the server 20. The client device 10 displays the transmitted list on the display. The viewing user selects one of the videos displayed in the list. When the client device 10 receives the selection operation of the viewing user, the client device 10 transmits, to the server 20, a moving image distribution request for requesting distribution of the selected moving image. Alternatively, the client device 10 activates the web browser stored in the storage 13 by accessing the server 20 and displays a web page described in a markup language such as HTML or XML on the display 16. It may be configured. The web page displays a list of videos. Alternatively, the client device 10 may display the moving image list using both the viewing program and the web browser (in-app browser) stored in the storage 13 of the client device 10.

  When the client device 10 receives moving image data from the server 20, the client device 10 displays the moving image on the display 16 based on the received data. The viewing user can input a message regarding the delivered moving image via the input I / F 14 of the client device 10 and post the message to the server 20. The message posted from each viewing user may be displayed superimposed on the moving image. Thus, the interaction between the actor and the viewing user and the interaction between the viewing user can be achieved.

  Next, various data stored in the storage 23 of the server 20 will be described. The storage 23 stores model data 23A, object data 23B, user management data 23C, a possession list 23D, a candidate list 23E, and a posting message 23F. Further, the storage 23 may store a moving image being distributed by the moving image distribution system 1 or a moving image already distributed.

  The model data 23A is model data for generating an animation of a character. The model data 23A may be three-dimensional model data for generating three-dimensional animation, or may be two-dimensional model data for generating two-dimensional model data. The model data 23A includes, for example, rig data (sometimes called "skeleton data") indicating the skeleton of a character, and surface data indicating the shape or texture of the surface of the character. The model data 23A can include a plurality of different model data. The plurality of model data may have different rig data, or may have the same rig data. The plurality of model data may have surface data different from each other or may have the same surface data. In the illustrated embodiment, in order to generate a character object corresponding to an actor, the model data 23A includes at least two types of model data different from each other.

  The object data 23B includes asset data for constructing a virtual space constituting a moving image. The object data 23 B is data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and for drawing various objects displayed in the moving image other than these. Contains data. The object data 23B may include object position information indicating the position of the object in the virtual space.

  In addition to the above, the object data 23B may include a gift object displayed in a moving image based on a display request from the viewing user of the client device 10. Gift objects may include effect objects, decoration objects, and regular objects. The gift objects may include those requiring consideration for holding by the viewing user and those not requiring consideration. An upper limit may be set on the number of purchasable objects or the purchase price of the objects.

  The effect object is an object that affects the impression of the entire viewing screen of the distributed moving image, and is, for example, an object that simulates confetti, an object that simulates a fireworks, or the like. An object simulating a confetti may be displayed on the entire viewing screen, which can change the impression of the entire viewing screen before and after the display. For example, the effect object may be represented by a particle system that represents an event composed of moving particles. In the particle system, the display time may be set for each particle. The effect object may be a static object or a dynamic object. The effect object may be displayed so as to overlap with the character object, but differs from the decorative object in that the display associated with a specific part of the character object is not made.

  The decoration object is an object displayed on the display screen in association with a specific part of the character object. The decorative object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to touch the specific part of the character object. The decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object.

  The decorative object is, for example, an accessory (such as a headband, a necklace, an earring, etc.) attached to a character object, clothes (such as a T-shirt), a costume, and an object that can be attached to other character objects. The object data 23B corresponding to the decoration object may include mounting position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decoration object can indicate to which part of the character object the decoration object is to be mounted. For example, when the decorative object is a headband, the mounting position information of the decorative object may indicate that the decorative object is mounted on the "head" of the character object. If the decorative object is a T-shirt, the mounting position information of the decorative object may indicate that the decorative object is mounted on the “body” of the character object.

  The decoration object is attached to the character object by being selected by an actor or a supporter after the server 20 is added to the list stored in the storage 23 or other storage. The viewing user feels familiarity with the character object by having the character object attach the decoration gift object transmitted by the user. On the other hand, even if the viewing user requests display of the decoration object, the decoration object is not attached to the character object unless it is selected by the actor or supporter. When the actor selects the decoration object, the actor confirms the list displayed on the sub display 43, and uses the pointing device such as the controller 40 or selects the decoration object according to the instruction to the supporter. Further, the supporter confirms the list displayed on the supporter computer 45, and selects the decoration object using the input interface 50.

  The normal object is a gift object other than the decoration object arranged as an object in the virtual space, and is, for example, an object imitating a stuffed toy or a bouquet. The normal object may be displayed so as to overlap with the character object, but differs from the decorative object in that the display associated with a specific part of the character object is not made. The normal object may differ in that the normal object can change its position by the actor, whereas the effect object can not change its position by the actor. Also, the normal object and the effect object may have different display times.

  The display time according to the kind may be set to each of the gift objects. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object or the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

  As shown in FIG. 5, the user management data 23C stores, for each content of a character object, information on a viewing user who has viewed the moving image. Basically, content is distributed multiple times. For example, "distributor A" distributes "content P" having "character P" as a main character over a plurality of times. Further, another “distributor B” distributes “content Q” having “character Q” as a main character over a plurality of times. The content is not necessarily different for each character object. For example, even if moving images of the same character object are not related to each other, different contents may be configured. The user management data 23C stores the activity of the viewing user after the start of distribution of the content for the first time. The activity is an activity of a viewing user for the content, and may include at least one of a viewing history of the content, a posting status of a message to the content, a providing status of a gift object for the content, a charging status for the content, and the like. In addition, when "viewing user C" has viewed both "content P" and "content Q", the activity of "viewing user C" in "content P" and "content Q" The activities of "viewing user C" are stored respectively.

  The user management data 23C may include, for each viewing user of content, identification information (user ID) of the viewing user, a group to which the viewing user belongs, an entering state of the viewing user, a viewing user ranking, and a viewing user charge state.

  The group corresponding to the content indicates the group to which the viewing user belongs in the content. A plurality of groups may be used to divide the viewing users. The viewing users are divided into each group based on the condition regarding the activity in the content that has been viewed and listened to. The conditions for dividing the group may be preset by the distributor or the operator of the studio unit 30. For example, based on the condition regarding the activity of the content, the viewing users are divided into a group consisting of viewing users who are keen fans of the content and a group consisting of viewing users having a small relation with the content, such as a viewing user who views first be able to.

  The conditions for dividing the group may include at least one of the number of viewing and listening times of the content, the number of postings of the posting message to the content, the number of transmitting gift objects to the content, and the billing amount for the content. For example, when the condition for dividing the group is the number of viewing times, viewing users whose viewing number of "content P" is a predetermined number of times (for example, 10 times) are included in the first group (for example, "VIP group") Viewing users less than the number of times are included in the second group. Also, when the condition for dividing the group is the number of message postings, viewing users whose number of message postings is a predetermined number of times (for example, 20 times) are included in the first group and viewing users whose number of message postings is less than a predetermined number are Include in the second group. If the condition for dividing the group is the number of times of provision of the gift object, the viewing user whose number of times of provision of the gift object is a predetermined number of times (for example 5 times) is included in the first group and the number of times of provision of the gift object is less than the predetermined number of times Users are included in the second group. When the condition for dividing the group is a billing amount, a viewing user whose billing amount is equal to or more than a predetermined amount is included in the first group, and a viewing user whose billing amount is less than the predetermined amount is included in the second group. Also, grouping may be performed by combining a plurality of the number of viewing and listening times of the content, the number of postings of the posting message to the content, the number of transmissions of the gift object to the content, the billing amount for the content, and other conditions.

  The grouping conditions may be other than the above conditions. For example, the usage status of the viewing application (frequency of use, number of years of usage, latest usage date and time), and attributes of the user (age, gender, occupation, place of residence, language of use, etc.) may be used. Further, grouping may be performed by combining these conditions.

  The entry state associated with the content is data indicating whether the content is being viewed while logged in to the moving image distribution system 1. When the content is distributed to the client device 10 of the viewing user, data indicating “entry” is stored. When the content is not distributed to the client device 10, data indicating “exit” is stored in the entry state. Note that after the content is distributed to the client device 10, viewing of the moving image may be interrupted, and when a predetermined time has elapsed from the interruption, data indicating “exit” may be stored. On the other hand, in the moving image being distributed, when the content is not viewed from the beginning of the distribution cycle, data other than "out of room" such as "not yet viewed" may be stored.

  The ranking associated with the content is data indicating the ranking of the viewing user in the content. The operator of the studio unit 30 or the distributor can decide the method of giving the order. For example, the ranking may be determined according to the number of viewing times of the content, the number of postings of the posting message to the content, the number of transmissions of the gift object to the content, the billing amount for the content, and the like. The ranking may be a population of all the viewing users of the content or a population of at least one of a plurality of groups (for example, the first group).

  The ranking associated with the content is data indicating the charging status of the viewing user in the content. The charge status is data such as "with charge" or "without charge". Alternatively, the charge status may be a charge amount.

  As shown in FIG. 6, the possession list 23D is a list of objects possessed by the viewing user. The possession list 23D can include identification information (object ID) of an object to be possessed in association with the user ID. The objects owned by the viewing user may be different for each content, and the objects owned by the viewing user may be common among different contents, or may include both of them. When the object is different for each content, the owned list 23D of the viewing user stores the identification information of the object for each content. The possession list 23D is continuously stored over a plurality of moving picture distributions. Alternatively, the possession list 23D may be newly generated or reset each time a content for one dose is distributed.

  As shown in FIG. 7, the candidate list 23E is a list of gift objects associated with the moving image. It is preferable that the candidate list 23E be generated or reset each time the moving image is distributed. When the viewing user sends a request for displaying a gift object to a moving image, information on the gift object is added to the candidate list 23E. The candidate list 23E includes the identification information (user ID) of the viewing user of the transmission source of the gift object, the identification information (object ID) of the gift object, the type of gift object (decoration object, effect object, normal object), transmission of the gift object The date and time may include the selection state of the gift object. The selection state of the gift object indicates whether the decoration object is selected by the actor or the supporter when the gift object is a decoration object. In the selection state, data indicating “selection” is stored when a decoration object is selected, and data indicating “not selected” is stored when a decoration object is not selected. If the gift object is not a decoration object, data other than "not selected" or "not selected" and "selected" is stored.

  As shown in FIG. 8, the posting message 23F may include information on a message posted by the viewing user to the moving image. The posting message 23F may include, for each content, identification information (user ID) of a viewing user, a group to which the viewing user belongs, contents of a posting message, and a posting date and time when the message was posted. The group to which the viewing user belongs may be omitted because it is stored in the user management data 23C. The post message 23F is newly generated or reset each time one-time content is delivered.

  Next, the screens confirmed by the viewing user, the actor, and the supporter will be described along with the flow of the content distribution. When the viewing application program is activated by the operation of the viewing user, the client device 10 requests the server 20 for a list of contents. The server 20 transmits information for displaying a list of contents to the client device 10.

  As shown in FIG. 9, a content list screen 100 is displayed on the display 16 of the client device 10. The content list screen 100 displays a list of contents being delivered or to be delivered. In the list, in addition to the image 101 of the content, the delivery date and time of the content, the content name, the names of characters appearing in the content, and the like are displayed.

The viewing user selects one content from the list. The client device 10 transmits the distribution request of the selected content to the server 20.
When the server 20 receives a content distribution request from the client device 10, the server 20 distributes the target content of the distribution request to the client device 10. When receiving the content, the client device 10 displays a moving image.

  As shown in FIG. 10, a moving image viewing screen 105 is displayed on the display 16 of the client device 10. The moving image viewing screen 105 displays a virtual space with the viewpoint position sensor 36 as a camera viewpoint and a character object 110 on which the motion of the actor is reflected. Further, on the moving image viewing screen 105, a gift selection unit 112 and a post selection unit 113 are displayed.

  When the gift selection unit 112 of the moving image viewing screen 105 is selected by the viewing user, the client device 10 acquires the possession list 23D from the server 20. Alternatively, the client device 10 acquires the possession list 23D acquired in advance from the server 20 and stored in the storage 13. Furthermore, based on the possession list 23D, the client device 10 displays the gift objects possessed by the viewing user as a list.

  When the viewing user selects a normal object from the list of gift objects, a request for displaying the normal object is transmitted from the client device 10 to the server 20. The display request usually includes identification information (object ID) of an object and identification information (user ID) of a user. In addition, since transmission of identification information of a user is necessary for the display request of a gift object, before transmitting the display request, the user is logged in to the video distribution system 1 or another user authentication system in cooperation with the video distribution system 1 There is a need.

  In response to the display request for the normal object, the server 20 displays the normal object 111 in the moving image distributed to the viewing user who made the display request and the other viewing users. In the illustrated embodiment, a plurality of types of normal objects 111A to 111C are displayed. The normal object 111A is a bear's stuffed toy object, and is disposed at a predetermined position in the virtual space. The normal object 111A may be movable in the virtual space by contact with the character object 110, for example, when the character object 110 performs an operation of holding it. The normal object 111B is an object of the multiplication axis, and is displayed at a predetermined position in the virtual space. The normal object 111C is an object movable in the virtual space. After moving in the virtual space, the normal object 111 </ b> C may be displayed at a position finally reached and may disappear from the screen.

  As shown in FIG. 11, when a viewing user makes a display request for an effect object, as in the case of a normal object display request, the effect object is displayed on the moving image viewing screen 105. In the illustrated embodiment, an effect object 115 corresponding to confetti is displayed.

  As shown in FIG. 12, as in the case of the normal object display request, when the viewing user makes a display request for the decoration object, the decoration object 120 is displayed on the moving image viewing screen 105. The decoration object 120 is displayed on the moving image viewing screen 105 in association with a specific part of the character object. The decorative object 120 may be displayed to touch a specific part of the character object. For example, the decoration object 120 imitating a cat's ear is attached to the head center of the character object 110 because it is associated with the head center of the character object. When the character object 110 moves, the decoration object 120 also moves along with the head as if being attached to the character object 110 while being associated with the character object 110.

  When the posting selection unit 113 is posted by any viewing user who is viewing the moving image when the moving image has a period in which the posting message can be posted, another screen or moving image view from the moving image viewing screen 105 is viewed. A message input screen is displayed in the screen 105. When a message is input on the input screen, information on the post message is transmitted to the server 20.

  When the server 20 receives a posting message within a postable period, it transmits moving image data including the posting message to the client device 10. The client device 10 displays the posting message 130 in the moving image viewing screen 105. Post message 130 is displayed in a predetermined message display area 131. Post messages 130 are arranged in the order of date and time of posting. For example, the latest post message 130 is displayed at the top of the message display area 131. Next, when the server 20 receives a new post message, the post message 130 displayed at the top is moved downward, and a new post message is displayed at the top. The post message that has reached the bottom of the message display area 131 moves further downward and is not displayed when a new post message is added at the top. Alternatively, the message display area 131 may be able to display only one post message.

Next, the screen which an actor confirms in studio room R is demonstrated.
FIG. 13 shows an example of the notification screen 200 displayed on the sub display 43 installed in the studio room R. The notification screen 200 may display a notification 201 to the actor. The data for displaying the notification screen 200 may be generated automatically by the supporter computer 45, or may be one requiring the supporter's input operation. In the illustrated embodiment, the notification 201 displays the remaining time, the schedule, information for notifying the actor, and the like. The actor performs performance while checking the notification screen 200. Note that the notification 201 may be displayed on the screen of the main display 41 so as to overlap or be aligned with the animation of the character object.

  FIG. 14 shows an example of the gift list screen 210 displayed on the sub display 43. The gift list screen 210 displays a list (object information) in which gift objects for which a display request has been made from the viewing user are displayed in association with the viewing user. On the gift list screen 210, an all gift list 211, an in-wear gift list 212 (first list), and an unmounted gift list 213 (second list) are displayed.

  In the all gift list 211, an image of a gift object for which a viewing request has been made from a viewing user during video distribution, a name of the gift object, and identification information of the viewing user who made a display request for the gift object (user account name Or user ID), may include the wearing state. The total gift list 211 preferably includes other types of gift objects in addition to the decoration objects. The avatar of the viewing user may be displayed as identification information of the viewing user. In the illustrated embodiment, the all gift list 211 displays gift objects of all types: regular objects, effect objects, and decorative objects.

  The “mounted state” of the all gift list 211 indicates whether the character object is mounted on the decoration object when the gift object displayed on the all gift list 211 is the decoration object. If the character object is wearing a decoration object, "loading" is displayed. When the mounting of the character object is completed, "mounted" is displayed. In the content being delivered, "mounted" is displayed for the decoration object for which the character object has already been mounted. The actor and the supporter can confirm, in the all gift list 211, the gift object for which the viewer has made a display request from the time when the distribution of the moving image is started. In addition, since the identification information of the user is displayed in association with the gift object in the all gift list 211, the actor is a voice of the moving image, and a message (for example, “ Thank you, Mr. A, etc.). As a result, the actor can increase communication with the viewing user, so that the degree of satisfaction of the viewing user can be improved.

  Display time may be defined for the decoration object. The decoration objects for which the display time has elapsed are displayed in a different display mode from the decoration objects for which the display time has not elapsed, such as graying out after the selection state is set to “already” in the entire gift list 211. Also, the decoration object for which the display time has elapsed is hidden on the moving image.

  In addition, in the moving image being distributed, when the display request of the same decoration object is issued from different viewing users and only one decoration object is mounted by the character object, the decoration object is set as “already mounted”, and the other is The decoration object may be "unmounted". Alternatively, both decoration objects may be "mounted".

  In the wearing gift list 212, a decoration gift object selected by an actor or a supporter and worn by a character object is displayed. The items of the in-wear gift list 212 are the same as those of all the gift lists. Among the decoration objects being worn, the gift list 212 with the latest date and time when the display request is made, that is, the newest one is displayed at the top and the date and time when the display request is issued is late In order, it is displayed side by side from the top. The actor and the supporter can grasp the decoration object worn by the character object by checking the gift list 212 during wearing. For this reason, the actor can transmit a message (for example, "This cat Mimi, I like it", etc.) such as an impression of the decoration object attached to the character object to the viewing user by the sound of the moving image. As a result, the actor can increase communication with the viewing user through the decoration object, so that not only the satisfaction of the viewing user who provided the decoration object is improved, but also viewing users other than the viewing user are decorated It can motivate you to provide objects.

  The decoration object for which the display time has elapsed is deleted from the in-wear gift list 212 or a display mode different from the decoration object for which the display time has not elapsed, such as graying out.

  In the unmounted gift list 213, decorative gift objects not selected by an actor or a supporter are displayed after the display user has made a display request. The items of the unmounted gift list 213 are the same as those of all the gift lists. In the unmounted gift list 213, the display request is made at the earliest when the display request is made, that is, the longest non-mounted time after the display request is made is displayed at the top, and the display request is made. They are displayed side by side from top to bottom in order from the earliest date and time. In this manner, since the unmounted decorative gift objects are listed, the actor or supporter can grasp the decorative objects provided by the viewing user and not selected. In this manner, since the actor can easily confirm the unselected decoration objects, it is possible to efficiently select as many decoration objects as possible. Furthermore, since the display request is displayed earlier on the top when the display request has been made, selection omission can be suppressed.

  Among the decoration gift objects, an object whose display time is limited is deleted from the moving image viewing screen 105 when the display time has elapsed since the attachment of the character object was started. The erased decoration object is erased from the gift list 212 during wearing. As described above, in the all-gift list 211, the selection state of the decoration object deleted from the moving image viewing screen 105 is updated to "already installed". The display time of the gift object may be displayed on the all gift list 211, the in-wear gift list 212, and the non-mounted gift list 213.

  In addition, when any decoration gift included in the non-mounted gift list 213 is selected by the actor or supporter, the server 20 deletes the information on the selected decoration object from the non-mounted gift list 213 and the gift being worn It is newly added to the list 212. Moreover, as for the selected decoration gift object, the selection state of the all gift list 211 is updated from “not selected” to “during mounting”.

  As described above, since the gift list during installation 212 and the non-mounted gift list 213 are separately displayed on the gift list screen 210, the actor or supporter can display even if many viewing objects are provided by the viewing user, It is possible to grasp the selected decoration object and the unselected decoration object, and efficiently select the decoration object. Then, as many decoration objects as possible are selected and attached to the character object within the limited delivery time, the opportunity for communication with the viewing user can be increased. Thereby, the degree of satisfaction of the viewing user with respect to the distribution moving image can be improved.

  FIG. 15 is a message display screen 220 displayed on the sub display 43. The message display screen 220 may be displayed on the same sub display 43 as the gift list screen 210, or may be displayed on a different sub display 43 when there are a plurality of sub displays 43. On the message display screen 220, a first message display area 221, a second message display area 222, and an entry log 223 are displayed.

  In the first message display area 221, the computer processor 21 of the server 20 reads out the posting messages 23F corresponding to the contents being distributed from the storage 23, and lists them in order of posting date and time. The latest posting message may be displayed at the top of the list, with the latest posting date and time. When a new post message is posted, the post message is added to the top of the first message display area 221, and the post message already displayed in the first message display area 221 is advanced downward. Note that the moving direction of the post message may be reverse. The list may include, for each post message, identification information of the viewing user (such as an account name of the viewing user), a posting time, and a message content. The avatar of the viewing user may be displayed as identification information of the viewing user.

  In the second message display area 222, the computer processor 21 of the server 20 extracts and lists only the posting messages of the viewing users belonging to the first group (VIP group) from the posting messages 23F stored in the storage 23. It is a thing. In the illustrated embodiment, the post message displayed in the second message display area 222 may be displayed in the first message display area 221, or may be displayed only in the second message display area 222. The second message display area 222 may include a ranking in addition to identification information of the viewing user (account name of viewing user, etc.), posting time, message content. The avatar of the viewing user may be displayed as identification information of the viewing user.

  The entry log 223 is a list of viewing users who are viewing the content being delivered. The computer processor 21 of the server 20 refers to the user management data 23C corresponding to the content being distributed, and extracts the viewing user whose entry state is "entry". The entry log 223 may include identification information of a viewing user who is viewing the content, entry time, entry status, and group. The avatar of the viewing user may be displayed as identification information of the viewing user.

  By referring to the entry log 223, the actor can describe a message such as "N, Hi" to the viewing user who has started viewing through the audio of the moving image. In this manner, the actor can communicate with the viewing user who has started viewing, so that the viewing user becomes attached to the character and the satisfaction with the content is enhanced.

  In addition, the actor can respond to the posting message from the viewing user by confirming the first message display area 221 and the second message display area 222. At this time, by separately displaying the first message display area 221 and the second message display area 222 to which the viewing user of the first group belongs, it is possible to easily grasp the tendency of the user who has sent the post message. . For example, the actor can give priority to the response to the posting message of the viewing user belonging to the first group. Thereby, the degree of satisfaction with the content of the viewing user belonging to the first group can be particularly enhanced. Further, if priority is given to the response to the posting message of the viewing user belonging to the second group, the degree of satisfaction with the content of the viewing user belonging to the second group can be particularly enhanced.

  Next, with reference to FIG. 16, a moving image delivery process according to an embodiment will be described. In the video distribution process, it is assumed that the actor is performing in the studio room R. First, in step S11, the motion data processing unit 21A of the server 20 converts body motion data, which is a digital representation of the movement of the actor's body, and face motion data, which is a digital representation of the movement (expression) of the actor's face. It is generated.

  Next, in step S12, a moving image is generated by the moving image generation unit 21B. In this step, by applying the body motion data and face motion data of the actor to the model data 23A for the actor, an animation of a character object moving in synchronization with the movement of the body and expression of the actor is generated. Furthermore, a moving image using this animation is generated. The voice of the actor is synthesized to this animation.

  Next, in step S13, the moving image distribution unit 21C distributes the moving image generated in step S12. The content is distributed to the client device 10 via the network 11. This content may be distributed to the supporter computer 45 and may be projected on the main display 41 in the studio room R. One dose of content is delivered continuously over a predetermined delivery period. The distribution period of the moving image may be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other time.

  Next, the process proceeds to step S14, and it is determined whether an end condition for ending the distribution of the moving image is satisfied. The end condition is, for example, that the end time of distribution has been reached, that the support computer 45 has instructed the end of distribution, or other conditions. If the end condition is not satisfied, the processing of steps S11 to S13 is repeatedly executed, and the distribution of the moving image including the animation synchronized with the movement of the actor is continued. If it is determined that the ending condition is satisfied for the moving image, the distribution processing of the moving image is ended.

  Next, the process of accepting gift objects will be described with reference to FIG. When the display request for the gift object transmitted from the client device 10 is received by the user request processing unit 21D of the server 20, the gift object is accepted (step S20). The display request may include the identification information of the viewing user, the identification information of the gift object, the transmission date, and the like.

  Information of the received gift object is added to the candidate list 23E by the user request processing unit 21D, and information of the gift object is added to the all gift list 211 of the gift list screen 210 (step S21).

  Next, the user request processing unit 21D determines whether the added gift object is a decoration object (step S22). If the gift object is not a decoration object but an effect object or a normal object (step S22: NO), the gift object reception process is ended.

If the gift object is a decoration object (step S22: YES), the gift object is added to the unmounted gift list 213 (step S23).
Next, the process of selecting a decoration object will be described with reference to FIG. If it is determined that the decoration object is selected by the operation of the actor or the supporter (step S30: YES), the selected decoration object is deleted from the unmounted gift list 213 by the user request processing unit 21D, and the gift list 212 being mounted Is displayed (step S31). Further, the selected decoration object is displayed by the moving image generation unit 21B at a predetermined part of the character object associated with the decoration object (step S32).

  Furthermore, it is determined whether or not the display period has ended for the decoration object displayed in the moving image (step S33). If the display period of the decoration object has not ended (step S33: NO), the display of the decoration object is continued. On the other hand, when the display time of the decoration object is ended (step S33: YES), the decoration object of which the display time is ended is updated in the wearing gift list 212 (step S34). Specifically, the display object is displayed differently from other decoration objects whose display time has not ended, such as the decorative object whose display time has ended is deleted from the gift list 212 during installation or grayed out.

  Next, the post message display process will be described with reference to FIG. When the identification information of the viewing user and the posting message are received, it is determined by the user request processing unit 21D whether the posting message is a posting message from the viewing user belonging to the first group (step S40). ). The grouping of the viewing users is performed by the user information management unit 21E at a predetermined timing.

  If it is determined that the received post message is a post message from a viewing user who belongs to the first group (step S40: YES), the user request processing unit 21D displays the post message in the first message display area 221 and the first message display area 221 2 Display in the message display area 222 (step S41). On the other hand, when it is determined that the received post message is a post message from a user belonging to the second group (step S40: YES), the post message is displayed only in the second message display area 222 (step S40). S42).

As described above, according to this embodiment, the following effects can be obtained.
(1) In the above embodiment, the moving picture distribution system receives a display request for an object from a viewing user. In addition, a list of objects for which a display request has been received is displayed on the sub display 43 disposed at a position visible from the actor. By checking the list displayed on the sub display 43, the actor in performance can quickly grasp the object for which the display request has been made and the viewing user who has made the display request for the object. Furthermore, the actor can send a message to the viewing user who made the display request at a suitable timing by quickly grasping the object and the viewing user. Therefore, the opportunity for communication with the viewing user can be increased.

  (2) In the above embodiment, an object selected by a user other than a viewing user such as an actor from the gift list screen 210 is displayed as a moving image. Since the objects for which the display request has been made are displayed on the gift list screen 210, an actor or the like can efficiently select the objects. For this reason, the effect of the list can be exhibited more.

  (3) In the above embodiment, in the gift list screen 210, the selected object and the unselected objects are displayed separately in another list, so it is easy to select an object from the list of unselected objects. You can choose to support the performance of the actor, etc.

  (4) In the above embodiment, only the decoration object is displayed on the in-wear gift list 212 and the un-mounted gift list 213. That is, since only objects that need to be selected by a user other than the viewing user are displayed in the first list and the second list, the actor can easily select a desired decoration object.

  (5) In the above embodiment, the post message of the viewing user belonging to the first group is displayed in the area different from the posting message of the viewing user belonging to the other group, so the actor is a viewing user belonging to the first group It is possible to prioritize and respond to post messages of. For this reason, the communication opportunity with respect to a specific viewing-and-listening user can be increased.

The above embodiments can be implemented with the following modifications. The present embodiment and the following modifications can be implemented in combination with one another as long as there is no technical contradiction.
In the above embodiment, the gift list screen 210 is displayed on the sub display 43 with a screen including the in-wear gift list 212 and the non-mounted gift list 213. Instead of or in addition to this, at least one of the gift list from the viewing user belonging to the first group and the gift list from the viewing user belonging to the second group may be displayed on the sub display 43. Furthermore, the gift list from the viewing user belonging to the first group may be divided into the in-wear gift list and the unmounted gift list. Similarly, the gift list from the viewing user belonging to the second group may be divided into the in-wear gift list and the non-mounted gift list. According to this, the decorative gift object can be displayed separately from the perspective of the group to which the viewing user belongs in addition to the perspective of wearing and non-mounting, so that communication according to the group to which the viewing user belongs can be taken. it can.

  In the above embodiment, the gift list screen 210 and the message display screen 220 are different screens. Instead of this, a plurality of the attached gift list 212, the unattached gift list 213, the first message display area 221, the second message display area 222, and the entry log 223 may be displayed side by side on one screen. In addition, the actor or supporter may select any one of the all gift list 211, the in-wear gift list 212, the non-mounted gift list 213, the first message display area 221, the second message display area 222, and the entry log 223. It may be configured to be freely arranged in the screen.

  In the above embodiment, the gift list screen 210 and the message display screen 220 may be alternately displayed on one sub display 43. The switching of the screen may be performed when any of the display request for the gift object and the posting message is received. For example, when a request for displaying a gift object is received, the gift list screen 210 is displayed for a predetermined time, and when a post message is received, the message display screen 220 is displayed for a predetermined time.

  In the above embodiment, the gift list screen 210 and the message display screen 220 are displayed on the sub display 43. Instead of this, at least one of the gift list screen 210 and the message display screen 220 may be displayed on the main display 41.

  In the above embodiment, after the decoration object is attached to the character object, it is not displayed when a predetermined display time elapses. Alternatively, the decoration object may be configured to be hidden by the operation of the actor or supporter.

  In the above embodiment, the gift list screen 210 and the message display screen 220 are displayed on the sub display 43. Instead of or in addition to this, it may be displayed on a head mounted display worn by the actor. The head mounted display may be transmissive or non-transmissive. On the head mounted display, moving images including animation of characters may be displayed, and those moving images may not be displayed and only at least one of the gift list screen 210 and the message display screen 220 may be displayed.

  In the above embodiment, the viewing users are divided into a plurality of groups according to the number of viewing of the content, the number of postings of the posting message to the content, the number of transmissions of the gift object to the content, the billing amount to the content . Instead of this, for the viewing user, a group to which the viewing user who performs an inappropriate action belongs to the video to be distributed belongs (eg: second group) and a group to which the other viewing users belong to (eg: first group) And may be separated. Information that specifies the viewing user, such as the real name or address of the viewing user, is not disclosed to the distributor or other viewing users except for necessary information such as the account name, user ID, avatar, etc. May take inappropriate action in activities such as posting a message to a moving image, and requesting display of a gift object. In order to prevent problems, the distributor needs to quickly grasp that these viewing users have "entered" (logged in), posted messages, and the like. A condition for dividing a group is that an inappropriate message has been sent in the past on a moving image, or that the number of times has reached a threshold. As a method of determining an inappropriate message, for example, a method of determining that the message is inappropriate when the server 20 analyzes the contents of the message and determines that the phrase included in the message corresponds to an inappropriate phrase There is. In addition, a method in which the distributor or the operator judges whether or not the message is inappropriate by visually checking the message posted in the moving picture, or from other viewing users There is a method etc. of judging it to be inappropriate by receiving a report. When the distributor or the operator determines whether the message is inappropriate, the distributor or the operator operates the supporter computer 45 or the like to transmit the viewing user who has sent the message, for example, the “second group”. Be attributed to Alternatively, the distributor or the operator operates the supporter computer 45 or the like to update the number of times the viewing user who has sent the message made an inappropriate speech. The server 20 receives the information from the supporter computer 45 or the like, and updates the user management data. These groupings may be managed for each content as in the above embodiment, or may be managed as common to the entire platform for distributing moving pictures. The room entry log 223 may display the identification information of the viewing user as well as the group to which the viewing user belongs. When a viewing user who needs monitoring belonging to the second group “enters”, the identification information of the viewing user is displayed in the entry log 223 (FIG. 15), so the distributor forcibly terminates the viewing user Is also possible. Alternatively, the server 20 may automatically be forced out of the room when the viewing user “enters”. Alternatively, the distributor can pay attention so as not to bother other viewing users only by the entry log of the viewing user being displayed in the entry log 223 without forced removal.

  -In one embodiment, a large number of infrared LEDs are mounted on each of the plurality of mounting sensors 33 mounted on the actor and the actor, and the light from this infrared LED is provided on the floor or wall of the studio room R The position and orientation of each of the mounting sensors 33 may be detected by detecting with an infrared camera. A visible light LED may be used instead of the infrared LED, and the position and the orientation of each of the mounting sensors 33 may be detected by detecting the light from the visible light LED with a visible light camera. As described above, a light emitting unit (for example, an infrared LED or a visible light LED) is provided to each of the plurality of mounting sensors 33 mounted to the actor, and light from the light emitting unit is provided to the light receiving unit For example, the position and the orientation of each of the mounting sensors 33 may be detected by detecting with an infrared camera or a visible light camera. In one embodiment, a plurality of markers can be used instead of the mounting sensor 33. A marker is provided for each of the actors. Alternatively, the marker may be provided on the actor's clothes (e.g., an upper or lower coat, or a suit in which they are integrated). By imaging an actor provided with a marker in this manner to generate imaging data and performing image processing on the imaging data, at least one of the position and the orientation of the marker can be detected. Also, signals can be transmitted / received to / from the external sensor 32 or the server 20, such as the attachment sensor 33, a sensor capable of detecting at least one of the position and orientation of an acceleration sensor, a gyro, etc., and a capacitive sensor. Sensors are provided on the actor's clothes (for example, upper or lower clothes, or a suit integrated with them), and at least one of the position, orientation, and movement of the sensors is determined based on the signals transmitted from these sensors. A section may be detected. Further, the tracking system 31 may be one which can detect the movement of the actor only by the external sensor 32 without using the mounting sensor 33.

  The method described in the embodiment is, for example, a magnetic disk (a floppy (registered trademark) disk, a hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), a semiconductor as a program that can be executed by a computer. It can be stored in a recording medium such as a memory (ROM, RAM, flash memory, etc.), and can be distributed by transmission via a communication medium. The program stored on the medium side includes a setting program for configuring the software means (not only the execution program but also the table and data structure) to be executed by the computer in the computer. A computer that implements the present apparatus reads a program recorded in a recording medium, and optionally constructs a software means by the setting program, and executes the above-described processing by controlling the operation by the software means. Incidentally, the recording medium referred to in the present specification is not limited to the distribution medium, but includes a storage medium such as a magnetic disk or a semiconductor memory provided in an apparatus connected inside a computer or via a network.

  1 ... video distribution system, 10 ... client device, 20 ... server.

Claims (6)

A moving image distribution system for distributing a moving image including animation of a character object generated based on the motion of an actor to a client device used by a viewing user,
One or more computer processors,
Storage for storing objects associated with the viewing user;
A display device visible from the actor;
Equipped with
The one or more computer processors execute computer readable instructions by:
Accepting a display request for the object from the viewing user,
Object information in which information of an object for which the display request has been received is associated with identification information of a viewing user who has made a display request for the object is displayed on the display device;
When the object information is selected by a user other than the viewing user who made the display request for the object, and the selection of the object is accepted, the object is displayed in the moving image,
The object information includes a first list including object information on a selected object and a second list including object information on an unselected object.
Video distribution system. The object includes a decoration object displayed in a moving image by being selected by a user other than the viewing user who made the display request, and an object displayed in the moving image when the display request is accepted.
Only the information of the decoration object is displayed in the first list and the second list.
The video distribution system according to claim 1 . The computer processor is
When the action of the viewing user on the moving image satisfies a predetermined condition, the viewing user is associated with one of a plurality of groups.
The video delivery system according to claim 1 or 2 . The viewing user is associated with one of a plurality of groups,
The computer processor is
Accept a post message sent to the video being delivered from the viewing user,
A message display area for displaying a post message transmitted by a viewing user belonging to a predetermined group among the plurality of groups, and a message display capable of displaying a message from a viewing user not included in the predetermined group on the display device Display area and
The video delivery system according to claim 1 or 2 . A moving image distribution method in which one or more computer processors execute computer readable instructions to distribute moving images including animations of character objects generated based on the motion of an actor to client devices used by a viewing user There,
Storing in storage an object associated with the viewing user;
Accepting a display request for the object from the viewing user;
Displaying the object information in which the information of the object for which the display request has been received is associated with the identification information of the viewing user who made the display request for the object on the display device arranged at a position visible to the actor When,
Displaying the object on the moving image when the object information is selected by a user other than the viewing user who made the display request for the object, and the selection of the object is accepted;
The object information includes a first list including object information on a selected object and a second list including object information on an unselected object.
Video delivery method. A moving image distribution program for distributing a moving image including animation of a character object generated based on the movement of an actor to a client device used by a viewing user,
One or more computer processors,
Storing in storage an object associated with the viewing user;
Accepting a display request for the object from the viewing user;
Displaying the object information in which the information of the object for which the display request has been received is associated with the identification information of the viewing user who made the display request for the object on the display device arranged at a position visible to the actor When,
Displaying the object on the moving image when the object information is selected by a user other than the viewing user who made the display request for the object, and the selection of the object is accepted;
The object information includes a first list including object information on a selected object and a second list including object information on an unselected object.
Video distribution program.