JP7261727B2 - Video distribution system, video distribution method and server - Google Patents

Description

The present invention relates to a video delivery system, video delivery method , and server.

2. Description of the Related Art Conventionally, there has been known a moving picture distribution system that generates animation of a character object based on the motion of an actor and distributes a moving picture including the animation of the character object (see, for example, Patent Document 1).

In this type of moving image distribution system, a system has been proposed in which an arbitrary object is displayed in a moving image distributed to a plurality of viewing users by the operation of the viewing users. The object displayed in the moving image by the viewing user is, for example, a gift object for the character object.

JP 2015-184689 A

One of the challenges for distributors is to increase the number of users who view moving images, the number of views, or the viewing time. In order to increase the number of viewing users, etc., it is also effective to have a mechanism that allows viewing users to actively participate in moving images. However, the actual situation is that it is difficult to increase opportunities for viewing users to participate in content only with measures that actors can take.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a mechanism that allows viewing users to participate in content.

A moving image distribution system that solves the above problems is a moving image distribution system that distributes moving images including animations of character objects generated based on the movements of actors, and includes a server that distributes moving images and a device used by a viewing user. and an information processing terminal on which an application for viewing a moving image is installed, wherein the server generates moving image data including the character object and a specific object whose display mode changes multiple times, and the moving image Data is transmitted to the information processing terminal, a message regarding the moving image is received from the information processing terminal, and a display mode of the specific object displayed in the moving image is changed according to the message.

A video distribution system that solves the above problems is a video distribution system that distributes videos including animations of character objects generated based on the movements of actors, comprising: a server that distributes videos; a storage for storing user activities; and an information processing terminal, which is a device used by the viewing user and in which an application for viewing moving images is installed, wherein the server stores the character object and the initial state to the final state. generating moving image data including a specific object whose display mode is irreversibly changed several times up to a form, transmitting the moving image data to the information processing terminal, and displaying the specific object in the moving image according to the activity; to change the display mode of

A video distribution system that solves the above problems is a video distribution system that distributes videos including animations of character objects generated based on the movements of actors, comprising: a server that distributes videos; a storage for storing user activities; and an information processing terminal, which is a device used by the viewing user and in which an application for viewing a moving image is installed, wherein the server stores the character object and a change in display mode. a plurality of times of a specific object; transmitting the video data to the information processing terminal; receiving information about the activity from the information processing terminal; A display mode of the specific object to be displayed is changed, and a synthesized object of the specific object is generated based on the plurality of specific objects and displayed in the moving image.

A video distribution system that solves the above problems is a video distribution system that distributes videos including animations of character objects generated based on the movements of actors, comprising: a server that distributes videos; a storage for storing user activities; and an information processing terminal, which is a device used by the viewing user and in which an application for viewing a moving image is installed, wherein the server distributes the character object and the moving image. generating video data including a specific object that displays video distribution advice for a distributor who wants to distribute the video, transmitting the video data to the information processing terminal, receiving information about the activity from the information processing terminal, A display mode of the specific object displayed in the moving image is changed according to the activity.

A video distribution system that solves the above problems is a video distribution system that distributes videos including animations of character objects generated based on the movements of actors, comprising: a server that distributes videos; a storage for storing user activities; and an information processing terminal, which is a device used by the viewing user and in which an application for viewing a moving image is installed, wherein the server stores the character object and a change in display mode. a specific object performing the above multiple times; transmitting the video data to the information processing terminal; receiving information about the activity from the information processing terminal; When it is determined that a change condition for changing the display mode is satisfied, the display mode of the specific object displayed in the moving image is changed according to date and time information when the change condition is satisfied.
A video distribution system that solves the above problems is a video distribution system that distributes videos including animations of character objects generated based on the movements of actors, comprising: a server that distributes videos; a storage for storing user activities; and an information processing terminal, which is a device used by the viewing user and in which an application for viewing a moving image is installed, wherein the server stores the character object and a change in display mode. a specific object performing the above multiple times; transmitting the video data to the information processing terminal; receiving information about the activity from the information processing terminal; When it is determined that a change condition for changing the display mode is satisfied, information about the external environment is obtained, and based on the obtained information about the external environment, the display mode of the specific object displayed in the moving image is changed. Let

According to the present invention, it is possible to provide a mechanism that enables viewing users to participate in content.

1 is a schematic diagram of a video distribution system according to an embodiment; FIG. FIG. 2 is a schematic diagram schematically showing facilities of a studio that produces moving images distributed by the moving image distribution system. FIG. 2 is a block diagram showing part of the moving picture distribution system; FIG. 2 is a block diagram showing a client device that constitutes the moving picture distribution system; FIG. 2 is a schematic diagram showing the configuration of object data used in the moving image delivery system; The data used in the video distribution system includes (a) content management data, (b) possession list, (c) gift list, (d) posted message, and (e) distributor data. Schematic diagram showing . FIG. 10 is a diagram showing an example of a viewing screen of a moving image distributed to a client device of the moving image distribution system, on which a specific object in an initial state is arranged; FIG. 11 is a diagram showing an example of a moving image viewing screen in which a specific object has changed from the initial state; FIG. 11A is a diagram showing an example of a moving image viewing screen when there are many messages of the first attribute, and FIG. 1B is an example of the screen when there are many messages of the second attribute; FIG. 10 is a moving image viewing screen for explaining a display mode of a specific object of “fruit”; 4 is a flow chart showing a processing procedure of the server of the moving picture distribution system; FIG. 10 is a diagram showing an example of a moving image viewing screen in which a specific object has changed; (a) and (b) show moving image viewing screens when different gift objects are provided the most. 4 is a flow chart showing a processing procedure of the server of the moving picture distribution system; Fig. 10A is an example of a moving picture viewing screen distributed by a first level distributor, and Fig. 7B is an example of a moving picture screen distributed by a second level distributor. 4 is a flow chart showing a processing procedure of the server of the moving picture distribution system; FIG. 11 shows an example of a screen for viewing a moving image on which a specific object including a product is displayed; FIG. By synthesizing the specific object displayed on the screen (a) and the specific object displayed on the screen (b) on the video viewing screen, the specific object displayed on the screen (c) is Diagram showing what is generated.

A video distribution system according to an embodiment of the present invention will be described below with reference to the drawings.
As shown in FIG. 1, the video distribution system 1 includes a client device 10, a server 20, and a studio unit 30. The client device 10, the server 20, and the studio unit 30 are connected via a network 11 so as to be able to communicate with each other. The network 11 includes various networks such as a local area network and the Internet.

In the moving picture distribution system 1, a distributor creates a moving picture using the studio unit 30. - 特許庁Animation includes animation of character objects based on the movements of actors. A character object is an individual such as a virtual person. The created moving image is distributed from the server 20 to the client device 10 used by the viewing user. A distributor may be an actor, an operator of studio unit 30, or otherwise.

An overview of the studio unit 30 will be described with reference to FIG. The studio unit 30 includes a tracking system 31 , controller 40 , main display 41 , sub-display 43 (display device), microphone 44 (see FIG. 3), and supporter computer 45 .

The tracking system 31 acquires information about the movement of actor A. Actor A is, for example, a performing human, an animal, or a moving object. Actor A may be, for example, a robot capable of autonomous movement. The number of actors in the studio room R may be plural.

Tracking system 31 detects at least one of actor A's orientation and position. Also, the tracking system 31 can detect the facial expression of actor A, the position of a virtual camera set in the virtual space, and the like. For example, tracking system 31 includes external sensors 32 , mounted sensors 33 and localization device 35 . These are methods of tracking the mounted sensor 33 using an external sensor, and detect at least one of the orientation and position of the mounted sensor 33 worn by the actor A. FIG.

The wearing sensor 33 is worn on the actor A. A plurality of mounted sensors 33 may be mounted on the actor A. FIG. For example, the wearing sensors 33 are worn on the actor A's left wrist, right wrist, left instep, right instep, waist, and top of the head. The mounting sensor 33 may be mounted on the actor A via a mounting tool. The wearing sensor 33 can be worn on various parts of the actor A. FIG. For example, the wearing sensor 33 may be worn on a finger and detect the movement of the finger. The number of attached sensors 33 attached to the actor A may be five or less, or may be seven or more. Also, the actor A may wear clothes or equipment provided with the wearing sensor 33 .

The mounted sensor 33 cooperates with the external sensor 32 to output information for identifying its own orientation and position to the position identifying device 35 . One of the external sensors 32 in the outside-in method is, for example, a multi-axis laser emitter. The external sensor 32 emits pulsed laser light for synchronization. The mounting sensor 33 has a sensor that detects laser light, and detects its own position and orientation while synchronizing with a synchronization pulse. As the mounting sensor 33, for example, Vive Tracker (registered trademark) and Vive BaseStation provided by HTC Corporation (registered trademark) can be used.

In addition to or instead of the above configuration, the mounting sensor 33 may incorporate a sensor for autonomously specifying the position. For example, the wearable sensor 33 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. Also, the mounted sensor 33 may be a capacitive sensor, a strain gauge sensor, or the like. may be used. Also, the mounting sensor 33 may be capable of detecting at least one of its orientation and position by itself.

Tracking system 31 also includes viewpoint position sensor 36 and camera 37 . The viewpoint position sensor 36 is configured such that its position can be changed by the user. The viewpoint position sensor 36 has the same configuration as the mounting sensor 33 . The viewpoint position sensor 36 outputs information for identifying its orientation and position to the position identifying device 35 via wireless communication or a communication cable. The viewpoint position sensor 36 is set as the viewpoint of the virtual camera in the virtual space. The viewpoint position sensor 36 may be supported by a stand, a gimbal, or a stabilizer, for example. The gimbal may be configured in a shape that can be held by an actor or other person. Camera shake can be suppressed by supporting the viewpoint position sensor 36 with a gimbal or stabilizer.

The camera 37 is arranged so as to capture an image of the actor A's face. For example, the camera 37 is attached to the actor A's head, neck, or the like, or is placed in front of the actor A. The camera 37 continuously images the face of the actor A, acquires imaged data of the face of the actor A, and transmits the imaged data to the server 20 . The camera 37 may be a 3D camera capable of detecting the depth of a person's face.

A microphone 44 is placed at a position where the voice uttered by the actor A can be collected. For example, the microphone 44 is attached to the actor A's head, neck, or the like, or is placed in front of the actor A. The microphone 44 transmits a signal corresponding to the voice to the server 20 .

The controller 40 is operated by the actor A. The controller 40 outputs a control signal according to the operation of the actor A to the server 20 . Also, the controller 40 may incorporate a sensor for autonomously identifying at least one of orientation and position. For example, controller 40 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. In addition to or instead of the above configuration, the controller 40 may be configured to detect at least one of orientation and position in cooperation with the external sensor 32 .

The main display 41 is configured to display moving images generated by the server 20 . The number of main displays 41 may be one, or may be plural as shown. The moving images displayed on the main display 41 include animation of character objects.

Sub-display 43 is configured to display information received from server 20 or supporter computer 45 . The number of sub-displays 43 may be one or plural. Information transmitted from the server 20 or the supporter computer 45 to the main display 41 may include, for example, text information, image information, and various other information. The main display 41 and the sub-display 43 are arranged at positions where the actor A can visually recognize them.

The supporter computer 45 is a computer used by an operator next to the studio room (referred to herein as a "supporter"). For example, since the room where the supporter computer 45 is installed and the studio room R are separated by a glass window, the supporter using the supporter computer 45 can see the actor A. In the illustrated embodiment, supporter B1 and supporter B2 are present in the room. The supporter computer 45 outputs various information to the sub-display 43 according to the operation of the supporter. In this specification, the supporter B1 and the supporter B2 may be collectively referred to as a "supporter" when there is no need to distinguish between the supporter B1 and the supporter B2. The components and functions of studio unit 30 shown in FIG. 2 are exemplary. A studio unit 30 applicable to the present invention may comprise various components not shown. For example, studio unit 30 may include a projector. The projector is capable of projecting moving images to be distributed to the client device 10 or other client devices on the screen.

The server 20 will be described according to FIG. The server 20 is configured to distribute moving images including animations of character objects based on actions of actors to viewing users. A character object included in this moving image may be motion-controlled in the virtual space. The server 20 includes a computer processor 21, a communication I/F 22, and a storage 23 (storage medium).

The computer processor 21 is an arithmetic device that loads an operating system and various programs that implement various functions from the storage 23 or other storage into its memory, and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may realize at least a part of the processing that it executes by circuitry such as ASIC, PLD, FPGA, and MCU. Although computer processor 21 is illustrated as a single component in FIG. 3, computer processor 21 may be a collection of a plurality of physically separate computer processors. In this specification, a program or instructions included in the program described as being executed by the computer processor 21 may be executed by a single computer processor, or may be executed by a plurality of computer processors in a distributed manner. good too. Also, the program executed by the computer processor 21 or the instructions contained in the program may be executed by multiple virtual computer processors.

The computer processor 21 executes the computer-readable instructions contained in the distribution program stored in the storage 23 or other storage to process the motion data processing unit 21A, the animation generation unit 21B, the animation distribution unit 21C, and the user requests. It functions as a processing section 21D, an object processing section 21E, a user information management section 21F, and a purchase processing section 21G. At least part of the functions implemented by the computer processor 21 may be implemented by a computer processor other than the computer processor 21 of the video distribution system 1 . At least part of the functions implemented by the computer processor 21 may be implemented by a computer processor included in the computer included in the studio unit 30, for example.

The motion data processing unit 21A generates body motion data based on tracking information detected by each of the wearing sensors 33 attached to the actor. Body motion data is a time-series digital representation of at least one of the position and orientation of each part of the actor's body. Body motion data is generated as needed over time. For example, body motion data may be generated at predetermined sampling intervals.

The motion data processing unit 21A also generates face motion data, which is a time-series digital representation of facial movements of the actor, based on the photographed data of the camera 37 of the studio unit 30 . Face motion data is generated as needed over time. For example, face motion data may be generated at predetermined sampling intervals.

The moving image generator 21B applies the body motion data and face motion data generated by the motion data processor 21A to predetermined model data included in the model data 23A stored in the storage 23 . Thereby, the moving image generation unit 21B is configured to generate an animation of a character object that moves in the virtual space and whose expression changes.

Furthermore, the moving image generation unit 21B constructs a virtual space using the object data 23B stored in the storage 23, and generates a moving image including the image of this virtual space and the animation of the character object corresponding to the actor A. The moving image generator 21B can set the position of the viewpoint position sensor 36 to the position of the virtual camera, which is the viewpoint of the moving image. Then, the position of the actor A relative to the position of the virtual camera is set as the position of the character object in the virtual space. Therefore, by changing the position or orientation of the viewpoint position sensor 36 to any position or orientation, the actor A can create a wide variety of animations, such as a video of the character object viewed from the left side, a video viewed from the right side, a bird's-eye view video, and the like. It can generate videos. Also, the moving image generator 21B may change the setting information (focus, angle of view, etc.) of the virtual camera based on the position of the virtual camera.

The moving image distribution unit 21C transmits the list of distribution moving images to the client device 10, and distributes the moving images generated by the moving image generation unit 21B. The moving image distribution unit 21C may distribute a moving image shot in the studio room R in real time, or may distribute a previously recorded moving image according to a distribution schedule or the like. The moving image distribution unit 21C may be configured to be able to distribute a plurality of moving images in the same time slot. For example, the video delivery unit 21C distributes the delivery video of "character X" played by "actor A1" and the delivery video of "character Y" played by "actor A2" at the same delivery start time (for example, "20:00"). ), or may be distributed with overlapping distribution time slots. In response to a list display request from the client device 10 , the moving image distribution unit 21</b>C transmits a list of distributable videos to the client device 10 . Upon receiving a video distribution request from the client device 10, the video distribution unit 21C transmits the selected video to the client device 10 based on the video distribution request.

The user request processing unit 21D receives an object display request and a message display request from the client device 10 of the viewing user, and performs processing according to the display request. A viewing user can transmit an object display request to the server 20 by operating his/her own client device 10 . Objects include gift objects that viewers provide to content. A gift object is an object that becomes a digital gift from a viewing user to an actor or the like. A gift object may be one that can be obtained or requested to be displayed without paying a consideration, or may be one that requires a consideration for acquisition or a display request. Alternatively, the fee may be paid after the display is made in response to the display request. When the viewing user pays for the gift object acquisition or display request, part of it is associated with the distributor, and the remaining part is associated with the operator who provides the video distribution platform. The gift object may be one that is continuously displayed in the virtual space, or one that temporarily adds an effect to the virtual space. The gift object display request may include the user ID of the viewing user and the identification information (object ID) of the object for which the display request is made.

On the other hand, when the user request processing unit 21D determines that the object requested to be displayed requires the determination of the actor or the supporter, the sub-display 43 displays the gift object requested to be displayed. When the actor or supporter issues a display instruction to the gift object for which the display request has been made, the object for which the display request has been made is displayed.

Also, the user request processing unit 21D performs processing for displaying a message received from the client device 10 in a video. The message includes the content of the message, the identification information of the viewing user (user ID or terminal ID), and the date and time of posting.

Upon receiving the message, the user request processing section 21D determines whether or not the message can be displayed. When the user request processing unit 21D determines that the received message can be displayed, the message is displayed in a predetermined area of the moving image via the moving image generating unit 21B. The user request processing unit 21D also displays the message and the attribute information of the message on the sub-display 43. FIG.

Further, the object processing unit 21E changes the display mode of a specific object (growth object) other than the character object when the change condition is satisfied. A specific object is an object that changes its display mode multiple times. The specific object may be an object that changes its display mode according to its life cycle, such as an object imitating a living thing such as a plant or an animal. Alternatively, the specific object may be an object imitating something other than a living thing. A specific object imitating a plant, for example, changes to a state of "seed", "bud", "flower", "fruiting", and "withering" each time a change condition is satisfied.

The specific object may be given at a predetermined timing by the studio operator. Alternatively, the specific object may be given as a gift from the viewing user to the character. Alternatively, a specific object may be granted to a broadcaster by an actor participating in an event that runs within the animation. In a mode in which the viewing user gives the distributor a specific object as a gift to the character, the viewing user can be involved in the content of the moving image. Therefore, the viewing user is motivated to purchase the specific object.

Also, the object processing unit 21E analyzes the content of each message sent from the viewing user. A dictionary in which a plurality of words are registered is stored in the storage 23, and the object processing unit 21E extracts a word included in the message and compares the word with the dictionary. Attributes are assigned to the words stored in the dictionary. For example, an attribute such as "positive (first attribute)" is assigned to positive phrases such as "like" and "cute". Moreover, an attribute such as "negative (second attribute)" is assigned to negative phrases such as "hate" and "painful". The object processing unit 21E determines the attribute to which each of the messages sent within the predetermined period belongs by searching the dictionary and identifying the attribute of the word/phrase that matches the extracted word/phrase. The message attributes may be determined by other methods, such as based on a predetermined symbol included in the message.

When the attribute of the message is determined, the object processing unit 21E updates the counter set for each attribute to calculate the number of messages of each attribute. In addition to the number of messages, the number of words with the first attribute and the number of words with the second attribute included in the messages may be counted. Alternatively, even words belonging to the same attribute may be weighted according to the words. For example, "cute" is set to "1 point" and "favorite" is set to "2 points", and these points may be totaled. Also, there may be messages that do not belong to any attribute.

The purchase processing unit 21G receives from the client device 10 a request to display a purchased medium such as a gift object related to the distributed moving image by the viewing user's operation. After receiving the display request for the purchased medium, the purchase processing unit 21</b>G transmits information on the purchased medium to the client device 10 . The purchase medium information may include the type of purchase medium, the image of the purchase medium, the price, and various information necessary for purchase. The viewing user confirms the information on the purchased media displayed on the client device 10 and selects an arbitrary purchased medium. When the viewing user selects a purchase medium, the client device 10 transmits a purchase request for the purchase medium to the server 20 . The purchase processing unit 21G performs settlement processing based on the purchase request. When this settlement process is completed, the purchased medium is stored in the server 20 as owned by the viewing user. In addition to the gift object, the purchase medium may be an object other than the gift object related to viewing a moving image, or viewing conditions such as the image quality of the moving image, a two-dimensional image, or a three-dimensional image. Alternatively, the purchased medium may be the moving image itself. Sales of purchasable gift objects and other media are shared with distributors. At this time, a part of the sales may be distributed to the operator of the studio unit 30.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver, or a combination thereof. Server 20 can transmit and receive data to and from other devices via communication I/F 22 .

Storage 23 is a storage device accessed by computer processor 21 . The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices capable of storing data. Various programs can be stored in the storage 23 . At least part of the programs and various data that can be stored in the storage 23 may be stored in a storage that is physically separate from the server 20 .

The storage 23 stores model data 23A, object data 23B, content management data 23C, possessed lists 23D, gift lists 23E, and posted messages 23F. In addition, the storage 23 may store moving images that are being distributed or have already been distributed by the moving image distribution system 1 .

Next, the locating device 35 and the supporter computer 45 of the studio unit 30 will be further described. The locating device 35 of the studio unit 30 includes a computer processor 35A, storage 35B (storage medium), and communication interface (I/F) 35C. The computer processor 35A, like the computer processor 21 of the server 20, is various arithmetic units such as a CPU. The storage 35B, like the storage 23 of the server 20, is various storage devices such as magnetic disks. A communication interface (I/F) 35C, like the communication interface 22 of the server 20, is various drivers, software, or a combination thereof for communicating with other devices. The computer processor 35A acquires tracking information from the external sensors 32 or the mounted sensors 33 and identifies the positions of the mounted sensors 33 by executing a position detection program stored in the storage 35B or other storage. Further, the computer processor 35A acquires tracking information from the external sensor 32 or the viewpoint position sensor 36 by executing a position detection program stored in the storage 35B or other storage, and identifies the position of the viewpoint position sensor 36. do. The position specifying device 35 also transmits the specified position to the server 20 .

The supporter computer 45 has a computer processor 46 , a communication I/F 47 , a storage 48 (storage medium), a display 49 and an input interface 50 .

The computer processor 46, like the computer processor 21 of the server 20, is various arithmetic units such as a CPU. The communication I/F 47 is, like the communication I/F 22, various drivers, software, or a combination thereof for communicating with other devices. The storage 48 is, like the storage 23, various storage devices such as magnetic disks that can store data. Various programs are stored in the storage 48 . The display 49 is a liquid crystal display, an organic EL display, an inorganic EL display, or any other display device capable of displaying images. The input interface 50 includes any pointing device that accepts input from a supporter such as a mouse and keyboard.

The computer processor 46 functions as a display control section 46A and a progress management section 46B by executing computer-readable instructions included in programs stored in the storage 48 or the like. At least part of the functions implemented by the computer processor 46 may be implemented by a computer processor other than the computer processor 46 of the video distribution system 1 . Also, at least some of the functions implemented by computer processor 46 herein may be implemented by computer processor 21 of server 20, for example.

The display control unit 46A displays, on the main display 41 or the sub-display 43, a screen that can be viewed by the actor but cannot be viewed by the viewing user, in response to various operation inputs by the supporter via the input interface 50. Also, it is configured to add various additional information to the distribution video distributed to the viewing user.

Next, referring to FIG. 4, the client device will be described.
The client device 10 is an information processing device such as a smart phone. The client device 10 is a mobile phone, a tablet terminal, a personal computer, an electronic book reader, a wearable computer including a head-mounted display, a game console, and other various information processing devices capable of reproducing moving images, in addition to smartphones. good too.

The client device 10 includes a computer processor 12 , a storage 13 (storage medium), an input interface (I/F) 14 (input unit), a communication interface (I/F) 15 and a display 16 . The computer processor 12, like the computer processor 21 of the server 20, is various arithmetic units such as a CPU. The storage 13, like the storage 23 of the server 20, is various storage devices such as magnetic disks. The storage 13 stores an application program for viewing moving images distributed from the server 20 . The input I/F 14 is an arbitrary input interface such as a touch panel that receives input from the viewing user. The communication I/F 15, like the communication I/F 22, is various drivers, software, or a combination thereof for communicating with other devices. The display 16 is, for example, an organic EL display integrated with a touch panel, a liquid crystal display, or any other display device capable of displaying images.

The client device 10 activates a viewing application program (also referred to as a native program) installed in the client device 10 by accepting a viewing user's operation via the input I/F 14 . The viewing application may at least be capable of viewing, and may have other functions. The computer processor 12 executes readable instructions contained in the viewing application program to retrieve the list of broadcast videos from the server 20 . The client device 10 displays the transmitted list on the display. The viewing user selects one of the videos displayed in the list. Upon receiving the selection operation of the viewing user, the client device 10 transmits to the server 20 a moving image distribution request requesting distribution of the selected moving image. Alternatively, the client device 10 accesses the server 20 to activate the web browser stored in the storage 13 and display a web page written in a markup language such as HTML or XML on the display 16. may be configured. The web page displays a list of videos. Alternatively, the client device 10 may use both the viewing program and the web browser (in-app browser) stored in its own storage 13 to display the video list.

When the client device 10 receives the moving image data from the server 20, the client device 10 displays the moving image on the display 16 based on the received data. The viewing user can input a message regarding the distributed video via the input I/F 14 of the client device 10 and post this message to the server 20 . The message posted by each viewing user may be displayed superimposed on the video. This facilitates interaction between actors and viewing users, and interaction between viewing users.

Next, various data stored in the storage 23 of the server 20 will be described. The model data 23A is model data for generating character animation. The model data 23A may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 23A includes, for example, rig data (sometimes referred to as "skeleton data") indicating the skeleton of the character, and surface data indicating the shape and texture of the surface of the character. The model data 23A can include a plurality of different model data. The plurality of model data may have rig data different from each other, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data. In the illustrated embodiment, the model data 23A has at least two different types of model data for generating character objects corresponding to actors. The moving image data distributed to the client device 10 may be two-dimensional moving image data or three-dimensional moving image data. For example, the server 20 may generate 3D video data based on the action of the actor, convert it into 2D video data, and distribute it to the client device 10 .

The object data 23B includes asset data for constructing a virtual space that constitutes a moving image. The object data 23B includes data for drawing the background of the virtual space that constitutes the moving image, data for drawing various objects displayed in the moving image, and data for drawing various objects displayed in the moving image. Contains data. The object data 23B may include object position information indicating the position of the object in the virtual space. The object data 23B may include data (components) for causing physical behavior of the object. This data may include setting data as to whether or not to collide with other objects, and data such as coefficient of friction and coefficient of restitution. For example, if setting data for colliding an object with another object is included, it is determined that the objects have collided when the positional relationship with the other object to collide satisfies a predetermined positional relationship, and the objects collide with each other. They repel or one of them rebounds. On the other hand, if setting data for preventing an object from colliding with another object is included, the object will not collide with the other object even if the positional relationship with the other object satisfies a predetermined positional relationship.

In addition to the above, the object data 23B may include gift objects that are displayed in moving images based on display requests from the viewing user of the client device 10 . Gift objects can include effect objects, decoration objects, and normal objects. An upper limit may be set on the number of objects that can be purchased or the purchase price of the objects.

The effect object is an object that affects the impression of the entire viewing screen of the distributed moving image, and is, for example, an object that imitates confetti, an object that imitates fireworks, or the like. The confetti-like object may be displayed on the entire viewing screen, thereby changing the impression of the entire viewing screen before and after the display. For example, an effect object may be represented by a particle system representing an event composed of moving particles. In the particle system, the display time may be set for each particle. An effect object may be a static object or a dynamic object. Effect objects may be displayed so as to overlap with character objects, but differ from decoration objects in that they are not displayed in association with specific parts of character objects.

A decoration object is an object displayed on the display screen in association with a specific part of the character object. The decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. A decoration object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover part or all of the specific part of the character object.

Decoration objects are, for example, accessories (headbands, necklaces, earrings, etc.), clothes (T-shirts, etc.), costumes, and other objects that can be worn on character objects. The object data 23B corresponding to the decoration object may include attachment position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decoration object can indicate on which part of the character object the decoration object is mounted. For example, when the decoration object is "cat ears", the attachment position information of the decoration object may indicate that the decoration object is attached to the "head" of the character object. When the decoration object is a "ring", the attachment position information of the decoration object may indicate that the decoration object is attached to the "finger" of the character object.

The decoration object is added to the list stored by the server 20 in the storage 23 or other storage, and then attached to the character object by being selected by an actor or a supporter. The viewing user feels a sense of familiarity with the character object by having the character object wear the decoration gift object sent by the viewing user. On the other hand, even if the viewing user makes a display request for a decoration object, the decoration object is not attached to the character object unless it is selected by the actor or the supporter. When the actor selects a decoration object, the actor confirms the list displayed on the sub-display 43 and selects the decoration object by using a pointing device such as the controller 40 or by instructing the supporter. Also, the supporter confirms the list displayed on the supporter computer 45 and selects a decoration object using the input interface 50 .

A normal object is a gift object other than a decorative object placed as an object in the virtual space, such as a stuffed toy or a bouquet of flowers. A normal object may be displayed so as to overlap with a character object, but differs from a decoration object in that it is not displayed in association with a specific part of the character object. A regular object may differ in that a regular object can have its position changed by an actor, whereas an effect object cannot have its position changed by an actor. Also, the normal object and the effect object may have different display times.

A display time corresponding to the type of gift object may be set for each gift object. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object or the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

Further, as shown in FIG. 5, the object data 23B includes drawing data of a specific object. The specific object may be different from the background. For example, for a specific object, one identification information (object ID) is associated with a plurality of drawing data 25A, 25B, 25C, 25D, . . . for drawing the specific object. Each piece of drawing data is associated with information indicating the stage of change (for example, "1" to "5"). The drawing data 25A of "1" is used for the specific object in the initial stage, and when the change condition is satisfied, the drawing data 25B of "2" is used as the specific object in the next stage. An example of the change pattern of the display mode of the specific object is to display according to a series of orders based on the drawing data associated with the information indicating the stage of change. Another example of the change pattern of the display mode of the specific object is one in which the drawing pattern branches at one change stage, and one of the drawing data is used at the branch point. For example, the information indicating the stages of drawing data change is "1", "2A", "2B", and so on. one of the data is selected. When the display mode branches, the pattern of each display mode may be followed, or the same display mode may be returned. Note that the specific object may be drawn on a transparent or opaque backdrop object, or may be drawn between the background and the character object, and the drawing position is not particularly limited.

As shown in FIG. 6(a), the content management data 23C is data that stores at least one of content viewing status and distribution status for each content of the character object. Some contents are distributed over multiple times, and some are finished after one distribution. For example, "distributor A" distributes "content P" with "character P" as the main character a plurality of times.

Another "distributor B" distributes "contents Q" with "character Q" as the main character a plurality of times. Content does not necessarily include animations of different characters. For example, different contents may be configured even if they are moving images of the same character object.

The content management data 23C includes at least one of the number of viewing users, the number of posted messages, the viewing time, and the number of distributions. The number of viewing users is the number of viewing users accumulated from the first distribution to the most recent distribution, the number of viewing users from the most recent distribution, and the number of viewing users from the first distribution to the most recent distribution. The number of viewing users for each distribution, the number of viewing users for the distribution with the fewest number of viewing users from the first distribution to the most recent distribution, the average number of viewing users from the first distribution to the most recent distribution, and the like. The number of message postings is the cumulative number of messages posted from the first delivery to the most recent delivery, the number of messages posted in the most recent delivery, and the number of messages posted in the delivery with the most messages. , the number of message postings in the distribution with the fewest message postings, the average number of message postings from the first distribution to the most recent distribution, and the like. The viewing time is the cumulative viewing time of each viewing user from the first delivery to the most recent delivery, the viewing time of the viewing user at the most recent delivery, and the like.

As shown in FIG. 6B, the owned list 23D is a list of objects owned by the viewing user. The owned list 23D can include identification information (object ID) of owned objects in association with the user ID. Objects held by the viewing user may differ for each content, objects held by the viewing user may be common among different contents, or may include both of them. When the object differs for each content, the list 23D held by the viewing user stores the identification information of the object for each content. This holding list 23D is continuously stored over a plurality of video distributions. Alternatively, the possessed list 23D may be newly generated or reset each time a content for one delivery is distributed.

As shown in FIG. 6(c), the gift list 23E is a list of gift objects associated with content. The gift list 23E is preferably generated or reset each time a moving image is distributed. When the viewing user sends a request to display a gift object in the moving image, information on that gift object is added to the gift list 23E. The gift list 23E includes content identification information, identification information (user ID) of the viewing user who sent the gift object, identification information (object ID) of the gift object, and types of the gift object (decorative object, effect object, normal object). , the date and time of posting, and the selection state of the gift object. The selection state of the gift object indicates whether or not the decoration object is selected by the actor or the supporter when the gift object is the decoration object. As the selection state, data indicating "selected" is stored when the decoration object is selected, and data indicating "unselected" is stored when the decoration object is not selected. If the gift object is not a decoration object, "unselected" or data other than "unselected" and "selected" are stored.

As shown in FIG. 6(d), the posted message 23F may include information regarding the message posted to the video by the viewing user. The posted message 23F may include the identification information (user ID) of the viewing user, the content of the message, and the posted date and time of posting the message for each content. The posted message 23F may be newly generated or reset each time one content is distributed. Also, the posted message 23F may include which attribute the message belongs to, such as "first attribute". If it does not belong to any attribute, the attribute data is not stored.

As shown in FIG. 6(e), the distributor data 23G includes information about the distributor. The distributor data 23G may include distributor identification information (distributor ID), content identification information, and distributor level. Further, the distributor data 23G may include the number of viewing users of the content and the number of distributions of the content. The level of the distributor is determined by the number of viewing users of the content, the number of distributions of the content, the number of registered favorites of the content, and the like. For example, the higher the number of viewing users, the higher the level of the distributor. Alternatively, the level of the distributor may increase as the number of distributions increases.

Next, screens displayed on the client device 10 will be described.
As shown in FIG. 7 , the video viewing screen 105 is displayed on the display 16 of the client device 10 based on the video data transmitted from the server 20 . The video viewing screen 105 displays a virtual space with the viewpoint position sensor 36 as a camera viewpoint, and a character object 110 reflecting the action of the actor. In addition, gift selection sections 112 and 113 and a post selection section 114 are displayed on the video viewing screen 105 . The gift selection unit 112 is an operation unit for displaying the gift object owned by the viewing user in the moving image. When the gift selection section 112 is selected, a list of gift objects held by the viewing user is displayed based on the holding list 23D. When the viewing user selects a gift object from the list, the client device 10 transmits a gift object display request. The gift selection unit 113 is an operation unit for requesting display of a predetermined object such as a “heart” object. The gift selection unit 113 may request display of gift objects that are not included in the holding list 23D. The post selection unit 114 is an operation unit for displaying a message input by the viewing user on the moving image during a message posting period. When the post selection section 114 is selected, a message input field is displayed, and the user inputs a message in the message input field.

When the server 20 receives a message from the client device 10 within the posting period, the server 20 transmits the video data including the message to all the client devices 10 connected to the server 20 . The client device 10 that has received the moving image data causes the message 130 to be displayed within the moving image viewing screen 105 . The message 130 displays the identification information of the viewing user who posted the message and the content of the message.

The messages 130 are arranged in the order of the posted date and time in a predetermined area of the video viewing screen 105 . When the server 20 receives a new message, it moves down the message 130 displayed at the top and displays the new message at the top. A message that reaches the bottom of the message display area moves further downward and is no longer displayed when a new message is added to the top. Alternatively, the message display area may be capable of displaying only one message.

Further, when the server 20 receives a gift object display request from the client device 10 within a period in which the gift object display request can be accepted, the server 20 displays the gift object at a timing corresponding to the type of the gift object. do. Gift objects are normal objects or effect objects. Also, the gift object is a decoration object (for example, “nekomimi”) displayed in association with a predetermined part (top of the head) of the character object 110 .

Also, a specific object is displayed in the moving image as a gift object or other object. The specific object 120</b>A may be requested to be displayed by the viewing user operating the gift selection section 112 . Alternatively, the specific object 120A may be displayed in a moving image by an actor operating the controller 40 or the like or by a supporter operating the supporter computer 45 .

The specific object 120A may be arranged at a predetermined position. Alternatively, the specific object 120A may be arranged at any position in the virtual space by the actor or the supporter. The specific object 120A may be placed at any position within the virtual space, not only on the landing surface of the character object 110 within the virtual space. Also, the specific object 120A may be set as an object that can collide with other objects displayed in the virtual space, or may be set as an object that does not collide. Furthermore, the specific object 120A may be set to avoid collision with a predetermined object. For example, when a plurality of specific objects 120A are arranged in the virtual space, it is not necessary to generate an action associated with collision (contact) between the specific objects 120A. Further, when the specific object 120A collides with another object other than the specific object, the first action is generated, and when the specific object 120A collides with the other specific object, the second action different from the first action is performed. may be generated.

As shown in FIG. 8, when the change condition is satisfied, the specific object 120A changes its display mode and becomes a specific object 120B. Note that the content shown in the figure is for distributing a moving image to the client device over a plurality of distribution times. The animation displaying the specific object of the form was distributed at a different distribution time.

Change conditions are stored in the storage 23 . The change condition may be set for each specific object 120A, or may be set for each drawing data of the same specific object 120A. An example of a change condition relates to the delivery status of moving images. For example, it is that a predetermined period of time has elapsed since the placement of the specific object 120A was started, or that a predetermined number of distributions has been reached. Alternatively, it is that a predetermined period of time has passed since the last growth, or that a predetermined number of distributions has been reached. Specifically, when "24 hours" have passed since the specific object 120A was placed in the virtual space, the specific object 120A can change from a "seed" display mode to a "bud" display mode. Alternatively, in a distribution cycle after a predetermined number of distribution cycles starting from the distribution cycle in which the specific object 120A is arranged in the virtual space, the display mode of the specific object 120A can be changed from the "seed" display mode to the "bud" display mode. . In a state where the specific object is changeable, when a moving image is generated according to the instructions of the distributor, the specific object 120A changes to the next stage specific object 120B.

The change condition may be something other than the distribution status of moving images. For example, it may be a condition related to a viewing user's activity or a viewing situation. Conditions related to video viewing conditions are, for example, that the total number of viewing users who have viewed the content from the first time has reached a predetermined number, or that the number of viewing users who have registered the content in a predetermined category such as "Favorites (Like)" The number of people has reached a predetermined number, the total viewing time of all viewing users from the first time has reached a predetermined time, the latest delivery time from the first time or a message to the content in the predetermined delivery time reaching a predetermined number of messages, the cumulative number of gift objects requested to be displayed reaches a predetermined number, the number of simultaneous viewing users and the number of visits reach a predetermined value, etc. be. Specifically, when the cumulative number of viewing users from the first time reaches "100", the specific object may be changed from a "seed" state to a "bud" state. Moreover, conditions other than these conditions may be sufficient as change conditions.

Since the display mode of the specific object changes as the moving image progresses in this way, the viewing user views the moving image with interest in the change of the specific object. This makes it possible to increase the number of viewing users. In particular, when the display mode of the specific object changes over a plurality of times of distribution, the number of repeaters increases, so the viewing count, viewing time, and the like can be increased.

The change in the display mode of the specific object 120A may branch according to the viewing user's activity or the video distribution status. The viewing user's activities include the posting of a message by the viewing user, a display request for a gift object, and the like. The viewing user activity may be content viewing status (the number of viewing users, viewing time, etc.) as long as it does not overlap with the change condition.

With reference to FIG. 9, a case will be described in which the display mode is branched according to the message posted by the viewing user. The object processing unit 21E of the server 20 analyzes the message 130 and determines whether the content of the message belongs to the first attribute or the second attribute. Also, the number of messages 130 belonging to the first attribute and the number of messages 130 belonging to the second attribute are calculated and compared. Then, the display mode of the specific object 120A is changed according to the attribute with the larger number of messages.

FIG. 9(a) shows the video viewing screen 105 when there are many messages belonging to the first attribute "positive". For example, the specific object 120C is a "cactus" with a "heart" flower.

FIG. 9(b) shows the moving image viewing screen 105 when there are many messages belonging to the second attribute "negative". For example, the specific object 120D is a "cactus" with long "thorns".

Since the activity of the viewing user can be reflected in the display mode of the specific object in this way, the viewing user can actively participate in the content. As a result, communication between the distributor and the viewing users can be facilitated, so that the number of new viewing users or repeaters of the content can be increased. In addition, for example, the actor (character) notifies the viewing user in advance of how the display mode of the specific object changes when there are many messages of each attribute. In order to change the display mode of the specific object, the message will be posted more actively. In addition, since the distributor can talk about the growth of the specific object, it is possible to support the distributor by changing the display mode of the specific object.

Next, with reference to FIG. 10, a state in which the change in the display mode of the specific object has progressed step by step will be described. In the illustrated embodiment, the specific object has changed to a "fruit" display mode. That is, the specific object 120E becomes a display mode including the deliverable 120F. The moving image distribution system 1 may treat the product 120F as an electronic data medium that can be used within the same content or on a platform that distributes the content. At this time, the viewing user or distributor acquires, owns, uses, manages, exchanges, synthesizes, enhances, sells, discards, or donates, etc., through the operation of the client device 10 or the supporter computer 45 . The deliverable 120F may be able to be used as a gift object to the animation or other animation from which the deliverable 120F was generated. The deliverable 120F is, for example, an item with high value such as rarity, an item with the name of the distributor, or the like.

A case will be described where the product 120F of the specific object 120E is given to the viewing user. The object processing unit 21E of the server 20 gives the deliverable 120F, for example, at a harvest event in the moving image. The object processing unit 21E identifies the viewing user who is viewing the harvest event. Furthermore, the data related to the product 120F is added to the possession list 23D of the identified viewing user to associate the product 120F with the viewing user. Data (components) for causing physical behavior may be set in the product 120F. Then, in the harvesting event, the process of causing the product 120F to behave physically may be performed and associated with the viewing user or the like. For example, when the product 120F is harvested, the product 120F may be moved vertically downward in the virtual space as if gravity were acting on the product 120F. Alternatively, when it is determined that the character object's hand or the like and the product 120F collide with each other and the positional relationship between the character object and the product 120F satisfies a predetermined relationship, the character object may hold the product 120F. may be displayed. Furthermore, the character object may place the deliverable 120F at a predetermined position.

Furthermore, a new specific object (product) such as "seed" may be generated from a specific object in the final stage such as "fruit". A new specific object of "seed" may be available for use within the same content or in other content. Alternatively, a new specific object such as a "seed" may be configured to be exchanged, sold, or donated on the platform that distributes the content. In this way, by giving the viewing user a new specific object that can be used by the viewing user, it is possible to increase the merit of giving the specific object to the viewing user.

Further, when a change condition is satisfied for a specific object in the display mode of "fruiting", the specific object may be hidden. Alternatively, it may be hidden through the following display mode such as "wither".

A processing procedure for changing the display mode of a specific object will be described with reference to FIG.
The user request processing unit 21D of the server 20 receives the message transmitted from the client device 10 of the viewing user (step S10). The user request processing unit 21D displays the received message as a moving image.

Also, the object processing unit 21E of the server 20 analyzes the content of the message (step S11). Then, the attribute of the message to be analyzed is determined (step S12). For example, a positive message such as "cute" is determined to belong to "positive (first attribute)". Negative messages such as "dislike" are determined to belong to "negative (second attribute)".

Furthermore, the object processing unit 21E updates the counter for each attribute (step S13). For example, when the object processing unit 21E determines that the message to be determined belongs to the first attribute, the object processing unit 21E increments the counter belonging to the first attribute.

Furthermore, the object processing unit 21E determines whether or not the change condition of the specific object is satisfied (step S14). In addition to the change conditions described above, the change condition may be that the value of the counter is equal to or greater than the threshold.

When the object processing unit 21E determines that the change condition is satisfied (step S14: YES), it changes the display mode of the specific object (step S15). Specifically, the object processing unit 21E reads the object data 23B and changes the display mode of the specific object being displayed to the display mode of the next stage. On the other hand, when the object processing unit 21E determines that it is not the growth timing (step S14: NO), the process returns to step S10 and repeats the above-described processes.

As described above, according to the above embodiment, the following effects are obtained.
(1) In the video delivered to the client device, the display mode of the specific object changes according to the viewing user's activity. That is, the viewing user can actively participate in the content. As a result, it is possible to increase the number of content viewing users, the number of times of viewing, or the viewing time.

(2) The display mode of the specific object changes according to the message posted to the video. As a result, the viewing user can be motivated to post the message, so that the viewing user actively participates in the content.

(3) When the specific object reaches the "fruit" display mode, the product 120F displayed in the specific object is associated with the viewing user. As a result, the viewing user can be motivated to perform an activity that changes the display mode of the specific object to "fruit".

(4) When the specific object is a gift object whose display is requested by the viewing user, the viewing user can actively participate in the content of the moving image. Therefore, it is possible to actively provide gift objects from viewing users.

(Second embodiment)
Next, a second embodiment of the video distribution system will be described. Note that the second embodiment differs from the first embodiment in the process of branching the display mode of the specific object. In the following, parts similar to those of the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

In this embodiment, the display mode of the specific object is branched according to the gift object requested by the viewing user.
As shown in FIG. 12, the moving image viewing screen 105 displays the gift object requested by the viewing user together with the specific object 130B. The object processing unit 21E of the server 20 changes the display mode of the specific object according to the type or attribute of the most common gift object among all the gift objects requested for display or the gift objects displayed in the animation. . For example, the object processing unit 21E compares the number of "star" gift objects G1 and the number of "heart" gift objects G2 among the gift objects requested to be displayed within a predetermined period. The predetermined period may be a period from the start of distribution of the content, a predetermined number of times of distribution, or a predetermined time period set for a predetermined number of times of distribution.

As shown in FIG. 13A, when the number of display requests for the "heart" gift object is greater than the number of display requests for other gift objects, the specific object 130C is displayed in a flowery display mode.

As shown in FIG. 13(b), when the number of display requests for the "star" gift object is greater than the number of display requests for the other gift objects, the specific object 130D has a flower different from the flower that blooms when there are many "hearts". It becomes a blooming display mode.

Referring to FIG. 14, processing for branching the display mode of the specific object according to the type of gift object will be described. The client device 10 transmits the display request to the server 20 when receiving the display request input operation by the viewing user. The object processing unit 21E of the server 20 updates the counter for each gift object when the counter is set for the gift object for which the display request has been made (step S30).

The object processing unit 21E of the server 20 determines whether or not the change condition of the specific object is satisfied (step S31). In addition to the change conditions described above, the change condition may be that the value of the counter is equal to or greater than the threshold. When the object processing unit 21E determines that the change condition is not satisfied (step S31: NO), the process returns to step S30.

On the other hand, when the object processing unit 21E determines that the change condition is satisfied (step S31: YES), based on the value of the counter, it determines the gift object for which the most display requests have been made (step S32). The object processing unit 21E determines, for example, that among the gift objects, "heart" gift objects are the most numerous. Then, the object processing unit 21E changes the display mode of the specific object according to the gift object for which the most display requests have been made (step S33). For example, when the largest number of display requests are made for the "heart" gift object, the specific object is displayed in a flowery display mode.

As described above, according to this embodiment, the following effects can be obtained in addition to at least some of the effects described in the above embodiments.
(5) Since the display mode of the specific object changes according to the gift object with the highest number of display requests, it is possible to motivate the viewing user to change the display mode of the specific object. This allows the viewing user to actively participate in the content.

(Third Embodiment)
Next, a third embodiment of the video distribution system will be described. Note that the third embodiment differs from the first embodiment in the process of changing the display mode of the specific object. In the following, parts similar to those of the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

In this embodiment, the display mode of the specific object is changed according to the distribution status of the moving image of the distributor.
As shown in FIG. 15(a), the specific object 140 is an object for supporting the distributor, and is an object that provides the distributor with advice on video distribution. In the illustrated embodiment, the specific object 140 is a specific object modeled after a tree 140B having display media 140A (hanging scroll, board) displaying advice to the distributor. The display medium 140A describes conversation themes recommended by the management side (for example, "let's introduce ourselves", "let's ask everyone a question", etc.), performance details, and the like.

The object processing unit 21E refers to the distributor data 23G and acquires advice from the storage 23 according to the distributor's level and the video distribution status. Then, the advice is displayed on the display medium 140A. A specific object 150 in the illustrated embodiment is an object on which advice is posted when the level is relatively low.

When using the advice written on the display medium 140A, the actor progresses the delivery of the moving image according to the advice. For example, introduce yourself or pose a question to the viewing user. The object processing unit 21E may erase the display medium 140A after displaying the display medium 140A for a predetermined time.

As shown in FIG. 15B, the object processing unit 21E changes the display mode of the specific object 150 when the change condition is satisfied. For example, the advice written on the display medium 140A is changed to content according to the level of the distributor.

A processing procedure for changing the display mode of the specific object according to the level of the distributor will be described with reference to FIG. The object processing unit 21E of the server 20 acquires the level of the distributor (step S40). The timing for obtaining the level may be when the distribution of the moving image is started or when the distribution of the moving image is finished. The object processing unit 21E determines whether or not the level change condition is satisfied based on the acquired level (step S41). In this case, the change condition is that the level has increased by one step, that the level has reached a predetermined level, or that a predetermined time or a predetermined number of times of distribution has elapsed since the level changed. Alternatively, the change condition may be a condition related to the number of viewing users, a condition related to the action or speech of an actor, or any of the conditions described in the above embodiments. .

When the object processing unit 21E determines that the acquired level does not satisfy the change condition (step S41: NO), the process returns to step S40. When the object processing unit 21E determines that the acquired level satisfies the change condition (step S41: YES), support information for supporting the distributor is displayed (step S42). For example, the display medium 140A of the specific object 150 is changed. After the support information is displayed, the process returns to step S40 and the above-described processing is repeated.

As described above, according to this embodiment, the following effects can be obtained in addition to at least some of the effects described in the above embodiments.
(7) Display the display medium 140A on which advice to the distributor is described as the specific object. As a result, even a distributor who has just started distributing a moving image can perform acting or the like according to the advice, so that it is possible to lower barriers to distribution and continuation of the distribution of the moving image. In addition, even a distributor who distributes videos many times tends to duplicate the content of distribution as the number of distributions increases. Therefore, by incorporating the advice into the video, a video with new content can be distributed.

Each of the above embodiments can be implemented with the following modifications. This embodiment and the following modified examples can be implemented in combination with each other within a technically consistent range.
・As shown in FIG. 17, the specific object 150 has a product 150A whose medium given to the viewing user or the distributor is unknown until the harvest event occurs (eg, Kusudama). good too. The object processing unit 21E displays the medium given to the viewing user or the distributor when the harvest event occurs. For example, an effect is performed such that an object (item, gift object, ticket, etc.) appears from the deliverable 150A of the "kusudama". Then, the object processing unit 21E associates the object obtained from the deliverable 150A with the viewing user or distributor who viewed the harvest event or the moving image including the harvest event. According to this, since at least some of the viewing users will view the product 150A until the content becomes clear, it is possible to increase the viewing count, viewing time, and the like.

• As shown in Figure 18, multiple specific objects may be synthesized. FIG. 18(a) shows a specific object 160A displayed in content distributed by "distributor A". FIG. 18(b) shows a specific object 160B displayed in content distributed by "Distributor B". When the server 20 receives the specific object synthesizing instruction from the terminal used by the distributor and the terminal used by the distributor, the server 20 generates the specific object 160A of "distributor A" and the specific object 160B of "distributor B". By synthesizing, a specific object 160C (FIG. 18(c)) is generated and displayed on the moving image viewing screen 105. FIG. If there are a plurality of specific objects in the content, the distributor may synthesize these specific objects even if they are not specific objects of different distributors. According to this aspect, it is possible not only to change the display aspect of the specific object, but also to have the viewing user expect and be interested in the change in the display aspect due to synthesis.

- In each of the above-described embodiments, the growth process of the specific object is branched according to the viewing user's activity and the video distribution status of the distributor. Alternatively, the growth process of the specific object may be made up of a plurality of non-branching stages. Even in this mode, if the change condition is related to the user's activity, the display mode of the specific object changes according to the viewing user's activity, so the viewing user can actively participate in the content. .

- The server 20 may change the display mode of the specific object according to the date and time information when the change condition of the specific object is satisfied. For example, if the time when the change condition is satisfied is "April", while the display mode of the specific object includes "cherry blossoms", the time when the change condition is satisfied for the specific object under the same conditions is "August" may include "sunflower" flowers. The date and time information is not limited to "year/month/day" but may be "time".

- The server 20 may acquire information about the external environment at that time when the change condition of the specific object is satisfied, and change the display mode of the specific object based on the obtained information about the external environment. . The information about the external environment includes weather, temperature, location information where the client device 10 is located, and the like. The server 20 may acquire information about the external environment from the client device 10 or from an external server. For example, the server 20 acquires the location information from the client device 10 when the change condition is satisfied, and acquires the weather corresponding to the location information from the external server. Then, when the weather corresponding to the location information is "rainy", the server 20 displays a specific object including an umbrella, or dynamically displays raindrop particles or the like around the specific object. may

- In the above embodiment, the display mode of the specific object is changed according to the activity of the actor. Instead of or in addition to this, the display mode may be changed according to the distribution status of the moving image. For example, when the number of deliveries reaches "10", the number of flowers for the specific object is set to "10", and when the number of deliveries reaches "20", the number of flowers for the specific object is set to "20". good.

- One specific object may be displayed in the moving image, or a plurality of specific objects may be displayed.
- In 3rd Embodiment, when the change conditions were satisfy|filled, the support information according to the level of the distributor was displayed. As for the support information, any one of a plurality of support information may be selected according to the state of the actor when the change condition is satisfied. For example, the server 20 stores a plurality of pieces of support information in the storage 23, and the object processing unit 21E acquires information regarding the actor's state when the change condition is satisfied. For example, the object processing unit 21E acquires information about the action of the actor based on various parameters acquired from the wearing sensor 33, such as the movement distance of the actor from the initial position and the number of times the arm is swung. Then, the object processing unit 21E displays support information such as "Let's dance" when it is determined that the movement of the actor is small based on various parameters, and displays support information such as "Let's dance" when it is determined that the movement of the actor is large enough Display different support information or display no support information. Alternatively, the object processing unit 21E calculates the amount of speech or the time during which the actor does not speak (silent) based on the voice of the actor input from the microphone 44 . The object processing unit 21E displays support information such as "Let's sing" when judging that the amount of speech by the actor is small, and displays other support information when it is judged that the amount of speech by the actor is sufficiently large. Display or do not display supporting information.

- The specific object (growth object) may be an object other than the above embodiments. For example, an object (bonsai) that grows when the number of continuous viewing users who continuously view videos delivered in each delivery time reaches a predetermined number ("100 people", "200 people") in stages. etc.

- In one embodiment, a large number of infrared LEDs are mounted on each of the actor and the plurality of mounting sensors 33 mounted on the actor, and the light from the infrared LEDs is projected onto the floor and walls of the studio room R. The position and orientation of each of the mounting sensors 33 may be detected by detecting with an infrared camera. The position and orientation of each mounting sensor 33 may be detected by using a visible light LED instead of the infrared LED and detecting light from the visible light LED with a visible light camera. In this way, each of the plurality of attached sensors 33 attached to the actor is provided with a light emitting unit (for example, an infrared LED or a visible light LED), and the light from the light emitting unit is received by a light receiving unit ( For example, the position and orientation of each mounting sensor 33 may be detected by detecting with an infrared camera or a visible light camera. In one embodiment, a plurality of reflective markers can be used in place of the mounted sensor 33 . Reflective markers are attached to each actor or provided as part of the clothing (suit) worn by the actor. By providing the reflective marker on the actor in this way, the actor is photographed to generate photographed data, and the photographed data is subjected to image processing to detect the position and orientation of the reflective marker. Also, the tracking system 31 may detect the movement of the actor only with the external sensor 32 without using the attached sensor 33 .

- Each above-mentioned embodiment and each above-mentioned modification can each be combined.
The method described in the embodiment can be executed by a computer (computer), for example, magnetic disk (floppy (registered trademark) disk, hard disk, etc.), optical disk (CD-ROM, DVD, MO, etc.), semiconductor It can be stored in a recording medium such as a memory (ROM, RAM, flash memory, etc.), or can be transmitted and distributed via a communication medium. The programs stored on the medium also include a setting program for configuring software means (including not only execution programs but also tables and data structures) to be executed by the computer. A computer that realizes this apparatus reads a program recorded on a recording medium, and in some cases, builds software means by a setting program, and executes the above-described processes by controlling the operation by this software means. The term "recording medium" as used herein is not limited to those for distribution, and includes storage media such as magnetic disks and semiconductor memories provided in computers or devices connected via a network.
Next, technical ideas that can be grasped from the above embodiment and another example will be added below.
[1] A moving image distribution system for distributing a moving image including animation of a character object generated based on the movement of an actor,
a server that distributes videos,
a storage that stores viewing user activity in video distribution;
A device used by the viewing user, comprising an information processing terminal in which an application for viewing a video is installed,
the server
generating video data including the character object and a specific object whose display mode changes multiple times;
transmitting the video data to the information processing terminal;
receiving information about the activity of the viewing user from the information processing terminal;
A video distribution system that changes a display mode of the specific object displayed in the video according to the activity of the viewing user.
[2] The moving image distribution system according to [1], wherein the display mode is changed according to the activity of the viewing user when the server determines that the change condition is satisfied in the moving image.
[3] the information processing terminal transmits a message for the moving image to the server based on the input of the viewing user to the input unit of the information processing terminal;
The moving image distribution system according to [1] or [2], wherein the display mode of the specific object is changed according to the message.
[4] the information processing terminal transmits a gift object display request to the server based on the input of the viewing user to the input unit of the information processing terminal;
The moving image distribution system according to any one of [1] to [3], wherein the server changes the display mode of the specific object according to the gift object.
[5] A moving picture distribution system for distributing a moving picture containing animation of a character object generated based on the movement of an actor,
a server that distributes videos,
a storage that stores the distribution status of video distribution for each content;
A device used by a viewing user, comprising an information processing terminal in which an application for viewing a moving image is installed,
the server
generating video data including the character object and the specific object;
transmitting the video data to the information processing terminal;
A moving image distribution system for changing the display mode of the specific object displayed in the moving image according to the distribution status of the moving image in one of the contents.
[6] The specific object irreversibly changes from the initial form to the final form,
When the specific object reaches the final form, the server displays the display mode of the specific object in the moving image as including a product,
The moving image distribution system according to any one of [1] to [5], wherein the deliverable is stored in the storage in association with a viewing user of the moving image.
[7] The moving picture distribution system according to [6], wherein when the specific object reaches its final form, the server generates a new specific object in an initial form associated with the specific object.
[8] The server associates the new specific object with the viewing user,
receiving, from the information processing terminal used by the viewing user, a request to display the new specific object for a video different from the video in which the new specific object is generated;
The moving picture distribution system according to [7], wherein the new specific object is displayed for the different moving picture based on the display request.
[9] The moving image distribution system according to any one of [1] to [8], wherein the server generates a composite object of the specific objects based on the plurality of specific objects and displays the composite object in the moving image.
[10] The moving image distribution system according to any one of [1] to [9], wherein the server displays, in the moving image, information for supporting a distributor who distributes the moving image as the specific object.
[11] The information processing terminal transmits to the server a request to display the specific object as a gift object for the moving image,
The moving image distribution system according to any one of [1] to [10], wherein the server displays the specific object in the moving image in response to a display request for the specific object.
[12] When a change condition for changing the display mode of the specific object is satisfied, the server changes the display mode according to date and time information when the change condition is satisfied [1] to [11] ].
[13] The server acquires information about the external environment when a change condition for changing the display mode of the specific object is satisfied;
The moving image distribution system according to any one of [1] to [12], wherein the display mode of the specific object is changed based on the acquired information about the external environment.
[14] A video distribution method for distributing a video including animation of a character object generated based on the movement of an actor, using a server for distributing video and an information processing terminal on which an application for viewing video is installed. and
the server
generating video data including the character object and a specific object whose display mode changes multiple times;
transmitting the video data to the information processing terminal;
receiving from the information processing terminal information about an activity of a viewing user using the information processing terminal;
A video distribution method for changing a display mode of the specific object displayed in the video according to the activity of the viewing user.
[15] A video distribution program for a server that distributes a video containing animation of a character object generated based on the movement of an actor,
to the server,
generating moving image data including the character object and a specific object whose display mode changes multiple times;
a step of transmitting the video data to an information processing terminal used by a viewing user;
receiving information about the viewing user's activity from the information processing terminal;
and changing a display mode of the specific object displayed in the moving image according to the activity of the viewing user.
[16] An information processing terminal that displays, on a display, a moving image including animation of a character object generated based on the movement of an actor,
a step of receiving, from a server, moving image data including the character object and a specific object whose display mode changes multiple times, and displaying the moving image data on the display;
sending to the server information about viewing user activity with respect to the video;
and receiving, from the server, video data in which the display mode of the specific object is changed according to the activities of the viewing user and other viewing users, and displaying the data on the display.
[17] A moving image viewing program for an information processing terminal that displays on a display a moving image including animation of a character object generated based on the movement of an actor,
to the information processing terminal,
a step of receiving, from a server, moving image data including the character object and a specific object whose display mode changes multiple times, and displaying the moving image data on the display;
sending to the server information about viewing user activity with respect to the video;
receiving, from the server, moving image data in which the display mode of the specific object is changed according to the activities of the viewing user and other viewing users, and displaying the data on the display.

DESCRIPTION OF SYMBOLS 1... Video distribution system, 10... Client apparatus, 20... Server.

Claims (20)

A moving picture distribution system for distributing a moving picture including animation of a character object generated based on the movement of an actor,
an information processing terminal, which is a device used by a viewing user and in which an application capable of viewing moving images is installed;
A server connected to the information processing terminal,
the server
generating moving image data including the character object and a specific object whose display mode changes multiple times, transmitting the moving image data to the information processing terminal;
recording the activity of the viewing user in a storage unit;
changing the display mode of the specific object when the number of viewing users who have viewed the moving image reaches a predetermined number, or when the total viewing time of all the viewing users reaches a predetermined time;
The information processing terminal
receiving the video data from the server;
A video distribution system for displaying a video based on the video data on a display viewed by the viewing user. The video delivered by the delivery user is delivered multiple times,
the server
A cumulative number of viewing users for each distribution time for videos distributed by the same distribution user is acquired as the number of viewing users, and it is determined whether or not the number of viewing users has reached a predetermined number. 1. The video distribution system according to 1. the server
2. The moving image distribution system according to claim 1, wherein the total number of viewing users who viewed the moving image at the same time is acquired as the number of viewing users, and whether or not the number of viewing users has reached a predetermined number is determined. The video delivered by the delivery user is delivered multiple times,
the server
Obtaining, as the total viewing time, the accumulated viewing time of the viewing user in each delivery time for the video delivered by the same delivery user, and determining whether or not the total viewing time has reached a predetermined time. The moving picture distribution system according to claim 1. the server
5. The moving image delivery system according to claim 1, wherein the display mode of the specific object is changed when the number of viewing users who have registered the moving image in their own category reaches a predetermined number. The information processing terminal transmits a message for the video,
the server
6. The moving image distribution system according to any one of claims 1 to 5, wherein the display mode of the specific object is changed when the number of received messages reaches a predetermined number. The information processing terminal transmits a gift object display request to the server based on the input of the viewing user to the input unit of the information processing terminal,
7. The server according to any one of claims 1 to 6, wherein the server generates moving image data including the specific object whose display mode is changed according to the gift object, and transmits the moving image data to the information processing terminal. video distribution system. the server
obtaining the number of times the display request has been made for each of the different gift objects;
8. The video distribution system according to claim 7, wherein video data is generated in which the specific object is set in a display mode according to the gift object that has been displayed a large number of times, and the video data is transmitted to the information processing terminal. . the server
generating moving image data including the character object and a specific object whose display mode is irreversibly changed from an initial form to a final form multiple times, and transmitting the moving image data to the information processing terminal; 1. The moving picture delivery system according to 1. the server
10. The method according to claim 9, wherein when the specific object reaches the final form, moving image data is generated in which the display mode of the specific object includes a product, and the moving image data is transmitted to the information processing terminal. video distribution system. When the specific object reaches the final form, the server generates video data including the new specific object in the initial form associated with the specific object, and transmits the video data to the information processing terminal. The moving image distribution system according to claim 9 or 10. the server
The video distribution system according to any one of claims 1 to 11, wherein video data including composite objects of said specific objects is generated based on said plurality of specific objects, and said video data is transmitted to said information processing terminal. . the server
generating moving image data including the character object and a specific object for displaying advice on moving image distribution to a distributor who distributes the moving image, and transmitting the moving image data to the information processing terminal; The moving image delivery system according to any one of items 1 and 2. the server
When it is determined that a change condition for changing the display mode of the specific object according to the activity is satisfied, video data including the specific object whose display mode is changed according to date and time information when the change condition is satisfied. and transmits the moving image data to the information processing terminal. the server
When it is determined that a change condition for changing the display mode of the specific object according to the activity is satisfied, information about the external environment is obtained, and the display mode is changed based on the obtained information about the external environment. The moving image distribution system according to any one of claims 1 to 14, wherein moving image data including a specific object is generated and the moving image data is transmitted to the information processing terminal. The information processing terminal transmits to the server a request to display the specific object as a gift object for the moving image,
16. The moving image distribution according to any one of claims 1 to 15, wherein the server generates moving image data including the specific object in response to a display request for the specific object, and transmits the moving image data to the information processing terminal. system. the server
Record the number of distributions of videos of distribution users,
17. The moving image distribution system according to any one of claims 1 to 16, wherein the display mode of the specific object is changed when the number of times of distribution reaches a predetermined number of times. Animation of a character object generated based on the movement of an actor is performed using an information processing terminal, which is a device used by a viewing user and on which an application capable of viewing moving images is installed, and a server connected to the information processing terminal. A video distribution method for distributing a video containing
the server
generating moving image data including the character object and a specific object whose display mode changes multiple times, and transmitting the moving image data to the information processing terminal;
recording the viewing user's activity in a storage unit;
changing the display mode of the specific object when the number of viewing users who have viewed the moving image reaches a predetermined number, or when the total viewing time obtained by accumulating the viewing time of all viewing users reaches a predetermined time; and run
The information processing terminal
receiving the video data from the server;
and displaying a moving image based on the moving image data on a display viewed by the viewing user. A moving image distribution method for a server connected to an information processing terminal, which is a device used by a viewing user and in which an application capable of viewing moving images is installed, comprising:
the server
generating moving image data including a character object and a specific object whose display mode changes multiple times, and transmitting the moving image data to the information processing terminal;
recording the viewing user's activity in a storage unit;
changing the display mode of the specific object when the number of viewing users who have viewed the moving image reaches a predetermined number, or when the total viewing time obtained by accumulating the viewing time of all viewing users reaches a predetermined time; Execute the video delivery method. A server connected to an information processing terminal, which is a device used by a viewing user and in which an application capable of viewing moving images is installed,
generating video data including a character object and a specific object whose display mode changes multiple times, transmitting the video data to the information processing terminal;
recording the activity of the viewing user in a storage unit;
A server that changes the display mode of the specific object when the number of viewing users who have viewed the moving image reaches a predetermined number, or when the total viewing time obtained by accumulating the viewing times of all the viewing users reaches a predetermined time.

Images