JP7001796B1 - Information processing program, information processing method and information processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing program, a method, a device and a server for distributing a moving image which does not make a viewing user bored by appropriately providing an opportunity to display an object provided to a distribution user. SOLUTION: In a moving image distribution system, a control unit of a user device for displaying a moving image on a display has a host avatar object 105A on which the movement of a host user is reflected and a guest avatar object 120 on which the movement of a guest user is reflected. When the video is displayed and the distribution status of the video satisfies the display condition of the provided object, the gift object 125 associated with the host avatar object is displayed and the second gift object associated with the guest avatar object is displayed. In addition, the control unit adds a gift object associated with the other guest avatar object when another guest avatar object corresponding to the other guest user is newly added to the video. [Selection diagram] FIG. 12

Description

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa July 11, 2 Published on the website https: // reality. app /

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa July 10, 2 Published on the website https: // reality. wishflyer. net / notebook / page / e64ZnDwfZMhZ

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa August 2, 2 Published on the website https: // reality. wishflyer. net / notebook / page / wtwSw4m4ZDwt

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa August 17, 2 Published on the website https: // reality. wishflyer. net / notebook / page / mn7wfjVmNdf

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa August 21, 2 Published on the website https: // reality. wishflyer. net / notebook / page / d7PNDZFh4Man

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa August 28, 2 Published on the website https: // reality. wishflyer. net / notebook / page / fZnnfNfSHtw4

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa September 4, 2 Published on the website https: // reality. wishflyer. net / notebook / page / 4dDHj4eNgjwf

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa September 14, 2 Published on the website https: // reality. wishflyer. net / notebook / page / Pgawawadf6Mff

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa September 25, 2 Published on the website https: // reality. wishflyer. net / notebook / page / 3izeHZSm6eaf

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 5, 2 Published on the website https: // reality. wishflyer. net / notebook / page / gVhPwPtwntFz

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 19, 2 Published on the website https: // reality. app / notebook / page / e7nfaNSm4tzf

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // reality. app / notebook / page / SjefMV3wzDaD

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / WFLE_REALITY /

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 12815131493917601795

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 129059558337928591364

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 1289867532355026945

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 1296012784050066432

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 1295308137461714944

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 129821028769390465

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 12967647535535210498

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 13007502483111034888

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 1299030824596666680

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 130184494630560252606? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 13032869677910466558? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 13054227315036434232

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 130582626193338318851? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 130494173666209482241? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 1311591683594960984? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 13150577915310298480? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 131343407408669909? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 131307269265272432417? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 1318814868896677890? s = 20

Application of Article 30, Paragraph 2 of the Patent Act Publication date Reiwa October 22, 2 Published on the website https: // twitter. com / REALITY_app / status / 1319218992523866112? s = 20

The present invention relates to an information processing program, an information processing method, and an information processing system for distributing or viewing moving images.

Conventionally, a video distribution system that distributes a video including an animation of an avatar object based on the movement of a distribution user has been known (see, for example, Patent Document 1). In this type of video distribution system, a function has been proposed in which an arbitrary object is displayed on a moving image in response to a display request transmitted from a terminal used by a viewing user who views the moving image.

JP-A-2015-184689

In the above-mentioned video distribution system, communication between the distribution user and the viewing user is activated by the distribution user reacting to the gift object, and the satisfaction level of the viewing user with the video is increased. There is also an advantage that other viewing users also request the display of the gift object, triggered by the display request of the gift object. Therefore, when the opportunity to display the gift object increases in this way, it is expected that the number of viewing users of the video, the viewing time per viewing user, or the cumulative viewing time accumulated by all the viewing users will increase. ..

By the way, in a video distribution system, many gift objects tend to be displayed in a video distributed by a popular distribution user. On the other hand, videos distributed by distribution users with a small number of viewing users tend to have a small number of gift objects. This tendency is particularly noticeable for beginner users who have a short period of time since the start of video distribution.

On the other hand, it is conceivable to automatically display the gift object in the moving image regardless of the display request of the viewing user. However, simply increasing the opportunities for gift objects that do not depend on display requests will reduce the value of the gift objects. When the value of a gift object decreases, even if the opportunity to display the gift object increases, the viewing user becomes less interested in displaying the gift object, and the effect of increasing the number of viewing users, viewing time, and cumulative viewing time decreases. .. Therefore, it is desired to appropriately provide an opportunity to display the gift object.

A program that solves the above problems displays a computer that displays a moving image on a video, a first avatar object that reflects the movement of the first user, and a second avatar object that reflects the movement of the second user. When the distribution status of the moving image satisfies the display condition of the provided object, the provided object associated with the first avatar object is displayed, and the provided object associated with the second avatar object is displayed. It functions as a second image processing unit to be displayed, and the second image processing unit provides a third avatar object corresponding to the third user in association with the third avatar object when the third avatar object is newly added to the moving image. Add an object.

As an information processing method for solving the above problem, a computer displaying a moving image on a display makes a moving image of a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user. When the first image processing step to be displayed and the distribution status of the moving image satisfy the display condition of the provided object, the provided object associated with the first avatar object is displayed and the provided object associated with the second avatar object is displayed. The second image processing step of displaying the object is executed, and in the second image processing step, when the third avatar object corresponding to the third user is newly added to the moving image, the third avatar object is added to the third avatar object. Add the associated offer object.

The information processing device that solves the above problems is an information processing device that displays a moving image on a display, and is a first avatar object that reflects the movement of the first user and a second avatar that reflects the movement of the second user. When the first image processing step of displaying the object in the moving image and the distribution status of the moving image satisfy the display condition of the provided object, the provided object associated with the first avatar object is displayed and the second avatar object is displayed. In the second image processing step, when a third avatar object corresponding to the third user is newly added to the moving image, the second image processing step of displaying the provided object associated with is executed, and the second image processing step is performed. 3 Add the provided object associated with the avatar object.

The server that solves the above problems is a server connected to a user device that displays a moving image on a display, and has data for drawing a first avatar object that reflects the movement of the first user and data of a second user. The first avatar object when the drawing data transmission step of transmitting the data for drawing the second avatar object to which the movement is reflected to the user device and the distribution status of the moving object satisfy the display condition of the provided object. A display request transmission step of transmitting a request for displaying the provided object associated with the second avatar object together with a request for displaying the provided object associated with the second avatar object is executed, and the display request transmission step is the third. When a third avatar object corresponding to the user is newly added to the moving image, a display request for the provided object associated with the third avatar object is transmitted to the user device.

The information processing method that solves the above problems is an information processing method of a server connected to a user device that displays a moving image on a display, and the server draws a first avatar object that reflects the movement of the first user. The drawing data transmission step of transmitting the data for transmitting the data for drawing and the data for drawing the second avatar object reflecting the movement of the second user to the user device, and the display condition of the provided object for the distribution status of the moving image. When the condition is satisfied, the display request transmission step of transmitting the request for displaying the provided object associated with the first avatar object and the request for displaying the provided object associated with the second avatar object are executed together with the request for displaying the provided object associated with the first avatar object. In the display request transmission step, when a third avatar object corresponding to the third user is newly added to the moving image, a display request of the provided object associated with the third avatar object is transmitted to the user device. ..

According to the present invention, by appropriately providing an opportunity to display an object provided to a distribution user, it is possible to distribute a moving image that does not make the viewing user bored.

The schematic diagram which shows one Embodiment of the moving image distribution system in one Embodiment. The figure which shows the data structure of a part of the user management information of the same embodiment. The figure which shows the positional relationship between the distribution user and the user apparatus in the real world in the same embodiment. The figure which shows the operation direction of the avatar object in the same embodiment. The figure which shows the display method of the gift object of the same embodiment. The figure which shows the display method of the guest avatar object of the same embodiment. The figure which shows the display method of the guest avatar object of the same embodiment. The figure which shows the distribution screen displayed on the user apparatus of the same embodiment. The figure which shows the approval screen of the collaboration delivery displayed on the user apparatus of the same embodiment. The figure which shows the distribution screen at the time of collaboration distribution displayed on the user apparatus of the same embodiment. The figure which shows the delivery screen which includes the gift object displayed on the user apparatus of the same embodiment. The figure which is the screen at the time of collaboration delivery displayed on the user apparatus of the same embodiment, and shows the screen which expressed the emote function. The figure which is the screen at the time of collaboration delivery displayed on the user apparatus of the same embodiment, and shows the screen which expressed one emote function. The figure which is the screen at the time of collaboration delivery displayed on the user apparatus of the same embodiment, and shows the screen which expressed the other emote function. The figure which shows the delivery screen which includes the gift object displayed on the user apparatus of the same embodiment. The chart which shows the display timing of the gift object in the same embodiment. A sequence chart of the procedure for collaborative delivery and display of gift objects in the same embodiment. The flowchart of the procedure of displaying a gift object in the same embodiment. A sequence chart of the procedure for collaborative delivery of variants and display of gift objects. Schematic diagram of the video distribution system of the modified example.

Hereinafter, an embodiment of the moving image distribution system will be described with reference to the drawings. The video distribution system of the present embodiment distributes a video in which an avatar object that moves according to the movement of a user is displayed in a three-dimensional virtual space.

<Video distribution system>
As shown in FIG. 1, the moving image distribution system 11 includes a user device 12 and a server 13. The moving image distribution system 11 is a system that displays a moving image on the user device 12 by transmitting and receiving data between the plurality of user devices 12 and the server 13 via the network 14. A video application program for viewing and distributing a video is installed in the user device 12. Hereinafter, a user who distributes a video is referred to as a "distribution user", and a user who views a video distributed by the distribution user is referred to as a "viewing user". The user is a viewing user when viewing a video, and a distribution user when distributing a video. Further, when no distinction is made between "delivery user" and "viewing user", it is simply referred to as "user".

The user device 12 is a wearable computer such as a smartphone (multifunctional telephone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display, a glasses-type wearable terminal, and information processing capable of reproducing moving images other than these devices. It is a device. The user device 12 may be a stand-alone device that operates independently, or may be composed of a plurality of devices that are connected to each other so as to be able to transmit and receive various data.

The user device 12 includes a control unit 20, a storage 22 (storage medium), and a communication interface (I / F) 23. The control unit 20 includes one or a plurality of arithmetic circuits such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and an NPU (Neural network Processing Unit). Further, the control unit 20 includes a memory which is a main storage device (recording medium) on which the arithmetic circuit can read and write. The memory is composed of a semiconductor memory or the like. The control unit 20 reads the operating system and other programs from the storage 22 or the external storage into the memory, and executes the instruction fetched from the memory. The communication I / F 23 can send and receive data to and from the server 13 and other user devices 12 via the network 14. The network 14 includes various networks such as a local area network and the Internet.

The storage 22 is an auxiliary storage device (recording medium), and is, for example, a storage medium such as a magnetic disk, an optical disk, or a semiconductor memory. The storage 22 can also be used in combination with a plurality of storages. The storage 22 stores a moving image application program 220, avatar data 221 for drawing an avatar object, object data 222, and user management information 223.

The control unit 20 appropriately acquires various data from the server 13 by executing the moving image application program 220. Further, the control unit 20 switches between a distribution mode in which the user receives an instruction from the user and distributes the video by himself / herself and a viewing mode in which the video distributed by another distribution user is viewed by executing the video application program 220. ..

The avatar data 221 is three-dimensional model data for drawing an avatar object. The user device 12 acquires the data for updating the avatar data 221 from the server 13 at a predetermined timing, such as when the moving image application program 220 is started. The avatar data includes data for drawing the avatar object body, texture data applied to the avatar object body, and the like. The data for drawing the avatar object body includes polygon data, skeleton data (bone) for expressing the operation of the avatar object, and the like. The avatar data 221 may include data for drawing a plurality of avatar object bodies. The texture data contains a plurality of part data applicable to the avatar object. For example, a plurality of parts data are prepared for each category such as "eyes", "eyebrows", "ears", and "clothes". The user selects the part data and applies it to the avatar object body to create the avatar object. The combination of the avatar object body and the part data selected by the user is recorded in the storage 22.

The object data 222 is data downloaded from the server 13 at a predetermined timing. The object data 222 is information about an object other than the avatar object. Objects other than the avatar object include an object that can be displayed by the distribution user and a gift object provided by the viewing user to the distribution user. As one of the types of gift objects, there is a wearing object that is displayed on the display screen in association with a specific part of the avatar object. The attached object is, for example, an object that can be attached to an accessory (hat, glasses, etc.), clothes (T-shirt, etc.) attached to the attached object, and an avatar object other than these. Examples of other objects include objects consisting of two-dimensional images such as fireworks and flames and two-dimensional particles, and objects having three-dimensional coordinates imitating stuffed animals and bouquets.

Further, the object may be an object that performs physical behavior. Specifically, the object may simulate physical behavior such as falling due to gravity, motion due to application of force, and the like. A component (program) for simulating physical behavior is executably associated with a physical behavior object.

The user management information 223 includes user identification information (user ID), default avatar object information, and the like. The user management information 223 may include user identification information (user ID), purchase media such as coins, points, distribution status, and the like.

Further, the user device 12 includes a sensor unit 24, a speaker 25, a microphone 26, an operation unit 27, and a display 28. At least one of the sensor unit 24, the speaker 25, the microphone 26, the operation unit 27, and the display 28 may be provided as the same device as the control unit 20, and may be provided in a manner of connecting to the device including the control unit 20. You may.

The sensor unit 24 is one or a plurality of sensors that detect a face motion indicating a change in the facial expression of the user and a body motion indicating a change in the relative position of the user's body with respect to the sensor unit 24. Face motion includes movements such as blinking and opening and closing of the mouth. A known sensor unit 24 can be used. An example of the sensor unit 24 is a ToF sensor that measures and detects the time of flight (Time of Flight) until the light emitted toward the user is reflected on the user's face and returned, and a camera that captures the user's face. It also includes an image processing unit that processes data captured by the camera. Further, the sensor unit 24 may include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared rays. For the RGB camera and the near-infrared camera, for example, True Depth of "iphoneX (registered trademark)", "LIDER" of "iPad Pro (registered trademark)", and other ToF sensors mounted on smartphones are used. It is possible. Specifically, this camera projects tens of thousands of invisible dots (points) on the user's face or the like by a dot projector. Then, the reflected light of the dot pattern is detected and analyzed to form a depth map of the face, and an infrared image of the face or the like is captured to capture accurate face data. The arithmetic processing unit of the sensor unit 24 generates various information based on the depth map and the infrared image, compares the information with the registered reference data, and compares the information with the depth of each point of the face (each point and the near-infrared camera). Calculate the deviation of the position other than the distance) and depth.

Further, the sensor unit 24 may have a function of tracking not only the user's face but also the hand (hand tracking). The sensor unit 24 may further include a sensor other than the above-mentioned sensors such as an acceleration sensor and a gyro sensor. Even if the sensor unit 24 has a spatial mapping function of recognizing an object in the real space in which the user exists based on the detection results of the ToF sensor and other known sensors, and mapping the recognized object to the spatial map. good. Hereinafter, when the face motion detection data and the body motion detection data are described without particular distinction, they are simply referred to as “tracking data”. The image processing unit of the sensor unit 24 may be provided by the control unit 20.

The speaker 25 converts voice data into voice and outputs it. The microphone 26 inputs the voice spoken by the user and converts it into voice data. The display 28 outputs various images in response to the output instruction of the control unit 20. As the operation unit 27, one corresponding to the type of the user device 12 can be used. An example of the operation unit 27 is a touch panel integrated with the display 28, operation buttons provided on the housing of the user device 12, a keyboard, a mouse, a controller operated by the user, and the like. The controller may incorporate various known sensors such as an acceleration sensor and an inertial measurement unit (IMU) such as a gyro. Further, another example of the operation unit 27 may be a tracking device that specifies the movement of the user's hand, the movement of the eyes, the movement of the head, the direction of the line of sight, and the like. In this aspect, for example, a user's instruction is determined based on the movement of the user's hand to start or end video distribution, an evaluation of a message or video, and a display of a predetermined object (for example, a gift described later). Various operations such as requests can be executed. If the sensor unit 24 also has an input interface function such as a hand truck function, the operation unit 27 can be omitted.

The control unit 20 functions as the application management unit 201 and the display control unit 202 by executing the moving image application program 220 stored in the storage 22. The application management unit 201 controls the main control of the video application program. The application management unit 201 acquires the user's request input through the operation unit 27, the request from the server 13, and the like, and outputs the request to the display control unit 202 according to the content of the request. Further, the application management unit 201 transmits a request from the display control unit 202 and various data to the server 13, and transmits the tracking data acquired from the sensor unit 24 to the server 13. Further, the application management unit 201 records various data received from the server 13 in the storage 22.

The display control unit 202 applies the tracking data acquired from the sensor unit 24 to the avatar data 221 in the distribution mode to generate an animation. Further, the display control unit 202 renders the avatar object and objects other than the avatar object. Rendering here refers to drawing processing including acquisition of the position of a virtual camera, fluoroscopic projection, hidden surface erasure (rasterization), and the like. Rendering may be at least one of these processes, or may include processes such as shading and texture mapping. Further, the display control unit 202 generates an animation using the rendered image. Further, the display control unit 202 outputs to the display 28 moving image data in which the animation is combined with the posted message transmitted from the user device 12 of the viewing user, the notification transmitted from the server 13, and the like.

In the distribution mode, the display control unit 202 synchronizes the audio data input from the microphone 26 with the moving image data and outputs the audio data to the display 28. Further, the display control unit 202 encodes the moving image data and the audio data. The application management unit 201 transmits the encoded data to the server 13.

Further, the display control unit 202 applies the tracking data of the distribution user received from the server 13 to the avatar data 221 in the viewing mode to generate an animation. In addition, objects other than the avatar object received from the server 13, posted messages, and the like are combined and output to the display 28. Further, the display control unit 202 synchronizes the audio data received from the server 13 with the moving image and outputs the audio data from the speaker 25.

Next, the server 13 will be described. The server 13 is used by a service provider or the like that provides a service for distributing a moving image. The server 13 includes a control unit 30, a communication I / F 34, and a storage 35. The control unit 30 has the same configuration as the control unit 20 of the user device 12. The control unit 30 may be configured by combining a plurality of arithmetic circuits. Further, the communication I / F 34 and the storage 35 have the same configuration as the user device 12. The server 13 may be composed of one device or may be composed of a plurality of devices. When the server 13 is composed of a plurality of devices, those devices are provided with the functions of the control unit 30 and various data stored in the storage 35 in a distributed manner.

The distribution program 353 is stored in the storage 35. The control unit 30 functions as a distribution management unit 301 and a purchase processing unit 302 by executing the distribution program 353.

The distribution management unit 301 stores various data received from the user device 12 in the storage 35, and outputs the request to the purchase processing unit 302 based on the purchase request received from the user device 12. Further, the distribution management unit 301 acquires the data requested from the user device 12 from the storage 35 or the like and transmits the data to the user device 12. Specifically, the distribution management unit 301 transmits a list of moving images being distributed in response to a request from the user device 12 used by the viewing user. The distribution management unit 301 receives the identification information of the moving image selected from the list from the user device 12. Further, the distribution management unit 301 transmits the tracking data or the like acquired from the user device 12 used by the distribution user of the selected moving image to the user device 12. In addition, the distribution management unit 301 receives a posted message or the like posted by the viewing user for the video being distributed. Further, the distribution management unit 301 transmits the received posted message to the user device 12 of the distribution user and the user device 12 of the viewing user. The posted message includes the content of the message, identification information of the viewing user (user's account name, etc.), posting date and time, and the like. In addition, the message displayed in the video includes a notification message of "User A has entered the room".

The distribution management unit 301 receives a request for displaying an object on the moving image being viewed from the user device 12 used by the viewing user. The object for which the display request is made is an object displayed in the virtual space, and includes a gift object provided by the viewing user to the distribution user who distributes the video, an evaluation object that favorably evaluates the video, and the like. The gift object may be one that can make a display request without paying a consideration, or may make a display request by paying a consideration. Alternatively, the gift object may be one that pays a consideration when the display is made in response to the display request. The distribution management unit 301 transmits a display request for the gift object together with the identification information of the gift object to the user device 12 of the distribution user and the user device 12 of the viewing user. The server 13 said, "User B presented fireworks" at a predetermined timing, such as when the display request for the gift object was received by the server 13, or when a predetermined operation was performed by the distribution user for the display request. Etc. are transmitted to the user device 12 of the distribution user and the user device 12 of the viewing user.

The purchase processing unit 302 performs the purchase processing of the object according to the operation of the user. The purchase process includes a process of paying the consideration (medium) for coins, points, tickets, etc. that can be used in the video application program. In addition, the purchase process may include the process of exchanging, selling, or transferring the object. Further, the purchase processing unit 302 may execute a lottery (gacha) in which a predetermined number of objects are selected from a plurality of objects by paying the consideration. The purchase processing unit 302 records the purchased object in at least one of the user device 12 and the server 13 in association with the user. When a user purchases an object in the distribution mode (or the closet mode before starting distribution), the purchase processing unit 302 may store the identification information of the purchased object in the storage 35 in association with the purchased user. Further, when the user purchases an object in the viewing mode, the purchase processing unit 302 may store the identification information of the purchased object in the storage 35 in association with the distribution user who distributes the moving image. Sales of purchaseable objects are distributed, for example, to distribution users and service providers.

Next, various data stored in the storage 35 of the server 13 will be described. In addition to the distribution program 353, the storage 35 stores user management data 350, avatar data 351 and object data 352.

The user management data 350 is information about a user who uses the moving image application program. The avatar data 351 is data that serves as a master for drawing an avatar object, and is transmitted to the user device 12 in response to a request from the user device 12.

The object data 352 is data that serves as a master for drawing the gift object, and is transmitted to the user device 12 in response to a request from the user device 12. The object data 352 includes data for drawing a gift object such as polygon data, as well as attribute information of the gift object.

Next, the user management data 350 will be described with reference to FIG. The user management data 350 is stored for each user. The user management data 350 includes user identification information (user ID), purchase media such as coins, points, distribution status, and the like. The coin was purchased by the user. Points are given to users at predetermined timings such as when distribution is performed, when an event is participated, or when an object or the like is sold. The delivery status includes identification information of the gift object received by the user while delivering the video, information on the message, and the like. In addition, only one of coins and points may be stored in the user management data 350.

<Gift object>
Next, the gift object will be described. In the present embodiment, the gift object is displayed as a first gift object that is displayed as a trigger for transmission of a display request by the user device 12 used by the viewing user, and a first gift object that is displayed without being triggered by the display request transmitted by the viewing user. 2 Gift objects and are included. The second gift object is displayed on the moving image by the server 13 executing the distribution program 353 when the distribution status of the moving image satisfies the display condition of the second gift object. When the first gift object and the second gift object are described without distinction, they are simply described as gift objects.

An example of the display condition of the second gift object is that the distribution of the moving image is started within a predetermined period. For example, when the moving image is distributed within a predetermined period such as "19:00 to 20:00", the provided object is displayed on the moving image after a predetermined time has elapsed from the time of the moving image distribution. Alternatively, the distribution user may determine the display timing of the second gift object on the condition that the moving image is distributed within a predetermined period. In this case, for example, an operation unit for executing the display of the second gift object may be displayed on the screen, and the second gift object may be displayed when the operation of the operation unit by the distribution user is accepted.

The display condition of the second gift object may be any condition related to the distribution of the moving image. For example, another example of the display condition may be that the cumulative delivery time obtained by accumulating the number of deliveries and the delivery times of a plurality of moving images satisfies a predetermined value. Further, another example of the display condition of the second gift object may be to deliver the moving image using a predetermined avatar object or other object.

In addition, instead of or in addition to satisfying the display condition of the second gift object in the distribution status, the second gift object may be displayed when the display condition of the second gift object is satisfied in the viewing status. good. The viewing status is, for example, the number of viewers, the viewing time per user, the cumulative viewing time obtained by accumulating the viewing times of the viewing users who view the moving image, and the like. The second gift object may be displayed when these are equal to or more than a predetermined value, or the second gift object may be displayed when these are less than a predetermined value.

<Video distribution method>
As the video distribution method, a video distribution method in which the user device 12 used by the distribution user generates and encodes video data and transmits the video data to the user device 12 used by the viewing user, and a video distribution method in which the viewing user in addition to the user device 12 used by the distribution user There is a client rendering method in which the user device 12 to be used acquires data necessary for generating a moving image and generates a moving image. In this embodiment, a method of displaying a moving image on the user device 12 by a client rendering method will be described. It should be noted that the user device 12 used by the viewing user may be a hybrid method in which the user device 12 used by the viewing user renders an object or the like and performs other image processing using the moving image data generated by the user device 12 used by the distribution user, or the moving image on the server 13. It may be a method of generating a video, or another method of distributing a moving image.

<Drawing an object>
Next, a method of drawing the avatar object and other objects in the moving image will be described with reference to FIGS. 3 to 8.

FIG. 3 shows a distribution user 100 and a user device 12 used by the distribution user 100. Here, the user device 12 is a smartphone. The user device 12 set in the distribution mode is referred to as a "distribution user device 12A" for convenience of explanation. The distribution user 100 puts the application program into the distribution mode. Further, the distribution user 100 confronts the distribution user device 12A so that at least his / her face is included in the detection range 101 of the sensor unit 24, and executes the application program. The detection range 101 shown in FIG. 3 is an example and is not limited to the range shown in the figure.

The distribution user device 12A applies the tracking data output from the sensor unit 24 to the avatar data 221 to generate an animation. A moving image of a virtual space including an avatar object is displayed on the display 28 of the user device 12. The relative distance between the virtual camera and the avatar object in the virtual space changes according to the relative distance between the distribution user 100 and the sensor unit 24. In other words, the shorter the relative distance in the real world, the shorter the relative distance between the virtual camera and the avatar object.

FIG. 4 shows an avatar object 105 arranged in the virtual space 102 and a local coordinate system 106 set in the avatar object 105. The local coordinate system 106 is a coordinate system set for each object having three-dimensional coordinates. The world coordinate system 103 is set in the entire virtual space 102. The avatar object 105 operates with reference to the local coordinate system 106 based on the operation of the operation unit 27 of the distribution user 100.

The method of controlling the operation of the avatar object is not particularly limited. For example, when the user swipes the touch panel which is the operation unit 27 of the user device 12 to the right in each of the operation directions 107 in FIG. 4, the avatar object 105 , Rotates in the Z-axis rotation direction 108 about the Z-axis of the local coordinate system. That is, the avatar object 105 rotates to the left with respect to the Z axis of the local coordinate system 106 without changing the standing position. At this time, the avatar object 105 rotates by the amount of rotation according to the length of the swipe operation. Similarly, when the distribution user 100 swipes the operation unit 27 of the distribution user device 12A to the left, the avatar object 105 rotates in the direction opposite to the Z-axis rotation direction 108 about the Z-axis of the local coordinate system 106.

Further, when the distribution user 100 swipes the operation unit 27 of the distribution user device 12A upward, the avatar object 105 rotates in the X-axis rotation direction 109 about the X-axis of the local coordinate system 106. That is, the avatar object 105 looks up in the three-dimensional virtual space in the Z direction of the world coordinate system 103. Similarly, when the distribution user 100 swipes the operation unit 27 of the distribution user device 12A downward, the avatar object 105 rotates in the direction opposite to the X-axis rotation direction 109 about the X axis of the local coordinate system. That is, the avatar object 105 looks below the virtual space in the direction opposite to the Z direction of the world coordinate system 103.

Further, the emote function (expression function) can be applied to the avatar object 105. The emote function is one of the functions that can be expressed by the video application program 220, and is a function that activates the movements and facial expressions of the avatar object, and each layer of the parts such as the hands, arms, and head of the avatar object 105. The component associated with. A predetermined number of basic emote functions such as "clapping", "waving", "joining hands", and "piece" can be applied to the avatar object 105. For example, in "waving", an animation of waving is associated with the "right hand" hierarchy of the avatar object 105. The distribution user 100 performs a predetermined operation on the operation unit 27 and selects one of those emote functions. The distribution user device 12A applies the selected emote function to the avatar object 105 and operates the avatar object 105.

Next, drawing of the gift object will be described with reference to FIG. Each of the gift objects is associated with a display area or display position in the virtual space 102. The display area or display position is represented by the coordinates of the virtual space 102. The display position of the gift object depends on the type of object. For example, the user device 12 displays a gift object 111 such as a "stuffed animal" at any position in the front area 110 of the avatar object 105. The user device 12 or the server 13 randomly selects a display position from the front area 110 of the avatar object 105. At this time, the user device 12 may move the gift object 111 from the upper side to the lower side of the virtual space. Further, the gift object 111 may move in the front area 110 after appearing in the front area 110.

Further, the user device 12 displays the gift object 113 such as a “hanging scroll” at any of a plurality of predetermined display positions 112 in the rear region of the avatar object 105. An order is assigned to the display positions 112. The user device 12 arranges the gift object 113 associated with the display position 112 at the display position 112 selected from the plurality of display positions 112 in order.

The case where the server 13 receives the display request of the gift object 113 which is the object associated with the display position 112 and exceeds the number of the display positions 112 from the user device 12 used by the viewing user will be described. If the server 13 receives the gift object 113 represented by "object 1" and the gift object 113 represented by "object 2" while the gift object is not displayed at the display position 112, the user device 12 is the server. The gift object 113 is displayed in order at each of the display positions 112 according to the instruction transmitted from 13.

Then, when the server 13 newly receives a display request for the gift object 113 indicated by "object 3" and the gift object 113 indicated by "object 4" from the user device of the viewing user in a state where there is no space in the display position 112, the server 13 adds the identification information of those gift objects 113 to the waiting line 114. For convenience of explanation, the waiting column 114 is schematically displayed in FIG. 5, but the gift object 113 added to the waiting column 114 is not displayed on the screen.

The gift object 113 added to the waiting column 114 waits for the order in which it is displayed at the display position 112. The user device 12 hides the already displayed gift object 113 when the non-display condition is satisfied. The non-display condition is that the display time of the gift object 113 reaches a predetermined time, the distribution end time of the video or the predetermined time before the distribution end time is reached, and the operation of hiding the gift object by the distribution user or the viewing user. And so on. For example, when the condition for hiding the gift object 113 of "object 1" is satisfied, the user device 12 hides the gift object 113. As a result, the display position 112 where the gift object 113 was displayed becomes empty. Next, based on the request from the server 13, the user apparatus 12 displays the gift object 113 at the head of the waiting row 114 at the vacant display position 112 as shown by the arrow 115 in FIG. Further, when the gift object 113 waiting in the waiting row 114 remains, the server 13 advances the waiting order as shown by the arrow 116 in FIG.

The gift object 113 added to the waiting line 114 may be only the first gift object, or may be a mixture of the first gift object and the second gift object. When the first gift object and the second gift object are associated with the same display position 112, the identification information of the gift objects is determined by the server 13 at the timing when the display request is received or the second gift object is determined to be displayed. Is added to the waiting column 114.

In another embodiment, the first gift object and the second gift object are associated with the same display position 112, and within the same period, the server 13 receives a display request for the first gift object from the user device 12, and the server 13 receives a display request for the first gift object. If it is determined that the second gift object is displayed according to the distribution program 353, either the first gift object or the second gift object may be prioritized. For example, the server 13 may prioritize the display of the first gift object. In this case, even if the waiting column 114 contains the identification information of the second gift object, the identification information of the first object is assigned in the order before the second gift object, and the identification information of the first object is assigned before the second gift object. It may be displayed in. Similarly, the server 13 may prioritize the display of the second gift object. In this case, even if the waiting column 114 contains the identification information of the first gift object, it may be displayed before the first gift object.

As another embodiment, the second object is not added to the waiting column 114, and the second gift object is displayed after waiting for the display of all the first gift objects included in the waiting column 114 to be completed. good. Specifically, when the server 13 determines that the second gift object is to be displayed, the server 13 stops receiving the display request for the first gift object. At this time, the user device 12 may not display the list of gift objects, or the list of gift objects may be displayed but the gift object may not be selectable.

As another aspect, when it is decided to display the second gift object at the time of starting the distribution of the video, such as when participating in an event, the server 13 is at least the second gift object from the time of starting the distribution of the video. It is not necessary to accept the display request of the first gift object until the end of the display of.

Further, during the period when the second gift object is displayed, all the first gift objects may not be displayed. This is because, for example, the second gift object may be a large one including the background, and the first gift object for which the display request is made does not match the world view of the second gift object, or the first gift object. This is because there is a risk of unintended interference with the avatar object 105 and other objects. In this embodiment, the server 13 may not accept the display request of the first gift object during a predetermined period such as the period during which the second gift object is displayed. Alternatively, the server 13 can accept the display request of the first gift object during the period when the second gift object is displayed, and displays the first gift object when the display of the second gift object is completed. You may do it.

Next, the collaboration distribution (co-starring function) will be described with reference to FIGS. 6 and 7. In collaborative distribution, multiple distribution users can display their avatar objects in one video. In the present embodiment, the distribution user is set to allow or prohibit the collaboration distribution, and the viewing user displays the avatar object corresponding to himself / herself on the video being distributed for which the collaboration distribution is permitted. In participating in the collaboration distribution, the user device 12 used by the viewing user transmits a participation request to the user device 12 used by the distribution user 100 via the server 13. When the distribution user approves the participation request, the distribution user 100 becomes the host user, and the viewing user who made the participation request becomes the guest user.

FIG. 6 schematically shows an avatar object (hereinafter, host avatar object 105A) corresponding to a host user and an avatar object (hereinafter, guest avatar object 120) corresponding to a guest user. The host avatar object 105A corresponds to the first avatar object, and the guest avatar object 120 corresponds to the second avatar object.

The number of guest avatar objects 120 that can co-star with the host avatar object 105A (hereinafter referred to as the number of co-stars) is predetermined. When the server 13 receives from the user device 12 more display requests than can be co-starred in the same period, the guest avatar object 120 is displayed in the order of accepting the display requests. First, the guest avatar object 120 for which the display request is received first is displayed at the display position 121 such as next to the host avatar object 105A. Then, the identification information of the guest avatar object 120 for which the display request has been received is added to the co-star waiting column 122. In FIG. 6, the identification information of the guest avatar object 120 indicated by “guest 2” and the identification information of the guest avatar object 120 indicated by “guest 3” are added in order. For convenience of explanation, the co-star waiting row 122 is schematically displayed in FIG. 6, but the guest avatar object 120 added to the co-star waiting row 122 is not displayed on the screen.

Further, in the case of collaborative distribution, the second gift object 125 can be displayed in association with the host avatar object 105A and the guest avatar object 120. For example, the second gift object 125 may be a wearing gift object attached to the host avatar object 105A and the guest avatar object 120. Further, the second gift object 125 may be an emote function or an emote function and an object applied to the host avatar object 105A and the guest avatar object 120. The emotes function provided as the second gift object is an emotes function other than the above-mentioned basic functions.

For example, the emote function as the second gift object may be a function of lifting, shaking, and manipulating the emote object 125A, which is also the second gift object. Specifically, the emote object 125A is associated with the hierarchy of the hands, arms, etc. of the avatar object, and the animation of the part is associated with it. For example, lifting the emote object 125A, which is the "mug" of the avatar object, waving the "flag", shooting the "gun", and the like. Since the emote function other than the basic function requires a relatively large amount of man-hours to be newly created by the service provider, etc., it has added value in the application compared to other gift objects such as "glasses". Is high. For example, when the emote function is provided as the first gift object, the consideration for coins and the like is higher than that of the first gift object other than the emote function. Especially for novice users, it is rare that the emote function is provided as the first gift object. However, by providing the distribution user 100 as the second gift object, the distribution user 100 can experience the emote function other than the basic function regardless of the popularity or the number of viewing users. The emote function as the second gift object 125 may be associated with the avatar object 105 even before the emote function is manifested. When the emote function is provided, the user apparatus 12 receives from the server 13 the identification information designating the emote function and the command for expressing the emote function. Then, the user apparatus 12 sets the emote function into a state in which it can be expressed at a predetermined timing based on the received identification information and the command of the emote function. As described above, by downloading the components of various emote functions in advance, the user device 12 reduces the amount of communication when the emote function is provided as the second gift object 125 during the moving image distribution. Therefore, it is also possible to express the emote function immediately after the emote function is provided as the second gift object 125.

Further, in the emote function, the avatar object 105 to be applied is set. For example, even if the emote function has the same "lifting mug" operation, the gender (female, male) set in the avatar object 105 may be set as the application target. Alternatively, the emote function may be applied to the age (children, adults), height, race, and type (humans, animals) of the avatar object 105. The guest avatar object 120 exits from the screen and is hidden when the exit condition is satisfied. The exit conditions are that the display time elapsed from the time when the host avatar object 105A starts co-starring reaches a predetermined time, the distribution user or the viewing user performs an operation to exit the guest avatar object 120, and the like.

As shown in FIG. 7, when the exit condition of the guest avatar object 120 is satisfied, the user device 12 causes the guest avatar object 120 to exit from the display position 121 as shown by the arrow 126. As a result, the display position 121 where the guest avatar object 120 was displayed becomes empty. As shown by the arrow 127, the user device 12 causes the guest avatar object 120 at the head of the co-star waiting row 122 to be displayed at the vacant display position 121. The guest avatar object 120 displayed in place of the exited guest avatar object 120 corresponds to the third avatar object. In the example shown in FIGS. 6 and 7, the guest avatar object 120 of "guest 2" is displayed at the display position 121. Further, as shown by the arrow 128, the server 13 advances the order of the gift objects waiting in the co-star waiting line 122, if any. In the examples shown in FIGS. 6 and 7, the order of the guest avatar objects 120 of "guest 3" is advanced.

When the guest avatar object 120 is displayed in association with the second gift object 125, the user device 12 hides the second gift object 125 at the same time as the guest avatar object 120 leaves. The second gift object 125 may be moved off the screen together with the guest avatar object 120, or may be extinguished and hidden immediately after the exit condition is satisfied.

Then, when the new guest avatar object 120 is displayed, the user device 12 newly displays the new second gift object 125 in association with the guest avatar object 120. For example, if the second gift object has an emote function, the emote function is associated with the new guest avatar object 120. At this time, the user device 12 associates the same second gift object 125 with each of the guest avatar objects 120. It should be noted that the provided emote function does not have to be accompanied by the display of the object. In this case, the emote function is a directing gift.

As another aspect, the user apparatus 12 may change the second gift object 125 for each guest avatar object 120 based on the request of the server 13. At this time, the server 13 selects one or a plurality of second gift objects 125 from the object group including a plurality of different second gift objects 125, and displays the selected second gift object 125 in association with the guest avatar object 120. You may. In this aspect, when the server 13 displays the guest avatar object 120 by using the data in which the guest avatar object 120 and the second gift object 125 are previously associated with each other, the server 13 displays the second gift associated with the guest avatar object 120. The object 125 may be displayed. Alternatively, the second gift object 125 may be displayed based on the attribute information of the guest avatar object 120. The attribute information is not particularly limited, but may be the group to which the guest avatar object belongs, the rarity, the height, the gender, the set age, and the like. For example, the female guest avatar object 120 may display the second gift object 125, which is a female wearing object. Further, the server 13 may select the second gift object 125 by using a predetermined lottery method such as a method using a random number.

Alternatively, the user device 12 displays the second gift object 125 in association with at least one of the host avatar object 105A and the guest avatar object 120 only when the moving image is delivered using the specific host avatar object 105A. May be good. Further, the user device 12 may display the second gift object 125 in association with the second gift object 125 only when the specific guest avatar object 120 co-stars. That is, when the guest avatar object 120 other than the specific guest avatar object 120 co-stars, the second gift object 125 is not displayed, and when the specific guest avatar object 120 co-stars, the guest avatar object 120 is displayed. The second gift object 125 is associated and displayed. The guest avatar object 120 associated with the second gift object 125 may be posted as one of the events on, for example, the notification screen or the home screen of the application program. Alternatively, is the guest avatar object 120 associated with and displayed with the second gift object 125 not notified in advance, and is the second gift object 125 given to the guest avatar object 120 until it co-stars with the host avatar object 105A? You may not know whether or not.

As another aspect, a part or all of the second gift object 125 associated with and displayed with the host avatar object 105A may be given to the host user corresponding to the host avatar object 105A. Further, a part or all of the second gift object 125 displayed in association with the guest avatar object 120 may be given to the guest user corresponding to the guest avatar object 120. In this embodiment, the server 13 updates the user management information 223 and the user management data 350 corresponding to the user with a part or all of the second gift object 125 available. The user device 12 of the user to which the object as a gift or the action is given can accept the input operation by the user, display the object in the virtual space 102, or apply the action to the avatar object 105.

<Screen configuration>
Next, the distribution screen displayed on the user device 12 will be described with reference to FIGS. 8 to 15.
FIG. 8 is a distribution screen 150 displayed on the distribution user device 12A. The display 28 of the user device 12 of the viewing user displays the same animation, although the operation buttons and the like are different.

The face of the avatar object 105 changes with the change of the facial expression of the distribution user, and the head of the avatar object 105 moves with the movement of the head of the distribution user. Further, as described above, the position of the avatar object 105 changes according to the change in the relative distance between the distribution user 100 and the sensor unit 24. The message 151 is displayed on the distribution screen 150 for a predetermined period. The message 151 includes a message transmitted from the user device 12 of the viewing user and a message automatically transmitted by the server 13. Further, various operation units are displayed on the distribution screen 150. For example, the comment button 152, the voice switching button 153, the game button 154, and the external moving image display button 155 may be displayed on the distribution screen 150. When the comment button 152 is selected, the distribution user can input a comment. The entered comment is displayed in the video. When the voice switching button 153 is selected, the voice input can be switched. If you select the game button 154, you can start the game in the video. When the external moving image display button 155 is selected, the operation of acquiring the moving image can be started from the external server or the server 13. When the collaboration setting button 156 is selected, a screen for setting the collaboration distribution can be displayed. Further, the distribution screen 150 may display a button for selecting an object that can be displayed in the moving image based on the object data 352 of the distribution user. Further, the distribution user can select the distribution user corresponding to the plurality of avatar objects 105 or the avatar object 105 displayed in the video as the target for giving the gift when the gift is given by the viewing user during the collaboration distribution. You may do so. The viewing screen displayed on the user device 12 of the viewing user includes a message input field, a display request transmission button for requesting the display of the gift object, and a button for requesting co-starring.

FIG. 9 is a distribution screen 160 displayed on the distribution user device 12A. When the viewing user performs an operation for transmitting the participation request using the user device 12, the approval request window 162 is displayed on the distribution screen 160. In the approval request window 162, a wait button 163 for waiting (denying) approval and an approval button 164 for approving are displayed. When the approval button 164 is selected, the server 13 adds the identification information of the avatar object corresponding to the user who requested the participation to the co-star waiting column 122 of the collaboration distribution, and creates the participation list of the collaboration distribution.

FIG. 10 shows an example of the collaboration distribution screen 170 displayed on the distribution user device 12A. A similar screen is displayed on the display 28 of the user device 12 of the viewing user. On the collaboration distribution screen 170, the host avatar object 105A of the host user and the guest avatar object 120 of the guest user are displayed. The guest avatar object 120 is displayed at the display position 121 next to the host avatar object 105A.

Next, an example in which the second gift object 125 is displayed will be described with reference to FIGS. 11 to 15. The second gift object 125 may be displayed from the start of distribution of the moving image, or may not be displayed at the start of distribution of the moving image, and may be displayed in the middle of the moving image. When displaying the second gift object 125 in the middle of the video, if there is a big difference between before and after displaying the second gift object 125 and it is unnatural to display it suddenly, the second gift object 125 The standby screen may be displayed between before and after the display of.

FIG. 11 shows a distribution screen 180 on which a second gift object displayed on the distribution user device 12A is displayed. A similar screen is displayed on the display 28 of the user device 12 of the viewing user. The second gift object 125 here includes an animation of the background 125B of the "night sky" and the fireworks object 125C. It should be noted that the first gift object cannot provide the background 125B and the fireworks object 125C that matches the background 125B. For example, the distribution user 100 swipes the touch panel, which is the operation unit 27, in accordance with the display of the second gift object 125, rotates the avatar object 105 to the left when viewed from the avatar object 105, and moves the head upward. It can be rotated to look up at the fireworks object 125C.

The second gift object 125 including the fireworks object 125C has, for example, its display condition set to participate in the event of the distribution user 100. The distribution user can participate in the event by starting the distribution of the video within a predetermined period in which the event is held. The event may also be synchronized with the duration of the real-world fireworks display.

12 and 13 show a distribution screen 190 in which the emote function is provided as the second gift object 125 in the collaboration distribution. A similar screen is displayed on the display 28 of the user device 12 of the viewing user. As shown in FIG. 12, the distribution screen 190 includes a background 191 of the "camp" as the second gift object 125. The background 191 may be a two-dimensional image or may be composed of a plurality of three-dimensional objects. In addition to the host avatar object 105A and the guest avatar object 120, the distribution screen 190 also displays the emote object 125A associated with the host avatar object 105A and the emote object 125A associated with the guest avatar object 120 as the second gift object 125. include. Further, the distribution screen 190 may include, as the second gift object 125, a wearing object 193 mounted on the host avatar object 105A and the guest avatar object 120 and corresponding to the background 191. For example, the host avatar object 105A and the guest avatar object 120 may be provided with clothing related to "camping" as wearing objects. This wearing object is displayed even if the host user and the guest user do not have the wearing object.

The emote function in the scene of the distribution screen 190 is to lift the "mug" which is the emote object 125A and perform the "toast" operation, to lower the arm while holding the "mug", and to drink a drink with the "mug". To do, put a "mug" on a table or the like. When the host user or the guest user performs a predetermined input operation such as pressing and holding the distribution screen 190, the emote function selection unit 192 is displayed. The emote function selection unit 192 can select each of the emote functions. For example, when the host user operates the operation unit 27 of the user device 12 to select the emote function, the emote function is applied to the host avatar object 105A. When the guest user operates the operation unit 27 of the user device 12 to select the emote function, the emote function is applied to the guest avatar object 120. The emote function selection unit 192 corresponds to the selection operation unit.

Further, the operation of the avatar object 105 provided by the emote function may be performed within the operable range determined with respect to the position of the avatar object 105. The operable range is set as a range having three-dimensional coordinates in a virtual space such as a cylinder, a sphere, and a hemisphere. When a plurality of avatar objects 105 collaborate and deliver, each of the operable ranges of the avatar objects 105 may be set so as not to overlap each other. Alternatively, when each of the operable ranges of the avatar object 105 overlaps, when the part belonging to one avatar object 105 enters the overlapping range, the part belonging to the other avatar object 105 is controlled so as not to fall within the overlapping range. You may. Specifically, the user device 12 determines whether or not the part of the avatar object 105 is included in the overlapping range, and if the part is included in the overlapping range, the user device 12 enters the overlapping range of the part of the other avatar object. Ban. Further, the movement direction may be set according to the height of the avatar object 105. For example, when the tall avatar object 105 makes a horizontal "cheers" operation, if there is a possibility of interfering with the short avatar object 105, the former avatar object 105 may be moved upward or in front of the object 105. It may be operated. According to these aspects, interference between the avatar objects 105 can be suppressed. Further, when the overlapping range is provided, interference can be suppressed even when the avatar object 105 is brought close to each other.

Further, the display mode of the emote object 125A changes when the display mode change condition is satisfied. The display mode change condition is, for example, that a predetermined time has elapsed from the start of the display of the emote object 125A, for example, that the number of times of expression of a predetermined emote function such as "drinking" has reached a predetermined number of times. The emote object 125A in the initial state is in the state of "full of drinks", but after a lapse of a predetermined time, it is in the transition state of being "empty".

When the guest avatar object 120 leaves, the emote object 125A associated with the guest avatar object 120 is also hidden. At this time, if the emote object 125A associated with the guest avatar object 120 is hidden, the emote object 125A of the host avatar object 105A may be hidden at the same time as the timing.

FIG. 13 shows a distribution screen 190 in which the guest avatar object 120 has left and a new guest avatar object 120 has been added. When the server 13 adds a new guest avatar object 120, the server 13 also adds the emote object 125A associated with the guest avatar object 120. At this time, if the emote object 125A associated with the guest avatar object 120 is displayed, the emote object 125A may be newly associated with the host avatar object 105A at the same time as the timing. As a result, the emote object 125A of the "mug" that has changed from the initial state such as "full" to the transition state such as "empty" becomes the emote object 125A of the "mug" in the initial state.

FIG. 14 shows a distribution screen 200 in which the emote function is provided as the second gift object 125 in the collaboration distribution. A similar animation is displayed on the display 28 of the user device 12 of the viewing user. The distribution screen 200 includes a background 125D of the "pool" as the second gift object 125. Further, the distribution screen 200 includes the host avatar object 105A and the guest avatar object 120, as well as the emote object 125A of the "water gun" associated with the host avatar object 105A and the guest avatar object 120 as the second gift object 125. Further, the distribution screen 200 includes, as the second gift object 125, a wearing object 203 mounted on the host avatar object 105A and the guest avatar object 120 and corresponding to the background 125D. Water is radiated from the emote object 125A of the water gun by operating the emote function selection unit (not shown). Although the direction in which water is radiated from the emote object 125A is constant, the direction in which water is radiated can be changed by changing the directions of the host avatar object 105A and the guest avatar object 120 by the user's operation.

FIG. 15 shows a delivery screen 210 provided with a second gift object 125 based on information indicating a real-world situation. A similar animation is displayed on the display 28 of the user device 12 of the viewing user. The distribution screen 210 includes an avatar object 105, a gift object 125E of "candy" as a second gift object 125, and a gift object 125F of "umbrella". The user device 12 displays these second gift objects 125 when it rains in the real world. In this embodiment, the server 13 acquires the current position of the distribution user device 12A. Further, the server 13 acquires the acquired weather information of the current position from an external server (not shown). Then, when the server 13 determines that the area where the distribution user device 12A exists is rainy, the server 13 transmits the identification information of the gift objects 125E and 125F to the user device 12 together with a display request. Upon receiving the identification information of the gift objects 125E and 125F and the request for display, the user device 12 reads out the images of the gift objects 125E and 125F from the storage 22 and displays them. The distribution user device 12A may acquire the weather information from its own current position and transmit it to the server 13. Alternatively, the distribution user device 12A may acquire the weather information from its own current position and determine whether or not to display the gift objects 125E and 125F from the acquired weather information. In addition, although the information indicating the situation in the real world is not particularly limited, environmental information such as the weather and the area where the distribution user device 12A exists (urban area, mountainous area, etc.), time information, date information, time of distribution (season, etc.) ).

The display condition of the second gift object 125 based on the information indicating the situation in the real world is, for example, that the information indicating the situation in the real world has changed.
(motion)
Next, with reference to FIGS. 16 and 17, a processing procedure when a host user and a plurality of guest users co-star will be described.

FIG. 16 is a timing chart when the distribution user 100 participates in the event in which the second gift object 125 is displayed. The event is held within a preset period such as "19:00 to 20:00". The display condition of the second gift object 125 is to start the distribution of the moving image within this period. The event scenario shown in FIG. 16 is the event scenario of the "fireworks display", and is composed of "Part 1", "Part 2", and "Part 3", and the second gift object 125 is different in each part. Is displayed. In the video delivered by the "delivery user A" who has participated in the event from the start of the event, the second gift object 125 of each part is displayed based on the request from the server 13. On the other hand, in the video distributed by "Distribution User B" who participated in the event from "Part 2", the second gift object displayed in "Part 2" and "Part 3" based on the request from the server 13. 125 is displayed, and the second gift object 125 displayed in "Part 1" is not displayed. Further, in the video distributed by the distribution user who participated in the event from the middle of each part, the animation from the time corresponding to the distribution start time of the video may be displayed. In the video of the distribution user 100 who participated in the event from the middle in this way, the second gift object 125 is displayed from the middle according to the scenario, so that the display of the second gift object 125 can be limited. .. Therefore, since the second gift object 125 is not displayed unnecessarily, it is possible to suppress a decrease in the value of the gift object.

FIG. 17 shows a distribution user device 12A and a server 13 used by a host user when a second gift object is displayed in collaboration distribution, a distribution user device 12A used by a distribution user who is a guest user, and a viewing user who does not request co-starring. The processing procedure of the viewing user apparatus 12B to be used is shown. As a premise, the distribution user 100 is set to allow collaboration distribution. The server 13 receives the participation request from the viewing user device 12B. The server 13 transmits the participation request to the distribution user device 12A, and the distribution user 100 permits the participation request. At this time, the distribution user device 12A transmits the permission of the participation request to the server 13. The server 13 adds the viewing user to the participation list of the collaboration distribution, and transmits the participation list to the distribution user device 12A and the viewing user device 12B. In this way, the host avatar object 105A corresponding to the distribution user 100 and the guest avatar object 120 corresponding to the viewing user who is permitted to co-star are displayed on one screen. The viewing user who participated in the collaboration distribution becomes a distribution user as a guest user.

In the example shown in FIG. 17, it is assumed that the second gift object 125 is displayed at the same time as the guest avatar object 120 is displayed. When the collaboration distribution is started, the distribution user device 12A transmits the moving image configuration data used for generating the moving image to the server 13 (step S11). The moving image configuration data includes at least tracking data that tracks the operation of the distribution user 100. Further, the moving image configuration data includes audio data. The identification information of the host avatar object 105A may be included in the moving image configuration data, or may be transmitted separately from the moving image composition data.

The server 13 determines whether or not to display the second gift object based on the display condition of the second gift object 125. The display conditions of the second gift object 125 are that the distribution user 100 participates in the event as described above, that the avatar object 105 of the distribution user 100 is a predetermined avatar object, and that the video distribution is started. It is included in the date and period.

When the server 13 determines that the second gift object is to be displayed, the server 13 transmits the identification information (ID) of the second gift object associated with the host avatar object 105A together with the video configuration data received from the distribution user device 12A to the guest user's distribution user device 12A. And transmission to the viewing user device 12B (step S12). The server 13 also transmits the identification information (ID) of the second gift object 125 to the distribution user device 12A (step S13). The distribution user device 12A and the viewing user device 12B have acquired various data for drawing the avatar object and the gift object in advance.

Similarly, the distribution user device 12A used by the guest user transmits the moving image configuration data to the server 13 (step S14). The server 13 transmits the identification information (ID) of the second gift object associated with the guest avatar object 120 to the viewing user device 12B together with the moving image configuration data received from the distribution user device 12A (step S15). Further, the server 13 similarly transmits the moving image configuration data and the identification information (ID) of the second gift object to the distribution user device 12A (step S16). Further, the server 13 transmits the identification information (ID) of the second gift object associated with the guest avatar object 120 to the distribution user device 12A of the guest user (step S17).

The distribution user device 12A and the viewing user device 12B generate an animation including the host avatar object 105A, the guest avatar object 120, the second gift object 125, etc., based on the received video configuration data and the identification information of the second gift object. It is displayed on the display 28 (steps S17 to S19). It should be noted that steps S11 to S17 can be changed as appropriate. The order of steps S11 to S17 may be changed, one step may be divided into a plurality of steps, or a plurality of steps may be combined into one step. In short, the distribution user device 12A of the host user and the distribution user device 12A of the guest user transmit the video configuration data, the server 13 transmits the identification information of the gift object, and the distribution user device 12A and the viewing user device 12B are others. It suffices if the video can be displayed based on the video configuration data sent from the device and the identification information of the gift object.

When the guest avatar object 120 of the guest user exits from the moving image, the exiting guest user becomes a viewing user. Then, when a new guest avatar object 120 is added to the moving image, the distribution user device 12A, the server 13, and the viewing user device 12B repeat the above steps S11 to S20. That is, the host avatar object 105A is associated with the second gift object 125 and displayed, and the new guest avatar object 120 is associated with the second gift object 125 and displayed. Since the host avatar object 105A does not leave, the display of the second gift object 125 associated with the host avatar object 105A does not have to be changed. If the second gift object 125 displayed in association with the guest avatar object 120 is not changed by the guest avatar object 120, the server 13 will refer to the distribution user device 12A and the viewing user device 12B as the second gift object. The identification information of 125 may be transmitted only once. In this case, each time the distribution user device 12A and the viewing user device 12B change the guest avatar object 120, the distribution user device 12A and the viewing user device 12B display the second gift object 125 based on the identification information of the second gift object 125 received from the server 13.

In this way, when the display condition of the second gift object is satisfied in the collaboration distribution, the second gift object 125 is displayed every time the guest avatar object 120 is added. Therefore, it is possible to increase the satisfaction level of the guest user with the collaboration delivery. Further, when it is notified in advance that the second gift object will be displayed if the user participates in the collaboration distribution, it is possible to increase the motivation of the viewing user to participate in the collaboration distribution.

In FIG. 18, the display condition of the second gift object 125 may be the presence or absence of an action from the viewing user. In this case, the server 13 refers to the user management data 350 and determines whether or not there is an action from the viewing user for a predetermined time or more (step S21). Specifically, it is determined whether or not the display request of the first gift object is received from the viewing user device 12B in the moving image being distributed. At this time, in addition to the display request of the first gift object, it may be determined whether or not a message has been posted.

When the server 13 determines that the action from the viewing user has been performed within the predetermined time (step S21: Yes), the server 13 does not display the second gift object 125. On the other hand, if it is determined that the action from the viewing user has not been performed within the predetermined time (step S21: none), the identification information of the second gift object 125 is transmitted to the distribution user device 12A and the viewing user device 12B. The distribution user device 12A and the viewing user device 12B that have received the identification information of the second gift object 125 read out the data for displaying the second gift object 125 corresponding to the identification information and display it on the display 28 (step S22). ). By doing so, even the distribution user 100 who has few requests for displaying the first gift object can liven up the moving image. In addition, the distribution user 100 is motivated to continue distribution of the moving image.

Next, the effect of this embodiment will be described.
(1) In the collaboration distribution in which the host avatar object 105A and the guest avatar object 120 are displayed in the moving image, the second gift object 125 is displayed only when the distribution status satisfies the display condition of the second gift object 125. Therefore, it is possible to suppress the decrease in the added value of the gift object. Further, when the guest avatar object 120 corresponding to the guest user is newly added, the second gift object 125 is displayed in association with the guest avatar object 120. Therefore, not only the host user but also all the guest users who participate in the collaboration distribution can be satisfied.

(2) When the user device 12 distributes the moving image within a predetermined period, the second gift object 125 is displayed on the moving image. Further, when the distribution of the moving image is started from the middle of the scenario, the display of the second gift object 125 is started from the scene corresponding to the time when the distribution of the moving image is started. Therefore, since the opportunity to display the second gift object 125 is limited, it is possible to suppress the decrease in the added value of the second gift object 125. In addition, when the event is common to all users in the application, the display of the second gift object 125 can be synchronized between a plurality of videos, so that the video looks like an event occurring in the real world. Can be delivered.

(3) The second gift object 125 is displayed after a predetermined time has elapsed from the start of distribution of the moving image within a predetermined period. Therefore, since the opportunity to display the second gift object 125 is limited, it is possible to suppress the decrease in the added value of the second gift object 125.

(4) The second gift object 125 is displayed when there is no activity of the viewing user such as a display request of the first gift object for a predetermined time. Therefore, the display of the second gift object 125 can be used as an opportunity to expand the range of expressions of the distribution user. In addition, communication between the distribution user and the viewing user can be activated.

(5) When the emote function selection unit 192 is operated, the second gift object 125 is displayed in the moving image. Therefore, the second gift object 125 can be displayed at the timing requested by the user.

(6) The second gift object 125 is displayed when a specific avatar object is displayed in the video. Therefore, since the opportunity to display the second gift object 125 is limited, it is possible to suppress the decrease in the added value of the second gift object 125. It can also increase the chances that a particular avatar object will be used by the distribution user 100.

(7) The second gift object 125 is displayed when the external conditions such as the weather in the real world satisfy the display conditions. Therefore, since the opportunity to display the second gift object 125 is limited, it is possible to suppress the decrease in the added value of the second gift object 125. Further, since the display of the second gift object 125 is synchronized with the external situation, it is possible to display a video rich in variety according to the season and time zone in which the video is delivered.

(8) The emote function of the avatar object 105 is displayed as the second gift object 125. The emotes object 125A, which is a part of the emotes function, is displayed in association with the parts constituting each of the avatar objects 105. Since the emote function is more valuable than other gift objects, even users who have few opportunities to provide the emote function as a gift can use the emote function other than the basic emote function. Therefore, the user's satisfaction can be enhanced.

(9) The second gift object 125 including the background of the avatar object 105 is displayed. The background is more valuable than other gift objects. Therefore, even a user who cannot provide the background as the first gift object or who has few opportunities to provide the background as a gift can have an opportunity to use the background. Therefore, the user's satisfaction can be enhanced.

(10) Since the second gift object 125 including the wearing object of the avatar object 105 is displayed, the user's satisfaction can be enhanced.
(11) Since the first gift object for which the viewing user has requested the display is preferentially displayed, the satisfaction of the viewing user who has sent the display request for the first gift object can be enhanced.

(12) Since the second gift object is displayed with priority, it is possible to proceed with the moving image according to the scenario.
The above embodiment can be modified and implemented as follows. The above embodiment and the following modified examples can be implemented in combination with each other within a technically consistent range.

-In the above embodiment, the guest user's avatar object is added to the video by requesting co-starring with the video distributed by the host user. Instead of this, a moving image in which an avatar object corresponding to a predetermined user is co-starred may be distributed without determining a host user and a guest user.

-In the above embodiment, the emote function has been described by way of exemplifying a device that moves a part such as a hand or an arm of the avatar object or a facial expression of the avatar object, but the present invention is not limited to this. The emote function may change the standing position of the avatar object, make the avatar object walk, or make the avatar object dance.

-In the above embodiment, the server 13 receives the gift object display request from the user device 12 and adds the gift object identification information to the waiting column 114. Instead of this, the user device 12 of the distribution user may receive a display request for the gift object from the server 13 and manage the waiting column 114.

-In the above embodiment, it is assumed that the video application program for viewing and distributing the video is installed in the user device 12. Instead of this, the application program for viewing the video and the application program for distributing the video may be separated into different application programs. When distributing, the video is distributed using the distribution application program. When viewing, watch the video using the viewing application program. The display request of the gift object is made by using the viewing application program.

-In the above embodiment, a client rendering method is used in which the distribution user device 12A and the viewing user device 12B receive the moving image configuration data and the like to generate a moving image. Alternatively or additionally, a video distribution method in which the distribution user device 12A encodes moving image data may be used. As shown in FIG. 19, the server 13 transmits the identification information of the gift object to the distribution user device 12A (step S30). The distribution user device 12A generates and encodes an animation using the received identification information of the gift object, tracking data, and the like (step S31). At this time, the message or voice data from the viewing user may be encoded together with the animation. Further, the distribution user device 12A transmits the encoded data to the server 13 (step S32). The server 13 transmits the encoded data to the viewing user device 12B (step S33). Further, the distribution user device 12A displays the animation using the tracking data and the identification information of the gift object (step S34). The viewing user device 12B decodes the encoded data and displays the animation (step S35). In the case of collaborative distribution, the distribution user device 12A of the distribution user as a guest user may receive the moving image configuration data or the like and generate a moving image based on the moving image composition data. Alternatively, the distribution user device 12A of the distribution user as a guest user may receive the encoded video data from the distribution user device 12A of the distribution user who is the host user.

-The sensor unit 24 is supposed to acquire the detection data that detects the change in the user's facial expression, the movement of the head, and the relative position of the user with respect to the sensor unit 24, but at least one of them may be used. In addition, the sensor unit 24 has, in addition to, or instead of at least one of the changes in the user's facial expression, the movement of the head, and the relative position of the user, other other information such as detection data that detects movements other than the movement of the head. The detection data may be acquired.

-The virtual space displayed in the moving image may be an augmented reality (AR) space. For example, animations such as an avatar object and a gift object may be superimposed and displayed on a real-world image taken by the camera of the user device 12. Further, an animation such as a gift object may be superimposed and displayed on a real-world image including the user taken by the camera of the user device 12.

-In the above embodiment, the user device 12 is an information processing device such as a smartphone, a mobile phone, a tablet terminal, a personal computer, a console game machine, a wearable computer such as a head-mounted display, and the like. Instead of this, it is a system provided in a studio for video distribution, and is an information processing device provided with a control unit 20 and the like, a sensor unit 24 mounted on the body of a distribution user, and tracking for detecting the position of the sensor unit 24. A system including a system, an operation unit 27, a speaker 25, and a display 28 may be used as a system for distributing a moving image. The tracking system may include a multi-axis laser emitter that emits pulsed laser light for synchronization. The sensor unit 24 includes a sensor that detects a laser beam, and detects its own position and orientation while synchronizing with a synchronization pulse. As the sensor unit 24, for example, Vive Tracker (registered trademark) and Vive Base Station provided by HTC Corporation (registered trademark) can be used.

-In the above embodiment, the sensor unit 24 is provided on the user device 12 side, but the present invention is not limited to this embodiment. For example, at least a part of the sensor unit 24 may be attached to the body of the distribution user or may be provided in the vicinity of the distribution user. FIG. 20 is a video distribution system installed in a video distribution studio, which includes a camera 229, a microphone 230, a controller 226, a distribution server 228, and the like. Further, the moving image distribution system includes a tracking system including a mounting sensor 227 mounted on the limbs of the distribution user 100, a position detection unit 225 for specifying the position of the mounting sensor 227, and the like. The camera 229 captures the face of the distribution user 100. The distribution server 228 generates an animation in which the tracking data acquired from the tracking system and the facial expression data acquired from the camera 229 are applied to the avatar object. Further, the animation obtained by rendering the background of the virtual space and the avatar object is distributed to the viewing user device 12B as moving image data together with the sound. Further, for example, the tracking system may be composed of a camera or the like that detects a marker attached to the body of the distribution user.

11 ... Video distribution system,
12, 12A, 12B ... User device 13 ... Server

Claims (21)

A computer that displays video on the display,
A first image processing unit that displays a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
A first gift object display processing unit that displays a first gift object triggered by transmission of a display request by a viewing user who watches the video, and a first gift object display processing unit.
The first is when the display condition of the second gift object displayed without being based on the display request sent by the viewing user and the condition that the distribution of the moving image is started within a predetermined period is satisfied . It is made to function as a second image processing unit that displays the second gift object associated with the avatar object and displays the second gift object associated with the second avatar object.
The second image processing unit is a program for adding the second gift object associated with the third avatar object when a third avatar object corresponding to the third user is newly added to the moving image. The program according to claim 1, wherein the second image processing unit displays the second gift object in association with a portion constituting each of the avatar objects. The second image processing unit displays the second gift object according to the scenario, and when the user starts the distribution of the video from the middle of the scenario within the period, the time when the video is started to be distributed. The program according to claim 1 or 2, wherein the display of the second gift object is started from the scene corresponding to the above. The program according to claim 1 or 2 , wherein the second image processing unit displays the second gift object after a predetermined time has elapsed from the start of distribution of the moving image. A computer that displays video on the display,
A first image processing unit that displays a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
A first gift object display processing unit that displays a first gift object triggered by transmission of a display request by a viewing user who watches the video, and a first gift object display processing unit.
When the display condition of the second gift object that is displayed without being based on the display request sent by the viewing user and the condition that the viewing user has no activity for the video continues for a predetermined time , the above is satisfied. The second gift object associated with the first avatar object is displayed, and the second gift object associated with the second avatar object is displayed as a second image processing unit.
The second image processing unit adds the second gift object associated with the third avatar object when the third avatar object corresponding to the third user is newly added to the moving image.
program. A computer that displays video on the display,
A first image processing unit that displays a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
A first gift object display processing unit that displays a first gift object triggered by transmission of a display request by a viewing user who watches the video, and a first gift object display processing unit.
When the display condition of the second gift object that is displayed without being based on the display request sent by the viewing user and the condition that a specific avatar object is displayed in the moving image is satisfied , the first avatar object is used. The second gift object associated with the second gift object is displayed and the second gift object associated with the second avatar object is displayed in the video, and the second gift is displayed when the specific avatar object is not displayed in the video. The object is made to function as a second image processing unit that does not display in the moving image.
The second image processing unit corresponds to the third user, and when the third avatar object, which is the specific avatar object, is newly added to the moving image, the second gift object associated with the third avatar object is associated with the third avatar object. To add
program. A computer that displays video on the display,
A first image processing unit that displays a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
A first gift object display processing unit that displays a first gift object triggered by transmission of a display request by a viewing user who watches the video, and a first gift object display processing unit.
An external situation specifying unit that specifies an external situation that is one of the real-world weather information , time information, and date information of the first user who distributes the moving image even when the moving image is distributed.
When the specified external situation satisfies the display condition of the second gift object displayed without being based on the display request sent by the viewing user, the second image processing unit for displaying the second gift object is made to function. ,
The second image processing unit is a program for adding the second gift object associated with the third avatar object when a third avatar object corresponding to the third user is newly added to the moving image. The second image processing unit displays a selection operation unit for displaying the second gift object in the moving image when the display condition of the second gift object is satisfied, and the selection operation unit displays the selection operation unit in the moving image. The program according to any one of claims 1 to 7 , which displays the second gift object in the moving image when operated. The second image processing unit displays an expression function selection unit for activating the expression function of the avatar object as the second gift object, and is based on the operation of the expression function selection unit of the user corresponding to the avatar object. The program according to any one of claims 1 to 8, which expresses the expression function. The program according to any one of claims 1 to 9 , wherein the second image processing unit displays the second gift object including the background of the avatar object. The program according to any one of claims 1 to 10, wherein the second image processing unit displays the second gift object including a wearing object mounted on a portion of the avatar object. The computer that displays the video on the display
A first image processing step of displaying a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
The first display processing step of displaying the first gift object triggered by the transmission of the display request by the viewing user who views the video, and
The first is when the display condition of the second gift object displayed without being based on the display request sent by the viewing user and the condition that the distribution of the moving image is started within a predetermined period is satisfied . A second image processing step of displaying the second gift object associated with the avatar object and displaying the second gift object associated with the second avatar object is performed.
In the second image processing step, when a third avatar object corresponding to the third user is newly added to the moving image, an information processing method for adding the second gift object associated with the third avatar object. The computer that displays the video on the display
A first image processing step of displaying a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
The first display processing step of displaying the first gift object triggered by the transmission of the display request by the viewing user who views the video, and
When the display condition of the second gift object that is displayed without being based on the display request sent by the viewing user and the condition that the viewing user has no activity for the video continues for a predetermined time, the above is satisfied. The second image processing step of displaying the second gift object associated with the first avatar object and displaying the second gift object associated with the second avatar object is executed.
In the second image processing step, when a third avatar object corresponding to the third user is newly added to the video, the second gift object associated with the third avatar object is added.
Information processing method. The computer that displays the video on the display
A first image processing step of displaying a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
The first display processing step of displaying the first gift object triggered by the transmission of the display request by the viewing user who views the video, and
When the display condition of the second gift object that is displayed without being based on the display request sent by the viewing user and the condition that a specific avatar object is displayed in the moving image is satisfied, the first avatar object is used. The second gift object associated with the second gift object is displayed and the second gift object associated with the second avatar object is displayed in the video, and the second gift is displayed when the specific avatar object is not displayed in the video. Execute the second image processing step of not displaying the object in the moving image,
In the second image processing step, when a third avatar object corresponding to the third user and which is the specific avatar object is newly added to the moving image, the second gift object associated with the third avatar object is associated with the third avatar object. To add
Information processing method. The computer that displays the video on the display
A first image processing step of displaying a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user in a moving image.
The first display processing step of displaying the first gift object triggered by the transmission of the display request by the viewing user who views the video, and
An external situation specifying step for specifying an external situation, which is one of the real-world weather information , time information, and date information of the first user who delivers the video even when the video is delivered.
When the specified external situation satisfies the display condition of the second gift object displayed without being based on the display request sent by the viewing user, the second image processing step of displaying the second gift object. Run and
In the second image processing step, when a third avatar object corresponding to the third user is newly added to the moving image, an information processing method for adding the second gift object associated with the third avatar object. An information processing system that displays moving images on the display of a user's device.
Drawing data for transmitting data for drawing a first avatar object that reflects the movement of the first user and data for drawing a second avatar object that reflects the movement of the second user to the user device. Send step and
The first display processing step of transmitting a request for displaying the first gift object to the user device triggered by the transmission of the display request by the viewing user who watches the moving image, and the first display processing step.
The first is when the display condition of the second gift object displayed without being based on the display request sent by the viewing user and the condition that the distribution of the moving image is started within a predetermined period is satisfied . A display request transmission step of transmitting a request for displaying the second gift object associated with the avatar object and a request for displaying the second gift object associated with the second avatar object are executed together with the request for displaying the second gift object.
In the display request transmission step, when a third avatar object corresponding to the third user is newly added to the moving image, a display request for the second gift object associated with the third avatar object is sent to the user device. Information processing system to send. An information processing system that displays moving images on the display of a user's device .
Drawing data for transmitting data for drawing a first avatar object that reflects the movement of the first user and data for drawing a second avatar object that reflects the movement of the second user to the user device. Send step and
The first display processing step of transmitting a request for displaying the first gift object to the user device triggered by the transmission of the display request by the viewing user who watches the moving image, and the first display processing step.
When the display condition of the second gift object that is displayed without being based on the display request sent by the viewing user and the condition that the viewing user has no activity for the video continues for a predetermined time, the condition is satisfied. A display request transmission step of transmitting a request for displaying the second gift object associated with the first avatar object and a request for displaying the second gift object associated with the second avatar object are executed together with the request for displaying the second gift object associated with the first avatar object. death,
In the display request transmission step, when a third avatar object corresponding to the third user is newly added to the video, a display request for the second gift object associated with the third avatar object is sent to the user device. Send
Information processing system . An information processing system that displays moving images on the display of a user's device .
Drawing data for transmitting data for drawing a first avatar object that reflects the movement of the first user and data for drawing a second avatar object that reflects the movement of the second user to the user device. Send step and
The first display processing step of transmitting a request for displaying the first gift object to the user device triggered by the transmission of the display request by the viewing user who watches the moving image, and the first display processing step.
When the display condition of the second gift object displayed without being based on the display request sent by the viewing user and the condition that a specific avatar object is displayed in the moving image is satisfied, the first avatar object is used. A display request transmission step of sending a request to display the second gift object associated with the second avatar object, along with a request to display the associated second gift object, is performed.
In the display request transmission step, when a third avatar object, which is the specific avatar object corresponding to the third user, is newly added to the video, the second gift object associated with the third avatar object is used. Send the display request to the user device
Information processing system . An information processing system that displays moving images on the display of a user's device.
Drawing data for transmitting data for drawing a first avatar object that reflects the movement of the first user and data for drawing a second avatar object that reflects the movement of the second user to the user device. Send step and
The first display processing step of transmitting a request for displaying the first gift object to the user device triggered by the transmission of the display request by the viewing user who watches the moving image, and the first display processing step.
An external situation specifying step for specifying an external situation, which is one of the real-world weather information , time information, and date information of the first user who delivers the video even when the video is delivered.
When the specified external situation satisfies the display condition of the second gift object displayed without being based on the display request sent by the viewing user, the second gift object associated with the first avatar object is displayed. To send a request to display the second gift object associated with the second avatar object, along with a display request sending step.
In the display request transmission step, when a third avatar object corresponding to the third user is newly added to the moving image, a display request for the second gift object associated with the third avatar object is sent to the user device. Information processing system to send. After the display condition of the second gift object is satisfied and the identification information of the second gift object is added to the waiting column of the gift object to be displayed, the user device used by the viewing user requests the display of the first gift object. We are in the waiting line, the first gift
When the identification information of the object is added, the third image processing unit for displaying the first gift object in preference to the second gift object in the waiting row is further provided .
The information processing system according to any one of claims 16 to 19 . The display condition of the second gift object after the display request of the first gift object is made from the user device used by the viewing user and the identification information of the first gift object is added to the waiting line of the gift object to be displayed. Is satisfied, and when the identification information of the second gift object is added to the waiting row, the third image processing unit that displays the second gift object with priority over the first gift object in the waiting row is displayed . Further prepare
The information processing system according to any one of claims 16 to 19 .

Images