JP7333528B2 - Program, information processing method and information processing apparatus - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act Publication date July 11, 2020 Published on the website https://reality. app/

Application of Article 30, Paragraph 2 of the Patent Act Publication date July 10, 2020 Published on the website https://reality. wrightflyer. net/notice/page/e64ZnDwfZMhZ

Article 30, Paragraph 2 of the Patent Law applies Publication date August 2, 2020 Published on the website https://reality. wrightflyer. net/notice/page/wtwSw4m4ZDwt

Article 30, Paragraph 2 of the Patent Law applies Publication date August 17, 2020 Published on the website https://reality. wrightflyer. net/notice/page/mn7wfjVmNdff

Article 30, Paragraph 2 of the Patent Law applies Publication date August 21, 2020 Published on the website https://reality. wrightflyer. net/notice/page/d7PNDZFh4Man

Article 30, Paragraph 2 of the Patent Law applies Publication date August 28, 2020 Published on the website https://reality. wrightflyer. net/notice/page/fZnfNfSHtw4

Application of Article 30, Paragraph 2 of the Patent Act Publication date September 4, 2020 Published on the website https://reality. wrightflyer. net/notice/page/4dDHj4eNgjwf

Article 30, Paragraph 2 of the Patent Law applies Publication date September 14, 2020 Published on the website https://reality. wrightflyer. net/notice/page/Pgawwadf6Mff

Article 30, Paragraph 2 of the Patent Law applies Publication date September 25, 2020 Published on the website https://reality. wrightflyer. net/notice/page/3ezeHZSm6eaf

Application of Article 30, Paragraph 2 of the Patent Act Publication date October 5, 2020 Published on the website https://reality. wrightflyer. net/notice/page/gVhPwPtwntFz

Article 30, Paragraph 2 of the Patent Law applies Publication date October 19, 2020 Published on the website https://reality. app/notice/page/e7nfaNSm4tzf

Application of Article 30, Paragraph 2 of the Patent Act Publication date October 22, 2020 Published on the website https://reality. app/notice/page/SjefMV3wzDaD

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/WFLE_REALITY/

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1281513493917601795

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1290595837928591364

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1289867532355026945

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1296012780450066432

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1295308137461714944

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1298210287699390465

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1296764735535210498

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1300750248311103488

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1299308245966663680

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1301844963056025606? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1303286967791046658? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1305427315036434432

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1305826193338318851? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1309417366209482241? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1311591683549609984? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1310507791531028480? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1313434074086699009? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1313072692652732417? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1318144868896677890? s=20

Article 30, Paragraph 2 of the Patent Law applies Publication date October 22, 2020 Published on the website https://twitter. com/REALITY_app/status/1319218992523866112? s=20

The present invention relates to a program, an information processing method, and an information processing apparatus for distributing or viewing moving images.

2. Description of the Related Art Conventionally, there has been known a moving image distribution system that distributes moving images including animations of avatar objects based on movements of distribution users (see Patent Document 1, for example). In this type of moving image distribution system, a function has been proposed for displaying an arbitrary object in a moving image in response to a display request transmitted from a terminal used by a viewing user viewing the moving image.

JP 2015-184689 A

In the moving image distribution system described above, communication between the distributing user and the viewing user is activated through the reaction of the distributing user to the gift object, and the viewing user's satisfaction with the moving image increases. In addition, there is also the advantage that other viewing users are also prompted by the display request of the gift object to request the display of the gift object. Therefore, if the opportunities for displaying gift objects increase in this way, it is expected that the number of video viewing users, the viewing time per viewing user, or the cumulative viewing time that is the accumulated viewing time of all viewing users will increase. .

By the way, in moving image distribution systems, many gift objects tend to be displayed in moving images distributed by popular distribution users. On the other hand, videos distributed by distribution users with a small number of viewing users tend to have a small number of gift objects. In particular, this tendency is remarkable for novice users who have been distributing moving images for a short period of time.

On the other hand, it is conceivable to automatically display the gift object in the moving image regardless of the viewing user's display request. However, simply increasing opportunities for gift objects that are not related to display requests will reduce the value of gift objects. If the value of the gift object decreases, the viewing users will lose interest in displaying the gift object even if the opportunity to display the gift object increases, and the effect of increasing the number of viewing users, the viewing time, and the cumulative viewing time will decrease. . Therefore, it is desired to appropriately provide an opportunity for displaying the gift object.

A program for solving the above problem is a computer that displays a moving image on a display, and displays a first avatar object reflecting the movement of the first user and a second avatar object reflecting the movement of the second user on the moving image. function as a first image processing unit.

Further, the program includes a first gift object display processing unit for displaying a first gift object when a display request is sent by a viewing user who watches the moving image as a trigger for display, and a display request not based on the display request sent by the viewing user. display the second gift object associated with the first avatar object and display the second gift object associated with the second avatar object when the display condition of the second gift object to be displayed is satisfied. The second image processing unit is caused to function as a second image processing unit, and the second image processing unit displays the second gift object according to a scenario, and the first user displays the moving image from the middle of the scenario within a predetermined period. is started, the display of the second gift object is started from the scene corresponding to the distribution start point of the moving image.

In the information processing method for solving the above problems, a computer that displays a moving image on a display generates a moving image of a first avatar object that reflects the movement of the first user and a second avatar object that reflects the movement of the second user. a first display processing step of displaying the first gift object in response to the transmission of a display request by the viewing user viewing the moving image as a trigger for display; and a display request transmitted by the viewing user display the second gift object associated with the first avatar object and display the second gift object associated with the second avatar object when the display condition of the second gift object displayed without the base is satisfied; and a second image processing step of displaying, in the second image processing step, displaying the second gift object according to a scenario, and displaying the second gift object from the middle of the scenario within a predetermined period of time. starts distributing the moving image, the display of the second gift object is started from the scene corresponding to the start point of distribution of the moving image.

An information processing device that solves the above problem is an information processing device that displays a moving image on a display of a user device, and includes data for drawing a first avatar object that reflects the movement of a first user; a drawing data transmitting step of transmitting data for drawing a second avatar object reflecting the movement of the moving image to the user device; a first display processing step of transmitting a request for displaying an object to the user device; a display request transmitting step of transmitting to the user device a display request for the second gift object associated with one avatar object and a display request for the second gift object associated with the second avatar object; In the request transmission step, a request for displaying the second gift object is transmitted to the user device according to a scenario, and the first user starts distribution of the moving image from the middle of the scenario within a predetermined period. case, a request to display the second gift object corresponding to the scene corresponding to the distribution start time of the moving image is transmitted to the user device.

An information processing method for an information processing device that solves the above problems is an information processing method executed by an information processing device that displays a moving image on a display of a user device, wherein the information processing device reflects movement of a first user. a drawing data transmission step of transmitting to the user device data for drawing a first avatar object that reflects the movement of the second user and data for drawing a second avatar object that reflects the movement of the second user; a first display processing step of transmitting a request for displaying the first gift object to the user device using transmission of a display request by the viewing user as a trigger for display; display request for the second gift object associated with the second avatar object together with the display request for the second gift object associated with the first avatar object when the display condition for the second gift object associated with the second gift object is satisfied. a display request transmission step of transmitting the display request to the user device, and in the display request transmission step, a display request of the second gift object is transmitted to the user device according to a scenario; When the first user starts distribution of the moving image in the middle of the scenario, a request to display the second gift object corresponding to the scene corresponding to the start of distribution of the moving image is transmitted to the user device.

According to the present invention, by appropriately providing opportunities for displaying objects provided to distribution users, it is possible to distribute moving images that do not bore viewing users.

1 is a schematic diagram showing one embodiment of a video distribution system according to one embodiment; FIG. The figure which shows the data structure of some user management information of the same embodiment. The figure which shows the positional relationship of the delivery user and user device in the real world in the same embodiment. The figure which shows the action direction of the avatar object in the same embodiment. The figure which shows the display method of the gift object of the same embodiment. The figure which shows the display method of the guest avatar object of the same embodiment. The figure which shows the display method of the guest avatar object of the same embodiment. The figure which shows the delivery screen displayed on the user device of the same embodiment. The figure which shows the approval screen of collaboration delivery displayed on the user device of the same embodiment. The figure which shows the delivery screen at the time of collaboration delivery displayed on the user device of the same embodiment. The figure which shows the delivery screen containing a gift object displayed on the user device of the same embodiment. FIG. 11 is a view showing a screen displayed on the user device of the embodiment at the time of collaboration distribution, and showing a screen in which an emote function is exhibited; FIG. 10 is a screen displayed on the user device of the embodiment at the time of collaboration distribution, and is a diagram showing a screen in which one emote function is exhibited; FIG. 11 is a screen displayed on the user device of the embodiment at the time of collaboration distribution, and is a diagram showing a screen in which another emote function is exhibited; The figure which shows the delivery screen containing a gift object displayed on the user device of the same embodiment. 4 is a chart showing the timing of displaying gift objects in the same embodiment. 4 is a sequence chart of procedures for collaboration distribution and display of gift objects in the same embodiment. 4 is a flow chart of the procedure for displaying a gift object in the same embodiment; FIG. 11 is a sequence chart of procedures for collaboration distribution and gift object display according to a modification; FIG. The schematic diagram of the moving image delivery system of a modification.

An embodiment of a video distribution system will be described below with reference to the drawings. The moving picture distribution system of this embodiment distributes a moving picture in which an avatar object that moves according to a user's movement is displayed in a three-dimensional virtual space.

<Video distribution system>
As shown in FIG. 1 , the moving image distribution system 11 includes a user device 12 and a server 13 . The moving image distribution system 11 is a system that displays moving images on the user devices 12 by transmitting and receiving data between the plurality of user devices 12 and the server 13 via the network 14 . A moving image application program for viewing and distributing moving images is installed in the user device 12 . Hereinafter, a user who distributes a video is called a "distribution user", and a user who views a video distributed by the distribution user is called a "viewing user". A user is a viewing user when viewing a moving image, and a distribution user when distributing a moving image. Also, when the "distribution user" and the "viewing user" are not distinguished from each other, they are simply referred to as "users."

The user device 12 is a wearable computer such as a smart phone (multi-function phone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display, an eyeglass-type wearable terminal, and information processing capable of reproducing moving images other than these devices. It is a device. The user device 12 may be a stand-alone device that operates independently, or may be composed of a plurality of devices connected to each other so as to be able to transmit and receive various data.

The user device 12 includes a control unit 20 , a storage 22 (storage medium), and a communication interface (I/F) 23 . The control unit 20 includes one or more arithmetic circuits such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and an NPU (Neural network Processing Unit). The control unit 20 also includes a memory that is a main storage device (recording medium) that can be read from and written to by the arithmetic circuit. The memory is composed of a semiconductor memory or the like. The control unit 20 loads an operating system and other programs from the storage 22 or external storage into memory and executes commands retrieved from the memory. The communication I/F 23 can transmit and receive data to and from the server 13 and other user devices 12 via the network 14 . The network 14 includes various networks such as a local area network and the Internet.

The storage 22 is an auxiliary storage device (recording medium), such as a magnetic disk, an optical disk, or a semiconductor memory. The storage 22 can also be used by combining multiple storages. The storage 22 stores a video application program 220 , avatar data 221 for drawing avatar objects, object data 222 , and user management information 223 .

The control unit 20 appropriately acquires various data from the server 13 by executing the video application program 220 . In addition, by executing the video application program 220, the control unit 20 switches between a distribution mode in which the user himself/herself distributes videos in response to user instructions and a viewing mode in which videos distributed by other distribution users are viewed. .

Avatar data 221 is three-dimensional model data for drawing an avatar object. The user device 12 acquires data for updating the avatar data 221 from the server 13 at a predetermined timing, such as when the video application program 220 is activated. The avatar data includes data for drawing the avatar object body, texture data applied to the avatar object body, and the like. The data for drawing the main body of the avatar object includes polygon data, skeleton data (bone) for expressing the motion of the avatar object, and the like. The avatar data 221 may include data for drawing multiple avatar object bodies. The texture data includes multiple parts data applicable to the avatar object. For example, a plurality of parts data are prepared for each category such as "eyes", "eyebrows", "ears", and "clothes". The user selects part data and applies it to the avatar object body to create an avatar object. A combination of the avatar object main body and parts data selected by the user is recorded in the storage 22 .

The object data 222 is data downloaded from the server 13 at a predetermined timing. Object data 222 is information about objects other than avatar objects. Objects other than avatar objects include objects that broadcast users can display and gift objects provided to broadcast users by viewing users. One type of gift object is a wearable object that is displayed on the display screen in association with a specific part of the avatar object. The wearable objects are, for example, accessories (hats, glasses, etc.) and clothes (T-shirts, etc.) to be worn by the wearable objects, and other objects that can be worn by the avatar object. Other objects include, for example, two-dimensional images such as fireworks and flames, two-dimensional particles, and objects with three-dimensional coordinates that imitate stuffed animals and bouquets.

The object may also be an object that performs physical behavior. Specifically, the object may simulate physical behavior such as falling due to gravity, motion due to application of force, and the like. A component (program) for simulating physical behavior is executable associated with the physical behavior object.

The user management information 223 includes user identification information (user ID), information on initially set avatar objects, and the like. The user management information 223 may include user identification information (user ID), purchase media such as coins, points, distribution status, and the like.

The user device 12 also includes a sensor unit 24 , a speaker 25 , a microphone 26 , an operation section 27 and a display 28 . At least one of the sensor unit 24, the speaker 25, the microphone 26, the operation unit 27, and the display 28 may be provided as the same device as the control unit 20, and is provided in a manner connected to a device including the control unit 20. may

The sensor unit 24 is one or more sensors that detect face motion, which indicates changes in the user's facial expression, and body motion, which indicates changes in the relative position of the user's body with respect to the sensor unit 24 . Face motion includes movements such as blinking and opening and closing the mouth. A well-known thing can be used for the sensor unit 24 . An example of the sensor unit 24 is a ToF sensor that measures and detects the time of flight until light emitted toward the user is reflected by the user's face and the like, and a camera that captures the user's face. and an image processing unit for image processing data captured by the camera. Moreover, the sensor unit 24 may include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. RGB cameras and near-infrared cameras use, for example, the True Depth of "iphoneX (registered trademark)", or "LIDAR" of "iPad Pro (registered trademark)", and other ToF sensors installed in smartphones. Is possible. Specifically, this camera projects tens of thousands of invisible dots onto the user's face or the like using a dot projector. The reflected light of the dot pattern is then detected and analyzed to form a depth map of the face, and an infrared image of the face or the like is captured to capture accurate face data. The arithmetic processing unit of the sensor unit 24 generates various information based on the depth map and the infrared image, compares the information with registered reference data, and determines the depth of each point on the face (each point and the near-infrared camera , and the positional deviation other than the depth is calculated.

Also, the sensor unit 24 may have a function of tracking not only the face of the user but also the hand (hand tracking). The sensor unit 24 may further include sensors other than the above sensors, such as an acceleration sensor and a gyro sensor. The sensor unit 24 has a spatial mapping function of recognizing an object in the real space where the user exists based on the detection results of the ToF sensor and other known sensors and mapping the recognized object on a spatial map. good. In the following description, face motion detection data and body motion detection data will simply be referred to as "tracking data" when they are not distinguished from each other. Note that the image processing section of the sensor unit 24 may be included in the control section 20 .

The speaker 25 converts the audio data into audio and outputs it. The microphone 26 receives voice uttered by the user and converts it into voice data. The display 28 outputs various images according to output instructions from the control unit 20 . The operation unit 27 can be used according to the type of the user device 12 . Examples of the operation unit 27 include a touch panel integrated with the display 28, operation buttons provided on the housing of the user device 12, a keyboard, a mouse, a controller manually operated by the user, and the like. The controller may incorporate various known sensors such as an acceleration sensor and an inertial measurement sensor (IMU: Inertial Measurement Unit) such as a gyro. Another example of the operation unit 27 may be a tracking device that identifies the user's hand movement, eye movement, head movement, line-of-sight direction, and the like. In this aspect, for example, based on the movement of the user's hand, the user's instruction is determined, the distribution of the video is started or ended, the message or video is evaluated, and a predetermined object (for example, a gift described later) is displayed. Various operations such as requests can be executed. It should be noted that if the sensor unit 24 also has an input interface function such as a hand track function, the operating section 27 can be omitted.

The control unit 20 functions as an application management unit 201 and a display control unit 202 by executing a video application program 220 stored in the storage 22 . The application management unit 201 is in charge of main control of the moving image application program. The application management unit 201 acquires requests from the user input through the operation unit 27 or requests from the server 13, and outputs requests to the display control unit 202 according to the content of those requests. The application management unit 201 also transmits requests and various data from the display control unit 202 to the server 13 and transmits tracking data acquired from the sensor unit 24 to the server 13 . The application management unit 201 also records various data received from the server 13 in the storage 22 .

In the distribution mode, the display control unit 202 applies the tracking data obtained from the sensor unit 24 to the avatar data 221 to generate animation. In addition, the display control unit 202 performs rendering including avatar objects and objects other than avatar objects. Rendering here refers to drawing processing including acquisition of the position of the virtual camera, perspective projection, hidden surface removal (rasterization), and the like. Rendering may be at least one of these processes, or may include processes such as shading and texture mapping. Also, the display control unit 202 generates an animation using the rendered image. Furthermore, the display control unit 202 outputs to the display 28 moving image data obtained by synthesizing the animation and the posted message transmitted from the user device 12 of the viewing user or the notification transmitted from the server 13 .

In the distribution mode, the display control unit 202 synchronizes the audio data and moving image data input from the microphone 26 and outputs them to the display 28 . Further, the display control unit 202 encodes moving image data and audio data. The application management unit 201 transmits the encoded data to the server 13 .

Also, in the viewing mode, the display control unit 202 applies the distribution user tracking data received from the server 13 to the avatar data 221 to generate animation. Also, objects other than the avatar object received from the server 13, posted messages, etc. are output to the display 28 together. Furthermore, the display control unit 202 synchronizes the audio data received from the server 13 with the moving image and outputs it from the speaker 25 .

Next, the server 13 will be explained. The server 13 is used by a service provider or the like who provides services for distributing moving images. The server 13 has a control unit 30 , a communication I/F 34 and a storage 35 . The control unit 30 has the same configuration as the control unit 20 of the user device 12 . The control unit 30 may be configured by combining a plurality of arithmetic circuits. Also, the communication I/F 34 and the storage 35 have the same configuration as the user device 12 . The server 13 may consist of one device, or may consist of a plurality of devices. When the server 13 is composed of a plurality of devices, these devices have the functions of the control unit 30 and various data stored in the storage 35 in a distributed manner.

A distribution program 353 is stored in the storage 35 . The control unit 30 functions as a distribution management unit 301 and a purchase processing unit 302 by executing the distribution program 353 .

The distribution management unit 301 stores various data received from the user device 12 in the storage 35 , and outputs a request to the purchase processing unit 302 based on the purchase request received from the user device 12 . Furthermore, the distribution management unit 301 acquires data requested by the user device 12 from the storage 35 or the like and transmits the data to the user device 12 . Specifically, the distribution management unit 301 transmits a list of videos being distributed in response to a request from the user device 12 used by the viewing user. The distribution management unit 301 receives the identification information of the moving image selected from the list from the user device 12 . In addition, the distribution management unit 301 transmits the tracking data and the like acquired from the user device 12 used by the distribution user of the selected moving image to the user device 12 . In addition, the distribution management unit 301 receives a posted message or the like posted by the viewing user for the video being distributed. Furthermore, the distribution management unit 301 transmits the received posted message to the user device 12 of the distribution user and the user device 12 of the viewing user. The posted message includes, in addition to the content of the message, identification information of the viewing user (user account name, etc.), posted date and time, and the like. In addition, the message displayed in the moving image also includes a notification message "Mr. A has entered the room".

The distribution management unit 301 receives a request to display an object in the moving image being viewed from the user device 12 used by the viewing user. Objects for which a display request is made are objects displayed in the virtual space, and include gift objects provided by viewing users to distribution users who distribute moving images, evaluation objects that evaluate moving images favorably, and the like. A gift object may be an object that can be requested to be displayed without paying a price, or a gift object that can be requested to be displayed by paying a price. Alternatively, the gift object may be paid for when it is displayed in response to a display request. The distribution management unit 301 transmits a gift object display request to the user device 12 of the distribution user and the user device 12 of the viewing user together with the identification information of the gift object. When the server 13 receives the display request of the gift object, or when the distribution user performs a predetermined operation in response to the display request, the server 13 sends "User B gave fireworks" at a predetermined timing. and other notification messages to the user devices 12 of the broadcasting users and the user devices 12 of the viewing users.

The purchase processing unit 302 performs object purchase processing according to the user's operation. The purchase process includes a process of paying consideration (medium) such as coins, points, and tickets that can be used within the video application program. Also, the purchase process may include the process of exchanging, selling, or transferring an object. Also, the purchase processing unit 302 may execute a lottery (gacha) in which a predetermined number of objects are selected from among a plurality of objects by paying a price. The purchase processing unit 302 records the purchased object in at least one of the user device 12 and the server 13 in association with the user. When a user purchases an object in the distribution mode (or the closet mode before starting distribution), the purchase processing unit 302 may store the identification information of the purchased object in the storage 35 in association with the user who purchased the object. Also, when the user purchases an object in the viewing mode, the purchase processing unit 302 may store the identification information of the purchased object in the storage 35 in association with the distribution user who distributes the moving image. Sales of purchasable objects are distributed, for example, to broadcast users and service providers.

Next, various data stored in the storage 35 of the server 13 will be described. The storage 35 stores user management data 350 , avatar data 351 , and object data 352 in addition to a distribution program 353 .

The user management data 350 is information on users who use the moving image application program. Avatar data 351 is master data for drawing an avatar object, and is transmitted to user device 12 in response to a request from user device 12 .

The object data 352 is master data for drawing a gift object, and is transmitted to the user device 12 in response to a request from the user device 12 . The object data 352 includes data for drawing the gift object such as polygon data, as well as attribute information of the gift object.

Next, referring to FIG. 2, the user management data 350 will be described. User management data 350 is stored for each user. The user management data 350 includes user identification information (user ID), purchase media such as coins, points, delivery status, and the like. Coins are purchased by users. Points are given to the user at a predetermined timing such as when distribution is performed, when participating in an event, or when an object or the like is sold. The delivery status includes identification information of gift objects received by the user while the video is being delivered, information on messages, and the like. Note that the user management data 350 may store only either coins or points.

<Gift Object>
Next, the gift object will be explained. In the present embodiment, the gift objects include the first gift object that is displayed when the user device 12 used by the viewing user transmits a display request, and the second gift object that is displayed without being triggered by the display request transmitted by the viewing user. 2 gift objects. The second gift object is displayed in the moving image by the server 13 executing the distribution program 353 when the distribution status of the moving image satisfies the display conditions for the second gift object. In addition, when explaining without distinguishing a 1st gift object and a 2nd gift object, it demonstrates simply as a gift object.

An example of the condition for displaying the second gift object is that the distribution of the moving image has started within a predetermined period. For example, when a moving image is distributed within a predetermined period such as "19:00 to 20:00", the provided object is displayed in the moving image after a predetermined period of time has passed since the distribution of the moving image. Alternatively, the distribution user may determine the timing of displaying the second gift object on the condition that the moving image is distributed within a predetermined period. In this case, for example, an operation unit for executing display of the second gift object may be displayed on the screen, and the second gift object may be displayed when an operation of the operation unit by the distribution user is received.

The display condition of the second gift object may be a condition related to distribution of moving images. For example, another example of the display condition may be that the number of times of distribution and the cumulative distribution time obtained by accumulating the distribution times of a plurality of moving images satisfy a predetermined value. Another example of the display condition of the second gift object may be distributing a moving image using a predetermined avatar object or other objects.

Note that the second gift object may be displayed when the viewing status satisfies the display condition of the second gift object instead of or in addition to the distribution status satisfying the display condition of the second gift object. good. The viewing status is, for example, the number of viewers, the viewing time per user, the accumulated viewing time obtained by accumulating the viewing time of the viewing user who views the moving image, and the like. The second gift object may be displayed when these are equal to or greater than a predetermined value, and the second gift object may be displayed when these are less than the predetermined value.

<Video distribution method>
As a video distribution method, there is a video distribution method in which the user device 12 used by the distribution user generates, encodes, and transmits video data to the user device 12 used by the viewing user, and in addition to the user device 12 used by the distribution user, the viewing user There is a client rendering method in which the user device 12 used acquires data necessary for generating a moving image and generates a moving image. In this embodiment, a method of displaying a moving image on the user device 12 using the client rendering method will be described. Note that a hybrid method may be used in which the user device 12 used by the viewing user performs rendering of objects and other image processing using video data generated by the user device 12 used by the distribution user. may be used, or another moving image distribution method may be used.

<Drawing an object>
Next, a method of drawing an avatar object and other objects in a moving image will be described with reference to FIGS. 3 to 8. FIG.

FIG. 3 shows a broadcast user 100 and a user device 12 used by the broadcast user 100 . Here, the user device 12 is a smart phone. For convenience of explanation, the user device 12 set to the distribution mode will be referred to as a “distribution user device 12A”. The distribution user 100 puts the application program in distribution mode. Also, the distribution user 100 faces the distribution user device 12A so that at least his own face is included in the detection range 101 of the sensor unit 24, and executes the application program. Note that the detection range 101 shown in FIG. 3 is an example, and is not limited to the illustrated range.

The distribution user device 12A applies the tracking data output from the sensor unit 24 to the avatar data 221 to generate animation. The display 28 of the user device 12 displays a moving image of the virtual space including the avatar object. The relative distance between the virtual camera and the avatar object in the virtual space changes according to the relative distance between the distribution user 100 and the sensor unit 24 . That is, the shorter the relative distance in the real world, the shorter the relative distance between the virtual camera and the avatar object.

FIG. 4 shows an avatar object 105 placed in the virtual space 102 and a local coordinate system 106 set on the avatar object 105 . A local coordinate system 106 is a coordinate system set for each object having three-dimensional coordinates. A world coordinate system 103 is set in the entire virtual space 102 . The avatar object 105 operates based on the local coordinate system 106 based on the operation of the operation unit 27 of the distribution user 100 .

Although the method of controlling the action of the avatar object is not particularly limited, for example, in each of the operation directions 107 in FIG. , rotates in the Z-axis rotation direction 108 about the Z-axis of the local coordinate system. That is, the avatar object 105 rotates leftward as viewed from itself around the Z-axis of the local coordinate system 106 without changing its standing position. At this time, the avatar object 105 rotates by an amount corresponding to the length of the swipe operation. Similarly, when the broadcast user 100 swipes the operation unit 27 of the broadcast user device 12A leftward, the avatar object 105 rotates about the Z axis of the local coordinate system 106 in the direction opposite to the Z-axis rotation direction 108 .

Also, when the broadcast user 100 swipes the operation unit 27 of the broadcast user device 12A upward, the avatar object 105 rotates in the X-axis rotation direction 109 about the X-axis of the local coordinate system 106 . That is, the avatar object 105 looks up in the Z direction of the world coordinate system 103 and upward in the three-dimensional virtual space. Similarly, when broadcast user 100 swipes operation unit 27 of broadcast user device 12A downward, avatar object 105 rotates in the direction opposite to X-axis rotation direction 109 about the X-axis of the local coordinate system. In other words, the avatar object 105 looks in the direction opposite to the Z direction of the world coordinate system 103 and below the virtual space.

Also, an emote function (expression function) can be applied to the avatar object 105 . The emote function is one of the functions that can be expressed by the video application program 220, and is a function that activates the actions and facial expressions of the avatar object. is the component associated with the . The avatar object 105 can be applied with a predetermined number of basic emote functions such as "clapping", "waving", "putting hands together", and "peace". For example, "waving hand" is associated with the "right hand" layer of the avatar object 105 with a hand waving animation. The distribution user 100 performs a predetermined operation on the operation unit 27 to select one of these emote functions. The broadcast user device 12A applies the selected emote function to the avatar object 105 to cause the avatar object 105 to act.

Rendering of the gift object will now be described with reference to FIG. Each gift object is associated with a display area or display position in the virtual space 102 . The display area or display position is represented by coordinates in the virtual space 102 . The display position of the gift object differs depending on the type of object. For example, the user device 12 displays a gift object 111 such as a “stuffed toy” at any position in the front area 110 of the avatar object 105 . The user device 12 or the server 13 randomly selects a display position in the front area 110 of the avatar object 105 . At this time, the user device 12 may move the gift object 111 downward in the virtual space. Also, the gift object 111 may move within the front area 110 after appearing in the front area 110 .

Also, the user device 12 displays a gift object 113 such as a “hanging scroll” at one of a plurality of display positions 112 specified in advance in the area behind the avatar object 105 . An order is assigned to the display positions 112 . The user device 12 arranges the gift object 113 associated with this display position 112 in one display position 112 selected from among the plurality of display positions 112 in order.

A case will be described in which the server 13 receives, from the user device 12 used by the viewing user, a display request for gift objects 113 that are associated with the display positions 112 and exceed the number of display positions 112 . When the server 13 receives the gift object 113 indicated by "object 1" and the gift object 113 indicated by "object 2" while no gift object is displayed at the display position 112, the user device 12 displays the server The gift objects 113 are displayed in order at each of the display positions 112 according to the instructions sent from 13 .

When the server 13 receives a new display request for the gift object 113 indicated by "object 3" and the gift object 113 indicated by "object 4" from the user device of the viewing user in a state where there is no space in the display position 112, the server 13 adds the identification information of those gift objects 113 to the queue 114 . For convenience of explanation, the waiting queue 114 is schematically displayed in FIG. 5, but the gift object 113 added to the waiting queue 114 is not displayed on the screen.

The gift object 113 added to the waiting queue 114 waits for its turn to be displayed at the display position 112 . The user device 12 hides the already displayed gift object 113 when the non-display condition is satisfied. The non-display condition is that the display time of the gift object 113 reaches a predetermined time, that the distribution end time of the moving image or reaches a predetermined time before the distribution end time, and that the distribution user or the viewing user hides the gift object. etc. For example, the user device 12 hides the gift object 113 when the condition for hiding the gift object 113 of "object 1" is satisfied. As a result, the display position 112 where the gift object 113 was displayed becomes free. Next, based on the request from the server 13, the user device 12 displays the gift object 113 at the head of the waiting line 114 at the vacant display position 112 as indicated by the arrow 115 in FIG. Also, when there are gift objects 113 waiting in the waiting queue 114, the server 13 advances the waiting order as indicated by the arrow 116 in FIG.

The gift objects 113 added to the waiting queue 114 may be only the first gift objects, or may be a mixture of the first gift objects and the second gift objects. When the first gift object and the second gift object are associated with the same display position 112, the server 13 receives the display request or determines to display the second gift object, and displays the identification information of those gift objects. is added to the queue 114 .

As another aspect, the first gift object and the second gift object are associated with the same display position 112, and within the same time period, the server 13 receives the display request for the first gift object from the user device 12, and the server 13 determines to display the second gift object according to the delivery program 353, either the first gift object or the second gift object may be prioritized. For example, the server 13 may give priority to displaying the first gift object. In this case, even if the identification information of the second gift object is included in the waiting queue 114, the identification information of the first object is assigned in the order before the second gift object, and the second gift object is preceded by the identification information of the second gift object. may be displayed in Similarly, the server 13 may prioritize the display of the second gift object. In this case, even if the identification information of the first gift object is included in the waiting queue 114, it may be displayed before the first gift object.

As another mode, the second gift object is displayed after waiting for the display of all the first gift objects included in the waiting queue 114 to be completed without adding the second gift object to the waiting queue 114. good too. Specifically, when the server 13 determines to display the second gift object, it stops receiving the display request for the first gift object. At this time, the list of gift objects may not be displayed on the user device 12, or the list of gift objects may be displayed but the selection of gift objects may be disabled.

As another aspect, when it is decided to display the second gift object at the start of distribution of the moving image, such as when participating in an event, the server 13 displays at least the second gift object from the start of distribution of the moving image. The display request for the first gift object may not be accepted until the display of .

Also, during the period in which the second gift object is displayed, all the first gift objects may not be displayed. This is because, for example, the second gift object may be large in scale including the background, and the first gift object requested to be displayed does not match the worldview of the second gift object, or the first gift object may cause unintended interference with the avatar object 105 or other objects. In this aspect, the server 13 may not accept the display request of the first gift object during a predetermined period such as the period during which the second gift object is displayed. Alternatively, the server 13 can receive a display request for the first gift object while the second gift object is being displayed, and display the first gift object when the display of the second gift object is finished. can be

Next, with reference to FIGS. 6 and 7, collaboration delivery (co-starring function) will be described. In collaborative distribution, multiple distribution users can display their own avatar objects in one moving image. In this embodiment, the distribution user makes settings to permit or prohibit collaboration distribution, and the viewing user displays an avatar object corresponding to himself/herself in the video being distributed for which collaboration distribution is permitted. When participating in the collaboration distribution, the user device 12 used by the viewing user transmits a participation request to the user device 12 used by the distribution user 100 via the server 13 . When the distribution user approves the participation request, the distribution user 100 becomes the host user, and the viewing user who made the participation request becomes the guest user.

FIG. 6 schematically shows an avatar object corresponding to the host user (hereinafter referred to as host avatar object 105A) and an avatar object corresponding to the guest user (hereinafter referred to as guest avatar object 120). The host avatar object 105A corresponds to the first avatar object, and the guest avatar object 120 corresponds to the second avatar object.

The number of guest avatar objects 120 that can co-star with the host avatar object 105A (hereinafter referred to as the number of co-stars) is predetermined. When the server 13 receives from the user device 12 display requests equal to or greater than the co-starring number during the same period, the guest avatar object 120 is displayed according to the order of reception of the display requests. First, the guest avatar object 120 whose display request is accepted first is displayed at the display position 121 such as next to the host avatar object 105A. Then, the identification information of the guest avatar object 120 whose display request has been accepted after the second time is added to the co-star queue 122 . In FIG. 6, the identification information of the guest avatar object 120 indicated by "guest 2" and the identification information of the guest avatar object 120 indicated by "guest 3" are added in this order. For convenience of explanation, the co-starring waiting queue 122 is schematically displayed in FIG. 6, but the guest avatar object 120 added to the co-starring waiting queue 122 is not displayed on the screen.

Also, when performing collaborative distribution, the second gift object 125 can be displayed in association with the host avatar object 105A and the guest avatar object 120 . For example, second gift object 125 may be an attached gift object attached to host avatar object 105A and guest avatar object 120 . Second gift object 125 may also be an emote function or an emote function and object applied to host avatar object 105A and guest avatar object 120 . The emote function provided as the second gift object is an emote function other than the basic functions described above.

For example, the emote function as the second gift object may be a function of lifting, shaking, or manipulating the emote object 125A, which is also the second gift object. Specifically, the layer of the avatar object such as hands and arms is associated with the emote object 125A and the animation of the part. For example, the emote object 125A, which is the avatar object's "stein", is lifted, the "flag" is waved, the "gun" is shot, and the like. Emote functions other than basic functions require a relatively large number of man-hours for service providers to newly create them, so compared to other gift objects such as "glasses", added value within the application is high. For example, in the case of providing an emote function as the first gift object, the price, such as coins, is higher than that of the first gift object other than the emote function. Especially for a novice user, it is rare that the emote function is provided as the first gift object. However, by providing the distribution user 100 as the second gift object, the distribution user 100 can experience the emote function other than the basic function regardless of popularity or the number of viewing users. Note that the emote function as the second gift object 125 may be associated with the avatar object 105 before the emote function is manifested. When the emote function is provided, the user device 12 receives from the server 13 identification information designating the emote function and a command for manifesting the emote function. Then, based on the received identification information and command of the emote function, the user device 12 puts the emote function into a state in which it can be activated at a predetermined timing. In this manner, the user device 12 downloads components of various emote functions in advance, thereby reducing the amount of communication when the emote function is provided as the second gift object 125 during video distribution. Therefore, it is also possible to express the emote function immediately after the emote function is provided as the second gift object 125 .

Also, the avatar object 105 to which the emote function is applied is set. For example, the emote function may be applied to the gender (female, male) set for the avatar object 105, even though it is the same action of “lifting the mug”. Alternatively, the age (child, adult), height, race, and type (human, animal) of the avatar object 105 may be set as application targets for the emote function. The guest avatar object 120 exits the screen and becomes invisible when the exit condition is satisfied. The leaving condition is that the display time that has elapsed since the co-starring of the host avatar object 105A has reached a predetermined time, that the broadcasting user or the viewing user has performed an operation to leave the guest avatar object 120, and the like.

As shown in FIG. 7 , when the exit condition for guest avatar object 120 is satisfied, user device 12 causes guest avatar object 120 to exit display position 121 as indicated by arrow 126 . As a result, the display position 121 where the guest avatar object 120 was displayed becomes free. The user device 12 displays the first guest avatar object 120 in the co-star waiting queue 122 at the vacant display position 121 as indicated by an arrow 127 . The guest avatar object 120 displayed in place of the guest avatar object 120 that has left corresponds to the third avatar object. In the example shown in FIGS. 6 and 7, the guest avatar object 120 of “guest 2” is displayed at the display position 121. FIG. In addition, as indicated by an arrow 128, the server 13 advances the order of gift objects waiting in the co-play waiting queue 122 if any. In the example shown in FIGS. 6 and 7, the order of the guest avatar object 120 of "guest 3" is advanced.

When the guest avatar object 120 is associated with the second gift object 125 and displayed, the user device 12 hides the second gift object 125 at the same time when the guest avatar object 120 leaves. The second gift object 125 may be moved out of the screen together with the guest avatar object 120, or may be extinguished and hidden immediately after the exit condition is satisfied.

Then, when the new guest avatar object 120 is displayed, the user device 12 newly displays the new second gift object 125 in association with the guest avatar object 120 . For example, if the second gift object was an emote function, associate the new guest avatar object 120 with the emote function. User device 12 then associates the same second gift object 125 with each of the guest avatar objects 120 . It should be noted that the emote functionality provided does not have to involve the display of objects. In this case, the emote function is a performance gift.

Alternatively, user device 12 may change second gift object 125 for each guest avatar object 120 based on a request from server 13 . At this time, the server 13 selects one or a plurality of second gift objects 125 from an object group including a plurality of different second gift objects 125, and displays the selected second gift objects 125 in association with the guest avatar object 120. You may In this aspect, the server 13 uses data that associates the guest avatar object 120 and the second gift object 125 in advance, and when the guest avatar object 120 is displayed, the second gift associated with the guest avatar object 120 is displayed. Object 125 may be displayed. Alternatively, the second gift object 125 may be displayed based on the attribute information of the guest avatar object 120. FIG. The attribute information is not particularly limited, but may be the group to which the guest avatar object belongs, rarity level, height, gender, set age, and the like. For example, a female guest avatar object 120 may display a second gift object 125 that is a wearable object for females. Also, the server 13 may select the second gift object 125 using a predetermined lottery method such as a method using random numbers.

Alternatively, the user device 12 displays the second gift object 125 in association with at least one of the host avatar object 105A and the guest avatar object 120 only when a video is distributed using a specific host avatar object 105A. good too. Also, the user device 12 may associate and display the second gift object 125 only when a specific guest avatar object 120 co-stars. That is, when a guest avatar object 120 other than a specific guest avatar object 120 co-stars, the second gift object 125 is not displayed. The second gift object 125 is associated and displayed. The guest avatar object 120 displayed in association with the second gift object 125 may be posted as one of the events on the notification screen or home screen of the application program, for example. Alternatively, the guest avatar object 120 displayed in association with the second gift object 125 is not notified in advance, and the second gift object 125 is given to the guest avatar object 120 until co-starring with the host avatar object 105A. You may make it so that it is not known whether or not.

Alternatively, some or all of the second gift objects 125 displayed in association with the host avatar object 105A may be given to the host user corresponding to that host avatar object 105A. Also, part or all of the second gift object 125 displayed in association with the guest avatar object 120 may be given to the guest user corresponding to that guest avatar object 120 . In this aspect, the server 13 updates the user management information 223 and the user management data 350 corresponding to the user, making part or all of the second gift object 125 usable. The user device 12 of the user given the object or action as a gift can receive the user's input operation, display the object in the virtual space 102, or apply the action to the avatar object 105.

<Screen configuration>
Next, distribution screens displayed on the user device 12 will be described with reference to FIGS. 8 to 15. FIG.
FIG. 8 shows a delivery screen 150 displayed on the delivery user device 12A. The same animation is displayed on the display 28 of the user device 12 of the viewing user, although the operation buttons and the like are different.

The face of the avatar object 105 changes as the distribution user's expression changes, and the head of the avatar object 105 moves as the distribution user's head moves. Also, as described above, the position of the avatar object 105 changes according to changes in the relative distance between the broadcast user 100 and the sensor unit 24 . A message 151 is displayed on the distribution screen 150 for a predetermined period. The messages 151 include messages sent from the viewing user's user device 12 and messages automatically sent by the server 13 . Various operation units are displayed on the delivery screen 150 . For example, the delivery screen 150 may display a comment button 152 , an audio switching button 153 , a game button 154 , and an external video display button 155 . Selecting the comment button 152 allows the broadcast user to enter a comment. The input comment is displayed on the video. When the voice switching button 153 is selected, voice input can be switched. Game button 154 can be selected to start a game within the animation. When the external video display button 155 is selected, an operation to acquire a video from an external server or server 13 can be started. When the collaboration setting button 156 is selected, a screen for setting the collaboration delivery can be displayed. Also, on the delivery screen 150, a button for selecting an object that can be displayed in the moving image may be displayed based on the object data 352 of the delivery user. Furthermore, when a viewing user gives a gift during collaboration distribution, the distribution user can select a plurality of avatar objects 105 displayed in the video or distribution users corresponding to the avatar objects 105 as objects to which the gift is given. You may do so. The viewing screen displayed on the user device 12 of the viewing user includes a message input field, a display request transmission button for requesting display of the gift object, and a button for requesting co-starring.

FIG. 9 shows a delivery screen 160 displayed on the delivery user device 12A. When the viewing user performs an operation for sending a participation request using the user device 12 , an approval request window 162 is displayed on the distribution screen 160 . The approval request window 162 displays a standby button 163 for waiting (denying) approval and an approval button 164 for approval. When the approval button 164 is selected, the server 13 adds the identification information of the avatar object corresponding to the user who made the participation request to the collaboration distribution co-star waiting queue 122 to create a collaboration distribution participation list.

FIG. 10 shows an example of a collaboration distribution screen 170 displayed on the distribution user device 12A. A similar screen is also displayed on the display 28 of the user device 12 of the viewing user. On the collaboration distribution screen 170, the host avatar object 105A of the host user and the guest avatar object 120 of the guest user are displayed. Guest avatar object 120 is displayed at display position 121 next to host avatar object 105A.

Next, an example in which the second gift object 125 is displayed will be described with reference to FIGS. 11 to 15. FIG. The second gift object 125 may be displayed from the start of distribution of the moving image, or may not be displayed at the start of distribution of the moving image and may be displayed in the middle of the moving image. When displaying the second gift object 125 in the middle of the moving image, if there is a large difference between before and after the display of the second gift object 125 and it would be unnatural to display the second gift object 125 abruptly, the second gift object 125 A standby screen may be displayed between before and after the display of .

FIG. 11 shows a delivery screen 180 displaying a second gift object displayed on the delivery user device 12A. A similar screen is also displayed on the display 28 of the user device 12 of the viewing user. The second gift object 125 here includes a "night sky" background 125B and an animation of a fireworks object 125C. Note that the first gift object cannot provide the background 125B and the fireworks object 125C that matches the background 125B. For example, the distribution user 100 swipes the touch panel, which is the operation unit 27, in accordance with the display of the second gift object 125, rotates the avatar object 105 leftward as viewed from the avatar object 105, and turns the head upward. It can be rotated to take a posture of looking up at the fireworks object 125C.

The display condition of the second gift object 125 including the fireworks object 125C is, for example, the distribution user 100's participation in the event. A distribution user can participate in an event by starting distribution of the moving image within a predetermined period during which the event is held. The event may also be synchronized with the duration of a real-world fireworks display.

12 and 13 show a delivery screen 190 provided with an emote function as the second gift object 125 in collaboration delivery. A similar screen is also displayed on the display 28 of the user device 12 of the viewing user. As shown in FIG. 12, the delivery screen 190 includes a “camp” background 191 as the second gift object 125 . Background 191 may be a two-dimensional image, or may be composed of a plurality of three-dimensional objects. In addition to the host avatar object 105A and the guest avatar object 120, the delivery screen 190 displays the emote object 125A associated with the host avatar object 105A and the emote object 125A associated with the guest avatar object 120 as the second gift object 125. include. Also, the distribution screen 190 may include, as the second gift object 125 , an attached object 193 attached to the host avatar object 105 A and the guest avatar object 120 and corresponding to the background 191 . For example, host avatar object 105A and guest avatar object 120 may be provided with clothing related to "camping" as wearable objects. This mounted object is displayed even if the host user and guest user do not possess the mounted object.

The emote function in the delivery screen 190 is to lift up the emote object 125A "Mug" to make a "cheers", to lower the arm while holding the "Mug", and to drink with the "Mug". and placing a "stein" on a table or the like. When the host user or guest user performs a predetermined input operation such as long-pressing the distribution screen 190, an emote function selection section 192 is displayed. The emote function selection unit 192 can select each emote function. For example, when the host user operates the operation unit 27 of the user device 12 to select the emote function, the emote function is applied to the host avatar object 105A. When the guest user operates the operation unit 27 of the user device 12 to select the emote function, the emote function is applied to the guest avatar object 120 . Note that the emote function selection unit 192 corresponds to the selection operation unit.

Also, the action of the avatar object 105 provided by the emote function may be performed within the operable range determined based on the position of the avatar object 105 . The operable range is set as a range having three-dimensional coordinates in the virtual space, such as cylindrical, spherical, or hemispherical. When a plurality of avatar objects 105 perform collaborative distribution, the operable ranges of the avatar objects 105 may be set so as not to overlap each other. Alternatively, when the operable ranges of the avatar objects 105 overlap each other, when a part belonging to one avatar object 105 enters the overlapping range, control is performed so that a part belonging to the other avatar object 105 does not enter the overlapping range. may Specifically, the user device 12 determines whether or not the part of the avatar object 105 is included in the overlap range, and if the part is included in the overlap range, the user device 12 instructs the other avatar object to enter the overlap range. prohibit. Also, the motion direction may be set according to the height of the avatar object 105 . For example, when a tall avatar object 105 makes a "Cheers" motion in the horizontal direction, if there is a possibility of interfering with a short avatar object 105, the former avatar object 105 may may operate. According to these aspects, interference between avatar objects 105 can be suppressed. In addition, when the overlap range is provided, interference can be suppressed even when the avatar object 105 is brought closer.

In addition, the display mode of the emote object 125A changes when the display mode change condition is satisfied. The display mode change condition is, for example, that a predetermined time has elapsed since the display of the emote object 125A was started, or that a predetermined emote function such as "drink" has been performed a predetermined number of times. The emote object 125A in the initial state is in the state of "full drink", but after a predetermined period of time has passed, it changes to the transition state of "empty".

When the guest avatar object 120 leaves, the emote object 125A associated with the guest avatar object 120 is also hidden. At this time, the emote object 125A of the host avatar object 105A may be hidden at the same time as the emote object 125A associated with the guest avatar object 120 is hidden.

FIG. 13 shows delivery screen 190 with guest avatar object 120 leaving and new guest avatar object 120 added. When the server 13 adds a new guest avatar object 120, it also adds an emote object 125A associated with the guest avatar object 120. FIG. At this time, the emote object 125A may be newly associated with the host avatar object 105A at the same time as the emote object 125A associated with the guest avatar object 120 is displayed. As a result, the "stein" emote object 125A that has transitioned from the initial state such as "full" to the transition state such as "empty" becomes the "stein" emote object 125A in the initial state.

FIG. 14 shows a delivery screen 200 provided with an emote function as the second gift object 125 in collaboration delivery. A similar animation is also displayed on the display 28 of the viewing user's user device 12 . The delivery screen 200 includes a “pool” background 125D as the second gift object 125 . In addition to the host avatar object 105A and the guest avatar object 120, the delivery screen 200 also includes a "water gun" emote object 125A associated with the host avatar object 105A and the guest avatar object 120 as a second gift object 125. Also, the distribution screen 200 includes, as the second gift object 125, an attached object 203 attached to the host avatar object 105A and the guest avatar object 120 and corresponding to the background 125D. Water is emitted from the water gun emote object 125A by operating an emote function selection unit (not shown). The direction in which water is emitted from the emote object 125A is constant, but the direction of water emission can be changed by changing the orientation of the host avatar object 105A and the guest avatar object 120 by user's operation.

FIG. 15 shows a distribution screen 210 in which a second gift object 125 is provided based on information indicating real world conditions. A similar animation is also displayed on the display 28 of the viewing user's user device 12 . Delivery screen 210 includes avatar object 105, and second gift object 125, gift object 125E of "candy" and gift object 125F of "umbrella". The user device 12 displays these second gift objects 125 when it rains in the real world. In this aspect, the server 13 obtains the current location of the broadcasting user equipment 12A. The server 13 also acquires weather information for the acquired current location from an external server (not shown). When the server 13 determines that it is raining in the area where the distribution user device 12A is present, the server 13 transmits the identification information of the gift objects 125E and 125F to the user device 12 together with a display request. When the user device 12 receives the identification information of the gift objects 125E and 125F and the display request, the user device 12 reads the images of the gift objects 125E and 125F from the storage 22 and displays them. Note that the distribution user device 12A may acquire weather information from its own current location and transmit it to the server 13. FIG. Alternatively, the distribution user device 12A may acquire weather information from its own current location and determine whether to display the gift objects 125E and 125F from the acquired weather information. Also, the information indicating the situation in the real world is not particularly limited, but environmental information such as the weather and the area where the distribution user device 12A is located (urban area, mountainous area, etc.), time information, date information, time of distribution (season, etc.) ) are available.

The display condition for the second gift object 125 based on the information indicating the situation in the real world is, for example, that the information indicating the situation in the real world has changed.
(motion)
Next, with reference to FIGS. 16 and 17, a processing procedure when the host user and a plurality of guest users co-star will be described.

FIG. 16 is a timing chart when broadcast user 100 participates in an event in which second gift object 125 is displayed. The event is held within a preset period such as "19:00 to 20:00", for example. The display condition for the second gift object 125 is to start distributing the moving image within this period. The event scenario shown in FIG. 16 is a "fireworks display" event scenario, and is composed of "Part 1", "Part 2", and "Part 3". is displayed. In the video distributed by “distributor user A” who participated in the event from the start of the event, the second gift objects 125 of each part are displayed based on the request from the server 13 . On the other hand, in the video distributed by "distributor user B" who participated in the event from "part 2", the second gift object displayed in "part 2" and "part 3" is based on a request from server 13. 125 is displayed, and the second gift object 125 displayed in the "first part" is not displayed. Also, in the video distributed by the distribution user who participated in the event from the middle of each part, the animation from the point corresponding to the distribution start point of the video may be displayed. In this way, in the moving image of the distribution user 100 who participated in the event halfway through, the second gift object 125 is displayed halfway along the scenario, so the display of the second gift object 125 can be limited. . Therefore, since the second gift object 125 is not displayed carelessly, it is possible to suppress the decrease in the value of the gift object.

FIG. 17 shows the distribution user device 12A used by the host user when the second gift object is displayed in the collaboration distribution, the server 13, the distribution user device 12A used by the distribution user who is the guest user, and the viewing users who do not request co-starring. The processing procedure of the viewing user device 12B used is shown. As a premise, the distribution user 100 has made settings to permit collaboration distribution. The server 13 receives the participation request from the viewing user device 12B. The server 13 transmits a participation request to the broadcast user device 12A, and the broadcast user 100 approves the participation request. At this time, the distribution user device 12A transmits permission for the participation request to the server 13. FIG. The server 13 adds the viewing users to the collaboration distribution participation list, and transmits the participation list to the distribution user device 12A and the viewing user device 12B. Thus, the host avatar object 105A corresponding to the broadcasting user 100 and the guest avatar object 120 corresponding to the viewing user permitted to co-star are displayed on one screen. A viewing user who participates in the collaboration distribution becomes a distribution user as a guest user.

In the example shown in FIG. 17, it is assumed that the second gift object 125 is displayed at the same time as the guest avatar object 120 is displayed. When collaboration distribution is started, the distribution user device 12A transmits moving image configuration data used for generating moving images to the server 13 (step S11). The motion picture composition data includes at least tracking data that tracks the motion of the distribution user 100 . Also, the moving image configuration data includes audio data. The identification information of the host avatar object 105A may be included in the animation composition data or may be transmitted separately from the animation composition data.

The server 13 determines whether or not to display the second gift object based on the display condition of the second gift object 125 . The display conditions for the second gift object 125 are that the distribution user 100 participates in the event as described above, that the avatar object 105 of the distribution user 100 is a predetermined avatar object, and that the video distribution start time is a predetermined It is included in the date and period.

When the server 13 determines to display the second gift object, the identification information (ID) of the second gift object to be associated with the host avatar object 105A is sent to the broadcast user device 12A of the guest user along with the animation configuration data received from the broadcast user device 12A. and transmitted to the viewing user device 12B (step S12). The server 13 also transmits the identification information (ID) of the second gift object 125 to the distribution user device 12A (step S13). Various data for drawing avatar objects and gift objects are obtained in advance by the distribution user device 12A and the viewing user device 12B.

Similarly, the distribution user device 12A used by the guest user transmits moving image configuration data to the server 13 (step S14). The server 13 transmits the identification information (ID) of the second gift object to be associated with the guest avatar object 120 to the viewing user device 12B together with the moving image configuration data received from the distribution user device 12A (step S15). Also, the server 13 similarly transmits the moving image configuration data and the identification information (ID) of the second gift object to the distribution user device 12A (step S16). Further, the server 13 transmits the identification information (ID) of the second gift object to be associated with the guest avatar object 120 to the guest user's distribution user device 12A (step S17).

The distribution user device 12A and the viewing user device 12B generate an animation including the host avatar object 105A, the guest avatar object 120, the second gift object 125, etc., based on the received moving image configuration data and the identification information of the second gift object. It is displayed on the display 28 (steps S17 to S19). Note that steps S11 to S17 can be changed as appropriate. The order of steps S11 to S17 may be changed, one step may be divided into a plurality of steps, or a plurality of steps may be combined into one step. In short, the distribution user device 12A of the host user and the distribution user device 12A of the guest user transmit moving image composition data, the server 13 transmits the identification information of the gift object, and the distribution user device 12A and the viewing user device 12B It suffices if the moving image can be displayed based on the moving image configuration data sent from the device and the identification information of the gift object.

When the guest user's guest avatar object 120 exits the video, the exited guest user becomes the viewing user. Then, when a new guest avatar object 120 is added to the video, the distribution user device 12A, the server 13 and the viewing user device 12B repeat steps S11 to S20 described above. That is, the second gift object 125 is associated with the host avatar object 105A and displayed, and the second gift object 125 is associated with the new guest avatar object 120 and displayed. Since the host avatar object 105A does not leave, the second gift object 125 associated with the host avatar object 105A does not have to change its display. Also, if the second gift object 125 displayed in association with the guest avatar object 120 does not change due to the guest avatar object 120, the server 13 sends the second gift object to the distribution user device 12A and the viewing user device 12B. 125 identification information may be transmitted only once. In this case, the distribution user device 12A and the viewing user device 12B display the second gift object 125 based on the identification information of the second gift object 125 received from the server 13 each time the guest avatar object 120 is changed.

In this way, when the display conditions for the second gift object are satisfied in collaboration delivery, the second gift object 125 is displayed every time the guest avatar object 120 is added. For this reason, it is possible to increase the guest user's degree of satisfaction with collaboration delivery. In addition, when it is notified in advance that the second gift object will be displayed if the user participates in the collaboration distribution, it is possible to increase the willingness of the viewing user to participate in the collaboration distribution.

In FIG. 18, the display condition of the second gift object 125 may be presence or absence of action from the viewing user. In this case, the server 13 refers to the user management data 350 and determines whether or not there is no action from the viewing user for a predetermined time or longer (step S21). Specifically, it is determined whether or not a request to display the first gift object in the moving image being distributed has been received from the viewing user device 12B. At this time, in addition to the display request for the first gift object, it may be determined whether or not a message has been posted.

When the server 13 determines that the viewing user has performed an action within a predetermined period of time (step S21: Yes), the second gift object 125 is not displayed. On the other hand, if it is determined that no action has been taken by the viewing user within the predetermined time (step S21: None), the identification information of the second gift object 125 is transmitted to the distribution user device 12A and the viewing user device 12B. Upon receiving the identification information of the second gift object 125, the distribution user device 12A and the viewing user device 12B read the data for displaying the second gift object 125 corresponding to the identification information and display it on the display 28 (step S22). ). In this way, even distribution users 100 who make few requests to display the first gift object can liven up the animation. In addition, distribution users 100 are motivated to continue distributing moving images.

Next, the effects of this embodiment will be described.
(1) In collaboration distribution in which the host avatar object 105A and the guest avatar object 120 are displayed in a moving image, the second gift object 125 is displayed only when the distribution status satisfies the display conditions for the second gift object 125 . Therefore, it is possible to suppress the decrease in the added value of the gift object. Also, when the guest avatar object 120 corresponding to the guest user is newly added, the second gift object 125 is displayed in association with the guest avatar object 120 . Therefore, not only the host user but also all guest users who participate in the collaboration delivery can be satisfied.

(2) The user device 12 displays the second gift object 125 in the moving image when the moving image is distributed within a predetermined period. Also, when distribution of the moving image is started in the middle of the scenario, display of the second gift object 125 is started from the scene corresponding to the start of distribution of the moving image. Therefore, the second gift object 125 can be displayed only on limited occasions, so that the added value of the second gift object 125 can be prevented from decreasing. In addition, in the case of an event common to users within an application, the display of the second gift object 125 can be synchronized between a plurality of moving images, so that a moving image that looks like an event occurring in the real world can be displayed. can be delivered.

(3) The second gift object 125 is displayed after a predetermined period of time has elapsed from the start of distribution of the moving image within a predetermined period. Therefore, the chances of displaying the second gift object 125 are limited, and the decrease in the added value of the second gift object 125 can be suppressed.

(4) The second gift object 125 is displayed when there is no activity of the viewing user, such as a display request for the first gift object, for a predetermined period of time. Therefore, with the display of the second gift object 125 as a trigger, the range of expression of the distribution user can be expanded. In addition, it is possible to activate communication between the distribution user and the viewing user.

(5) When the emote function selection unit 192 is operated, the second gift object 125 is displayed in the moving image. Therefore, the second gift object 125 can be displayed at the timing requested by the user.

(6) The second gift object 125 is displayed when a specific avatar object is displayed in the moving image. Therefore, the chances of displaying the second gift object 125 are limited, and the decrease in the added value of the second gift object 125 can be suppressed. Also, it is possible to increase the chances that a specific avatar object is used by the broadcast user 100 .

(7) Display the second gift object 125 when the external conditions such as the weather in the real world satisfy the display conditions. Therefore, the chances of displaying the second gift object 125 are limited, and the decrease in the added value of the second gift object 125 can be suppressed. In addition, since the display of the second gift object 125 is synchronized with the external situation, it is possible to display a variety of moving images according to the season and time period in which the moving images are distributed.

(8) The emote function of the avatar object 105 is displayed as the second gift object 125; The emote object 125A, which is part of the emote function, is displayed in association with the parts forming each of the avatar objects 105. FIG. Emote functions are more valuable than other gift objects, so even users who have few opportunities to receive emote functions as gifts can use emote functions other than basic emote functions. Therefore, user satisfaction can be enhanced.

(9) A second gift object 125 containing the background of the avatar object 105 is displayed. Backgrounds are more valuable than other gift objects. Therefore, even users who cannot provide the background as the first gift object or who have few opportunities to receive the background as a gift can have the opportunity to use the background. Therefore, user satisfaction can be enhanced.

(10) Since the second gift object 125 including the wearing object of the avatar object 105 is displayed, user satisfaction can be enhanced.
(11) Since the first gift object requested by the viewing user to be displayed is preferentially displayed, it is possible to increase the satisfaction of the viewing user who has transmitted the display request for the first gift object.

(12) Since the second gift object is preferentially displayed, it is possible to progress the animation according to the scenario.
The above embodiment can be implemented with the following modifications. The above embodiments and the following modifications can be combined with each other within a technically consistent range.

- In the above-described embodiment, the guest user's avatar object is added to the moving image distributed by the host user by requesting co-starring. Alternatively, a moving image may be distributed in which avatar objects corresponding to predetermined users co-star without determining the host user or the guest user.

- In the above-described embodiment, the emote function is explained by exemplifying the movement of parts such as hands and arms of the avatar object and the expression of the avatar object, but the emote function is not limited to this. The emote function may change the standing position of the avatar object, make the avatar object walk or dance.

- In the above embodiment, the server 13 receives a gift object display request from the user device 12 and adds the identification information of the gift object to the waiting queue 114 . Alternatively, the user device 12 of the distribution user may receive a gift object display request from the server 13 and manage the queue 114 .

- In the above-described embodiment, the user device 12 is assumed to have a moving image application program installed therein for viewing and distributing moving images. Alternatively, an application program for viewing moving images and an application program for distributing moving images may be separated from each other. When performing distribution, a distribution application program is used to distribute moving images. For viewing, the video is viewed using a viewing application program. A gift object display request is made using a viewing application program.

- In the above-described embodiment, a client rendering method is used in which the distribution user device 12A and the viewing user device 12B receive moving image configuration data and the like and generate moving images. Instead of or in addition to this, a video distribution method in which the distribution user device 12A encodes video data may be used. As shown in FIG. 19, the server 13 transmits the identification information of the gift object to the distribution user device 12A (step S30). The distribution user device 12A generates and encodes an animation using the received identification information of the gift object, tracking data, and the like (step S31). At this time, a message from the viewing user and voice data may be encoded together with the animation. Also, the distribution user device 12A transmits the encoded data to the server 13 (step S32). The server 13 transmits the encoded data to the viewing user device 12B (step S33). Also, the distribution user device 12A displays the animation using the tracking data and the identification information of the gift object (step S34). The viewing user device 12B decodes the encoded data and displays the animation (step S35). In the case of collaborative distribution, the distribution user device 12A of the distribution user as the guest user may receive moving image composition data and the like and generate a moving image based on the moving image composition data. Alternatively, the broadcast user device 12A of the broadcast user as the guest user may receive encoded video data from the broadcast user device 12A of the broadcast user who is the host user.

- Although the sensor unit 24 acquires detection data obtained by detecting changes in the user's facial expression, movement of the head, and the relative position of the user with respect to the sensor unit 24, at least one of them may be acquired. In addition to or instead of at least one of a change in the user's facial expression, a movement of the head, and a relative position of the user, the sensor unit 24 detects other data such as detection data that detects movements other than the movement of the head. Detection data may be acquired.

- The virtual space displayed in the moving image may be an augmented reality (AR) space. For example, an image of the real world captured by the camera of the user device 12 may be overlaid with an animation of an avatar object, a gift object, or the like. Alternatively, an animation of a gift object or the like may be superimposed on an image of the real world including the user captured by the camera of the user device 12 .

- In the above embodiment, the user device 12 is an information processing device such as a smart phone, a mobile phone, a tablet terminal, a personal computer, a console game machine, or a wearable computer such as a head-mounted display. Instead of this, a system provided in a studio for video distribution, which includes an information processing device including a control unit 20 and the like, a sensor unit 24 worn on the distribution user's body, and a tracking system that detects the position of the sensor unit 24 A system including the system, the operation unit 27, the speaker 25, and the display 28 may be used as a system for distributing moving images. The tracking system may include a multi-axis laser emitter that emits pulsed laser light for synchronization. The sensor unit 24 includes a sensor that detects laser light, and detects its own position and orientation while synchronizing with a synchronization pulse. For the sensor unit 24, for example, Vive Tracker (registered trademark) and Vive Base Station provided by HTC Corporation (registered trademark) can be used.

- In the above embodiment, the sensor unit 24 is provided on the user device 12 side, but the present invention is not limited to this aspect. For example, at least part of the sensor unit 24 may be worn on the body of the distribution user or provided near the distribution user. FIG. 20 shows a video distribution system installed in a video distribution studio, comprising a camera 229, a microphone 230, a controller 226, a distribution server 228, and the like. In addition, the moving image distribution system includes a tracking system including mounting sensors 227 worn on the hands and feet of the distribution user 100 and a position detection unit 225 for specifying the positions of the mounting sensors 227 and the like. Camera 229 photographs the face of distribution user 100 . The distribution server 228 generates animation by applying the tracking data obtained from the tracking system and the facial expression data obtained from the camera 229 to the avatar object. Also, an animation obtained by rendering the background of the virtual space and the avatar object is distributed to the viewing user device 12B as moving image data together with the sound. Also, for example, the tracking system may be composed of a camera or the like that detects a marker attached to the body of the distribution user.
Next, technical ideas that can be grasped from the above-described embodiment and another example will be added below together with their effects.
[1]
A computer that displays video on the display,
a first image processing unit that displays a moving image of a first avatar object reflecting the motion of the first user and a second avatar object reflecting the motion of the second user;
a first gift object display processing unit that displays the first gift object in response to transmission of a display request by a viewing user who watches the moving image;
When the display condition of the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied, the second gift object associated with the first avatar object is displayed, and the second avatar object is displayed. function as a second image processing unit that displays the second gift object associated with the
The second image processing unit displays the second gift object according to a scenario, and when the first user starts distributing the moving image in the middle of the scenario within a predetermined period, the A program for starting display of the second gift object from a scene corresponding to a distribution start point of a moving image.
[2]
the display condition for the second gift object is that the first user participates in an event that is held at a certain time;
the period comprises a plurality of event periods that are executed in sequence, each of the event periods being associated with the second gift object;
The second image processing unit displays the second gift object associated with the event period corresponding to the distribution start point of the moving image when distribution of the moving image is started from the event period after the second event period. , the program according to [1], wherein the second gift object associated with the event period before the distribution start time is not displayed.
[3]
The second image processing unit hides the second gift object associated with the second avatar object when hiding the second avatar object from the moving image, and hides the second gift object associated with the second avatar object. The program according to [1] or [2], displaying the second gift object associated with the third avatar object in the moving image when an avatar object is newly displayed in the moving image.
[4]
The program according to any one of [1] to [3], wherein the second image processing unit displays the second gift object in association with a part constituting each avatar object.
[5]
The program according to any one of [1] to [4], wherein the second image processing unit displays the second gift object after a predetermined time has elapsed from the start of distribution of the moving image.
[6]
The program according to [1], wherein the second image processing unit displays the second gift object when the display condition that the viewing user's no activity on the moving image has continued for a predetermined time period is satisfied.
[7]
The second image processing unit displays a selection operation unit for displaying the second gift object in the moving image when a display condition is satisfied, and displays the selection operation unit when the selection operation unit is operated. The program according to any one of [1] to [6], displaying the second gift object in the moving image.
[8]
The second image processing unit displays an expressive function selection unit for activating an expressive function of an avatar object as the second gift object, and displays an expressive function selection unit for activating an expressive function of the avatar object as the second gift object. The program according to any one of [1] to [7], which expresses the expression function by
[9]
The program according to any one of [1] to [8], wherein the second image processing unit displays the second gift object including a background of an avatar object.
[10]
The program according to any one of [1] to [9], wherein the second image processing unit displays the second gift object including a wearable object to be worn on a part of the avatar object.
[11]
A computer that displays video on a display
a first image processing step of displaying, in a video, a first avatar object reflecting the movement of the first user and a second avatar object reflecting the movement of the second user;
a first display processing step of displaying a first gift object triggered by transmission of a display request by a viewing user viewing the moving image;
When the display condition of the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied, the second gift object associated with the first avatar object is displayed, and the second avatar object is displayed. and performing a second image processing step of displaying the second gift object associated with
In the second image processing step, the second gift object is displayed according to a scenario, and if the first user starts distributing the moving image from the middle of the scenario within a predetermined period, the An information processing method, wherein the display of the second gift object is started from a scene corresponding to a distribution start point of a moving image.
[12]
An information processing device that displays a moving image on a display of a user device,
Drawing data for transmitting to the user device data for drawing a first avatar object reflecting the movement of the first user and data for drawing a second avatar object reflecting the movement of the second user. a sending step;
a first display processing step of transmitting a request for displaying a first gift object to the user device, triggered by transmission of a display request by a viewing user viewing the moving image;
When the display condition for the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied, the display request for the second gift object associated with the first avatar object and the second avatar object are met. and a display request transmission step of transmitting a display request for the second gift object associated with the user device to the user device,
In the display request transmission step, a display request for the second gift object is transmitted to the user device according to a scenario, and the first user requests distribution of the moving image from the middle of the scenario within a predetermined period. An information processing device that, when started, transmits to the user device a request to display the second gift object corresponding to a scene corresponding to a distribution start point of the moving image.
[13]
An information processing method executed by an information processing device that displays a moving image on a display of a user device,
The information processing device
Drawing data for transmitting to the user device data for drawing a first avatar object reflecting the movement of the first user and data for drawing a second avatar object reflecting the movement of the second user. a sending step;
a first display processing step of transmitting a request for displaying a first gift object to the user device, triggered by transmission of a display request by a viewing user viewing the moving image;
When the display condition for the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied, the display request for the second gift object associated with the first avatar object and the second avatar object are met. and a display request transmission step of transmitting a display request for the second gift object associated with the user device to the user device,
In the display request transmission step, a display request for the second gift object is transmitted to the user device according to a scenario, and the first user requests distribution of the moving image from the middle of the scenario within a predetermined period. An information processing method, wherein, when started, a request to display the second gift object corresponding to a scene corresponding to a time point at which distribution of the moving image is started is transmitted to the user device.

11 ... Video distribution system,
12, 12A, 12B... User device 13... Server

Claims (20)

A computer that displays video on the display,
a first image processing unit that displays an avatar object reflecting a user's movement in the video;
a first gift object display processing unit that displays the first gift object in response to transmission of a display request by a viewing user who watches the moving image;
functioning as a second image processing unit for displaying the second gift object when the display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied;
The first image processing unit displays a first avatar object reflecting movement of a first user and a second avatar object reflecting movement of a second user in the moving image,
The second image processing unit reproduces the second gift object associated with the first avatar object when the display condition that the viewing user has not taken any action on the moving image for a predetermined period of time is satisfied. A program for displaying in the animation and displaying the second gift object associated with the second avatar object . 2. The program according to claim 1 , wherein said second image processing unit displays said second gift object in association with a part constituting said first avatar object and a part constituting said second avatar object. The second image processing unit displays an expression function selection unit for activating an expression function of the first avatar object or the second avatar object as the second gift object, 3. The program according to claim 1 or 2, wherein said expressive function is expressed based on a user's operation of said expressive function selection unit corresponding to 2 avatar objects. The program according to any one of claims 1 to 3 , wherein said second image processing section displays said second gift object including a background of said first avatar object and said second avatar object. 5. The second image processing unit according to any one of claims 1 to 4 , wherein the second gift object including an attachment object attached to parts of the first avatar object and the second avatar object is displayed. program. The second image processing unit hides the second gift object associated with the second avatar object when hiding the second avatar object from the moving image, and hides the second gift object associated with the second avatar object. 6. The program according to any one of claims 1 to 5, wherein when an avatar object is newly displayed in the moving image, the second gift object associated with the third avatar object is displayed in the moving image. A computer that displays video on the display,
a first image processing unit that displays an avatar object reflecting a user's movement in the video;
a first gift object display processing unit that displays the first gift object in response to transmission of a display request by a viewing user who watches the moving image;
functioning as a second image processing unit for displaying the second gift object when the display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied;
The second image processing unit displays the second gift object according to the attribute of the avatar object when the display condition that the viewing user does not take any action on the moving image continues for a predetermined period of time is satisfied. A program displayed in the moving image. 8. The program according to claim 7 , wherein said second image processing section displays said second gift object in association with a part constituting said avatar object. The second image processing unit displays an expressive function selection unit for activating an expressive function of the avatar object as the second gift object, and displays an expressive function selection unit for operating the expressive function selection unit by a user corresponding to the avatar object. 9. The program according to claim 7 or 8 , which expresses the expressive function based on. 10. The program according to any one of claims 7 to 9 , wherein said second image processing section displays said second gift object including a background of said avatar object. 11. The program according to any one of claims 7 to 10 , wherein said second image processing unit displays said second gift object including an attached object attached to a part of said avatar object. 3. The second image processing unit displays the second gift object in the moving image when a request to display the first gift object for the moving image is not received from a viewing user device used by the viewing user. 12. The program according to any one of 1 to 11 . The second image processing unit according to any one of claims 1 to 12, wherein the second image processing unit displays the second gift object in the moving image when a message regarding the moving image is not received from the viewing user device used by the viewing user. program as described. The second image processing unit displays in the moving image a selection operation unit for displaying the second gift object in the moving image when the display condition is satisfied, and when the selection operation unit is operated 14. The program according to any one of claims 1 to 13 , wherein said second gift object is displayed in said animation. A computer that displays video on a display
a first image processing step of displaying an avatar object reflecting a user's movement in the moving image;
a first display processing step of displaying a first gift object triggered by transmission of a display request by a viewing user viewing the moving image;
a second image processing step of displaying the second gift object when the display condition of the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied;
In the first image processing step, a first avatar object reflecting movement of a first user and a second avatar object reflecting movement of a second user are displayed in the moving image;
In the second image processing step, the second gift object associated with the first avatar object is displayed when the display condition that the viewing user has not taken any action on the moving image for a predetermined period of time is satisfied. An information processing method , wherein the second gift object associated with the second avatar object is displayed while displaying the moving image. An information processing device that displays a moving image on a display of a user device,
a drawing data transmission step of transmitting data for drawing an avatar object reflecting a user's movement to the user device;
a first display processing step of transmitting a request for displaying a first gift object to the user device, triggered by transmission of a display request by a viewing user viewing the moving image;
a display request transmission step of transmitting a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied; death,
In the drawing data transmitting step, data for drawing a first avatar object reflecting movement of a first user and a second avatar object reflecting movement of a second user are transmitted to the user device;
In the display request transmission step, when the display condition is satisfied that the viewing user has not taken any action on the moving image for a predetermined period of time, the second gift object associated with the first avatar object and the An information processing device that transmits a request to display the second gift object associated with the second avatar object to the user device . An information processing method executed by an information processing device that displays a moving image on a display of a user device,
The information processing device
a drawing data transmission step of transmitting data for drawing an avatar object reflecting a user's movement to the user device;
a first display processing step of transmitting a request for displaying a first gift object to the user device, triggered by transmission of a display request by a viewing user viewing the moving image;
and a display request transmission step of transmitting a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied. ,
In the drawing data transmitting step, data for drawing a first avatar object reflecting movement of a first user and a second avatar object reflecting movement of a second user are transmitted to the user device;
In the display request transmission step, when the display condition is satisfied that the viewing user has not taken any action on the moving image for a predetermined period of time, the second gift object associated with the first avatar object and the An information processing method , wherein a request for displaying the second gift object associated with the second avatar object is transmitted to the user device . A computer that displays video on a display
a first image processing step of displaying an avatar object reflecting a user's movement in the moving image;
a first display processing step of displaying a first gift object triggered by transmission of a display request by a viewing user viewing the moving image;
a second image processing step of displaying the second gift object when the display condition of the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied;
In the second image processing step, the second gift object corresponding to the attribute of the avatar object is generated when the display condition that the viewing user does not take any action on the moving image continues for a predetermined period of time is satisfied. An information processing method displayed in the moving image. An information processing device that displays a moving image on a display of a user device,
a drawing data transmission step of transmitting data for drawing an avatar object reflecting a user's movement to the user device;
a first display processing step of transmitting a request for displaying a first gift object to the user device, triggered by transmission of a display request by a viewing user viewing the moving image;
a display request transmission step of transmitting a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied; death,
In the display request transmission step, the second gift object is displayed according to the attribute of the avatar object when the display condition that the viewing user has not taken any action on the moving image for a predetermined period of time is satisfied. An information processing device that transmits a request to the user device . An information processing method executed by an information processing device that displays a moving image on a display of a user device,
The information processing device
a drawing data transmission step of transmitting data for drawing an avatar object reflecting a user's movement to the user device;
a first display processing step of transmitting a request for displaying a first gift object to the user device, triggered by transmission of a display request by a viewing user viewing the moving image;
and a display request transmission step of transmitting a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied. ,
In the display request transmission step, the second gift object is displayed according to the attribute of the avatar object when the display condition that the viewing user has not taken any action on the moving image for a predetermined period of time is satisfied. A method of processing information, wherein a request is sent to the user equipment .