JP2023086784A - Moving image data processing system, moving image data processing method, and moving image data processing program - Google Patents

Abstract

To make interaction between distributing users and viewing users of moving images active.SOLUTION: A user device 12 executes the processes of: switching between a distributing mode for distributing a moving image and a viewing mode for viewing a moving image distributed by another user; associating a group with a user and registering it; displaying a moving image based on moving image data distributed by a distributing user who distributes the moving image on the display unit of a user device used by a viewing user who watches the moving image; receiving an operation of the viewing user for an operation reception unit displayed on the display unit of the user device, and transmitting a request to display a gift object associated with points on the moving image; and displaying, on the display unit, evaluation information obtained by evaluating the group based on statistical results reflecting the points based on the display request transmitted for the moving image of the distributing user belonging to the group.SELECTED DRAWING: Figure 1

Description

Patent Act Article 30, Paragraph 2 Application Applied Article 30, Paragraph 2, April 5, 2019, website https://reality-notice. wrightflyer. net/805245028f78ca39a75afb9a4f9d982c6268c16c. On html, GREE Co., Ltd. publishes the video distribution system, video distribution method, information processing device, and video viewing program invented by Takumi Fukuda.

Patent Act Article 30, Paragraph 2 Application Applied Article 30, Paragraph 2, April 23, 2019, website https://reality-notice. wrightflyer. net/180fde13eff5a1236a71156f469312e6dde7bee0. On html, GREE Co., Ltd. publishes the video distribution system, video distribution method, information processing device, and video viewing program invented by Takumi Fukuda.

There is an application for application of Article 30, Paragraph 2 of the Patent Act Application of Article 30, Paragraph 2, April 5, 2019, website https://twitter. com/WFLE_REALITY/, https://twitter.com/WFLE_REALITY/. com/WFLE_REALITY/status/1114120999539077122, GREE, Inc. discloses the video distribution system, video distribution method, information processing device, and video viewing program invented by Takumi Fukuda.

There is an application for application of Article 30, Paragraph 2 of the Patent Act Application of Article 30, Paragraph 2, April 23, 2019, website https://twitter. com/WFLE_REALITY/, https://twitter.com/WFLE_REALITY/. com/wfle_reality/status/1120613765966225408, GREE, Inc. discloses the video distribution system, video distribution method, information processing device, and video viewing program invented by Takumi Fukuda.

Patent Act Article 30, Paragraph 2 application filed Article 30, Paragraph 2 applies, April 8, 2019 to April 14, 2019, April 26, 2019 to May 6, 2019 date, website https://le. wrightflyer. net/reality/, https://reality-public. akamaized. net/viewer/download. At the "team battle event" and "GW team battle" held in the VTuber live app "REALITY" specified by html, GREE Co., Ltd. used the video distribution system, video distribution method, and information processing invented by Takumi Fukuda. Disclosure of device and video viewing program

The present invention relates to a moving picture data processing system, a moving picture data processing method and a moving picture data processing program.

2. Description of the Related Art Conventionally, there has been known a moving picture distribution system that generates animation of a character object based on the motion of an actor and distributes a moving picture including the animation of the character object (see, for example, Patent Document 1).

In this type of moving image delivery system, a system has been proposed in which an arbitrary object is displayed in a moving image by a viewing user's operation. The object displayed in the moving image by the viewing user is, for example, a gift object for the wearable object.

JP 2015-184689 A

In the moving image distribution system as described above, the number of viewing users, the viewing time, or the number of times of viewing the moving image tends to increase as the real-time interaction between the distributing user and the viewing user becomes more active. Therefore, there is a demand for distributing moving images that allow distribution users and viewing users to easily interact with each other.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object of the present invention is to activate interaction between moving image distribution users and viewing users.

A video processing system for solving the above problems is a switching unit for switching between a distribution mode for distributing a video and a viewing mode for viewing a video distributed by another user for each user device, and a group associated with a user and registered. a group registration unit, a first display control unit for displaying a video based on video data distributed by a distribution user on a display unit of the user device in the viewing mode, and a display on the display unit of the user device in the viewing mode. a transmission unit that receives a user's operation on the operation reception unit and transmits a request to display the gift object associated with the points on the moving image; a second display control unit that displays on the display unit evaluation information obtained by evaluating the group based on statistical results that reflect the points based on the display request.
A moving image data processing method for solving the above problems is a moving image data processing method executed by one or more computers, wherein each user device has a distribution mode for distributing a moving image and viewing a moving image distributed by another user. a step of associating a group with a user and registering it; a step of displaying a video based on video data distributed by a distribution user on a display unit of the user device in the viewing mode; a step of receiving a user's operation on an operation receiving unit displayed on the display unit of the user device in mode, and transmitting a request to display a gift object associated with points on the moving image; and the distribution belonging to the group. and displaying, on the display unit, evaluation information obtained by evaluating the group based on statistical results reflecting points based on the display request sent to the user's moving image.

A moving image data processing method for solving the above problems includes a process in which one or more computers switch between a distribution mode in which moving images are distributed and a viewing mode in which videos distributed by other users are viewed, and a group is associated with a user. A process of registering, a process of displaying a video based on video data distributed by a distribution user who distributes a video on a display unit of a user device used by a viewing user who watches the video, and a process of displaying on the display unit of the user device a process of receiving an operation of the viewing user on the operation receiving unit and transmitting a display request to the video of the gift object associated with points; and a process of displaying on the display unit evaluation information obtained by evaluating the group based on statistical results in which the points based on the display request are reflected.

A video data processing program for solving the above problems comprises a mode switching unit for switching one or more computers between a distribution mode for distributing videos and a viewing mode for viewing videos distributed by other users; a first display control unit for displaying a moving image based on the obtained moving image data on a display unit; a display request transmission unit that transmits a display request for a gift object that is an object and is associated with a point; It functions as a second display control unit for displaying.
In the moving image data processing program, it is preferable that the first display control unit displays moving image data including a moving image of the avatar object to which action information is applied on the display unit.
In the moving image data processing program, it is preferable that the first display control unit displays on the display unit moving image data including real-world moving images based on photographed data captured by a photographing device provided in the user device.
In the moving image data processing program, it is preferable that the evaluation information is information obtained by evaluating the groups based on different evaluation axes.
It is preferable that the moving picture data processing program further comprises a message display unit for displaying a message associated with the user who has made the display request together with the gift object for which the display request is made.
In the moving image data processing program, it is preferable that the evaluation information is information obtained by evaluating the group based on a history of display requests for gift objects requiring consideration.

A video data processing method for solving the above problems is a video data processing method executed by one or more computers, wherein the computer has a distribution mode for distributing videos and viewing videos distributed by other users. A switching process for switching between a viewing mode, a first display control process for displaying a moving image based on moving image data distributed by a distribution user on a display unit, and a user's operation on an operation receiving unit displayed on the display unit in the viewing mode. and a display request transmission process for transmitting a display request for a gift object associated with points, which is an object for the video distributed by the distribution user, and a statistical result reflecting the points based on the display request a second display control process for displaying evaluation information obtained by evaluating the group based on the evaluation information on the display unit.

According to the present invention, it is possible to activate exchanges between moving image distribution users and viewing users.

1 is a schematic diagram showing an embodiment of a video distribution system; FIG. FIG. 4 shows the configuration of data stored in the server of the same embodiment, where (a) is user management information, (b) is possession list information, (c) is gift object information, and (d) is event information. FIG. 4 is a schematic diagram showing the positional relationship between the user device and the user in the physical space in the same embodiment; FIG. 4 is a schematic diagram for explaining a team competition event in the same embodiment; FIG. 4 is an explanatory diagram of an event participation screen displayed on the user device according to the embodiment; The figure which shows an example of the screen displayed on the user device of the same embodiment. It is an example of transition of screens displayed on the user device of the same embodiment, wherein (a) is a viewing screen, (b) is a viewing screen displayed when a gift button is operated, and (c) is a gift object. shows a viewing screen on which is displayed. 4 shows a video distribution list of the same embodiment; 4 is a flowchart showing a procedure for calculating accumulated points in the team competition event of the embodiment; 4 is a flowchart showing a procedure for determining victory or defeat in the team competition event of the same embodiment;

An embodiment of a video distribution system will be described below with reference to the drawings.
As shown in FIG. 1 , the video delivery system 11 includes multiple user devices 12 and a server 13 . The moving picture distribution system 11 is a system in which a user uses a user device 12 to distribute a moving picture including an avatar object corresponding to the user to the user devices 12 used by other users via the server 13 . A moving image application program for viewing and distributing moving images is installed in the user device 12 . Hereinafter, a user who distributes a video is called a "distribution user", a user who views a video distributed by the distribution user is called a "viewing user", and when they are not distinguished, they are simply called a "user". A distribution user can also be a viewing user who views a video distributed by another distribution user when the distribution user himself/herself does not distribute a video. Note that the user device 12 corresponds to a distribution device and a viewing device.

(user device)
The user device 12 is a smart phone (multifunctional phone terminal), a tablet terminal, a personal computer, a console game machine, a wearable computer such as a head-mounted display, and an information processing device other than these devices capable of reproducing moving images.

The user device 12 includes a computer processor 20 , memory 21 , storage 22 (storage medium), and communication interface (I/F) 23 . The computer processor 20 is an arithmetic device that loads an operating system and other programs into the memory 21 from the storage 22 or other storage and executes instructions retrieved from the memory 21 . The computer processor 20 is one or more arithmetic circuits such as a CPU (Central Processing Unit), GPU (Graphic Processing Unit), NPU (Neural network Processing Unit). The communication I/F 23 can transmit and receive data to and from the server 13 and other user devices 12 via the network 14 . The network 14 includes various networks such as a local area network and the Internet. Communication I/F 12 is implemented as hardware, software, or a combination thereof.

The memory 21 is a main storage device (recording medium) directly readable and writable by the computer processor 20, and is composed of a semiconductor memory or the like. The storage 22 is an auxiliary storage device (recording medium), such as a magnetic disk, an optical disk, or a semiconductor memory. The storage 22 can also be used by combining multiple storages. The storage 22 stores a video application program 22A, avatar data 22B for drawing an avatar object, and other information for executing the video application program 22A. The moving image application program 22A includes a moving image distribution program and a moving image viewing program, and switches between a distribution mode in which the user himself/herself distributes a moving image and a viewing mode in which the user views a moving image distributed by another distribution user according to a user's instruction. be done. Avatar data 22B is three-dimensional model data for generating a three-dimensional animation. The user device 12 acquires the avatar data 22B from the server 13 at a predetermined timing. For example, the avatar data 22B includes skeletal data and mesh data for rendering an avatar object following the skeletal data. The avatar data 22B is model data capable of moving at least the head, eyes, mouth, hair, and the like.

The user device 12 also includes a sensor unit 24 , a speaker 25 , a microphone 26 , an operation section 27 and a display 28 . At least one of the sensor unit 24, the speaker 25, the microphone 26, the operation unit 27, and the display 28 may be provided as the same device as the computer processor 20, or may be provided separately. The sensor unit 24 corresponds to the detection section, and the display 28 corresponds to the display section.

The sensor unit 24 is a sensor group that detects changes in the user's facial expression (including blinking, opening and closing of the mouth, etc.), head movements, and changes in the user's relative position to the sensor unit 24 . For example, the sensor unit 24 includes an infrared camera that detects an infrared ray reflected from the user's face, an infrared camera that emits infrared rays toward the user, a camera that captures the user's face, and image processing of the data captured by the camera. and at least one of an image processing unit. Alternatively, the sensor unit 24 may be a sensor other than this, or may be further combined with sensors other than the above sensors such as an acceleration sensor and a gyro sensor.

The speaker 25 converts the audio data into audio and outputs it. The microphone 26 receives voice uttered by the user and converts it into voice data. The operation unit 27 includes a touch panel integrated with the display 28, operation buttons, a keyboard, a mouse, a controller, etc. provided on the housing of the user device 12 or the like. The display 28 outputs various images according to output instructions from the computer processor 20 .

The computer processor 20 functions as an application management section 20A, a motion data generation section 20B, and a display control section 20C by executing a video application program 22A stored in the storage 22. FIG. The application management unit 20A manages moving image application programs. The application management section 20A receives a request from the operation section 27 or a request from the server 13, and outputs the request to the motion data generation section 20B or the display control section 20C according to the content of the request. The application management unit 20A also transmits requests from the motion data generation unit 20B and the display control unit 20C to the server 13 and records various data received from the server 13 in the storage 22 . The application management unit 20A corresponds to the motion information transmission unit and the request transmission unit, the motion data generation unit 20B corresponds to the motion detection unit, and the display control unit 20C corresponds to the first display control unit and the second display control unit. corresponds to the identification information display portion.

The motion data generator 20B acquires from the sensor unit 24 detection data obtained by detecting the user's facial expression, head movement, and the relative position of the user with respect to the sensor unit 24, and applies the acquired detection data to the avatar data 22B.

In the distribution mode, the display control unit 20C displays the data received from the server 13 while displaying the avatar object to which the detected data is applied. In the distribution mode, the display control unit 20C may display a moving image by combining the moving image data generated by itself and the data received from the server 13, or may receive the entire data for displaying the moving image from the server 13. You can also display a video using In addition, the display control unit 20C reads image data stored in the storage 22 and displays various screens on the display 28 in response to a request from the application management unit 20A when no video is being distributed or viewed. . Such a screen may be displayed when the distribution user edits his/her own avatar object or sets a moving image application program. Furthermore, the display control unit 20C reproduces the moving image using the moving image data received from the server 13 in the viewing mode. The display control unit 20C may reproduce a data file downloaded from the server 13 and stored in the storage 22, or may perform streaming reproduction in which data is received from the server 13 and reproduced.

(server)
Next, the server 13 will be explained. The server 13 is used by a service provider or the like who provides a platform service for distributing moving images. The server 13 has a computer processor 30 , a memory 31 , a storage 32 and a communication I/F 33 . Computer processor 30 is similar in configuration to computer processor 20 of user device 12 . The computer processor 30 may be configured by combining a plurality of arithmetic circuits. Also, the memory 31 , storage 32 , and communication I/F 33 have the same configurations as those of the user device 12 . The server 13 may be composed of a plurality of devices, and the computer processor 30, memory 31, storage 32, and communication I/F 33 may be distributed among these devices.

The storage 32 stores a distribution program 32A. The computer processor 20 functions as a distribution manager 30A, a video generator 30B, and a purchase processor 30C by executing a distribution program 32A. Note that the distribution management unit 30A corresponds to the group registration unit, the calculation unit, and the evaluation unit.

The distribution management unit 30A stores various data received from the user device 12 in the storage 32, and based on the requests received from the user device 12, outputs requests to the video generation unit 30B and the purchase processing unit 30C. Furthermore, the distribution management unit 30A receives requests from the moving image generation unit 30B and the purchase processing unit 30C and transmits the requests to the user device 12 . Specifically, the distribution management unit 30A transmits a list of videos being distributed in response to a request from the user device 12 . When the distribution management unit 30A receives the identification information of the requested moving image from the user device 12, the distribution management unit 30A distributes the moving image data generated by the moving image generation unit 30B to the user device 12 that made the request. In addition, the distribution management unit 30A distributes the entire video data generated by the video generation unit 30B or a part of the video data, such as the data of a message posted to the video or an object for which a display request is made, to the user device of the distribution user. Deliver to 12. As a result, the broadcast user can see the message or the object requested to be displayed on the screen of the user device 12 .

The moving image generation unit 30B includes a physics calculation engine, and uses the motion data of the avatar object received from the user device 12 used by the distribution user to generate a virtual space moving image including voice and image. In addition, the moving image generation unit 30B receives a request to display an object in the moving image being viewed and a request to display a message from the user device 12 used by the viewing user who views the moving image, and performs processing according to the display request. Objects for which display requests are made are objects displayed in the virtual space, and include gift objects provided by viewing users to distribution users who distribute moving images. A gift object may be an object that can be requested to be displayed without paying a price, or a gift object that can be requested to be displayed by paying a price. Alternatively, the gift object may be paid for when it is displayed in response to a display request.

Furthermore, the moving image generation unit 30B performs processing for displaying the message received from the user device 12 in a moving image. The message includes, in addition to the content of the message, identification information of the viewing user (user's account name, etc.), posted date and time, and the like.

The purchase processing unit 30C performs object purchase processing according to user's operation. Purchasing processes include purchase of coins that can be used in the video application program, purchase of paid objects by paying consideration (medium) such as coins, acquisition of free objects, exchange, sale of objects, It also handles transfers. Note that the free object may be one that does not require payment at all, or may be one that can be exchanged for points that can be obtained by watching moving images. The purchase processing unit 30C stores the purchased object in the server 13 as being owned by the user. Sales of purchasable objects are distributed, for example, to broadcast users and service providers.

Next, various data stored in the storage 32 of the server 13 will be described. The storage 32 stores asset data 32B, user management information 32C, possession list information 32D, gift object information 32E, and event information 32F.

The asset data 32B is data for drawing a virtual space that constitutes a moving image. Specifically, the asset data 32B includes data for drawing the background of the virtual space, audio data such as sound effects, and three-dimensional model data (object model data) for drawing various objects displayed in the moving image. , texture data, etc.

Objects included in the object model data are distinguished according to the usage pattern of the user. Specifically, in addition to objects that can be displayed by broadcast users, gift objects provided by viewing users to broadcast users are included. Gift objects include effect objects, wearing objects, and normal objects. The effect object is an object that affects the impression of the entire viewing screen of the distributed moving image, and is, for example, an object that imitates confetti, an object that imitates fireworks, or the like. A wearable object is an object displayed on the display screen in association with a specific part of the wearable object. The wearable objects are, for example, accessories (hats, glasses, etc.), clothes (T-shirts, etc.), costumes, and other objects that can be worn by the avatar object. After being provided by the viewing user, the mounting object is mounted on the avatar object by being selected by the distribution user. A normal object is a gift object other than a wearable object placed as an object in the virtual space, such as a stuffed toy or a bouquet of flowers.

Next, the user management information 32C will be described with reference to FIG. 2(a). User management information 32C is stored for each user. The user management information 32C includes user identification information (user ID), user's video distribution history, video viewing history, and the like. Also, the user management information 32C includes coins and points. A coin is a medium that can be used on a video application program or a platform service that provides it, and is purchased by a user. Coins can be exchanged for objects such as gift objects or other media available in the animation application program. The points include viewing bonus points given to the viewing user by viewing the moving image. It should be noted that media that can be used in a moving image application program or the like and objects that can be placed in the virtual space will be described as "elements" when not distinguished.

The possession list information 32D will be described with reference to FIG. 2(b). The possession list information 32D is stored for each user. The owned list information 32D includes user identification information (user ID) and identification information of owned objects that can be displayed in moving images distributed by the user. Note that the possessed object is, for example, a hat, a T-shirt, a cat ear, or the like. In addition, the possessed list information 32D includes information indicating whether or not the possessed object can be attached to the avatar object, and the attachment site. The wearing part is information indicating which part of the avatar object can be worn when the possessed object is a wearable object. Objects included in the user's owned list information 32D can be used in moving images distributed by the user himself/herself. Note that the possessed list information 32D may include the number of possessed objects.

The gift object information 32E will be described with reference to FIG. 2(c). Gift object information 32E is stored for each user. The gift object information 32E includes the identification information (user ID) of the distribution user, the identification information of the gift, the number of each gift, and the identification information (user ID) of the viewing user as the providing user who requested the display of the gift object. . A gift is an element of an animation application program and is an object or a medium that can be used by an animation application program or the like. Gifts included in the user's gift object information 32E can be requested to be displayed in the video or provided to the distribution user when another distribution user is distributing the video. Cannot be used in videos. When a user exchanges gacha tickets for gacha points obtained by performing a lottery, the gacha ticket cannot be used by the user himself/herself. be

The event information 32F will be described with reference to FIG. 2(d). The event information 32F is information that records the history of the team competition event held by the video distribution service. The event information 32F includes, for each team, identification information of users belonging to the team, first accumulated points based on free gift objects, second accumulated points based on paid gift objects, and the like. The first accumulated points are points accumulated when the gift object requested to be displayed in the moving image is a free gift object. Predetermined points may be added to the first accumulated points for each free gift object, or different points may be given according to the type of free gift object. The second accumulated points are points accumulated according to the value of the paid gift object when the gift object requested to be displayed in the moving image is a paid gift object. For example, the higher the required coins for the paid gift object, the higher the points given to the second accumulated points.

The positional relationship between the user who distributes the video and the user device 12 will be described with reference to FIG. 3 . It should be noted that the user device 12 used for video distribution and the user device 12 used for video viewing will be specifically described as smartphones. The distribution user 100 faces the user device 12 so that at least his own face is included in the detection range 101 of the sensor unit 24, and executes the distribution application program. At this time, the distribution user 100 puts the distribution application program into distribution mode. Furthermore, when an operation to start distribution is performed in the distribution mode, motion data is transmitted from the user device 12 to the server 13 . During video distribution, the display 28 of the user device 12 used by the distribution user 100 displays the virtual space video including the avatar object. The viewpoint position of the moving image is the position of the sensor unit 24 . The position of the avatar object changes as the relative distance between the broadcast user 100 and the sensor unit 24 changes. For example, when the distribution user 100 moves in the y direction in FIG. The position is also reflected, and the avatar character moves in the depth direction of the screen.

With reference to FIG. 4, the team competition event held within the video distribution service will be described. The distribution users 100 participating in the team competition event belong to one of the two teams. A viewing user 110 who views a video makes a gift object display request 105 for the video, as indicated by an arrow in FIG. Also, the distribution user 100 becomes a viewing user who views the moving images distributed by the other distribution users 100, and can make an object display request 105 to the other distribution users 100. FIG.

The server 13 adds points to the event information 32F associated with the distribution user 100 on the condition that the gift object display request is made or the gift object is displayed in the moving image, and updates the accumulated points. . In addition, the server 13 calculates, for each team, the total value of accumulated points of the distribution users 100 belonging to that team. Further, the server 13 calculates the total accumulated points of a predetermined number of broadcast users 100 (for example, five per team) having the highest accumulated points among the broadcast users 100 belonging to each team. Then, the server 13 calculates the total value of accumulated points of all distribution users participating in the event and the total value of accumulated points of high-ranking distribution users, and calculates an acquisition rate, which is the ratio of the former to the latter. The server 13 evaluates each team based on the total value of accumulated points and acquisition rate of each team, and determines whether the team wins or loses. In addition, the information indicating the victory or defeat of the team corresponds to the evaluation information.

The broadcast user 100 views the moving image of the broadcast user 100 belonging to the same team and makes a gift object display request 105 during the period in which the team competition event is held. This activates communication between the distribution users 100 . Also, a viewing user 110 who does not belong to a team may view a video of his/her favorite distribution user 100 and request display of a gift object, or may request display of a gift object. or watch videos of In this way, an opportunity is created for the distribution user 100 and the viewing user 110 to view the video of the new distribution user 100 .

An example of transition of screens displayed on the user device 12 in the team competition event will be described with reference to FIGS. 5 to 10. FIG.
As shown in FIG. 5 , an event participation screen 200 is displayed on the user device 12 . The event participation screen 200 is displayed by selecting the banner of the team competition event displayed on the screen when the moving image application program is executed. The event participation screen 200 displays a selection button 201 for selecting one team and a selection button 202 for selecting the other team. When one of the selection buttons 201 and 202 is selected by the distribution user, an event participation request including information on participating teams is transmitted from the user device 12 to the server 13 . The server 13 registers the distribution user information in the event information 32F based on the received event participation request. Note that the server 13 may set an upper limit on the number of people who can belong to one team. For example, when the number of participants in the team reaches the upper limit, the event participation screen 200 is made undisplayable.

FIG. 6 shows a video screen 210 displayed on the user device 12 of the distribution user. The face of the avatar object 111 changes as the distribution user's expression changes, and the head of the avatar object 111 moves as the distribution user's head moves. Also, the position of the avatar object 111 changes according to changes in the relative distance between the distribution user 100 and the sensor unit 24 . A message 213 posted by the viewing user is displayed on the video screen 210 for a predetermined period. Also displayed on the video screen 210 is a message 213 output by the server 13 according to an event that occurs during video distribution. The server 13 detects an event such as the viewing user starting viewing or requesting the display of a gift object, and displays a message 213 such as "You have entered the room", or displays the user's account name and the message "Hat A message 213 such as "I sent you a gift" is displayed on the video screen 210. Furthermore, on the moving image screen 210, a distribution switching button 113 and a possession list display button 114 are displayed. When the delivery switching button 113 is selected, it is possible to start or stop the delivery of the moving image. Further, when the distribution user selects the possession list display button 114, an object that can be displayed in the moving image can be selected based on the distribution user's possession list information 32D.

FIG. 7 shows the viewing screen 211 displayed on the user device 12 of the viewing user. The viewing screen 211 is displayed by selecting one from the video distribution list.
As shown in FIG. 7( a ), viewing screen 211 includes avatar object 111 , message posting button 214 , and gift button 215 . A message 213 is displayed on the viewing screen 211 when a message is entered in the input field displayed by selecting the message posting button 214 . When the gift button 215 is selected, a list based on the possession list information 32D is displayed on the screen. Also, when the distribution user participates in the team competition event, team identification information 212 is displayed on the viewing screen 211 . The team identification information 212 is a banner or the like indicating the name of the team in which the distribution user participates. When there is a team that the viewing user supports, the viewing user refers to the team identification information 212 and views the video of the team that the viewing user supports.

FIG. 7B shows the viewing screen 211 displayed when the gift button 215 is selected. A gift list 221 is displayed on the viewing screen 211 . The gift list 221 displays the normal objects 222 and the like included in the gift object information 32E. When the viewing user selects a normal object or an effect object and selects the decision button 224, the user device 12 transmits a display request including identification information of those objects to the server 13, and these objects are displayed in the moving image. . Further, when the viewing user selects the mounted object, the user device 12 transmits a display request including the identification information of the object to the server 13, and the present list information 32D of the distribution user distributing the moving image is added to the gift list information 32D. Object identification information is stored. Also, when an object display request is made, a message notifying that the object has been given is displayed in the animation.

FIG. 7(c) is the viewing screen 211 including the normal object 222 and the effect object 223. FIG. The server 13 records the accumulated points in the event information 32F according to the gift object requested by the viewing user. It should be noted that, in the case where a display request for a wearable object is made, it is displayed so as to be worn on the avatar object 111 when the distribution user selects the wearable object. Alternatively, the wearable objects may be automatically displayed on the avatar object 111 in the order in which display requests are output from the viewing user.

FIG. 8 shows the video distribution list screen 230 after the team competition event has ended. On the video distribution list screen 230, thumbnail images 231 indicating video channels that are being distributed live are displayed. When the distribution user who belonged to the winning team in the team competition event is distributing the video, an indicator 231A that can be distinguished from the normal thumbnail image 231 is displayed. For example, the indicator 231A is a gold frame or the like. By making it possible to identify the distribution user who won the team competition event in this way, the viewer's attention to the video of the distribution user is increased, and the effect of attracting customers to the video can be improved.

Further, after the team competition event ends, the distribution management unit 30A of the server 13 determines the order of the viewing users who requested the display of the gift object based on the gift object information 32E, and displays the order on the user device 12. 28. The order may be determined based on the number of gift object display requests, or may be determined based on consideration such as coins or points required for the viewing user to purchase the gift object.

9 and 10, operations of the user device 12 and the server 13 will be described together with processing procedures executed by the video application program.
With reference to FIG. 9, the procedure of processing the team competition event executed by the server 13 will be described. The distribution management unit 30A determines whether or not a gift object display request has been received from the user device 12 of the viewing user for each video distributed during the event period (step S1). When the delivery management unit 30A determines that the gift object display request has not been received (step S1: NO), it continues to wait for the reception of the display request.

When the delivery management unit 30A determines that the gift object display request has been received (step S1: YES), the distribution management unit 30A determines whether the requested gift object is a free gift that does not require consideration such as coins. (Step S2). When the distribution management unit 30A determines that the gift object requested to be displayed is a free gift (step S2: YES), the distribution management unit 30A adds points corresponding to the predetermined free gift to an event associated with the distribution user who distributes the moving image. It is added to the first accumulated points of the information 32F (step S3). Further, when the distribution management unit 30A determines that the gift object requested to be displayed is a paid gift (step S2: NO), the distribution management unit 30A adds points corresponding to the value of the paid gift to the second accumulated points of the event information 32F. (Step S4).

The delivery management unit 30A determines whether or not the team competition event has ended (step S5). When the distribution management unit 30A determines that the team competition event has not ended (step S5: NO), it returns to step S1 and repeats the above processing for each video distributed during the event holding period.

With reference to FIG. 10, the procedure of the winning/losing determination process of the team competition event will be described. 30 A of delivery management parts acquire the total point for every team based on the event information 32F (step S10). Here, the first accumulated points and the second accumulated points are acquired for each team.

The distribution management unit 30A also calculates the point acquisition rate of the top distribution users based on the event information 32F (step S11). Specifically, the total value of unpaid points and paid points of all broadcast users and the total value of unpaid points and paid points of top broadcast users for each team are calculated. Then, for each team, the acquisition rate, which is the ratio of the top distribution users to the total value for all users, is calculated.

Then, the distribution management unit 30A determines victory or defeat based on the first accumulated points for each team and the acquisition rate calculated in step S11 (step S12). At this time, the distribution management unit 30A may add the cumulative points and acquisition rate of each team, and determine the team with the higher added value as the winning team. Alternatively, at least one of the accumulated points and acquisition rate for each team may be multiplied by a coefficient and added.

Next, the distribution management unit 30A gives a reward to the winning team (step S13). Specifically, the distribution management unit 30A displays the thumbnail image of the distribution user who belonged to the winning team in the distribution list so as to be identifiable from other distribution users.

Next, the effects of this embodiment will be described.
(1) Since the winning team is determined by the points corresponding to the object display request, an opportunity is created for a plurality of distribution users belonging to the group to cooperate with each other. As a result, it is possible to actively interact with distribution users. In addition, since the viewing user is given an opportunity to view the videos of the distribution users who have never viewed the videos among the groups that the viewing users support, the chances of viewing the videos can be increased. Therefore, it is possible to increase the viewing time, the number of viewing times, and the number of viewing users of moving images.

(2) Since the index 231A for identifying belonging to the winning team is displayed in the video distribution list, the viewing user can refer to the index 231A when selecting a video to watch. In addition, by displaying the indicator 231A in the video distribution list, it is expected that the attention of the video with the indicator 231A displayed will increase and the number of viewing users will increase. can increase the motivation of

(3) Predetermined points are accumulated for each group in response to display requests for free objects, so the distribution user performs a performance to obtain a large number of free gift objects for moving images. As a result, the moving image distribution service can be activated.

(4) Predetermined points are accumulated for each group in response to display requests for charged objects, so the distribution user performs performances that allow him or her to obtain many high-value gift objects. As a result, the moving image distribution service can be activated.

(5) Since the group to which the distribution user belongs is displayed on the video screen in an identifiable manner, the viewing user can easily select the video of the distribution user who belongs to the group to support.
The above embodiment can be implemented with the following modifications. The above embodiments and the following modifications can be combined with each other within a technically consistent range.

・In the above embodiment, the winning team is determined based on the first accumulated points based on the free gift object display request and the acquisition rate of the top distribution users. should be determined. For example, the total value of the first accumulated points for each team, the total value of the second accumulated points for each team, the total value of the first accumulated points and the second accumulated points for each team, and the ratio of the second accumulated points to the first accumulated points. The winning team may be determined by any one of the ratio, the ratio of the first accumulated points to the second accumulated points, and the like. In addition, the first cumulative points and the points obtained by multiplying the second cumulative points by a coefficient (for example, "first cumulative points + 10 x second cumulative points") are added for each team, and the winning team is determined by comparing them. You may make it

- In the above-described embodiment, as the evaluation of each team, the victory or defeat of two teams is determined in the team competition event, but the number of teams may be three or more. Also, the evaluation of each team is not limited to winning or losing. For example, evaluation may be performed based on evaluation criteria such as "many free gifts", "many paid gifts", and "large total number of gifts", and it is not necessary to determine victory or defeat. Then, an index based on this evaluation information may be displayed on the video distribution list. That is, different indexes evaluated by different evaluation axes (parameters) are displayed in the video distribution list.

- In the above embodiment, the team identification information 212 is displayed on the viewing screen including the avatar object so that the team to which the distribution user belongs can be identified (Fig. 7(a)). Instead of or in addition to this, the team identification information associated with the thumbnail image of the moving image may be displayed in the moving image distribution list in which the moving images being distributed are listed. For example, the team identification information may be a frame surrounding the thumbnail image, an icon (badge), or the like. Alternatively, avatar objects belonging to the same team may wear the same wearing object so that the team to which the distribution user belongs can be identified.

- In the above-described embodiment, the reward is the display of the index 231A that identifiably indicates that the member belongs to the winning team in the video distribution list. Instead of or in addition to this, each element of the video distribution service, such as gift objects, media such as gems, coins, points, etc., gacha tickets that can be selected for rewards and lotteries, and the right to participate in events in the real world. You may make it give to the distribution user who belonged to the winning team. At events where you can appear with event appearance rights, you can distribute a video that expresses the appearance of participating in the event with an avatar object or the like. Also, titles, ranks, etc. that can be used in the video distribution service may be given to the distribution users who belonged to the winning team.

- In the above embodiment, the mounting object is mounted on the avatar object by being selected by the distribution user. Alternatively, the avatar object may be worn for a predetermined period of time in the order in which the viewing user provided the wearable object.

- In the above-described embodiment, the possessed objects included in the possessed list information 32D can be displayed as moving images distributed by the user. Alternatively, an object associated with a user may be available in videos distributed by the user and videos distributed by other users, regardless of whether the possessed object or the gift object. For example, it may be possible to request display of a possessed object as a gift object in a moving image distributed by another distribution user.

- In the above embodiment, the user device 12 transmits the avatar object in which the motion is reflected to the server 13 . Alternatively, data detected by the sensor unit 24 may be transmitted to the server 13 and the server 13 may apply the detected data to the avatar data 22B stored in the storage 32 .

- In the above-described embodiment, the user device 12 is assumed to have a moving image application program installed therein for viewing and distributing moving images. Alternatively, the application program for viewing moving images and the application program for distributing moving images may be separate application programs. A user who only views moving images installs a viewing application program on the user device 12 . A user who only distributes moving images installs an application program for distribution on the user device 12 . A user who both views and distributes moving images installs both application programs on the user device 12 .

Various types of information such as asset data 32B, user management information 32C, possession list information 32D, gift object information 32E, and event information 32F stored in the storage 32 of the server 13 can also be stored in the storage 22 of the user device 12. is.

- The computer processor 20 of the user device 12 may perform at least some of the functions of the distribution management unit 30A, the moving image generation unit 30B, and the purchase processing unit 30C of the server 13 .
- The computer processor 30 of the server 13 may perform at least part of the functions of the application management unit 20A, the motion data generation unit 20B, and the display control unit 20C of the user device 12 .

- The motion detection unit, the motion information transmission unit, the first display control unit, the request transmission unit, the moving image generation unit, the group registration unit, the calculation unit, the evaluation unit, the second display control unit, and the identification information display unit are each connected to the server 13 , or may be provided in the user device 12 . For example, the first display control section and the second control display section may be provided in the server 13 . In this case, the server 13 acquires the detection data of the sensor unit 24 from the user device 12, uses the avatar data 22B stored in the storage 32 to generate a moving image including the avatar object, and displays it on the display 28 of the user device 12. may be displayed. Also, the user device 12 may include an object display section. In this aspect, a display request including object identification information may be received from the server 13, and the object may be displayed based on this display request. As such a case, there is a case where a native application of a game installed in the storage 22 or the like is executed. Also, when the user device 12 executes a native application, the user device 12 may include a game medium granting section and a reward granting section.

- The virtual space displayed in the video may be an augmented reality space. For example, the virtual space background may be a moving image of the real world captured by the camera of the user device 12 .
- In the above embodiment, the user device 12 is an information processing device such as a smart phone, a mobile phone, a tablet terminal, a personal computer, a console game machine, or a wearable computer such as a head-mounted display. Alternatively, the user device 12 may be a system composed of at least one information processing device, an input device, and an output device. For example, in the user device 12, a console game machine including a computer processor 20, etc., a sensor unit 24 provided separately from this, a controller as an operation unit 27, a speaker 25, a display 28, etc. can exchange data with each other. system. In the user device 12, an information processing device such as a personal computer, a sensor unit 24 provided separately from this, a controller as an operation unit 27, a speaker 25, a wearable display as a display 28, etc. exchange data with each other. It may be a system that can transmit and receive. Alternatively, the user system for distribution is a system installed in a studio for video distribution, in which the information processing device, the sensor unit 24, the operation section 27, the speaker 25, and the display 28 are arranged separately. may

- In the above embodiment, the sensor unit 24 is provided on the user device 12 side, but at least part of the sensor unit 24 may be provided on the body of the distribution user or in the vicinity of the distribution user. For example, the sensor unit 24 is composed of an emitting part that emits detection light such as infrared rays at predetermined intervals, and a light receiving part that is attached to the body of the distribution user, receives the detection light, and transmits the detection result to the computer processor 20. You may Alternatively, the sensor unit 24 may be composed of a camera or the like that detects a marker attached to the body of the distribution user.
Next, technical ideas that can be grasped from the above embodiment and another example will be added below.
[1] A video data processing method executed by one or more computers, comprising a step of receiving a request to join a group to which a plurality of users belong from a user device used by the user, and the user device that sent the participation request. displaying a video based on video data distributed by a distribution user who distributes a video on a display unit of a user device used by a viewing user who watches the video; displaying the image corresponding to the distribution user belonging to the group in a moving image distribution list including the images of the moving images of the group so that the group to which the distribution user belongs can be identified; and displaying on the display unit of the user device a step of receiving an operation of the viewing user on the operation receiving unit, and transmitting a display request to the video of the gift object associated with the points; is sent, the points are added to the accumulated points associated with the group, and evaluation information obtained by evaluating the group based on the statistical results of the accumulated points for each group is displayed on the display unit; Video data processing method including
[2] A first display control unit for displaying, on a display unit, a moving image based on moving image data distributed by a distribution user, on one or more computers; an identification information display unit for identifiably displaying the group to which the distribution user belongs to the image corresponding to the distribution user; a display request transmission unit for transmitting a display request for a gift object associated with points, which is an object for the moving image distributed by the distribution user; and cumulative points for each group in which the points based on the display request are reflected. A moving image data processing program that functions as a second display control unit that displays evaluation information obtained by evaluating the group based on the display unit.
[3] The video data processing program according to [2], wherein the first display control unit displays video data including a video of the avatar object to which action information is applied on the display unit.
[4] In [2] or [3], the first display control unit displays, on the display unit, moving image data including real-world moving images based on photographed data captured by a photographing device provided in the user device; Described video data processing program.
[5] The evaluation information is victory or defeat of the group, and the second display control unit displays a video distribution list in which a plurality of images corresponding to the video distributed by the distribution user is displayed, and belongs to the winning group. The moving image data processing program according to any one of [2] to [4], displaying an index that enables identification of an image corresponding to the moving image of the distribution user.
[6] The moving image data processing program according to any one of [2] to [5], wherein the evaluation information is information obtained by evaluating the groups on different evaluation axes.
[7] The moving image according to any one of [2] to [6], further comprising a message display unit that displays a message associated with the user who made the display request together with the gift object that is the target of the display request. Data processing program.
[8] The moving image data processing program according to any one of [2] to [7], wherein the evaluation information is information obtained by evaluating the group based on a history of display requests for gift objects requiring compensation. .
[9] The moving image distribution list includes images based on image data distributed by the distribution users belonging to the group and images based on image data distributed by the distribution users not belonging to the group [2] The moving picture data processing program according to any one of [8].
[10] A moving image data processing method executed by one or more computers, comprising: a first display control step of displaying on a display unit a moving image based on moving image data distributed by a distribution user; and images of a plurality of moving images. an identification information display step of identifiably displaying the group to which the distribution user belongs to the image corresponding to the distribution user belonging to the group in the video distribution list; a display request transmission step of receiving a user's operation on an operation reception unit and transmitting a display request for a gift object associated with points, which is an object of the moving image distributed by the distribution user; and points based on the display request. a second display control step of displaying, on the display unit, evaluation information obtained by evaluating the group based on the accumulated points of each group in which the above is reflected.
[11] A participation reception unit that receives a request to join a group to which a plurality of users belong from a user device used by a user, and a group registration unit that associates and registers a group with a user corresponding to the user device that has transmitted the participation request. a display request receiving unit that receives a request from a viewing user who watches a video to display a gift object associated with points for a video of a distribution user who belongs to the group and distributes the video; a point recording unit that adds and records the accumulated points associated with the group corresponding to the distribution user who distributes the moving image that is the target of the display request; and and an evaluation unit that transmits evaluation information obtained by evaluating the group to the user device.
[12] A video data processing method executed by one or more computers, comprising: a participation reception step of accepting a request for participation in a group to which a plurality of users belong from a user device used by the user; A group registration step of associating and registering a group with a user corresponding to a user device, and a gift object associated with points for a video of a distribution user belonging to the group and distributing the video from the viewing user who watches the video. a display request receiving step of receiving a display request; and when the display request is received, the point is added to the accumulated points associated with the group corresponding to the distribution user who distributes the moving image that is the target of the display request. A video data processing method, comprising: a point recording unit for recording; and an evaluation step of transmitting evaluation information obtained by evaluating the group based on the statistical result of the accumulated points to the user device.

DESCRIPTION OF SYMBOLS 11... Video distribution system, 12... User device, 13... Server, 14... Network, 20... Computer processor, 21... Memory, 22... Storage, 23... Communication interface, 24... Sensor unit, 25... Speaker, 26... Microphone, 27... Operation unit, 28... Display, 30... Computer processor, 31... Memory, 32... Storage.

Claims (9)

a switching unit for switching between a distribution mode for distributing moving images and a viewing mode for viewing moving images distributed by other users for each user device;
a group registration unit for registering a group associated with a user;
a first display control unit that displays a video based on video data distributed by a distribution user on the display unit of the user device in the viewing mode;
a transmission unit that receives a user's operation on an operation reception unit displayed on the display unit of the user device in the viewing mode and transmits a request to display a gift object associated with points on the video;
a second display control unit for displaying, on the display unit, evaluation information obtained by evaluating the group based on statistical results reflecting the points based on the display request transmitted for the videos of the distribution users belonging to the group; , a video data processing system. A video data processing method executed by one or more computers,
switching between a distribution mode for distributing moving images and a viewing mode for viewing moving images distributed by other users for each user device;
associating and registering a group with a user;
displaying a video based on video data distributed by a distribution user on the display unit of the user device in the viewing mode;
a step of receiving a user's operation on an operation receiving unit displayed on the display unit of the user device in the viewing mode, and transmitting a request to display a gift object associated with points on the moving image;
displaying, on the display unit, evaluation information obtained by evaluating the group based on statistical results reflecting the points based on the display request sent to the videos of the distribution users belonging to the group. Data processing method. one or more computers,
a mode switching unit for switching between a distribution mode for distributing videos and a viewing mode for viewing videos distributed by other users;
a first display control unit for displaying, on a display unit, a moving image based on moving image data distributed by a distribution user belonging to a group;
A display for receiving a user's operation on an operation receiving unit displayed on the display unit in the viewing mode and transmitting a display request for a gift object associated with a point, which is an object for the moving image distributed by the distribution user. a request sender;
A video data processing program for functioning as a second display control unit for displaying on the display unit evaluation information obtained by evaluating the group to which the distribution user belongs based on statistical results reflecting points based on the display request. 4. The video data processing program according to claim 3, wherein the first display control unit displays video data including a video of the avatar object to which action information is applied, on the display unit. 5. The moving image data processing according to claim 3, wherein the first display control unit displays on the display unit moving image data including real-world moving images based on photographed data captured by a photographing device provided in a user device. program. 6. The moving image data processing program according to any one of claims 3 to 5, wherein the evaluation information is information obtained by evaluating the groups according to different evaluation axes. 7. The moving image data processing program according to any one of claims 3 to 6, further comprising a message display unit that displays a message associated with the user who made the display request together with the gift object for which the display request is made. The moving image data processing program according to any one of claims 3 to 7, wherein the evaluation information is information obtained by evaluating the group based on a history of display requests for gift objects requiring consideration. A video data processing method executed by one or more computers,
a switching step of switching between a delivery mode for delivering videos and a viewing mode for viewing videos delivered by other users;
a first display control step of displaying, on the display unit, a video based on video data distributed by a distribution user belonging to the group;
A display for receiving a user's operation on an operation receiving unit displayed on the display unit in the viewing mode and transmitting a display request for a gift object associated with a point, which is an object for the moving image distributed by the distribution user. a request sending step;
and a second display control step of displaying, on the display unit, evaluation information obtained by evaluating the group to which the distribution user belongs based on statistical results reflecting points based on the display request.

Images