JP6691631B1 - Movie processing method, server device, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving image processing method, a server device, and a computer program for increasing a viewing user's gifting opportunity. A moving image processing method according to one embodiment is a moving image processing method executed by one or a plurality of processors that execute computer-readable instructions, and includes a moving image including an animation of an avatar object of a distribution user. A request signal, which is generated based on an operation of the viewing user for viewing and requests to attach the first gift to the wearing part of the avatar object, is received from the terminal device of the viewing user via the communication line. If it is determined that a combination of the plurality of first gifts given to the wearing part of the avatar object satisfies a predetermined condition based on the receiving step and the plurality of request signals, the avatar object A second gift having the same features as the first gift is attached to the attachment site of And a generation step of generating the moving image including an animation. [Selection diagram]

Description

  The technology disclosed in the present application relates to a moving image processing method for a moving image viewed by a viewing user, a server device for controlling the moving image, and a computer program.

  BACKGROUND ART A moving image distribution service that distributes a moving image to a terminal device via a network has been conventionally known. In this type of video distribution service, the avatar (avatar object) of the distribution user who distributes the video is displayed, and the viewing user who views the video and the distribution user can communicate with each other through a message or chat. An environment is provided in which you can do it.

  Further, as a communication tool between a viewing user and a distribution user, Patent Document 1 electronically realizes an act (gifting) of providing an item acquired by the viewing user as a present to an avatar (distribution user) in a video. Is disclosed.

  In addition, in a video distribution service such as REALITY (registered trademark), an environment is provided in which a viewing user can give a gift for each wearing part (for example, head, neck, and hand) of an avatar (distribution user). (Non-patent document 1).

  The above-mentioned Patent Document 1 and Non-Patent Document 1 are incorporated herein by reference in their entirety.

Japanese Patent Laid-Open No. 2012-120098

"REALITY", [online], [Search August 27, 2019], Internet (URL: https://twitter.com/WFLE_REALITY)

  The above-mentioned gifting cultivates a closeness and a sense of involvement of the viewing user to the avatar through direct communication between the viewing user and the distribution user (avatar). However, in the gifting for each wearing part of the avatar as described in Non-Patent Document 1, one viewing user gives a gift to the head of the avatar, for example, and the gift based on the gifting is given to the head. If a video containing the avatar worn on the head is delivered, even if other viewing users give a gift to the head of the avatar during the predetermined time until the gift worn on the head is deleted from the video. , The gift based on the gifting will not be worn on the head of the avatar. Therefore, in the case of such a gifting control, only a limited gifting act is reflected in the video, and the viewing user's gifting opportunity is limited, which suppresses the viewer's willingness to give a gift. There are challenges.

  On the other hand, as a method of solving the above-mentioned problem, one viewing user gifts a gift A to the head of an avatar, for example, and a video including an avatar wearing the gift A based on the gifting is distributed. In such a case, an alternative that controls to immediately overwrite the gift B with the gift A when another viewing user gifts the gift B to the head of the avatar has been proposed. However, in this case, for the viewing user who gifted the gift A, the gift gifted by himself / herself is suddenly deleted from the video due to the gifting by the other viewing user. There are also issues such as aggravating disappointment with the ting act.

  In addition, the gifting means a mode in which the viewing user purchases a gift by paying the price to the service provider who provides the video distribution service, and then gifts the gift to the distribution user (avatar). Therefore, it can be said that increasing the number of viewing users' gifting opportunities is a challenge for service providers.

  Therefore, some embodiments disclosed in the present application provide a moving image processing method, a server device, and a computer program that increase the number of gifting opportunities by a viewing user.

  A moving image processing method according to one aspect is a moving image processing method executed by one or more processors that execute computer-readable instructions, and is for a viewing user who views a moving image including an animation of an avatar object of a distribution user. A receiving step of receiving a request signal generated based on an operation and requesting to attach the first gift to the wearing part of the avatar object from the terminal device of the viewing user via a communication line; When it is determined that the combination of the plurality of first gifts given to the wearing portion of the avatar object satisfies a predetermined condition based on the request signal of An animation in which a second gift having the same features as the first gift is attached A generation step of generating free the moving image, is intended to include.

  A server device according to one aspect includes one or a plurality of processors, and the processors are generated based on an operation of a viewing user who views a moving image including an animation of an avatar object of a distribution user, and the attachment site of the avatar object. To the wearing site of the avatar object based on a plurality of request signals, the request signal requesting to give the first gift to the terminal device of the viewing user via the communication line. When it is determined that the combination of the plurality of the first gifts given as a result satisfies the predetermined condition, the second gift having the same feature as the first gift is attached to the attachment site of the avatar object. The moving image including the attached animation is generated.

  A server device according to one aspect includes one or a plurality of processors, and the processors are generated based on an operation of a viewing user who views a moving image including an animation of an avatar object of a distribution user, and the attachment site of the avatar object. To the wearing site of the avatar object based on a plurality of request signals, the request signal requesting to give the first gift to the terminal device of the viewing user via the communication line. When it is determined that the combination of the plurality of first gifts given as a result satisfies a predetermined condition, the second gift having the same feature as the first gift in the wearing part of the avatar object A terminal of the viewing user, which generates the moving image including the animation in which the second gift is attached to the information.置又 is intended to be transmitted to the terminal device of the distributing user.

  The computer program according to an aspect is generated by an operation of a viewing user who views a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to a wearing part of the avatar object. On the other hand, a request signal for requesting to give the first gift is received from the terminal device of the viewing user via the communication line, and based on the plurality of request signals, the attachment part of the avatar object is attached. When it is determined that the given combination of the plurality of first gifts satisfies a predetermined condition, the second gift having the same characteristics as the first gift is attached to the attachment site of the avatar object. That causes the processor to generate the animation containing the animated animation. That.

  The computer program according to an aspect is generated by an operation of a viewing user who views a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to a wearing part of the avatar object. On the other hand, a request signal for requesting to give the first gift is received from the terminal device of the viewing user via the communication line, and based on the plurality of request signals, the attachment part of the avatar object is attached. When it is determined that a combination of the plurality of the first gifts that have been given satisfies a predetermined condition, the second gift having a feature that is common to the first gift on the attachment site of the avatar object Information is provided to the viewing user that generates the video including the animation in which the second gift is worn. Transmitted to The terminal device or the server device is intended to function the processor so.

  The computer program according to an aspect is generated by an operation of a viewing user who views a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to a wearing part of the avatar object. A request signal requesting to give the first gift to the user is transmitted via a communication line, and a plurality of the plurality of the first parts given to the wearing part of the avatar object based on the plurality of the request signals are sent. When it is determined that the combination of one gift satisfies a predetermined condition, the moving image including the animation in which the second gift having the same feature as the first gift is attached to the attachment site of the avatar object. In order to generate the information, the information related to the second gift is distributed to the user's terminal device or server device. Received from so that they appear to the processor as.

  The computer program according to an aspect is generated by an operation of a viewing user who views a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to a wearing part of the avatar object. A request signal requesting to give the first gift to the user is transmitted via a communication line, and a plurality of the plurality of the first parts given to the wearing part of the avatar object based on the plurality of the request signals are sent. When it is determined that the combination of one gift satisfies a predetermined condition, the moving image including the animation in which the second gift having the same feature as the first gift is attached to the attachment site of the avatar object. Is received from the distribution user's terminal device or server device. Is shall.

FIG. 1 is a block diagram showing an example of the configuration of a moving image distribution system according to an embodiment. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal device (server device) shown in FIG. FIG. 3 is a block diagram schematically showing an example of functions of the terminal device shown in FIG. FIG. 4 is a block diagram schematically showing an example of the functions of the server device shown in FIG. FIG. 5 is a diagram showing an example of a table managed by the database unit. FIG. 6A is a diagram illustrating an example of a table managed by the database unit, and is a diagram schematically illustrating an image when the determination unit determines. FIG. 6B is a diagram showing an example of a table managed by the database unit, and is a diagram schematically showing an image when the determination unit makes a determination. FIG. 6C is a diagram illustrating an example of a table managed by the database unit, and is a diagram schematically illustrating an image when the determination unit determines. FIG. 6D is a diagram illustrating an example of a table managed by the database unit, and is a diagram schematically illustrating an image when the determination unit determines. FIG. 7 is a diagram showing an example of the confirmation screen displayed on the display unit of the terminal device of the distribution user. FIG. 8 is a flowchart showing an example of the operation performed in the moving image distribution system shown in FIG. FIG. 9 is a diagram showing an example of a moving image including an animation of an avatar object of a distribution user. FIG. 10 is a diagram illustrating an example of a moving image including an animation in which the first gift is attached to the attachment site of the avatar object of the distribution user. FIG. 11 is a diagram schematically showing an example of an image in which a second gift is worn in place of the first gift at the site where the delivery user wears the avatar object.

  Various embodiments of the present invention will be described below with reference to the accompanying drawings. In the drawings, common components are designated by the same reference numerals. Also, it should be noted that components illustrated in one drawing may be omitted in another drawing for convenience of description. Furthermore, it should be noted that the attached drawings are not necessarily drawn to scale. Furthermore, the term application may be referred to as software or a program, and it may be an instruction to a computer, which is combined so as to obtain a certain result.

1. Structure of Video Distribution System In short, the video distribution system 1 disclosed in the present application is performed by a distribution user who performs distribution, by using the terminal device, data regarding the operation of the distribution user and / or a message issued by the distribution user. It is possible to deliver a moving image including an animation of an avatar object generated based on voice data related to a given utterance or song to a terminal device of a viewing user who views the moving image via a communication line. .

  FIG. 1 is a block diagram showing an example of the configuration of a moving image distribution system 1 according to an embodiment. As shown in FIG. 1, the moving image distribution system 1 includes a plurality of terminal devices 10 connected to a communication line (not shown) and one or more server devices 20 connected to the communication line. You can Each terminal device 10 is connected to one or more server devices 20 via a communication line.

  Note that the communication line can include a mobile phone network, a wireless LAN, a fixed telephone network, the Internet, an intranet, and / or Ethernet (registered trademark) without being limited thereto.

1-1. Terminal device 10
As shown in FIG. 1, the plurality of terminal devices 10 include one or more distribution user terminal devices 10 (here, terminal devices 10A) and one or more viewing user terminal devices 10 (here, terminal devices). 10B to 10D). Since each terminal device 10 has a common configuration, it can be used as either a terminal device for distributing a moving image (a terminal device 10 of a distribution user) or a terminal device for viewing a moving image (a terminal device 10 of a viewing user). Can also be.

  When each terminal device 10 operates as the terminal device 10 of the distribution user, by executing the installed video distribution application, the data regarding the operation of the distribution user and / or the utterance issued by the distribution user, Acquiring voice data relating to singing, generating a moving image including an animation of a virtual character (avatar object) changed according to the acquired data, and transmitting the moving image to the server device 20 (distribution server device 20C) via a communication line. Can be sent to. The moving image is distributed by the server device 20 (distribution server device 20C) to the terminal device 10 (the viewing user's terminal device 10) for executing the installed moving image viewing application and receiving the moving image. To be done.

  Further, when each terminal device 10 operates as the terminal device 10 of the distribution user, the server device 20 attaches to the wearing part of the distribution user (avatar object) based on the operation of the viewing user via the communication line. When a request signal requesting to give a gift (first gift) is received from the terminal device 10 of the viewing user who views the video, each terminal device 10 receives the server device 20 (information processing server device). 20B), the request signal can be received from the server device 20 to generate a moving image including an animation in which the first gift is attached to the attachment site of the avatar object.

  By the way, the wearing part of the avatar object is a part of the avatar object such as the head, face, neck, right hand, left hand, waist, right foot, left foot, etc. of the avatar object, and / or a part (overhead, foot, (Including the space surrounding the avatar object, such as behind).

  In addition, at the time of the above-mentioned gifting, a plurality of request signals requesting to attach the first gift to the wearing part of the avatar object (when a plurality of request signals are transmitted from one viewing user terminal device 10, And a case where a request signal is transmitted from a plurality of viewing user terminal devices 10), the distribution user's terminal device 10 transmits the avatar object from the server device 20 (information processing server device 20B). It is possible to generate the moving image by receiving information requesting to generate a moving image including an animation in which the second gift having the same feature as the first gift is attached to the wearing part of the item. .

  A method of determining whether or not to generate a moving image including an animation in which the second gift is attached to the attachment site of the avatar object will be described later, but the determination is performed by the server device 20 (described later). It is executed by the information processing server device 20B).

  On the other hand, when each terminal device 10 operates as a terminal device for viewing a moving image (viewing user's terminal device), the terminal device 10 of the distribution user executes the installed moving image viewing application. The distributed moving image can be received via the server device 20 (distribution server device 20C).

  Further, when each terminal device 10 operates as the terminal device of the viewing user, by executing the video viewing application, a gift is given to the attachment site of the distribution user (avatar object) based on the operation of the viewing user. It is possible to transmit a request signal for requesting to give the (first gift) to the server device 20 (gift API server device 20A).

  Further, when each terminal device 10 operates as the terminal device of the viewing user, the information related to the comment from the viewing user to the distribution user (avatar object) is executed by the server device 20 (comment by executing the video viewing application). It can be sent to the API server device 20D).

  The above-described video distribution application and video viewing application can be installed and executed in each terminal device 10 as an integrated application or as separate applications.

  Each terminal device 10 is an arbitrary terminal device capable of performing such an operation, and includes a smartphone, a tablet, a mobile phone (feature phone), and / or a personal computer without being limited thereto. Is something that can be done.

1-2. Server device 20
As shown in FIG. 1, the server device 20 can also be called a moving image distribution system in which a plurality of server devices described later are combined.

  The server device 20 can distribute the moving image transmitted from the terminal device 10 of the distribution user to the terminal device 10 of each viewing user.

  Further, the server device 20 can receive from the terminal device 10 of each viewing user a request signal requesting to give a gift (first gift) to the wearing part of the avatar object (gifting). . In addition, after transmitting the information related to the request signal to the terminal device 10 of the distribution user, the gift is attached to the attachment part of the avatar object generated by the terminal device 10 of the delivery user who receives the information. You can also receive videos that include animation.

  In addition, at the time of the above-mentioned gifting, a plurality of request signals requesting to attach the first gift to the wearing part of the avatar object (when a plurality of request signals are transmitted from one viewing user terminal device 10, And a case where request signals are transmitted from a plurality of viewing user terminal devices 10), the server device 20 is in a state in which the second gift is attached to the attachment site of the avatar object. It is determined whether or not to generate a moving image including the animation, and when it is determined that the moving image is to be generated, information requesting generation of the moving image can be transmitted to the terminal device 10 of the distribution user. it can. Then, the server device 20 can receive the moving image including the animation in which the second gift is attached to the attachment part of the avatar object from the terminal device 10 of the delivery user.

  Further, the server device 20 can receive from the viewing user the terminal device 10 of the viewing user information regarding the comment to the distribution user (avatar object) from the viewing user, and the viewing user who views the same video can receive the comment. Can be delivered.

  In order to perform such an operation, the server device 20 is connected to each other via a communication line (including a wireless line and / or a wired line (not shown)) in one embodiment. The information processing server device 20B, the distribution server device 20C, and the comment API server device 20D can be included.

  The gift API server device 20A issues a request signal for requesting (gifting) a gift (first gift) to the wearing part of the avatar object based on the operation of the viewing user, to the terminal device of each viewing user. 10 can be received. At this time, the gift API server device 20A identifies, from the request signal, the identification information of the viewing user who performed the gifting action (the serial number of the terminal device 10 of each viewing user, the ID information given to each viewing user, etc.), Information related to the gift that has been gifted (information about what kind of gift corresponds to which attachment part of the avatar object), and identification information of the distribution user that is the avatar object to be gifted (the terminal device 10 of the distribution user). Serial number and ID information given to the distribution user), and transmits the read information to the information processing server device 20B automatically or when an inquiry is received from the information processing server device 20B. You can

  The information processing server device 20B receives the information from the gift API server device 20A automatically or by inquiring itself about the information read by the gift API server device 20A. Further, the information processing server device 20B can have a table (database) for each distribution user, and can store the information on the gift read by the gift API server device 20A in each table.

  Furthermore, the information processing server device 20B refers to the information on the gifts stored in the table to refer to a plurality of gifting actions (a plurality of gifting actions by one viewing user, and a plurality of viewing users. If a second gift having the same characteristics as the first gift is attached to the attachment part of the avatar object, a moving image including an animation is generated. Whether or not can be determined. The determination is made based on whether or not a combination of a plurality of gifting actions (a plurality of first gifts) satisfies a preset predetermined condition.

  Furthermore, the information processing server device 20B requests to generate a moving image including an animation in which the first gift is attached to the attachment part of the avatar object by referring to the information on the gift stored in the table. The information to be transmitted can be transmitted to the terminal device 10 of the distribution user. Similarly, when it is determined by the above determination that the moving image including the animation in which the second gift is attached is generated, the animation in which the second gift is attached is included in the attachment part of the avatar object. Information requesting generation of a moving image can be transmitted to the terminal device 10 of the distribution user.

  Furthermore, the information processing server device 20B refers to the identification information of the viewing user and the information related to the gift stored in the table, and which viewing user determines what viewing user with respect to the attachment part (distribution user) of the avatar object. All or part of the information regarding whether or not a gift has been given can be transmitted to the comment API server device 20D.

  Furthermore, when the information processing server device 20B determines that the combination of the plurality of gifting actions (the plurality of first gifts) does not satisfy the predetermined condition set in advance, the predetermined combination of the combinations is given. It is also possible to calculate the necessary condition related to whether the condition is satisfied and then send the necessary condition to the comment API server device 20D. The details of the necessary conditions mentioned here will be described later.

  The distribution server device 20C can distribute the moving image transmitted from the terminal device 10 of the distribution user to the terminal device 10 of each viewing user.

  In addition, the distribution server device 20C receives from the terminal device 10 of the distribution user a moving image including an animation in which the first gift is attached to the attachment part of the avatar object, and the moving image is received by the terminal device 10 of each viewing user. Can be delivered to.

  Furthermore, the distribution server device 20C receives, from the distribution user's terminal device 10, a moving image containing an animation in which the second gift is attached to the attachment part of the avatar object, and receives the moving image from the terminal device of each viewing user. Can be delivered to 10.

  The comment API server device 20D can receive the comment of the viewing user from the terminal device 10 of the viewing user, and can distribute the received comment to each viewing user who is viewing the same video. .

  In addition, the comment API server device 20D corresponds to all or part of information received from the information processing server device 20B and related to which viewing user gave what gift to the wearing part (distribution user) of the avatar object. The comment can be distributed to each viewing user who is watching the same video.

  Furthermore, the comment API server device 20D can also deliver the comment, which is received from the information processing server device 20B and corresponds to the above-described requirements, to each viewing user who is watching the same moving image.

  In the example shown in FIG. 1, the server device 20 includes a gift API server device 20A, an information processing server device 20B, a distribution server device 20C, and a comment API server device 20D for the purpose of distributing loads. A configuration having four server devices is shown. However, at least one of these four server devices may be integrated with any of the remaining server devices.

2. Hardware Configuration of Each Device Next, an example of the hardware configuration of each of the terminal device 10 and the server device 20 will be described.

2-1. Hardware Configuration of Terminal Device 10 A hardware configuration example of each terminal device 10 will be described with reference to FIG. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal device 10 (server device 20) shown in FIG. 1 (note that reference numerals in parentheses in FIG. 2 will be described later). It is described in relation to the server device 20.)

  As shown in FIG. 2, each terminal device 10 mainly includes a central processing unit 11, a main storage device 12, an input / output interface device 13, an input device 14, an auxiliary storage device 15, and an output device 16. And can be included. These devices are connected to each other by a data bus and / or a control bus.

  The central processing unit 11 is called a "CPU", and it performs an operation on the instructions and data stored in the main memory 12 and stores the result of the operation in the main memory 12. is there. Further, the central processing unit 11 can control the input device 14, the auxiliary storage device 15, the output device 16 and the like via the input / output interface device 13. The terminal device 10 may include one or more such central processing units 11.

  The main storage device 12 is called a “memory”, and receives commands and instructions received from the input device 14, the auxiliary storage device 15 and the communication line 30 (server device 20, etc.) via the input / output interface device 13. The data and the calculation result of the central processing unit 11 are stored. The main storage device 12 can include a RAM (random access memory), a ROM (read only memory), and / or a flash memory without being limited thereto.

  The auxiliary storage device 15 is a storage device having a larger capacity than the main storage device 12. The specific application (video distribution application, video viewing application, etc.) and the instructions and data (computer program) configuring the web browser and the like are stored, and these are controlled by the central processing unit 11. Instructions and data (computer programs) can be sent to the main storage device 12 via the input / output interface device 13. The auxiliary storage device 15 can include a magnetic disk device and / or an optical disk device, etc. without being limited thereto.

  The input device 14 is a device for fetching data from the outside, and includes a touch panel, buttons, a keyboard, a mouse, and / or a sensor without being limited to these. Sensors may include, without limitation, sensors including one or more cameras, etc., and / or one or more microphones, etc., as described below.

  The output device 16 may include a display device, a touch panel, and / or a printer device, etc. without being limited thereto.

  In such a hardware configuration, the central processing unit 11 sequentially loads and loads the instructions and data (computer program) that form a specific application stored in the auxiliary storage device 15 into the main storage device 12. By controlling the command and data, the output device 16 is controlled via the input / output interface device 13, or another device is operated via the input / output interface device 13 and the communication line 30 (communication network 30). Various information can be transmitted / received to / from (for example, the server device 20 and the other terminal device 10 or the like).

  As a result, the terminal device 10 executes an installed specific application to perform an operation required to generate a moving image, an operation required to send (deliver) and / or receive a moving image, and a gifting action. Necessary operations for sending a comment (including various operations described later in detail).

  The terminal device 10 may include one or more microprocessors and / or a graphics processing unit (GPU) instead of or together with the central processing unit 11.

2-2. Hardware Configuration of Server Device 20 An example hardware configuration of each server device 20 will be described with reference to FIG. The hardware configuration of each server device 20 (gift API server device 20A, information processing server device 20B, distribution server device 20C, and comment API server device 20D) is, for example, the same as the hardware configuration of each terminal device 10 described above. It is possible to use the thing of. Therefore, the reference numerals for the components included in each server device 20 are shown in parentheses in FIG.

  As shown in FIG. 2, each server device 20 mainly includes a central processing unit 21, a main storage device 22, an input / output interface device 23, an input device 24, an auxiliary storage device 25, and an output device 26. And can be included. These devices are connected to each other by a data bus and / or a control bus.

  The central processing unit 21, the main storage device 22, the input / output interface device 23, the input device 24, the auxiliary storage device 25, and the output device 26 are included in each of the terminal devices 10 described above, respectively. The device 12, the input / output interface device 13, the input device 14, the auxiliary storage device 15, and the output device 16 may be substantially the same.

  In such a hardware configuration, the central processing unit 21 sequentially loads and loads the instructions and data (computer program) configuring the specific application stored in the auxiliary storage unit 25 into the main storage unit 22. By controlling the commands and data, the output device 26 is controlled via the input / output interface device 23, or another device via the input / output interface device 23 and the communication line 30 (communication network 30). Various information can be transmitted / received to / from (for example, each terminal device 10 or the like).

  As a result, the server device 20 performs an operation required to distribute the moving image transmitted by the terminal device 10 of each distribution user to the terminal device 10 of each viewing user, and the gift transmitted from the terminal device 10 of each viewing user. Operation required to receive a moving picture action, operation required to generate request information required to cause the terminal device 10 to generate a moving image, operation required to send (deliver) and / or receive a moving image Etc. (including various operations detailed below).

  The server device 20 may include one or more microprocessors and / or a graphics processing unit (GPU) instead of or in addition to the central processing unit 21.

3. Functions of Each Device Next, an example of details of functions of each of the terminal device 10 and the server device 20 will be described.

3-1. Functions of Terminal Device 10 An example of functions of the terminal device 10 will be described with reference to FIG. FIG. 3 is a block diagram schematically showing an example of functions of the terminal device 10 shown in FIG.

  As shown in FIG. 3, the terminal device 10 may mainly include a moving image generation unit 100, a display unit 110, a storage unit 120, a user interface unit 130, a gift storage unit 140, and a communication unit 150.

(1) Video generation unit 100
The moving image generation unit 100 can generate a moving image including an animation of the avatar object of the distribution user, based on the data regarding the operation of the distribution user and / or the voice data regarding the utterance or song uttered by the distribution user. To realize this, the moving image generation unit 100 may include, for example, an acquisition unit (not shown) and a processing unit (not shown).

  The acquisition unit acquires one or more first sensors (not shown) that acquire data regarding the face, limbs, etc. (entire body) of the distribution user, and voice data regarding the utterance and / or singing uttered by the distribution user. And one or more second sensors (not shown) for obtaining

  The first sensor may include, in a preferred embodiment, an RGB camera that images visible light and a near-infrared camera that images near-infrared. As such a camera, for example, a camera included in a True Depth camera of iphone X (registered trademark) can be used. The second sensor can include a microphone that records voice.

  First, regarding the first sensor, the acquisition unit images the face, limbs, and the like of the distribution user by using the first sensor arranged in proximity to the face, limbs, and the like of the distribution user. Accordingly, the acquisition unit can generate data (for example, an MPEG file) in which the image acquired by the RGB camera is associated with a time code (a code indicating the acquired time) and recorded for a unit time. Further, the acquisition unit associates the predetermined number (for example, 51) of the depth values (for example, a floating point value) acquired by the near-infrared camera with the time code and records the data (for example, a TSV file). [File of a format in which multiple data are recorded by separating data with tabs]) can be generated.

  Regarding the near-infrared camera, specifically, a dot projector radiates an infrared laser forming a dot pattern to the face and limbs of the distribution user, and the near-infrared camera projects infrared light projected and reflected on the face and limbs of the distribution user. The dots are captured, and the infrared dot image thus captured is generated. The acquisition unit compares an image of a dot pattern emitted by a dot projector registered in advance with an image captured by a near-infrared camera, and compares each point (each characteristic point) (for example, 51 pieces of points) in both images. The depth of each point (each feature point) (the distance between each point and each feature point and the near-infrared camera) can be calculated by using the positional deviation at each point / feature point. The acquisition unit can generate data in which the numerical value indicating the depth calculated in this way is associated with the time code as described above and recorded over a unit time.

  Next, with respect to the second sensor, the acquisition unit acquires the voice related to the utterance and / or the song uttered by the distribution user using the second sensor arranged in proximity to the distribution user. Accordingly, the acquisition unit can generate data (for example, an MPEG file) recorded in unit time in association with the time code. In one embodiment, the acquisition unit acquires data regarding the face and limbs of the distribution user using the first sensor, and at the same time, voice data regarding utterance and / or singing uttered by the distribution user using the second sensor. Can be obtained. In this case, the acquisition unit associates the image acquired by the RGB camera with the voice data regarding the utterance and / or the song uttered by the distribution user using the second sensor, in association with the same time code. It is possible to generate data (for example, an MPEG file) recorded for a unit time.

  The acquisition unit generates data relating to the face, limbs and the like of the distribution user (MPEG file and TSV file etc.) and / or voice data relating to utterance and / or singing issued by the distribution user (MPEG file etc.). ) Can be output to the processing unit.

  In addition, although the case where the first sensor includes an RGB camera and an infrared camera has been described here, the first sensor is, for example, (A) infrared rays emitted by an infrared laser and reflected on the face, limbs, etc. of the distribution user. The camera may include any one of a camera that detects the light, (B) a plurality of RGB cameras that capture visible light, and (C) a single camera that captures visible light. In the case of (A) above, the acquisition unit can calculate the depth for each feature point on the face, limbs, etc. of the delivery user by the same method as described above. In the case of (B), the acquisition unit can calculate the depth (depth) for each feature point on the face, limbs, and the like of the delivery user, using the plurality of images captured by the plurality of RGB cameras. . In the case of (C), the acquisition unit calculates the depth (depth) of each feature point on the face, limbs, etc. of the delivery user from the image captured by the single camera by using deep learning or the like. can do. In addition, in the case of (C), the acquisition unit performs the depth (depth) of each feature point on the face, limbs, etc. of the delivery user by performing analysis processing (image processing, etc.) on the image captured by the single camera. May be calculated.

  The processing unit can generate a moving image including an animation of a virtual character (avatar object) based on the data regarding the face, limbs, and the like of the delivery user from the acquisition unit. Regarding the moving image of the avatar object itself, the processing unit uses various information (for example, geometry information, bone information, texture information, shader information, blend shape information, etc.) stored in the character data storage unit (not shown) A moving image of the avatar object can also be generated by causing the rendering unit to execute rendering.

  It should be noted that, in order to generate a moving image including the animation of the avatar object of the distribution user based on the data regarding the operation of the distribution user and / or the voice data regarding the utterance or song uttered by the distribution user, any other well-known method is available. It is also possible to use technology.

  By the way, the moving image generation unit 100 sends request information to the communication device 150, which will be described later, to generate a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object, and the server device 20. When received from (the information processing server device 20B), the request information can be received from the communication unit 150 and the moving image can be generated. In this case, the moving image generation unit 100, the data related to the moving image including the animation of the avatar object generated in detail as described above, and the data related to the first gift or the second gift (which attachment part of the avatar object is attached). And the data relating to which shape, size, and color the gift is), and a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object. Can be generated. Specifically, the first gift and the second gift are set in advance with information (wearing position information) about which wearing part of the avatar object is worn, and the gifting from the viewing user is performed. Alternatively, when a predetermined condition described later is satisfied, the first gift or the second gift can be displayed on the moving image on the wearing site based on the wearing position information. For example, when the first gift is “red school bag”, the wearing position information is “back”, and when the “red school bag” is gifted by the viewing user, at least a part of “back” of the avatar object is displayed. The “red school bag” is displayed on the moving image so as to cover (or contact at least a part of “back”). Similarly, when the second gift is a “rainbow large fork”, the mounting position information is “left hand” (may be “right hand”), and when the “left hand” satisfies the predetermined condition described later, The "large rainbow-colored fork" is displayed on the moving image so that it touches the "left hand" of the avatar object (covers part of the "left hand"). The position (positional information) of each wearing part of the avatar object in the moving image is detected by, for example, a sensor such as a motion sensor described later. Therefore, when displaying a "red school bag" on the "back" of the avatar object, the position information of the "back" at that time is referenced, and the "red school bag" is displayed as a video corresponding to the "back". Will be displayed above. In addition, the displayed first gift and the second gift are displayed on the moving image such that they move in association with the movement of the wearing part of the worn avatar object while these are displayed (duration described later). May be displayed in. Such a method of generating a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object is described in Japanese Patent No. 6431233 or other known methods. Technology can be used.

(2) Display unit 110
The display unit 110 displays various information necessary for distribution and / or viewing of a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object). Can be displayed. For example, the display unit 110 can display a distributed moving image, a received moving image, and / or a generated moving image. The display unit 110 can also display various comments distributed from the server device 20 to each terminal device 10 together with the received moving image. Furthermore, the gift information stored in the gift storage unit 140 can be appropriately displayed according to the operation of the viewing user.

(3) Storage unit 120
The storage unit 120 stores various information required for distribution and / or viewing of a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object). Can be memorized.

(4) User interface unit 130
The user interface unit 130 may be used for various distribution and / or viewing of a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object). Information can be entered via operation of the delivering or viewing user. For example, the user interface unit 130 performs an operation of the viewing user related to the gifting for the avatar object (such as selecting a predetermined gift from a plurality of first gifts prepared in advance and selecting a command to be given to the avatar object. Operation data indicating the contents (including operation) can be input from the viewing user, and the operation data can be output to the communication unit 150. Here, the above-mentioned operation data can include, for example, information regarding what kind of gift (gift type) the viewing user gave to the distribution user.

  In addition, as another example, when the viewing user makes one or more gifting, the user interface unit 130 sends a gift (first gift or second gift) corresponding to the gifting to the avatar object. When receiving an inquiry from the server device 20 about mounting on the mounting site, the operation data relating to the answer to the inquiry can be input from the distribution user and the operation data can be output to the communication unit 150.

(5) Gift storage unit 140
When the video distribution application and the video viewing application are installed in the terminal device 10, the gift storage unit 140 can store gift information preset in these applications. The gift information can include identification information such as the name, shape, and color of each gift, and the amount of each gift charged to the viewing user when the viewing user gives a gift.

(6) Communication unit 150
The communication unit 150 provides various information necessary for distribution and / or viewing of a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object). , And can communicate with the server device 20. For example, when the terminal device 10 operates as the distribution user's terminal device 10, the communication unit 150 creates a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object. It is possible to receive the request information for the generation from the server device 20 (information processing server device 20B) and transmit the generated moving image to the server device 20 (distribution server device 20C). Similarly, when the terminal device 10 operates as the distribution user's terminal device 10 and one or more gifts are made by the viewing user, the gift corresponding to the gift (first gift or A second gift) is received from the server device 20 about mounting the avatar object on the mounting site, the information of the inquiry is output to the display unit 110, and the operation data related to the reply to the inquiry is transmitted to the user interface. Information related to the answer received from the face unit 130 can be transmitted to the server device 20.

  On the other hand, when the terminal device 10 operates as the terminal device 10 of the viewing user, the communication unit 150 can receive the moving image generated by the terminal device 10 of the distribution user from the server device 20. Similarly, when the terminal device 10 operates as the terminal device 10 of the viewing user, the viewing user relates to the information about the gifting to the distribution user (avatar object) and the comment from the viewing user to the distribution user (avatar object). Information can be transmitted to the server device 20 (comment API server device 20D).

(7) Studio Unit A studio unit (not shown) including the moving image generation unit 100, the display unit 110, the storage unit 120, the user interface unit 130, the gift storage unit 140, and the communication unit 150 is used as the terminal device 10. You can also

  The studio unit can be implemented by an information processing device such as a personal computer, and like the terminal device 10 and the server device 20 described above, mainly the central processing unit, the main storage device, and the input / output interface. A device, an input device, an auxiliary storage device, and an output device can be included. These devices are connected to each other by a data bus and / or a control bus. In addition, the studio unit functions as an information processing device that executes a specific installed application, so that the data regarding the operation of the distribution user in the studio room (not shown) in which the studio unit is installed and / or the distribution user. A moving image including the animation of the avatar object can be generated based on the data relating to the utterance and song uttered by.

  Many of the components of the moving image generation unit 100 included in the studio unit are arranged in the studio room. Further, in the studio room, the distribution user performs various performances, and the studio unit detects the motion, facial expression, utterance (including singing), etc. of the distribution user.

  The distribution user is a target for capturing actions, facial expressions, utterances (including singing), etc. by various sensor groups included in the studio unit (moving image generation unit 100). In this case, the distribution user does not necessarily have to be a human, and may be, for example, a robot capable of independent movement. The number of distribution users in the studio room may be one, or may be two or more.

  The moving image generation unit 100 in the studio unit includes various motion sensors (not shown) worn by the distribution user, a controller (not shown) held by the distribution user's hand, and a wearing tool (not shown). A camera (not shown) that is attached to the head of the delivery user via the. In addition, the studio unit is provided with a microphone at any place (for example, a wall, a floor, a ceiling, etc.) in the above-described wearing equipment or the studio room in order to acquire the voice data of the distribution user. Further, the studio unit may have a plurality of base stations (not shown), a tracking sensor (not shown), and a display (not shown) in addition to the above configuration.

  The aforementioned motion sensor can cooperate with the aforementioned base station to detect the position and orientation of the distribution user. In one embodiment, the plurality of base stations are multi-axis laser emitters, one base station scans the laser light, for example around a vertical axis, and then another base station after emitting a flashing light for synchronization. Is configured to scan the laser light around a horizontal axis, for example. The motion sensor is equipped with multiple optical sensors that detect the incidence of blinking light and laser light from the base station. The time difference between the blinking light incidence timing and the laser light incidence timing, the light receiving time at each optical sensor, each optical sensor It is possible to detect the incident angle of the laser light detected by the. The motion sensor may be, for example, a Vive Tracker provided by HTC CORPORATION, or ZERO C SVEN Inc. Xsens MVN Analyze provided by K.K.

  The moving image generation unit 100 in the studio unit acquires detection information indicating the position and orientation of each motion sensor calculated by the motion sensor. The motion sensor is attached to a part such as a wrist, an instep, a waist, or a crown of the distribution user, so that the motion of the distribution user can be detected by detecting the position and orientation of the motion sensor.

  In one embodiment, a large number of infrared LEDs are mounted on a plurality of motion sensors, and the light from the infrared LEDs is detected by an infrared camera provided on the floor or wall of the studio room to detect the motion sensors. The position and orientation may be detected. Further, a visible light LED may be used instead of the infrared LED, and the position and orientation of the motion sensor may be detected by detecting light from the visible light LED with a visible light camera.

  In one embodiment, multiple reflective markers may be used in place of the motion sensor. The reflective marker is attached to the distribution user with an adhesive tape or the like. As described above, the distribution user to which the reflective marker is attached may be imaged to generate imaging data, and the imaging data may be image-processed to detect the position and orientation of the reflective marker.

  The controller outputs a control signal according to the operation of the distribution user, and the moving image generation unit 100 acquires this.

  The tracking sensor generates tracking information for defining setting information of a virtual camera for constructing a virtual space included in a moving image. The tracking information is calculated as a position in the three-dimensional orthogonal coordinate system and an angle around each axis, and the moving image generation unit 100 acquires the tracking information.

  The camera attached to the head of the distribution user is arranged so that the face of the distribution user can be captured. The camera acquires imaged data of the face of the distribution user by continuously imaging the face of the distribution user, and the moving image generation unit 100 acquires the imaged data from the camera. Note that the camera may be a 3D camera capable of detecting the depth of the face of the distribution user.

  The display functions as the display unit 110, is arranged at a position that can be visually recognized by the distribution user, and the distribution user can acquire various information and visually recognize the moving image generated by the moving image generation unit 100 through the display. It is possible.

  In addition to the components described above, the studio unit similarly includes the storage unit 120, the user interface unit 130, the gift storage unit 140, and the communication unit 150 described above. Further, the components of the studio unit described above are examples, and may include various other applicable components.

3-2. Functions of Server Device 20 An example of functions of the server device 20 will be described with reference to FIGS. 4 to 7. FIG. 4 is a block diagram schematically showing an example of functions of the server device 20 shown in FIG. FIG. 5 is a diagram showing an example of a table managed by the database unit 230. 6A to 6D are diagrams showing an example of a table managed by the database unit 230, and are diagrams schematically showing an image when the determination unit 240 makes a determination. FIG. 7 is a diagram showing an example of the confirmation screen displayed on the display unit 110 of the terminal device 10 of the distribution user.

  As shown in FIG. 4, the server device 20 can mainly include a storage unit 200, a communication unit 210, a gift processing unit 220, a database unit 230, a determination unit 240, and a comment processing unit 250.

(1) Storage unit 200
The storage unit 200 stores various information required for distribution and / or viewing of a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object). Can be memorized.

(2) Communication unit 210
The communication unit 210 provides various information required for distribution and / or viewing of a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object). , And can communicate with the terminal device 10 of the distribution user and / or the terminal device 10 of the viewing user. For example, the communication unit 210 receives a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object) from the terminal device 10 of the delivery user, and receives each. It can be delivered to the terminal device 10 of the viewing user.

  In addition, the communication unit 210 receives from the terminal device 10 of the viewing user, information related to the gifting from the viewing user to the distribution user (avatar object) and information related to the comment from the viewing user to the distribution user (avatar object). Information related to gifting is output to the gift processing unit 220, and information related to comments is output to the comment processing unit 250.

  Furthermore, the communication unit 210 transmits, to the terminal device 10 of the distribution user, request information indicating that a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object is generated. be able to.

  Furthermore, when the viewing user has made a plurality of gifts and the determination unit 240 described later determines that the combination of the first gifts satisfies a predetermined condition, the second gift is an avatar object. A request signal related to an inquiry (confirmation) for obtaining confirmation of the distribution user about mounting on the mounting site of the distribution user is transmitted to the terminal device 10 of the distribution user, and information related to a response to the inquiry is transmitted from the terminal device 10 of the distribution user. You can also receive.

(3) Gift processing unit 220
When the gift processing unit 220 outputs the information related to the gifting (request signal related to the gifting) from the communication unit 210, the gift processing unit 220 includes the identification information of the viewing user who performed the gifting action (the serial number of the terminal device 10 of each viewing user). Numbers, ID information given to each viewing user, etc., and gifted gift information (information about what kind of gift the avatar object is attached to, and the name and shape of each gift). Information read out by reading out at least the identification information such as color) and the identification information of the delivery user that is the avatar object of the gifting (the serial number of the terminal device 10 of the delivery user and the ID information given to the delivery user). Are stored in the database unit 230 automatically or in response to an inquiry.

(4) Database unit 230
The database unit 230 can receive various information read by the gift processing unit 220 from the gift processing unit 220 automatically or by inquiring the gift processing unit 220 at predetermined time intervals. Further, as shown in FIG. 5, the database unit 230 has a table (reference table) for each distribution user, and stores various information received from the gift processing unit 220 in each table of the corresponding distribution user. To do.

  Next, an example of the information stored in the table will be described with reference to FIG.

  When the database unit 230 has the table 500 for each distribution user, the distribution user identification information 501 (for example, distribution user ID information) is added to each table 500. Further, the database unit 230 sequentially provides gift information gifted to the corresponding table according to the distribution user identification information 501 received from the gift processing unit 220 (in FIG. 5, the gifted order is an example. However, they may be stored in the order in which the first gift is attached to the avatar object, for example.

  More specifically, first, from the state where the gift is not attached to the attachment part of the avatar object (initial state), as shown in FIG. 5, a “red school bag”, a “diamond crown”, and a “silver fork” are shown. , "Golden Hallisen", "Golden Ring", and "White Sneakers" in that order, if one or more viewing users perform the gifting related to the first gift, the attachment part of the avatar object is displayed. Each wears the first gift in that order (a moving image including an animation in which the first gift is worn on the wearing part of the avatar object is generated). Therefore, the database unit 230 selects “red school bag”, “diamond crown”, “silver fork”, “golden halisen”, “gold ring”, and “white sneaker” in this order in the table 500. It is stored in the box 502 of the “equipped gift list” in the order of (gifting order or wearing order). Although not shown in FIG. 5, information relating to the attachment site of the avatar object corresponding to each first gift (the attachment site of the avatar object corresponding to the “red school bag” is “back”) and each item. The identification information of the viewing user who has gifted one gift (for example, the ID information of the viewing user) may be stored (displayed) in the box 502 so as to correspond to each first gift.

  Next, from the state where the above six first gifts are attached to the attachment parts of the avatar objects, respectively, further, "diamond crown", "silver fork", "silver ring", "copper knife". , "Black rucksack", "white school bag", "gold fork", "gold glasses", and "silver spoon" in this order from one or more viewing users to further gift the first gift. Is executed. In this case, the above-mentioned six first gifts are already attached to the attachment parts of the avatar objects corresponding to these gifts. In other words, "red" on the "back", "diamond crown" on the "head", "silver fork" on the "left hand", "golden halisen" on the "right hand", and "fingers" on the "finger" "Gold ring" and "both feet" are wearing "white sneakers". On the other hand, corresponding wearing parts such as a "black rucksack" on the "back" and a "silver ring" on the "fingers" will overlap. In such a case, the database unit 230 at least temporarily stores the further gifted first gifts in the box 503 of the “unattached gift list” in the gifted order. In this case, as in the case of the box 502, the information regarding the wearing part of the corresponding avatar object and the identification information of the viewing user who gifted each first gift are stored in the box 503 so as to correspond to each first gift. (Display).

  Based on the information stored as described above, the database unit 230 associates the type of the first gift given to the wearing part of the avatar object with the number of the given first gifts for each type. It can be said that I remember. In other words, the database unit 230 manages (stores), using the table 500, what kind of first gift and how many first gifts were given to each wearing part, and the information managed (stored) is determined. It is also output to the determination unit 240 in response to the inquiry from the unit 240.

  Note that the first gift attached to the avatar object is automatically deleted from the moving image after a predetermined time (for example, 1 minute or 2 minutes) from the time when the first gift is attached to the avatar object. , Is preset in the video distribution application and the video viewing application. Therefore, if the "black rucksack" is gifted after a predetermined time has elapsed since the "red school bag" was attached to the avatar object, the "black rucksack" is attached to the avatar object. (In this case, the database 230 would store “black rucksack” in the box 502).

(5) Judgment unit 240
The determination unit 240 determines whether or not the avatar object is attached to a portion where a plurality of gifting actions (including both a single viewing user and a plurality of viewing users). With respect to the first gift, it is determined whether or not to generate a moving image including an animation in which the second gift having the same features as the first gift is attached. This determination is executed by referring to the table 500 managed by the database unit 230 (based on the information output from the database unit 230), and a combination of the plurality of first gifts is used for the video distribution application and the video viewing application. It is determined by whether or not a predetermined condition preset in the application is satisfied.

  An example of the determination will be described with reference to FIGS. 6A to 6D.

  As described above with reference to FIG. 5, focusing on the “head” of the attachment parts of the avatar object, the “diamond crown” is already attached. In this state, if the "diamond crown" is further gifted, the first gift combination has two identical "diamond crowns" (see FIG. 6A). Here, if at least one of the above-mentioned predetermined conditions is that two identical first gifts are prepared, the above-mentioned predetermined condition is satisfied that two "diamond crowns" are prepared. Such a predetermined condition can be arbitrarily set in advance in the video distribution application and the video viewing application. When the predetermined condition is satisfied as described above, the determination unit 240 includes an animation in which the second gift having the same feature as the first gift “diamond crown” is attached to the “head” of the avatar object. Determine to generate a video. In this case, the second gift may be, for example, a "large diamond crown" or a "100 carat diamond tiara" in which the size, color, and / or shape of at least part of the first gift changes. Can be appropriately adopted.

  Next, as described above with reference to FIG. 5, focusing on the “fingers” of the attachment parts of the avatar object, the “gold ring” is already attached. In this state, if the "silver ring" is further gifted, the first gift combination is "gold ring" and "silver ring" (see FIG. 6B). Here, when at least one of the above-described predetermined conditions is that two first gifts having different colors are provided, the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240, similar to the case described with reference to FIG. 6A, determines whether the first gift such as the “gold ring” has the same feature as the “gold ring”. It is determined that a moving image including an animation in which the gift 2 is attached is generated.

  Next, as described above with reference to FIG. 5, focusing on the “back” of the attachment parts of the avatar object, the “red school bag” has already been attached. In this state, if the "black rucksack" and the "white school bag" are further gifted, the first gift combination is three combinations of "red school bag", "black rucksack" and "white school bag". (See FIG. 6C). Here, when at least one of the above-mentioned predetermined conditions is that three first gifts are prepared for the "back", the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 is in a state where the second gift having the same features as the first gift “red school bag” is attached, as in the case described with reference to FIG. 6A. It is determined to generate a video including the animation. As the second gift in this case, for example, "big wing" is set. In this way, the second gift may have the same feature as the first gift only by the fact that the first gift and the second gift have the same wearing part. In addition, the second gift has the same color as the first gift, the same size, the same kind of article (the same kind), and the like. It can be said that they have common characteristics.

  Next, as described above with reference to FIG. 5, focusing on the “left hand” of the attachment parts of the avatar object, the “silver fork” is already attached. In this situation, if the "silver fork", "copper knife", "gold fork", and "silver spoon" are further gifted, the first gift combination is two "silver forks". , “Copper knife”, “gold fork” and “silver spoon”, for a total of 5 combinations (see FIG. 6D). Here, if at least one of the above-described predetermined conditions is that the colors of gold, silver, and copper are the same and that the knife, fork, and spoon are the same in the “left hand”, the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 wears the second gift having the same characteristics as the first gift, the silver fork, as in the case described with reference to FIG. 6A. It is determined to generate a moving image including a state animation. As the second gift in this case, for example, “a large iridescent fork” or the like is set.

  As in the above example, the above-mentioned predetermined condition can be set in any manner. If the predetermined condition is simple (for example, the example described with reference to FIGS. 6A and 6B, etc.), many kinds of second gifts can be made to appear, and thus the viewing user's motivation for gifting. Can be stimulated. On the other hand, even if the predetermined condition is difficult (for example, the example described with reference to FIG. 6D), what kind of first gift should be combined with the second gift for the viewing user. That interest and curiosity are evoked. Therefore, the viewing user's chance of gifting increases.

  By the way, when the combination of the plurality of first gifts does not satisfy the predetermined condition, the determination unit 240 determines that the necessary condition for the combination to satisfy the predetermined condition (the gift required for satisfying the predetermined condition is Types, numbers, etc.) can be calculated. The determination unit 240 compares the set predetermined condition with a combination of a plurality of first gifts, and what kind of first gift needs to be additionally gifted in order to satisfy the predetermined condition. The condition that is there is calculated. The calculated necessary condition is output to the comment processing unit 250. Here, a specific example of the necessary conditions will be described. For example, in the above-described case described with reference to FIG. 6C, if the predetermined condition is “to have three first gifts on the back” as described above, the viewing user selects “red school bag” (wearing). Done) and only "Black Rucksack" is being gifted, the requirement is "one first gift corresponding to the back of the avatar object". In the case of such a necessary condition, the comment processing unit 250 synthesizes comment information such as "if there is one more gift on the back, the gift will change" with the video (displayed on the video. It is transmitted to the terminal device 10 of the distribution user. Further, in the case described above with reference to FIG. 6D, it is assumed that the predetermined condition is “the gold, silver, and copper colors are aligned and the knife, fork, and spoon are aligned with the left hand” as described above. , If the viewing user only gives "Silver fork" (already installed), "Gold fork", and "Silver spoon", the requirement is "Copper knife corresponding to the left hand of the avatar object". Becomes In the case of such a necessary condition, the comment processing unit 250 synthesizes comment information such as “Call for gifting of copper knife! It is transmitted to the terminal device 10.

  When the determination unit 240 determines that the combination of the first gifts satisfies the predetermined condition, the determination unit 240 attaches the second gift to the attachment site of the avatar object (the second gift is attached to the attachment site of the avatar object. For generating a moving image including an animation), a request signal relating to an inquiry for obtaining the confirmation of the distribution user can be output to the communication unit 210. The communication unit 210 transmits the request signal to the distribution user (the distribution user's terminal device 10), and receives information regarding the answer to the inquiry from the distribution user's terminal device 10. In this case, specifically, a screen 600 as shown in FIG. 7 is displayed on the display unit 110 of the terminal device 10 of the distribution user. In addition, "Do you want to synthesize?" In FIG. 7 can be replaced with the phrase "Do you want to attach the second gift to the avatar object?" In this way, when the delivery user understands that the second gift is attached to the avatar object (when the delivery user selects “Yes” in FIG. 7), the avatar object on which the second gift is attached Even if the viewing user further performs the gifting on the wearing part of, the notification is given to the viewing user such that the gifting is not reflected in the avatar object for a certain time (duration described later). The determination unit 240 may instruct the comment processing unit 250 to transmit comment information such as “I can't do it” or “Already wearing the second gift!” To the terminal device 10 of the distribution user. .

  The second gift attached to the avatar object lasts in the video (the second gift exists in the video including the animation in which the second gift is attached to the attachment part of the avatar object). ) A duration (for example, 1 minute or 2 minutes) is set in advance, and in the video distribution application and the video viewing application, the second gift is deleted from the video when the duration elapses. It is set. The duration of the second gift may start from the time when the second gift is attached to the attachment site of the avatar object, or the time of the last gifting performed by the viewing user to satisfy the predetermined condition. The starting point may be (the time point when the predetermined condition is satisfied). Further, in order to cause the viewing user to give a gift at the timing immediately after the second gift is deleted from the video, immediately before the second gift is deleted from the video, for example, “the second gift disappears”. Therefore, the determination unit 240 may instruct the comment processing unit 250 to transmit comment information such as “Call for new gifting!” To the terminal device 10 of the distribution user.

(6) Comment processing unit 250
The comment processing unit 250 can receive comment information from the viewing user with respect to the distribution user (avatar object) from the terminal device 10 of the viewing user via the communication unit 210, and the comment information from the viewing user is the same. It can be distributed to each viewing user who is watching the video.

  In addition, the comment processing unit 250 refers to the table 500 managed by the database unit 230, and responds to all or part of information relating to which viewing user gifted what gift to the wearing part of the avatar object. It is also possible to create comment information to be distributed and distribute the comment information to each viewing user who is watching the same video.

  Furthermore, the comment processing unit 250 refers to the table 500 managed by the database unit 230, and indicates that the first gift and / or the second gift has been given to the attachment site of the avatar object and / or Alternatively, it is also possible to create comment information indicating that the device is attached and distribute the comment information to each viewing user who is viewing the same video.

  Furthermore, the comment processing unit 250 creates comment information corresponding to the above-described necessary conditions calculated by the determination unit, and distributes the comment information to each viewing user who is watching the same video. You can also

4. Overall Operation of Video Distribution System 1 Next, the overall operations performed in the video distribution system 1 having the above configuration will be described with reference to FIGS. 8 to 11. FIG. 8 is a flowchart showing an example of the operation performed in the moving image distribution system 1 shown in FIG. FIG. 9 is a diagram showing an example of a moving image including an animation of an avatar object of a distribution user. FIG. 10 is a diagram illustrating an example of a moving image including an animation in which the first gift is attached to the attachment site of the avatar object of the distribution user. FIG. 11 is a diagram schematically illustrating an example of an image in which the second gift is worn in place of the first gift at the site where the delivery user wears the avatar object.

  First, in step (hereinafter referred to as “ST”) 300, the terminal device 10 (here, terminal device 10A) activates and executes the moving image distribution application according to the operation of the distribution user (here, distribution user A).

  Next, in ST301, the terminal device 10A generates a moving image including the animation of the avatar object of the distribution user A based on the data regarding the operation of the distribution user A and / or the voice data regarding the utterance or the song uttered by the distribution user A. . As a result, as illustrated in FIG. 9, the moving image 401 including the animation of the avatar object 400 of the distribution user A is displayed on the display unit 110 of the terminal device 10A.

  Further, the terminal device 10A transmits the generated moving image 401 to the distribution server device 20C of the server device 20. The distribution server device 20C distributes the moving image received from the terminal device 10A to the terminal device 10 of each viewing user who is executing the moving image viewing application. Accordingly, the moving image 401 as illustrated in FIG. 9 is also displayed on the display unit 110 of the terminal device 10 of each viewing user.

  Next, in ST302, the terminal device 10 of the viewing user gives the first gift to the distribution user A (the wearing part of the avatar object 400) based on the operation of the viewing user on the user interface unit 130. A request signal for requesting is sent to the server device 20 (gift API server device 20A).

  Next, in ST303, the server device 20 (gift API server device 20A) that has received the request signal relating to the first gift from the terminal device 10 of the viewing user, the identification information of the viewing user who performed the gifting act, the gifting. At least the information related to the given gift and the identification information of the distribution user as the avatar object of the gifting target are read out. Then, the various types of read information are stored in a table in the information processing server device 20B of the server device 20.

  Next, in ST304, the server device 20 (information processing server device 20B) has already sent the first gift to each wearing part of the avatar object 400 of the distribution user A when the information is stored in the table in ST303. Check if it is installed. In ST304, the wearing part of the avatar object 400 that has been gifted by the viewing user is, for example, the “head”, and when the information related to the gifting is stored in the table in ST303, the first part is added to the “head”. If the above gift is not attached, the server device 20 (information processing server device 20B) judges “NO” in ST304 and proceeds to ST310, so that the viewing user gives a gift to the “head” of the avatar object 400. The terminal device 10A of the distribution user A transmits information requesting generation of a moving image including an animation in which the first gift (for example, “diamond crown”) that has been attached is attached.

  On the other hand, in ST304, the wearing part of the avatar object 400 that has been gifted by the viewing user is, for example, the “head”, and when the information related to the gifting is stored in the table in ST303, the “head” is added. If the "diamond crown" has already been attached, the server device 20 (information processing server device 20B) requests the first head ("diamond crown") to the "head". Under the existence of a plurality of items, it is determined “YES” in ST304, and then in ST320, which will be described later, the determination related to the first gift combination is executed.

  Next, as described above, as a result of the server device 20 determining “NO” in ST304, the terminal device 10A of the distribution user A views the “head” of the avatar object 400 from the server device 20 (information processing server device 20B). When the user receives information requesting to generate a moving image including an animation in which a gifted first gift (for example, “diamond crown”) is attached, the terminal device 10A transmits the moving image in ST310. To generate. As a result, as illustrated in FIG. 10, the animation in which the first gift 410, which is the “diamond crown” is attached to the “head” of the avatar object 400 of the distribution user A, is displayed on the display unit 110 of the terminal device 10A. A moving image 402 including is displayed. Note that the moving image 402 in FIG. 10 shows an example in which the first gift 420, which is a “silver fork”, is attached to the “left hand” of the avatar object 400 in the same steps.

  Further, the terminal device 10A transmits the generated moving image 402 to the distribution server device 20C of the server device 20. In ST311, distribution server device 20C distributes the moving image received from terminal device 10A to terminal device 10 of each viewing user who is executing the moving image viewing application. As a result, the moving image 402 illustrated in FIG. 10 is also displayed on the display unit 110 of the terminal device 10 of each viewing user, and the step in the case where the server device determines “NO” in ST304 ends.

  On the other hand, when the server device 20 determines “YES” in ST304 as described above, the determination unit 240 determines whether or not the first gift combination satisfies the predetermined condition. When the combination of the first gifts satisfies the predetermined condition (“YES” in ST320), the server device 20 (determination unit 240 of the information processing server device 20B) notifies the distribution user A in ST321. Information relating to an inquiry (confirmation) as to whether the second gift may be attached to the avatar object 400 is transmitted to the terminal device 10A of the distribution user A. In response to this inquiry, when the answer that the distribution user A is OK is transmitted from the terminal device 10A of the distribution user A to the server device 20, the server device 20 (information processing device 20B) causes the server device 20 (information processing device 20B) to attach the avatar object 400 ( For example, the terminal device 10A of the distribution user A transmits information requesting to generate a moving image including an animation in which a second gift (for example, "100 carat diamond tiara") is attached to the "head"). By the way, supplementing a specific example of the second gift with reference to FIG. 11, for example, when the first gift 420, which is a “silver fork”, is attached to the “left hand” of the avatar object 400, the predetermined condition is satisfied. When is satisfied, the second gift 420Z, which is “a large iridescent fork”, is generated (combined). In this case, the first gift 420 and the second gift 420Z not only have the same wearing part of the avatar object 400, but also have the same shape, which is one of the features. As described above, the first gift 420 and the second gift 420Z have some common features.

  Next, in ST322, the terminal device 10A of the distribution user A receives a second gift (for example, “100 carat diamond tiara”) from the server device 20 (information processing server device 20B) to the “head” of the avatar object 400. ) Receives information requesting to generate a moving image including the attached animation, the terminal device 10A generates the moving image (not shown).

  Further, the terminal device 10A transmits the generated moving image to the distribution server device 20C of the server device 20. In ST323, the distribution server device 20C distributes the moving image received from the terminal device 10A to the terminal device 10 of each viewing user who is executing the moving image viewing application. As a result, the same moving image is displayed on the display unit 110 of the terminal device 10 of each viewing user, and it is determined that the server device is “YES” in ST304 and is “YES” in ST320. If so, the step ends.

  When the combination of the first gifts does not satisfy the predetermined condition in ST320 (“NO” in ST320), the server device 20 (determination unit 240 of the information processing server device 20B) determines in ST330. Necessary necessary conditions for the combination to satisfy the predetermined condition (types and number of gifts necessary for satisfying the predetermined condition, etc.) are calculated. Further, the calculated necessary conditions are converted into comment information and distributed to the terminal device 10 of each viewing user via the comment processing unit 250. As a result, similar comment information is displayed on the display unit 110 of the terminal device 10 of each viewing user. Thus, the step when ST320 returns "NO" is completed.

  The above steps are executed each time the viewing user makes a gifting act. Therefore, for every gifting action, a moving image including an animation in which the first gift or the second gift is attached can be generated and delivered at each attachment site of the avatar object 400 in a timely manner.

5. Regarding Modification Example In the above-described embodiment, the generation of the moving image (including the moving image including the animation in which the first gift or the second gift is attached to the attachment part of the avatar object) is generated by the terminal device 10 of the distribution user. However, in another embodiment, it may be executed by the server device 20 or the terminal device 10 of the viewing user. Further, each of the terminal device 10 of the distribution user, the server device 20, and the terminal device 10 of the viewing user may generate a part of the moving image to generate a final moving image, or a device other than these devices. May further generate a part of the moving image. Further, in the above-described another embodiment, a rendering unit (not shown) is provided in the server device 20 and / or the terminal device 10 of the viewing user, and the terminal device 10 of the distribution user is the server device 20 and / or In order for the terminal device 10 of the viewing user to generate a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment part of the avatar object), for example, the first In addition to the information related to the gift and the information related to the second gift, only the data regarding the operation of the distribution user and / or the data regarding the utterance or song uttered by the distribution user are generated, and these data are stored in the server device 20. And / or it may be configured to transmit to the terminal device 10 of the viewing user.

  In order to realize such a configuration, another embodiment is adopted in which the respective functions of the server device 20, the viewing user terminal device 10, and the distribution user terminal device 10 are appropriately changed from the above-described one embodiment. sell. For example, in one embodiment, the moving image generation unit 100 is included in the terminal device 10, but may be included in the server device 20 or may be included in the terminal device 10 or the terminal device 10 of the viewing user.

  Further, the table 500 storing the gift information and the determination as to whether or not the first gift combination satisfies the predetermined condition by referring to the table 500, in the above-described one embodiment, the information processing server in the server device 20. Although executed by the device 20B, in another embodiment, it may be executed by the terminal device 10 of the distribution user. Accordingly, the determination unit 240 is included in the server device 20 in the above-described embodiment, but may be included in the terminal device 10 of the distribution user.

  Furthermore, in the above-described one embodiment, based on the combination of the first gifts given to each wearing part of the avatar object (for example, the combination of the first gifts given to the “head”), the combination. Was determined to satisfy the predetermined condition, but in another embodiment, the predetermined combination is determined based on, for example, a combination of a plurality of first gifts given to a plurality of wearing parts of the avatar object. It may be determined whether or not the condition is satisfied. Specifically, a combination of the first gift given to the "head" of the avatar object and the first gift given to the "neck", or the first gift given to the "left hand" of the avatar object. , A first gift given to the “right hand”, a first gift given to the “left foot”, and a first gift given to the “right foot”.

  Furthermore, in another embodiment, the above-mentioned predetermined condition may be set so as to change every predetermined time (for example, every day, every week, every month).

  Furthermore, as described with reference to FIG. 11 in the above-described embodiment, the second gift is set such that a predetermined gift is combined according to a preset combination of the first gifts. However, in another embodiment, a plurality of types of second gifts are set to be combined in accordance with a preset first gift combination, and the plurality of types of second gifts are combined. The second gift determined by the distribution user's selection from the gifts may be set to be attached to the avatar object.

  Therefore, according to various embodiments, it is possible to provide a moving image processing method, a server device, and a computer program that increase the number of gifting opportunities by the viewing user.

6. Regarding the various aspects, the moving image processing method according to the first aspect is “a moving image processing method executed by one or more processors that execute computer-readable instructions, and includes animation of an avatar object of a distribution user. A request signal generated based on the operation of the viewing user who views the video and requesting to attach the first gift to the wearing part of the avatar object is transmitted from the terminal device of the viewing user via the communication line. When it is determined that a combination of the plurality of first gifts given to the wearing part of the avatar object based on the receiving step of receiving and the plurality of request signals satisfies a predetermined condition, A second gift having the same features as the first gift is attached to the attachment part of the avatar object. A generation step of generating the moving image including the animation, is intended to include "a.

  The moving image processing method according to the second aspect is the one in which the animation is generated based on the action of the distribution user in the first aspect.

  In the moving image processing method according to the third aspect, in the first aspect or the second aspect, "the second gift is the size, color, and / or at least a part of the first gift. The shape changes. "

  A moving image processing method according to a fourth aspect is the method according to any one of the first aspect to the third aspect, wherein “when a combination of a plurality of the first gifts does not meet a predetermined condition, the combination is the predetermined value. The method further includes a step of transmitting comment information indicating a necessary condition for satisfying the conditions to the terminal devices of a plurality of viewing users. "

  A moving image processing method according to a fifth aspect is the method according to any one of the first aspect to the fourth aspect, wherein “in response to the request signal received from a terminal device of a certain viewing user, The comment information indicating that the first gift has been attached to the wearing portion and / or that the first gift has been attached to the wearing portion of the avatar object has terminals of a plurality of viewing users. It further includes the step of transmitting to the device ”.

  The moving image processing method according to a sixth aspect is the moving image processing method according to any one of the first aspect to the fifth aspect, wherein “determination regarding whether or not the combination satisfies the predetermined condition is performed on the attachment site of the avatar object. It is performed based on a reference table that stores the types of the first gifts given to the first gifts and the numbers of the first gifts given for the respective types in association with each other.

  A moving image processing method according to a seventh aspect is the method according to any one of the first to sixth aspects, wherein "when the combination satisfies the predetermined condition, the second gift is added to the moving image. The method further includes the step of setting a duration to last and deleting the second gift from the moving image when the duration has elapsed ".

  The moving image processing method according to an eighth aspect is the method according to any one of the first to seventh aspects, wherein "the receiving step and the generating step are the terminal device of the viewing user and / or the terminal of the distribution user. It is performed by a server device connected to the device via a communication line. "

  A moving image processing method according to a ninth aspect is the same as the eighth aspect, wherein “the server device determines that the combination satisfies the predetermined condition”.

  A moving image processing method according to a tenth aspect is the method according to any one of the first to seventh aspects, wherein "the generating step is executed by the terminal device of the distribution user".

  The moving image processing method according to the eleventh aspect is the “10th aspect,” in which it is determined by the server device or the terminal device of the distribution user that the combination satisfies the predetermined condition.

  The moving image processing method according to the twelfth aspect is the method according to any one of the first to seventh aspects, wherein "the generating step is executed by the terminal device of the viewing user".

  A moving image processing method according to a thirteenth aspect is the method according to the twelfth aspect, wherein "the server device or the terminal device of the distribution user determines that the combination satisfies the predetermined condition".

  A moving image processing method according to a fourteenth aspect is the method according to any one of the first to thirteenth aspects, wherein "the wearing part of the avatar object is separated from a part of the avatar object and / or the avatar object. It's part of it. "

  A moving image processing method according to a fifteenth aspect is the moving image processing method according to any one of the first to fourteenth aspects, wherein "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)." It is something.

  A moving image processing method according to a sixteenth aspect is the method according to any one of the first to fifteenth aspects, wherein the communication line includes the Internet.

  A server device according to a seventeenth aspect is provided with "a processor including one or a plurality of processors, the processor being generated based on an operation of a viewing user who views a video including an animation of an avatar object of a distribution user, and the avatar object. Receiving a request signal for requesting to attach the first gift to the wearing part of the avatar object through the communication line from the terminal device of the viewing user, and wearing the avatar object based on a plurality of the request signals. A second feature having the same feature as the first gift in the attachment part of the avatar object when it is determined that a combination of the plurality of first gifts given to the part satisfies a predetermined condition. To generate the animation including the animation of wearing the gift.

  A server device according to an eighteenth aspect is “a processor includes one or a plurality of processors, and the processor is generated based on an operation of a viewing user who views a moving image including an animation of an avatar object of a distribution user. Receiving a request signal for requesting to attach the first gift to the wearing part of the avatar object through the communication line from the terminal device of the viewing user, and wearing the avatar object based on a plurality of the request signals. A second feature having the same feature as the first gift in the attachment part of the avatar object when it is determined that a combination of the plurality of first gifts given to the part satisfies a predetermined condition. Information related to the gift of the viewing user who generates the moving image including the animation in which the second gift is attached. It is transmitted to the terminal device or the distributing user of the terminal device "ones.

  A server apparatus according to a nineteenth aspect is the server apparatus according to the seventeenth aspect or the eighteenth aspect, wherein "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)". .

  A server device according to a twentieth aspect is the server apparatus according to any one of the seventeenth aspect to the nineteenth aspect, wherein the communication line includes the Internet.

  A computer program according to a twenty-first aspect is "generated by an operation of a viewing user who views a moving image including an animation of an avatar object of a delivery user by being executed by one or more processors, and A request signal for requesting to attach the first gift to the wearing site is received from the terminal device of the viewing user via a communication line, and the wearing site of the avatar object based on a plurality of the request signals. When it is determined that a combination of the plurality of first gifts given to the avatar object satisfies a predetermined condition, the second part having the same feature as the first gift in the wearing part of the avatar object. Functioning the processor to generate the video including an animation with a gift attached "It is intended.

  A computer program according to a twenty-second aspect is “generated by an operation of a viewing user who views a moving image including an animation of an avatar object of a distribution user by being executed by one or more processors, and A request signal for requesting to attach the first gift to the wearing site is received from the terminal device of the viewing user via a communication line, and the wearing site of the avatar object based on a plurality of the request signals. When it is determined that a combination of the plurality of first gifts given to the avatar object satisfies a predetermined condition, the second part having the same feature as the first gift in the wearing part of the avatar object. Before generating the moving image that includes the gift-related information and the animation in which the second gift is attached. And transmits to the terminal device or the server device viewing user, the processor to function as "is intended.

  A computer program according to a twenty-third aspect is the computer program according to the twenty-first aspect or the twenty-second aspect, wherein "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)". .

  A computer program according to a twenty-fourth aspect is the computer program according to any one of the twenty-first to twenty-third aspects, wherein “the communication line includes the Internet”.

  A computer program according to a twenty-fifth aspect is “generated by an operation of a viewing user who views a moving image including an animation of an avatar object of a delivery user by being executed by one or more processors, and A plurality of request signals for requesting to attach the first gift to the wearing part are transmitted through the communication line, and a plurality of the plurality of parts are provided to the wearing part of the avatar object based on the plurality of request signals. When it is determined that the combination of the first gifts satisfies the predetermined condition, the animation in which the second gift having the same feature as the first gift is attached to the attachment part of the avatar object is displayed. In order to generate the moving image, the information related to the second gift is distributed to the terminal device of the user or Received from over server device, the processor to function as "is intended.

  A computer program according to a twenty-sixth aspect is “generated by an operation of a viewing user who views a video including an animation of an avatar object of a delivery user by being executed by one or more processors, and A plurality of request signals for requesting to attach the first gift to the wearing part are transmitted through the communication line, and a plurality of the plurality of parts are provided to the wearing part of the avatar object based on the plurality of request signals. When it is determined that the combination of the first gifts satisfies the predetermined condition, the animation in which the second gift having the same feature as the first gift is attached to the attachment part of the avatar object is displayed. The processor including to receive the moving image from a terminal device or a server device of a distribution user. Function is to "is intended.

  A computer program according to a 27th aspect is the computer program according to the 25th aspect or the 26th aspect, wherein "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)". .

  A computer program according to a twenty-eighth aspect is the computer program according to any one of the twenty-fifth aspect to the twenty-seventh aspect, wherein “the communication line includes the Internet”.

7. Fields to which the Technology Disclosed in the Present Application is Applied The technology disclosed in the present application can be applied in the following fields , for example.
(1) Application service that delivers live video in which an avatar object appears (2) Application service that can communicate using characters and avatar objects (chat application, messenger, mail application, etc.)

1 Video distribution system 10 (10A-10D) Terminal device 20 Server device 20A Gift API server device 20B Information processing server device 20C Distribution server device 20D Comment API server device 100 Video generation unit 220 Gift processing unit 230 Database unit 240 Judgment unit 250 Comment Processing unit
400 Avatar object 401, 402 Video 410, 420 First gift 420Z Second gift 500 Table

Claims (28)

A video processing method executed by one or more processors executing computer readable instructions, comprising:
The requesting signal is generated based on the operation of the viewing user who views a video including the animation of the avatar object of the delivery user, and a request signal requesting that the first gift be given to the wearing part of the avatar object. Receiving step of receiving from the terminal device of the above through the communication line,
The attachment site of the avatar object when it is determined that a combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the plurality of request signals. A generation step of generating the moving image including an animation in which a second gift having the same characteristics as the first gift is attached to the first gift;
Video processing method including.   The moving image processing method according to claim 1, wherein the animation is generated based on an operation of the distribution user.   The moving image processing method according to claim 1 or 2, wherein the second gift is one in which the size, color, and / or shape of at least part of the first gift changes.   If a combination of the plurality of first gifts does not satisfy a predetermined condition, the method further includes the step of transmitting comment information indicating a necessary condition for the combination to satisfy the predetermined condition to the terminal devices of the plurality of viewing users. The moving image processing method according to any one of claims 1 to 3, further comprising:   In response to the request signal received from the terminal device of a certain viewing user, the fact that the first gift is given to the wearing part of the avatar object, and / or the wearing part of the avatar object. The moving image according to any one of claims 1 to 4, further comprising: transmitting comment information indicating that the first gift is attached to terminal devices of a plurality of viewing users. Processing method.   The determination as to whether or not the combination satisfies the predetermined condition is based on the type of the first gift given to the attachment part of the avatar object and the number of the first gifts given for each type. The moving image processing method according to any one of claims 1 to 5, which is performed based on a reference table stored in association with each other.   When the combination satisfies the predetermined condition, a duration that lasts in the video is set for the second gift, and the second gift is deleted from the video when the duration has elapsed. The moving image processing method according to claim 1, further comprising a step.   8. The receiving device and the generating process are executed by a server device connected to the terminal device of the viewing user and / or the terminal device of the distribution user via a communication line. The moving image processing method described in one item.   The moving image processing method according to claim 8, wherein the server device determines that the combination satisfies the predetermined condition.   The moving image processing method according to claim 1, wherein the generating step is executed by a terminal device of the distribution user. Whether the combination satisfies the predetermined condition is determined by the server device connected to the terminal device of the viewing user and / or the terminal device of the distribution user via a communication line , or the terminal device of the distribution user. The moving image processing method according to claim 10. The receiving step is executed by a server device connected to the terminal device of the viewing user and / or the terminal device of the distribution user via a communication line, or the terminal device of the distribution user,
It is determined by the server device or the terminal device of the distribution user that the combination satisfies the predetermined condition,
The generation of the moving image including the animation in which the second gift is worn in the generation step is executed by the terminal device of the viewing user. Video processing method. 13. The server device or the terminal device of the distribution user, when determining that the combination satisfies the predetermined condition, transmits information related to the second gift to the terminal device of the viewing user . Video processing method.   14. The moving image processing method according to claim 1, wherein the attachment part of the avatar object is a part of the avatar object and / or a part apart from the avatar object.   The moving image processing method according to any one of claims 1 to 14, wherein the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU).   The moving image processing method according to any one of claims 1 to 15, wherein the communication line includes the Internet. Comprising one or more processors,
The processor
The requesting signal is generated based on the operation of the viewing user who views a video including the animation of the avatar object of the delivery user, and a request signal requesting that the first gift be given to the wearing part of the avatar object. Received from the terminal device of
The attachment site of the avatar object when it is determined that a combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the plurality of request signals. A server device that generates the moving image including an animation in which a second gift having the same features as the first gift is attached to the first gift. Comprising one or more processors,
The processor
The requesting signal is generated based on the operation of the viewing user who views a video including the animation of the avatar object of the delivery user, and a request signal requesting that the first gift be given to the wearing part of the avatar object. Received from the terminal device of
The attachment site of the avatar object when it is determined that a combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the plurality of request signals. The terminal device of the viewing user or the terminal of the distribution user, which generates the moving image including the animation in which the second gift is attached to the information related to the second gift having the same features as the first gift. A server device that sends to the device.   The server device according to claim 17 or 18, wherein the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU).   20. The server device according to claim 17, wherein the communication line includes the Internet. By being executed on one or more processors,
The requesting signal is generated based on the operation of the viewing user who views a video including the animation of the avatar object of the delivery user, and a request signal requesting that the first gift be given to the wearing part of the avatar object. Received from the terminal device of
The attachment site of the avatar object when it is determined that a combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the plurality of request signals. And generating the animation including an animation in which a second gift having the same features as the first gift is attached to
A computer program that causes the processor to function. By being executed on one or more processors,
The requesting signal is generated based on the operation of the viewing user who views a video including the animation of the avatar object of the delivery user, and a request signal requesting that the first gift be given to the wearing part of the avatar object. Received from the terminal device of
The attachment site of the avatar object when it is determined that a combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the plurality of request signals. And transmitting the information related to the second gift having the same characteristics as the first gift to the terminal device or the server device of the viewing user who generates the moving image including the animation in which the second gift is attached. ,
A computer program that causes the processor to function.   23. Computer program according to claim 21 or 22, wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU).   The computer program according to any one of claims 21 to 23, wherein the communication line includes the Internet. By being executed on one or more processors,
A request signal, which is generated based on an operation of a viewing user who views a video including an animation of the avatar object of the delivery user, and requests to attach the first gift to the wearing part of the avatar object is transmitted through the communication line. Outgoing through
The attachment site of the avatar object when it is determined that a combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the plurality of request signals. In order to generate the moving image including the animation in which the second gift having the same features as the first gift is attached, the information related to the second gift is received from the terminal device or the server device of the distribution user. To do
A computer program that causes the processor to function. By being executed on one or more processors,
A request signal, which is generated based on an operation of a viewing user who views a video including an animation of the avatar object of the delivery user, and requests to attach the first gift to the wearing part of the avatar object is transmitted through the communication line. Outgoing through
The attachment site of the avatar object when it is determined that a combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the plurality of request signals. And receiving the moving image including the animation in which the second gift having the same features as the first gift is attached from the terminal device or the server device of the distribution user,
A computer program that causes the processor to function.   The computer program according to claim 25 or 26, wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU).   The computer program according to any one of claims 25 to 27, wherein the communication line includes the Internet.