JP2022167902A - Video processing method, server device, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video processing method, a server device, and a computer program that increases a gifting opportunity for a viewing user.

SOLUTION: A video processing method performed by one or more processors that execute computer-readable instructions includes a receiving step of generating a video including an animation of an avatar object of a distribution user on the basis of the operation of a viewing user, and receiving a request signal that requests that a first gift is given to an attachment part of the avatar object from a terminal device of the viewing user through a communication line, and a generation step of generating the video including the animation in which a second gift having the same characteristics as the first gift is attached to the attachment part of the avatar object when it is determined that a combination of a plurality of first gifts given to the attachment part of the avatar object satisfies a predetermined condition on the basis of the plurality of request signals.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2023,JPO&INPIT

Description

The technology disclosed in the present application relates to a moving image processing method for moving images viewed by a viewing user, a server device for controlling the moving images, and a computer program.

2. Description of the Related Art Conventionally, there has been known a moving picture distribution service for distributing moving pictures to terminal devices via a network. In this type of video distribution service, the avatar (avatar object) of the distribution user who distributes the video is displayed, and the viewing user who watches the video and the distribution user can communicate with each other through messages, chats, etc. An enabling environment is provided.

Furthermore, as a communication tool between viewing users and distribution users, Patent Document 1 discloses an act (gifting) of electronically providing an item acquired by a viewing user to an avatar (distribution user) in a video as a gift. purport is disclosed.

In addition, in a video distribution service such as REALITY (registered trademark), an environment is provided in which a viewing user can make a gift for each wearing part (for example, head, neck, and hand) of an avatar (distribution user). (Non-Patent Document 1).

The entirety of Patent Literature 1 and Non-Patent Literature 1 is incorporated herein by reference.

JP 2012-120098 A

"REALITY", [online], [searched on August 27, 2019], Internet (URL: https://twitter.com/WFLE_REALITY)

The above-mentioned gifting fosters the viewer's sense of affinity and involvement with the avatar through direct communication between the viewer and the distribution user (avatar). However, in the gifting for each attachment part of the avatar as described in Non-Patent Document 1, one viewing user gives a gift to the head of the avatar, for example, and the gift based on the gifting is the head. When a video containing an avatar attached to the head is distributed, even if other viewing users gift the avatar's head during the predetermined time until the gift attached to the head is deleted from the video , the gift based on the gifting will not be worn on the avatar's head. Therefore, in the case of such gifting control, only limited gifting acts are reflected in the video, which limits the viewing user's gifting opportunities and deters the viewing user's willingness to gift. I have a problem.

On the other hand, as a method for solving the above-mentioned problems, one viewing user gifts a gift A to the head of an avatar, for example, and a video containing the avatar wearing the gift A based on the gifting is distributed. An alternative is also proposed to control gift A to overwrite gift B immediately when another viewing user gifts gift B to the avatar's head. However, in this case, for the viewing user who gifted the gift A, the gift that he gave himself would suddenly be deleted from the video due to the gifting by another viewing user. There is also a problem that it encourages disappointment about the ping act.

In addition, gifting means that a viewing user purchases a gift by paying a consideration to a service provider that provides a video distribution service, and then gives the gift to the distribution user (avatar). Therefore, it can be said that increasing the gifting opportunities for viewing users is a challenge for service providers.

Accordingly, some embodiments disclosed in the present application provide a video processing method, a server device and a computer program that increase gifting opportunities by viewing users.

A video processing method according to one aspect is a video processing method executed by one or more processors that execute computer-readable instructions, wherein a video including an animation of an avatar object of a broadcasting user is viewed by a viewing user. a receiving step of receiving, from the terminal device of the viewing user via a communication line, a request signal that is generated based on an operation and requests that the first gift be given to the wearing part of the avatar object; when it is determined that the combination of the plurality of first gifts given to the attachment site of the avatar object satisfies a predetermined condition based on the request signal of and a generating step of generating the animation including an animation of a second gift being worn having characteristics in common with the first gift.

A server device according to one aspect includes one or more processors, and the processor is generated based on an operation of a viewing user who watches a moving image including an animation of an avatar object of a distribution user, and a region where the avatar object is attached receive a request signal requesting that a first gift be given to the avatar object from the terminal device of the viewing user via a communication line; when it is determined that the combination of the plurality of first gifts granted by the above method satisfies a predetermined condition, a second gift having features common to the first gift is placed on the attachment site of the avatar object. It generates the animation including the wearing animation.

A server device according to one aspect includes one or more processors, and the processor is generated based on an operation of a viewing user who watches a moving image including an animation of an avatar object of a distribution user, and a region where the avatar object is attached receive a request signal requesting that a first gift be given to the avatar object from the terminal device of the viewing user via a communication line; when it is determined that the combination of the plurality of first gifts given by the above satisfies a predetermined condition, a second gift having features common to the first gift at the attachment site of the avatar object Such information is transmitted to the terminal device of the viewing user or the terminal device of the distribution user that generates the moving image including the animation in which the second gift is attached.

A computer program according to one aspect is generated based on an operation of a viewing user who watches a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to the wearing site of the avatar object receive a request signal requesting that a first gift be given to the avatar object from the terminal device of the viewing user via a communication line, and send a request signal to the wearing part of the avatar object based on the plurality of request signals; When it is determined that the combination of the given first gifts satisfies a predetermined condition, a second gift having characteristics common to the first gift is attached to the attachment site of the avatar object. The processor is operable to generate the animation including the rendered animation.

A computer program according to one aspect is generated based on an operation of a viewing user who watches a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to the wearing site of the avatar object receive a request signal requesting that a first gift be given to the avatar object from the terminal device of the viewing user via a communication line, and send a request signal to the wearing part of the avatar object based on the plurality of request signals; a second gift having characteristics common to the first gift at the mounting site of the avatar object when it is determined that the combination of the given first gifts satisfies a predetermined condition; The processor functions to transmit information to the viewing user's terminal device or server device that generates the moving image including the animation of the second gift being worn.

A computer program according to one aspect is generated based on an operation of a viewing user who watches a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to the wearing site of the avatar object a request signal requesting that the first gift be given to the avatar object via a communication line; Said moving image including an animation in which a second gift having characteristics common to said first gift is attached to said attachment site of said avatar object when it is determined that a combination of one gift satisfies a predetermined condition. to receive information about the second gift from the distribution user's terminal device or server device.

A computer program according to one aspect is generated based on an operation of a viewing user who watches a video including an animation of an avatar object of a distribution user by being executed by one or more processors, and is attached to the wearing site of the avatar object a request signal requesting that the first gift be given to the avatar object via a communication line; Said moving image including an animation in which a second gift having characteristics common to said first gift is attached to said attachment site of said avatar object when it is determined that a combination of one gift satisfies a predetermined condition. from the distribution user's terminal device or server device.

FIG. 1 is a block diagram showing an example of the configuration of a video distribution system according to one embodiment. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal device (server device) shown in FIG. 1. As shown in FIG. FIG. 3 is a block diagram schematically showing an example of functions of the terminal device shown in FIG. FIG. 4 is a block diagram schematically showing an example of functions of the server device shown in FIG. FIG. 5 is a diagram illustrating an example of a table managed by the database unit; FIG. 6A is a diagram showing an example of a table managed by a database unit, and schematically showing an image when a judgment unit judges. FIG. 6B is a diagram showing an example of a table managed by the database unit, and is a diagram schematically showing an image when the judgment unit judges. FIG. 6C is a diagram showing an example of a table managed by the database section, and schematically showing an image when the judging section judges. FIG. 6D is a diagram showing an example of a table managed by the database section, and schematically showing an image when the judging section judges. FIG. 7 is a diagram showing an example of a confirmation screen displayed on the display unit of the distribution user's terminal device. FIG. 8 is a flow diagram showing an example of operations performed in the moving picture delivery system shown in FIG. FIG. 9 is a diagram showing an example of a moving image including animation of a distribution user's avatar object. FIG. 10 is a diagram showing an example of a moving image including an animation of a state in which the first gift is attached to the attachment site of the avatar object of the distribution user. FIG. 11 is a diagram schematically showing an example of an image in which a second gift is worn in place of the first gift at the attachment site of the avatar object of the distribution user.

Various embodiments of the present invention will now be described with reference to the accompanying drawings. In addition, the same reference numerals are attached to common components in the drawings. Also, it should be noted that components depicted in one drawing may be omitted in another drawing for convenience of explanation. Furthermore, it should be noted that the attached drawings are not necessarily drawn to scale. Furthermore, the term application may also be referred to as software or program, which may be instructions to a computer that are combined to produce some result.

1. Configuration of Moving Image Distribution System Briefly speaking, the moving image distribution system 1 disclosed in the present application allows a distribution user who performs distribution to use the terminal device to transmit data related to the behavior of the distribution user and/or data transmitted by the distribution user. It makes it possible to distribute moving images including animations of avatar objects generated based on audio data related to utterances and singing that are received to terminal devices of viewing users who view the moving images via communication lines. .

FIG. 1 is a block diagram showing an example of the configuration of a video distribution system 1 according to one embodiment. As shown in FIG. 1, a video distribution system 1 includes a plurality of terminal devices 10 connected to a communication line (not shown) and one or more server devices 20 connected to the communication line. can be done. Each terminal device 10 is connected to one or more server devices 20 via a communication line.

Note that the communication line is not limited to mobile phone networks, wireless LANs, fixed phone networks, the Internet, intranets and/or Ethernet (registered trademark).

1-1. terminal device 10
As shown in FIG. 1, the plurality of terminal devices 10 includes one or more distribution user terminal devices 10 (here, terminal devices 10A) and one or more viewing user terminal devices 10 (here, terminal devices 10B to 10D). Each terminal device 10 has a common configuration, so that it can be used as a terminal device for distributing moving images (distribution user's terminal device 10) or a terminal device for viewing moving images (viewing user's terminal device 10). It can also be

When each terminal device 10 operates as a distribution user's terminal device 10, each terminal device 10 executes an installed application for video distribution to obtain data related to the distribution user's actions and/or utterances and/or messages uttered by the distribution user. Acquisition of voice data related to singing, generation of animation including animation of a virtual character (avatar object) changed according to the acquired data, and delivery of the animation via a communication line to server device 20 (distribution server device 20C) can be sent to The moving image is distributed by the server device 20 (distribution server device 20C) via a communication line to the terminal device 10 (viewing user's terminal device 10) for receiving the moving image that executes the installed video viewing application. be done.

Furthermore, when each terminal device 10 operates as the distribution user's terminal device 10, the server device 20, via the communication line, for the distribution user's (avatar object) attachment site based on the operation of the viewing user. When a request signal requesting the giving of a gift (first gift) (gifting) is received from the terminal device 10 of the viewing user who watches the video, each terminal device 10 receives the server device 20 (information processing server device). 20B) can receive the request signal from the server device 20 and generate a moving image including an animation of a state in which the first gift is attached to the attachment site of the avatar object.

By the way, the wearing part of the avatar object means a part of the avatar object such as the head, face, neck, right hand, left hand, waist, right leg, left leg, etc. (including the space surrounding the avatar object, such as behind).

In the gifting described above, a plurality of request signals requesting that the first gift be given to the attachment site of the avatar object (when a plurality of request signals are transmitted from one viewing user terminal device 10, and when request signals are transmitted from a plurality of viewing user terminal devices 10), the terminal device 10 of the distribution user receives the avatar object receiving information requesting the generation of a moving image including an animation of a state in which a second gift having features common to the first gift is worn on the wearing site of the gift, and generating the moving image .

A method of determining whether or not to generate a moving image including an animation of a state in which the second gift is attached to the attachment site of the avatar object will be described later. It is executed by the information processing server device 20B).

On the other hand, when each terminal device 10 operates as a terminal device for viewing videos (viewing user's terminal device), by executing the installed video viewing application, the distribution user's terminal device 10 The distributed video can be received via the server device 20 (distribution server device 20C).

Furthermore, when each terminal device 10 operates as a viewing user's terminal device, each terminal device 10 executes a moving image viewing application to give gifts to distribution users (avatar objects) based on the viewing user's operation. A request signal requesting to give the (first gift) can be transmitted to the server device 20 (gift API server device 20A).

Furthermore, when each terminal device 10 operates as a terminal device of a viewing user, each terminal device 10 executes a moving image viewing application to transmit information related to comments from the viewing user to the distribution user (avatar object) to the server device 20 (comment API server device 20D).

Note that the moving image distribution application and the moving image viewing application described above can be installed and executed in each terminal device 10 as one integrated application or as separate applications.

Each terminal device 10 is any terminal device capable of executing such operations, and includes, but is not limited to, smartphones, tablets, mobile phones (feature phones) and/or personal computers. is possible.

1-2. Server device 20
As shown in FIG. 1, the server device 20 can also be referred to as a video delivery system in which a plurality of server devices, which will be described later, are combined.

The server device 20 can distribute the video transmitted from the distribution user's terminal device 10 to each viewing user's terminal device 10 .

Furthermore, the server device 20 can receive a request signal requesting (gifting) to give a gift (first gift) to the attachment site of the avatar object from the terminal device 10 of each viewing user. . In addition, information related to the request signal is transmitted to the terminal device 10 of the distribution user, and the gift is attached to the attachment site of the avatar object generated by the terminal device 10 of the distribution user who received the information. You can also receive videos with animations.

In the gifting described above, a plurality of request signals requesting that the first gift be given to the attachment site of the avatar object (when a plurality of request signals are transmitted from one viewing user terminal device 10, and when request signals are sent from a plurality of viewing user terminal devices 10), the server device 20 puts the second gift on the attachment site of the avatar object. If it is determined whether or not to generate a moving image including the animation, and if it is determined to generate the moving image, information requesting to generate the moving image can be sent to the terminal device 10 of the distribution user. can. In addition, the server device 20 can receive, from the distribution user's terminal device 10, a moving image including an animation in which the second gift is attached to the attachment site of the avatar object.

Furthermore, the server device 20 can receive information related to comments from the viewing user to the distribution user (avatar object) from the terminal device 10 of the viewing user, and send the comment to the viewing user viewing the same video. can be delivered

In order to perform such operations, in one embodiment, the server device 20 includes a gift API server device 20A, a gift API server device 20A, and a gift API server device 20A, which are connected to each other via a communication line (including a wireless line and/or a wired line, not shown). An information processing server device 20B, a distribution server device 20C, and a comment API server device 20D can be included.

The gift API server device 20A transmits a request signal requesting (gifting) to give a gift (first gift) to the attachment site of the avatar object based on the operation of the viewing user, to the terminal device of each viewing user. 10 can be received. At this time, the gift API server device 20A receives from the request signal identification information of the viewing user who performed the gifting act (serial number of the terminal device 10 of each viewing user, ID information given to each viewing user, etc.), Information about the given gift (information about what kind of gift it corresponds to which part of the avatar object is attached), and identification information of the distribution user who is the avatar object to be gifted (distribution user's terminal device 10 serial number, ID information assigned to the distribution user, etc.), and automatically or upon receiving an inquiry from the information processing server device 20B, transmitting the read information to the information processing server device 20B. can be done.

The information processing server device 20B receives the information read by the gift API server device 20A automatically or by making an inquiry by itself, and receives the information from the gift API server device 20A. Further, the information processing server device 20B can have a table (database) for each distribution user, and can store the information related to the gift read by the gift API server device 20A in each table.

Furthermore, the information processing server device 20B refers to the information related to gifts stored in the table, and performs a plurality of gifting actions (a plurality of gifting actions by one viewing user and a plurality of gifting actions by a plurality of viewing users). (including both gifting acts), generate a video including an animation of a state in which a second gift having features common to the first gift is attached to the attachment site of the avatar object It can be determined whether or not The determination is made based on whether or not a combination of a plurality of gifting acts (a plurality of first gifts) satisfies a preset condition.

Furthermore, the information processing server device 20B refers to the information related to the gift stored in the table, and requests to generate a moving image including an animation of the state in which the first gift is attached to the attachment site of the avatar object. It is possible to transmit the information to be transmitted to the terminal device 10 of the distribution user. Similarly, if it is determined by the above determination that a moving image including an animation of the second gift being worn is to be generated, an animation of the second gift being worn at the attachment site of the avatar object is included. Information requesting to generate a moving image can be transmitted to the terminal device 10 of the distribution user.

Furthermore, the information processing server device 20B refers to the identification information of the viewing users and the information related to the gift stored in the table, and determines which viewing user has what type of information for the attachment site (distribution user) of the avatar object. All or part of the information regarding whether the gift has been given can be transmitted to the comment API server device 20D.

Furthermore, when the information processing server device 20B determines that a combination of a plurality of gifting acts (a plurality of first gifts) does not satisfy a predetermined condition, what kind of combination is the predetermined condition? It is also possible to calculate a necessary condition related to whether the condition is satisfied and then transmit the necessary condition to the comment API server device 20D. The details of the necessary conditions here will be described later.

20 C of distribution server apparatuses can distribute the moving image transmitted from the terminal device 10 of a distribution user to the terminal device 10 of each viewing user.

In addition, the distribution server device 20C receives from the distribution user's terminal device 10 a moving image including an animation in which the first gift is attached to the attachment site of the avatar object, and transmits the moving image to each viewing user's terminal device 10. can be delivered to

Furthermore, the distribution server device 20C receives from the distribution user's terminal device 10 a moving image including an animation in which the second gift is attached to the attachment site of the avatar object, and transmits the moving image to each viewing user's terminal device. 10 can be delivered.

The comment API server device 20D can receive the comments of the viewing users from the terminal devices 10 of the viewing users, and distribute the received comments to each viewing user viewing the same video. .

Also, the comment API server device 20D supports all or part of the information received from the information processing server device 20B regarding which viewing user gave what kind of gift to the attachment site (distribution user) of the avatar object. Such comments can be delivered to each viewing user viewing the same video.

Furthermore, the comment API server device 20D can distribute comments corresponding to the above-described necessary conditions received from the information processing server device 20B to each viewing user viewing the same moving image.

In the example shown in FIG. 1, the server device 20 includes a gift API server device 20A, an information processing server device 20B, a distribution server device 20C, and a comment API server device 20D for the purpose of distributing the load. A configuration with four server devices is shown. However, at least one of these four server devices may be integrated with any of the remaining server devices.

2. Hardware Configuration of Each Device Next, an example of a hardware configuration of each of the terminal device 10 and the server device 20 will be described.

2-1. Hardware Configuration of Terminal Device 10 A hardware configuration example of each terminal device 10 will be described with reference to FIG. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal device 10 (server device 20) shown in FIG. It is described in relation to the server device 20.)

As shown in FIG. 2, each terminal device 10 mainly includes a central processing unit 11, a main storage device 12, an input/output interface device 13, an input device 14, an auxiliary storage device 15, and an output device 16. and can include These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 11, which is called a "CPU", performs operations on instructions and data stored in the main memory 12, and stores the results of the operations in the main memory 12. be. Furthermore, the central processing unit 11 can control an input device 14, an auxiliary storage device 15, an output device 16, and the like via the input/output interface device 13. FIG. Terminal 10 may include one or more such central processing units 11 .

The main storage device 12 is referred to as a “memory” and receives commands and commands from the input device 14, the auxiliary storage device 15 and the communication line 30 (server device 20, etc.) via the input/output interface device 13. It stores data and calculation results of the central processing unit 11 . Main memory 12 may include, but is not limited to, RAM (random access memory), ROM (read only memory), and/or flash memory.

The auxiliary storage device 15 is a storage device having a larger capacity than the main storage device 12 . Instructions and data (computer programs) constituting the above-described specific applications (video distribution application, video viewing application, etc.), web browsers, etc. are stored, and controlled by the central processing unit 11. Instructions and data (computer programs) can be sent to main memory 12 via input/output interface device 13 . The auxiliary storage device 15 can include, but is not limited to, a magnetic disk device and/or an optical disk device.

The input device 14 is a device that takes in data from the outside, and includes, but is not limited to, a touch panel, buttons, keyboard, mouse and/or sensor. Sensors may include, but are not limited to, sensors including one or more cameras, etc. and/or one or more microphones, etc., as described below.

Output devices 16 may include, without limitation, display devices, touch panels, and/or printer devices.

In such a hardware configuration, the central processing unit 11 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 15 into the main storage device 12, and loads them. By computing instructions and data, it controls the output device 16 via the input/output interface device 13, or also controls other devices via the input/output interface device 13 and the communication line 30 (communication network 30). (For example, the server device 20 and other terminal devices 10, etc.) can transmit and receive various information.

As a result, the terminal device 10 executes the installed specific application to perform actions required to generate a moving image, actions required to transmit (distribute) and/or receive a moving image, a gifting action, and so on. and operations necessary to send a comment (including various other operations that will be described in detail later).

Note that the terminal device 10 may include one or more microprocessors and/or graphics processing units (GPUs) in place of or together with the central processing unit 11 .

2-2. Hardware Configuration of Server Apparatus 20 An example of the hardware configuration of each server apparatus 20 will be described with reference to FIG. 2 as well. The hardware configuration of each server device 20 (gift API server device 20A, information processing server device 20B, distribution server device 20C, and comment API server device 20D) is, for example, the same as the hardware configuration of each terminal device 10 described above. can be used. Therefore, the reference numerals for the components of each server device 20 are shown in parentheses in FIG.

As shown in FIG. 2, each server device 20 mainly includes a central processing unit 21, a main storage device 22, an input/output interface device 23, an input device 24, an auxiliary storage device 25, and an output device 26. and can include These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 21, the main storage device 22, the input/output interface device 23, the input device 24, the auxiliary storage device 25, and the output device 26 are included in each terminal device 10 described above, respectively. The device 12, the input/output interface device 13, the input device 14, the auxiliary storage device 15 and the output device 16 can be substantially the same.

In such a hardware configuration, the central processing unit 21 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 25 into the main storage device 22, and loads them. By operating on commands and data, it controls an output device 26 via an input/output interface device 23, or also communicates with other devices via an input/output interface device 23 and a communication line 30 (communication network 30). (For example, each terminal device 10, etc.) can transmit and receive various information.

As a result, the server device 20 performs the operations necessary for distributing the video transmitted from each distribution user's terminal device 10 to each viewing user's terminal device 10, and the gift transmitted from each viewing user's terminal device 10. operations necessary to receive a posting action, operations necessary to generate request information necessary to cause the terminal device 10 to generate a moving image, operations necessary to transmit (distribute) and/or receive a moving image etc. (including various operations detailed below) can be performed.

Note that the server device 20 may include one or more microprocessors and/or graphics processing units (GPUs) in place of or together with the central processing unit 21 .

3. Functions of Each Device Next, an example of detailed functions of each of the terminal device 10 and the server device 20 will be described.

3-1. Functions of Terminal Device 10 An example of functions of the terminal device 10 will be described with reference to FIG. FIG. 3 is a block diagram schematically showing an example of functions of the terminal device 10 shown in FIG.

As shown in FIG. 3 , the terminal device 10 can mainly include a video generator 100 , a display unit 110 , a storage unit 120 , a user interface unit 130 , a gift storage unit 140 and a communication unit 150 .

(1) Movie generator 100
The moving image generation unit 100 can generate a moving image including an animation of the avatar object of the broadcast user based on data related to the broadcast user's actions and/or voice data related to utterances and songs uttered by the broadcast user. In order to achieve this, the moving image generation unit 100 can include, for example, an acquisition unit (not shown) and a processing unit (not shown).

The acquisition unit includes one or more first sensors (not shown) that acquire data relating to the face, limbs, etc. (whole body) of the distribution user, and voice data relating to speech and/or singing uttered by the distribution user. and one or more second sensors (not shown) that acquire the .

The first sensor, in a preferred embodiment, can include an RGB camera that images visible light and a near-infrared camera that images near-infrared. Such a camera can be, for example, the one included in the iPhone X (registered trademark) True Depth camera. A second sensor may include a microphone that records sound.

First, regarding the first sensor, the acquisition unit captures an image of the face, limbs, etc. of the distribution user using the first sensor arranged close to the face, limbs, etc. of the distribution user. Thereby, the acquisition unit can generate data (for example, an MPEG file) in which an image acquired by the RGB camera is associated with a time code (a code indicating acquisition time) and recorded over a unit time. Furthermore, the acquisition unit associates a predetermined number (eg, 51) of numerical values (eg, floating-point numerical values) indicating depth acquired by the near-infrared camera with the time code, and records data (eg, TSV file [a file in a format in which a plurality of data are recorded by separating the data with tabs]) can be generated.

Regarding the near-infrared camera, specifically, the dot projector emits an infrared laser that forms a dot (point) pattern to the face and limbs of the distribution user, and the near-infrared camera projects and reflects infrared rays on the face and limbs of the distribution user. A dot is captured and an image of the infrared dot thus captured is generated. The acquisition unit compares the image of the dot pattern emitted by the pre-registered dot projector and the image captured by the near-infrared camera, and obtains each point (each feature point) (for example, 51 points) in both images. The depth of each point (each feature point) (distance between each point/feature point and the near-infrared camera) can be calculated using the positional deviation of each point/feature point. The acquisition unit can generate data recorded over a unit time by associating the numerical value indicating the depth calculated in this way with the time code as described above.

Next, with respect to the second sensor, the acquisition unit acquires the speech and/or singing voice uttered by the broadcast user using the second sensor arranged close to the broadcast user. Thereby, the acquisition unit can generate data (for example, an MPEG file) recorded over a unit time in association with the time code. In one embodiment, the acquisition unit uses the first sensor to acquire data related to the distribution user's face and limbs, and uses the second sensor to acquire voice data related to speech and/or singing uttered by the distribution user. can be obtained. In this case, the acquisition unit associates the image acquired by the RGB camera and the audio data related to the speech and/or singing uttered by the distribution user using the second sensor with the same time code. Data (eg, MPEG files) recorded over a unit time can be generated.

The acquisition unit obtains the data (MPEG file, TSV file, etc.) related to the distribution user's face, hands and feet, etc., and/or the voice data (MPEG file, etc.) related to the speech and/or singing uttered by the distribution user. ) can be output to the processing unit.

Although the case where the first sensor includes an RGB camera and an infrared camera has been described here, the first sensor may be, for example, (A) infrared rays emitted by an infrared laser and reflected on the distribution user's face, limbs, etc. (B) multiple RGB cameras imaging visible light; and (C) a single camera imaging visible light. In the case of (A) above, the acquisition unit can calculate the depth for each feature point on the distribution user's face, hands and feet, etc., using the same method as described above. In the case of (B) above, the acquisition unit can calculate the depth (depth) for each feature point on the distribution user's face, limbs, etc., using a plurality of images captured by a plurality of RGB cameras. . In the case of (C) above, the acquisition unit calculates the depth (depth) of each feature point on the distribution user's face, limbs, etc. from the image captured by a single camera using deep learning, etc. can do. Further, in the case of (C) above, the acquisition unit performs analysis processing (image processing, etc.) on an image captured by a single camera to determine the depth (depth) of each feature point on the distribution user's face, limbs, etc. may be calculated.

The processing unit can generate a moving image including animation of a virtual character (avatar object) based on the data regarding the distribution user's face, limbs, etc. from the acquisition unit. For the animation of the avatar object itself, the processing unit uses various information (eg, geometry information, bone information, texture information, shader information, blend shape information, etc.) stored in the character data storage unit (not shown) to convert the animation into the shown image. A moving image of the avatar object can also be generated by having a rendering unit that does not perform rendering.

It should be noted that, based on the data on the motion of the broadcast user and/or the voice data on the utterances and songs uttered by the broadcast user, any other well-known It is also possible to use technology.

By the way, the moving image generation unit 100 transmits request information to the server device 20 to the effect that the communication unit 150, which will be described later, generates a moving image including an animation in which the first gift or the second gift is attached to the attachment site of the avatar object. When receiving from (the information processing server device 20B), the request information can be received from the communication unit 150 and the moving image can be generated. In this case, the moving image generation unit 100 generates data related to the moving image including the animation of the avatar object generated in detail as described above, and data related to the first gift or the second gift (which part of the avatar object is attached). Data related to what kind of shape, size, and color the gift has), and a video containing an animation of the state in which the first gift or the second gift is attached to the attachment part of the avatar object can be generated. Specifically, information (wearing position information) about which part of the avatar object the first gift and the second gift are to be worn is set in advance, and the gifting from the viewing user is performed. Alternatively, when a predetermined condition to be described later is satisfied, the first gift or the second gift can be displayed on the moving image at the attachment site based on the attachment position information. For example, when the first gift is a "red school bag", the wearing position information is "back". The "red school bag" is displayed on the moving image so as to cover (or touch at least part of the "back"). Similarly, if the second gift is a "large rainbow-colored fork", the wearing position information is "left hand" (or "right hand"). The "large rainbow-colored fork" is displayed on the moving image so as to touch the "left hand" of the avatar object (so as to cover part of the "left hand"). It should be noted that the position (positional information) of each wearing part of the avatar object in the moving image is detected by a sensor such as a motion sensor, which will be described later, for example. Therefore, when the "red school bag" is displayed on the "back" of the avatar object, the position information of the "back" at that time is referred to, and the "red school bag" corresponding to the "back" is displayed in the video. will be displayed above. In addition, the displayed first gift and second gift are displayed on the moving image so as to accompany the movement of the wearing part of the worn avatar object while they are being displayed (duration described later). may be displayed in Such a method for generating a moving image including an animation in which the first gift or the second gift is attached to the attachment site of the avatar object includes the method described in Japanese Patent No. 6431233 and other well-known methods. technology can be used.

(2) Display unit 110
The display unit 110 displays various information required for distribution and/or viewing of moving images (including moving images including animations in which the first gift or the second gift is attached to the attachment site of the avatar object). can be displayed. For example, the display unit 110 can display distributed videos, received videos, and/or generated videos, and the like. The display unit 110 can also display various comments delivered from the server device 20 to each terminal device 10 together with the received video. Furthermore, the gift information stored in the gift storage unit 140 can be appropriately displayed according to the operation of the viewing user.

(3) Storage unit 120
The storage unit 120 stores various information required for distribution and/or viewing of moving images (including moving images including animations in which the first gift or the second gift is attached to the attachment site of the avatar object). can be memorized.

(4) User interface unit 130
The user interface unit 130 provides various functions required for distribution and/or viewing of moving images (including moving images including animations in which the first gift or the second gift is attached to the attachment site of the avatar object). The information can be entered through manipulation of the broadcast user or the viewing user. For example, the user interface unit 130 can be operated by the viewing user regarding gifting to the avatar object (such as selecting a predetermined gift from a plurality of first gifts prepared in advance and selecting a command to be given to the avatar object). (including operation) can be input by the viewing user, and the operation data can be output to the communication unit 150 . Here, the aforementioned operation data can include, for example, information relating to what kind of gift (type of gift) the viewing user gave to the distribution user.

As another example, when one or more gifts are given by the viewing user, the user interface unit 130 sends a gift (a first gift or a second gift) corresponding to the gifting to the avatar object. When receiving an inquiry from the server device 20 about wearing on the attachment site, the distribution user can input the operation data related to the answer to the inquiry, and the operation data can be output to the communication unit 150.

(5) Gift storage unit 140
When the moving image distribution application and the moving image viewing application are installed in the terminal device 10, the gift storage unit 140 can store gift information preset in these applications. Note that the gift information can include identification information such as the name, shape, and color of each gift, and the amount of each gift charged to the viewing user when the viewing user makes the gift.

(6) Communication unit 150
The communication unit 150 receives various information required for distribution and/or viewing of moving images (including moving images including animations in which the first gift or the second gift is attached to the attachment site of the avatar object). , and the server device 20 . For example, when the terminal device 10 operates as the distribution user's terminal device 10, the communication unit 150 transmits a moving image including an animation in which the first gift or the second gift is attached to the attachment site of the avatar object. It is possible to receive request information for generation from the server device 20 (information processing server device 20B) and transmit the generated moving image to the server device 20 (distribution server device 20C). Similarly, when the terminal device 10 operates as the distribution user's terminal device 10 and one or more gifts are given by the viewing user, the gift corresponding to the gift (first gift or (second gift) is received from the server device 20, the information of the inquiry is output to the display unit 110, and the operation data related to the answer to the inquiry is sent to the user interface. Information related to the answer received from the face unit 130 can be transmitted to the server device 20 .

On the other hand, when the terminal device 10 operates as the terminal device 10 of the viewing user, the communication unit 150 can receive the video generated by the terminal device 10 of the distribution user from the server device 20 . Similarly, when the terminal device 10 operates as the terminal device 10 of the viewing user, information related to gifting from the viewing user to the distribution user (avatar object) and comments from the viewing user to the distribution user (avatar object) Information can be sent to the server device 20 (comment API server device 20D).

(7) Studio Unit A studio unit (not shown) including the moving image generation unit 100, the display unit 110, the storage unit 120, the user interface unit 130, the gift storage unit 140, and the communication unit 150 is used as the terminal device 10. can also

The studio unit can be implemented by an information processing device such as a personal computer, and, like the terminal device 10 and the server device 20 described above, mainly includes a central processing unit, a main storage device, and an input/output interface. A device, an input device, a secondary storage device, and an output device may be included. These devices are connected to each other by a data bus and/or a control bus. In addition, the studio unit functions as an information processing device that executes a specific installed application, thereby providing data and/or information regarding the actions of the distribution users in the studio room (not shown) in which the studio unit is installed. A moving image including animation of the avatar object can be generated based on the data about the utterances and songs uttered by the .

Many of the constituent elements of the moving image generation section 100 included in the studio unit are arranged in the studio room. Also, in the studio room, the distribution users perform various performances, and the studio unit detects the actions, facial expressions, and utterances (including singing) of the distribution users.

The distribution user is an object whose actions, facial expressions, speech (including singing), etc. are captured by various sensor groups included in the studio unit (moving image generation unit 100). In this case, the distribution user does not necessarily have to be a human being, and may be, for example, a robot capable of autonomous movement. Also, the number of delivery users in the studio room may be one, or two or more.

The moving image generation unit 100 in the studio unit includes various motion sensors (not shown) worn by the distribution user, a controller (not shown) held by the hand of the distribution user, and a mounting tool (not shown). and a camera (not shown) mounted on the head of the broadcast user via. In addition, in the studio unit, a microphone is provided on the above-described attachment or at any place (for example, wall, floor, ceiling, etc.) in the studio room in order to acquire voice data of the distribution user. Further, the studio unit may have multiple base stations (not shown), tracking sensors (not shown), and displays (not shown) in addition to the above configurations.

The aforementioned motion sensors can cooperate with the aforementioned base stations to detect the position and orientation of the broadcast user. In one embodiment, the multiple base stations are multi-axis laser emitters, and after emitting flashing lights for synchronization, one base station scans the laser light around, for example, the vertical axis, and the other base station is configured to scan the laser light around, for example, a horizontal axis. The motion sensor has a plurality of optical sensors that detect the incidence of flashing light and laser light from the base station. can detect the incident angle of the laser beam detected by the . The motion sensor may be, for example, Vive Tracker provided by HTC CORPORATION or ZERO C SEVEN Inc. Xsens MVN Analyze provided by .

The moving image generator 100 in the studio unit acquires detection information indicating the position and orientation of each motion sensor calculated in the motion sensor. Motion sensors are attached to the distribution user's wrists, insteps, waist, top of the head, etc., and by detecting the position and orientation of the motion sensor, the movement of the distribution user's body can be detected.

In one embodiment, a large number of infrared LEDs are mounted on a plurality of motion sensors, and the light from the infrared LEDs is detected by an infrared camera provided on the floor or wall of a studio room, so that the motion sensor Position and orientation may be detected. Also, the position and orientation of the motion sensor may be detected by using a visible light LED instead of the infrared LED and detecting light from the visible light LED with a visible light camera.

In one embodiment, multiple reflective markers can be used in place of the motion sensor. The reflective marker is attached to the distribution user with an adhesive tape or the like. A configuration may be adopted in which the position and orientation of the reflective marker are detected by photographing the distribution user to which the reflective marker is attached in this way, generating photographed data, and performing image processing on this photographed data.

The controller outputs a control signal according to the operation of the distribution user, and the video generation unit 100 acquires this.

The tracking sensor generates tracking information for determining virtual camera setting information for constructing a virtual space included in the moving image. The tracking information is calculated as a position in a three-dimensional orthogonal coordinate system and an angle around each axis, and the moving image generation unit 100 acquires the tracking information.

A camera attached to the head of the distribution user is arranged so as to capture the face of the distribution user. The camera continuously captures images of the distribution user's face to obtain imaged data of the distribution user's face, and the moving image generation unit 100 obtains the imaged data from the camera. Note that the camera may be a 3D camera capable of detecting the depth of the distribution user's face.

The display functions as the display unit 110 and is arranged at a position that can be viewed by the distribution user, and the distribution user acquires various information and visually recognizes the moving image generated by the moving image generation unit 100 through the display. It is possible.

The studio unit similarly includes the storage unit 120, the user interface unit 130, the gift storage unit 140, and the communication unit 150 described above, in addition to the components described above. Also, the components of the studio unit described above are merely examples, and may include various other applicable components.

3-2. Functions of Server Apparatus 20 An example of functions of the server apparatus 20 will be described with reference to FIGS. 4 to 7. FIG. FIG. 4 is a block diagram schematically showing an example of functions of the server device 20 shown in FIG. FIG. 5 is a diagram showing an example of a table managed by the database unit 230. As shown in FIG. 6A to 6D are diagrams showing examples of tables managed by the database unit 230, and are diagrams schematically showing images when the judgment unit 240 judges. FIG. 7 is a diagram showing an example of a confirmation screen displayed on the display unit 110 of the terminal device 10 of the distribution user.

As shown in FIG. 4 , the server device 20 can mainly include a storage section 200 , a communication section 210 , a gift processing section 220 , a database section 230 , a determination section 240 and a comment processing section 250 .

(1) Storage unit 200
The storage unit 200 stores various information required for distribution and/or viewing of moving images (including moving images including animations in which the first gift or the second gift is attached to the attachment site of the avatar object). can be memorized.

(2) Communication unit 210
The communication unit 210 receives various information required for distribution and/or viewing of moving images (including moving images including animations in which the first gift or the second gift is attached to the attachment site of the avatar object). , the terminal device 10 of the broadcasting user and/or the terminal device 10 of the viewing user. For example, the communication unit 210 receives a moving image (including a moving image including an animation in which the first gift or the second gift is attached to the attachment site of the avatar object) from the distribution user's terminal device 10, It can be distributed to the terminal device 10 of the viewing user.

In addition, the communication unit 210 receives, from the viewing user's terminal device 10, information related to gifting from the viewing user to the distribution user (avatar object) and information related to comments from the viewing user to the distribution user (avatar object), Information related to gifting is output to the gift processing unit 220 , and information related to comments is output to the comment processing unit 250 .

Furthermore, the communication unit 210 transmits to the distribution user's terminal device 10 request information for generating a moving image including an animation in which the first gift or the second gift is attached to the attachment site of the avatar object. be able to.

Furthermore, when a plurality of gifts are given by the viewing user and the determination unit 240 (to be described later) determines that the combination of the first gifts satisfies the predetermined condition, the second gift is the avatar object. A request signal relating to an inquiry (confirmation) for obtaining confirmation from the distribution user about wearing it on the attachment site of the distribution user is transmitted to the terminal device 10 of the distribution user, and information related to the answer to the inquiry is sent from the terminal device 10 of the distribution user You can also receive

(3) Gift processing unit 220
When the communication unit 210 outputs the gifting-related information (gifting-related request signal), the gift processing unit 220 receives the identification information of the viewing user who performed the gifting act (the serial number of the terminal device 10 of each viewing user). number, ID information given to each viewing user, etc.), gift information given (information about what kind of gift it corresponds to which part of the avatar object is attached, and the name and shape of each gift・Identification information such as color) and identification information of the distribution user who is the avatar object to be gifted (such as the serial number of the terminal device 10 of the distribution user and the ID information given to the distribution user) are read and read information are stored in the database unit 230 automatically or in response to an inquiry.

(4) Database unit 230
The database unit 230 can receive various information read by the gift processing unit 220 from the gift processing unit 220 automatically or by inquiring the gift processing unit 220 at predetermined time intervals. Further, as shown in FIG. 5, the database unit 230 has a table (reference table) for each distribution user, and stores various information received from the gift processing unit 220 in each table of the corresponding distribution user do.

Next, an example of information stored in the table will be described with reference to FIG.

The database unit 230 has a table 500 for each distribution user, and each table 500 is provided with distribution user identification information 501 (for example, distribution user ID information). Furthermore, the database unit 230 sequentially stores the gift information gifted in the corresponding table according to the delivery user identification information 501 received from the gift processing unit 220 (in FIG. 5, the order of gifting is taken as an example). However, for example, the order in which the first gift is attached to the avatar object may also be used).

To explain in more detail, first, from a state (initial state) in which no gift is attached to the attachment site of the avatar object, "red school bag", "diamond crown", and "silver fork" as shown in FIG. , “Golden Harisen”, “Golden Ring”, and “White Sneakers” in this order, when one or more viewing users give the first gift, , each first gift is attached in that order (a moving image including an animation in which the first gift is attached to the attachment site of the avatar object is generated). Therefore, database unit 230 sorts "red school bag", "diamond crown", "silver fork", "golden Harisen", "golden ring", and "white sneakers" in this order in table 500. The gifts are stored in the box 502 of the "list of attached gifts" in the order in which they were gifted or in the order in which they were attached. Although not shown in FIG. 5, information related to the attachment site of the avatar object corresponding to each first gift (the attachment site of the avatar object corresponding to the "red school bag" is "back"), The identification information of the viewing user who gifted one gift (for example, the viewing user's ID information) may be stored (displayed) in box 502 so as to correspond to each first gift.

Next, from the state in which the aforementioned six first gifts are respectively attached to the attachment sites of the avatar object, the "diamond crown", "silver fork", "silver ring", and "copper knife" are added. , “black rucksack”, “white school bag”, “golden fork”, “golden glasses”, and “silver spoon” from one or more viewing users in the order of the first gift. is executed. In this case, the avatar object corresponding to these gifts has already been fitted with the above-mentioned six first gifts. In other words, the "back" is a "red school bag", the "head" is a "diamond crown", the "left hand" is a "silver fork", the "right hand" is a "golden Harisen", and the "fingers" are "Golden ring" and "white sneakers" are attached to "both feet". On the other hand, the corresponding wearing parts such as "black rucksack" for "back" and "silver ring" for "fingers" are duplicated. In such a case, the database unit 230 stores, at least temporarily, the first gifts that have been gifted in the "unworn gift list" box 503 in the order in which they were given. In this case, as in box 502, information related to the attachment site of the corresponding avatar object and identification information of the viewing user who gifted each first gift are stored in box 503 so as to correspond to each first gift. (display).

Based on the information stored as described above, the database unit 230 associates the type of the first gift given to the wearing part of the avatar object with the number of given first gifts for each type. I can say that I remember. In other words, the database unit 230 uses the table 500 to manage (store) how many types of first gifts have been given for each wearing site, and the managed (stored) information is determined. It is also output to the determination unit 240 in response to an inquiry from the unit 240 .

Note that the first gift attached to the avatar object is automatically erased from the video after a predetermined period of time (for example, 1 or 2 minutes) has elapsed since the time the gift was attached to the avatar object. , is set in advance in the moving image distribution application and the moving image viewing application. Therefore, if a "black rucksack" is gifted after a predetermined period of time has elapsed since the "red school bag" was attached to the avatar object, the "black rucksack" will be attached to the avatar object. (In this case, database 230 would store "black rucksack" in box 502).

(5) Determination unit 240
If there are multiple gifting acts (including both multiple gifting acts by one viewing user and multiple gifting acts by multiple viewing users), the determination unit 240 determines the attachment site of the avatar object. It is determined whether or not to generate a moving image including an animation of a state in which a second gift having characteristics common to the first gift is worn. This determination is executed by referring to the table 500 managed by the database unit 230 (based on information output from the database unit 230), and the combination of the plurality of first gifts is determined by the video distribution application and the video viewing application. It is determined by whether or not a predetermined condition preset in the application is satisfied.

An example of determination will be described with reference to FIGS. 6A to 6D.

As described above with reference to FIG. 5, focusing on the "head" of the attachment parts of the avatar object, the "diamond crown" is already attached. In this state, if a "diamond crown" is further gifted, the first gift combination will be two identical "diamond crowns" (see FIG. 6A). Here, if at least one of the above-mentioned predetermined conditions is that two of the same first gifts are available, then matching of two "diamond crowns" satisfies the above-described predetermined condition. Such a predetermined condition can be arbitrarily set in advance in the moving image distribution application and the moving image viewing application. When the predetermined condition is satisfied in this way, the determination unit 240 includes an animation in which the second gift having characteristics common to the first gift "diamond crown" is attached to the "head" of the avatar object. Determine to generate a video. In this case, the second gift is, for example, a "large diamond crown" or "100-carat diamond tiara" that changes the size, color, and/or at least part of the shape of the first gift. can be employed as appropriate.

Next, as described above with reference to FIG. 5, focusing on the "fingers" among the attachment parts of the avatar object, the "golden ring" is already attached. In this state, if a "silver ring" is further gifted, the first gift combination is "gold ring" and "silver ring" (see FIG. 6B). Here, if at least one of the predetermined conditions is that two first gifts that differ only in color are available, the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this manner, the determining unit 240 selects a first gift, such as a "diamond ring" having characteristics common to the first gift "golden ring", as in the case described with reference to FIG. 6A. It is determined to generate a moving image including an animation in which the gift of 2 is attached.

Next, as described above with reference to FIG. 5, when focusing on the "back" of the wearing parts of the avatar object, the "red school bag" is already worn. In this state, if a "black rucksack" and a "white school bag" are further gifted, the first combination of gifts is a combination of "red school bag", "black rucksack" and "white school bag". (see FIG. 6C). Here, if at least one of the above-mentioned predetermined conditions is to have three first gifts for the "back", the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 determines that the second gift having the same characteristics as the first gift "red school bag" is attached, as in the case described with reference to FIG. 6A. It is determined that a moving image including the animation of is generated. As the second gift in this case, for example, "big wings" or the like is set. In this way, the second gift may have features in common with the first gift only because the first gift and the second gift have a common attachment site. In addition, the fact that the second gift is the same color as the first gift, that it is the same size, that it is the same type of product (same type), etc. It can be said that they have common features.

Next, as described above with reference to FIG. 5, focusing on the "left hand" of the avatar object's wearing parts, the "silver fork" is already worn. In this state, if a "silver fork", a "copper knife", a "golden fork" and a "silver spoon" are also gifted, the first gift combination is two "silver forks". ”, “copper knife”, “golden fork” and “silver spoon” (see FIG. 6D). Here, if at least one of the above-mentioned predetermined conditions is that the colors of gold, silver, and copper are aligned and the knife, fork, and spoon are aligned in the "left hand", the combination satisfies the predetermined conditions. When the predetermined condition is satisfied in this manner, the determination unit 240 determines that the second gift having characteristics common to the first gift "silver fork" is attached as described with reference to FIG. 6A. It is determined to generate a movie including state animation. As the second gift in this case, for example, "a large rainbow-colored fork" or the like is set.

As in the above examples, the above-described predetermined conditions can be set in any way. If the predetermined condition is simple (for example, the examples described with reference to FIGS. 6A and 6B), many types of second gifts can appear, and the viewing user's motivation for gifting can be reduced. can stimulate On the other hand, even if the predetermined condition is difficult (for example, the example described with reference to FIG. 6D), the viewing user cannot understand what kind of first gift should be combined to make the second gift appear. It arouses interest and curiosity. Therefore, gifting opportunities by viewing users are increased.

By the way, when the combination of a plurality of first gifts does not satisfy the predetermined condition, the determination unit 240 determines the necessary condition necessary for the combination to satisfy the predetermined condition (the number of gifts required to satisfy the predetermined condition). type, number, etc.) can be calculated. The determination unit 240 compares the set predetermined condition with the combination of a plurality of first gifts, and determines what kind of first gift needs to be additionally gifted in order to satisfy the predetermined condition. Calculate the condition of whether or not there is. The calculated necessary conditions are output to the comment processing section 250 . A specific example of the necessary conditions will now be described. For example, in the above-described case described with reference to FIG. 6C, if the predetermined condition is "to have three first gifts on the back" as described above, the viewing user requests a "red school bag" (wearing a school bag). already) and a "black rucksack", the requirement is "one first gift corresponding to the back of the avatar object". In the case of such a necessary condition, the comment processing unit 250 synthesizes comment information such as, for example, "If you have one more gift to wear on your back, the gift will change." ) is transmitted to the terminal device 10 of the distribution user. Also, in the above-described case described with reference to FIG. 6D, if the predetermined condition is "the colors of gold, silver, and copper are aligned with the left hand and the knife, fork, and spoon are aligned" as described above. , if the viewing user has gifted only "silver fork" (equipped), "golden fork", and "silver poon", the requirement is "a copper knife corresponding to the left hand of the avatar object" becomes. In the case of such a necessary condition, the comment processing unit 250 synthesizes comment information such as, for example, "Copper knife gifting is being sought!" It is transmitted to the terminal device 10 .

Further, when determining that the combination of the first gifts satisfies the predetermined condition, the determination unit 240 causes the second gift to be attached to the attachment site of the avatar object (the second gift is attached to the attachment site of the avatar object). It is possible to output to the communication unit 210 a request signal relating to an inquiry for obtaining the distribution user's confirmation about (generating a moving image including an animation). The communication unit 210 transmits the request signal to the distribution user (the terminal device 10 of the distribution user) and receives information related to the reply to the inquiry from the terminal device 10 of the distribution user. In this case, specifically, a screen 600 as shown in FIG. 7 is displayed on the display unit 110 of the terminal device 10 of the distribution user. 7 can be replaced with the text "Would you like the avatar object to be equipped with the second gift?". In this way, when the distribution user agrees to equip the avatar object with the second gift (when the distribution user selects "Yes" in FIG. 7), the avatar object equipped with the second gift In order to notify the viewing user that the gifting will not be reflected in the avatar object for a certain period of time (duration described later) even if the viewing user further performs gifting on the wearing part of the The determination unit 240 may instruct the comment processing unit 250 to transmit comment information such as "I can't do it" or "I'm already wearing the second gift!!" .

The second gift attached to the avatar object persists in the video (the second gift exists in the video including the animation in which the second gift is attached to the attachment site of the avatar object ) The duration (for example, 1 minute or 2 minutes) is set in advance, and the second gift is erased from the video when the duration has passed, in the video distribution application and the video viewing application is set. The duration of the second gift may start from the time when the second gift is attached to the attachment part of the avatar object, or the time of the last gifting performed by the viewing user to satisfy the predetermined condition. (A time point when a predetermined condition is satisfied) may be used as a starting point. In addition, in order to trigger the gifting by the viewing user at the timing immediately after the second gift is deleted from the moving image, immediately before the second gift is deleted from the moving image, for example, "The second gift has disappeared. The determination unit 240 may instruct the comment processing unit 250 to transmit comment information such as “Cheap, new gifting recruitment!!” to the terminal device 10 of the distribution user.

(6) Comment processing section 250
The comment processing unit 250 can receive comment information from the viewing user to the distribution user (avatar object) from the terminal device 10 of the viewing user via the communication unit 210, and can process the comment information from the viewing user in the same It can be distributed to each viewing user who is viewing the moving image.

In addition, the comment processing unit 250 refers to the table 500 managed by the database unit 230, and corresponds to all or part of the information regarding which viewing user gave what kind of gift to the attachment site of the avatar object. It is also possible to create comment information for viewing the same moving image and distribute the comment information to each viewing user who is viewing the same moving image.

Furthermore, the comment processing unit 250 refers to the table 500 managed by the database unit 230 to indicate that the first gift and/or the second gift has been given to the attachment site of the avatar object and/or Alternatively, it is also possible to create comment information indicating that the device has been installed, and distribute the comment information to each viewing user who is viewing the same moving image.

Furthermore, the comment processing unit 250 creates comment information corresponding to the above-described necessary conditions calculated by the determination unit, and distributes the comment information to each viewing user viewing the same video. can also

4. Overall Operation of Moving Image Distribution System 1 Next, the overall operation performed in the moving image distribution system 1 having the above configuration will be described with reference to FIGS. 8 to 11. FIG. FIG. 8 is a flow chart showing an example of operations performed in the moving picture distribution system 1 shown in FIG. FIG. 9 is a diagram showing an example of a moving image including animation of a distribution user's avatar object. FIG. 10 is a diagram showing an example of a moving image including an animation of a state in which the first gift is attached to the attachment site of the avatar object of the distribution user. FIG. 11 is a diagram schematically showing an example of an image in which a second gift is worn in place of the first gift at the attachment site of the broadcast user's avatar object.

First, in step (hereinafter referred to as “ST”) 300, the terminal device 10 (here, terminal device 10A) activates and executes the moving image distribution application according to the operation of the distribution user (here, distribution user A).

Next, in ST301, the terminal device 10A generates a moving image including an animation of the avatar object of broadcast user A based on data related to broadcast user A's actions and/or voice data related to utterances and songs uttered by broadcast user A. . Thereby, as illustrated in FIG. 9, a moving image 401 including an animation of the distribution user A's avatar object 400 is displayed on the display unit 110 of the terminal device 10A.

Further, the terminal device 10A transmits the generated video 401 to the distribution server device 20C of the server device 20. FIG. The distribution server device 20C distributes the video received from the terminal device 10A to the terminal device 10 of each viewing user executing the video viewing application. As a result, the video 401 as illustrated in FIG. 9 is also displayed on the display unit 110 of the terminal device 10 of each viewing user.

Next, in ST302, the terminal device 10 of the viewing user gives the first gift to the distribution user A (the site where the avatar object 400 is worn) based on the viewing user's operation on the user interface unit 130. to the server device 20 (gift API server device 20A).

Next, in ST303, the server device 20 (gift API server device 20A) that has received the request signal for the first gift from the viewing user's terminal device 10 receives the identification information of the viewing user who performed the gifting act, the gifting At least the information about the given gift and the identification information of the distribution user who is the avatar object to be gifted are read. Then, the read various information is stored in a table in the information processing server device 20B in the server device 20. FIG.

Next, in ST304, server device 20 (information processing server device 20B) has already attached the first gift to each wearing site of distribution user A's avatar object 400 at the time when the information was stored in the table in ST303. Check if it is installed. In ST304, the wearing part of the avatar object 400 gifted by the viewing user is, for example, the "head", and when the information related to the gifting is stored in the table in ST303, the first If the gift is not attached, server device 20 (information processing server device 20B) determines "NO" in ST304 and proceeds to ST310 to proceed to ST310 by placing a gift from the viewing user on the "head" of avatar object 400. Information requesting that a moving image including an animation in which the received first gift (for example, "a crown of diamonds") is attached is transmitted to the terminal device 10A of the distribution user A.

On the other hand, in ST304, the wearing part of the avatar object 400 gifted by the viewing user is, for example, the "head". If the "diamond crown" has already been worn, the server device 20 (information processing server device 20B) sends a request signal to give the first gift ("diamond crown") to the "head". exists, and after determining "YES" in ST304, determination relating to the first gift combination is executed in ST320, which will be described later.

Next, as a result of the server device 20 judging "NO" in ST304 as described above, the terminal device 10A of the distribution user A is viewed from the server device 20 (information processing server device 20B) to the "head" of the avatar object 400. Upon receiving information requesting to generate a moving image including an animation in which the first gift (for example, "diamond crown") given by the user is attached, in ST310, the terminal device 10A generates the moving image. Generate. As a result, as illustrated in FIG. 10, the display unit 110 of the terminal device 10A displays an animation in which the first gift 410, which is the "crown of diamonds," is attached to the "head" of the avatar object 400 of the distribution user A. A moving image 402 including is displayed. Note that the moving image 402 in FIG. 10 shows an example in which a first gift 420, which is a "silver fork", is attached to the "left hand" of the avatar object 400 in similar steps.

Further, the terminal device 10A transmits the generated video 402 to the distribution server device 20C of the server device 20. FIG. In ST311, the distribution server device 20C distributes the video received from the terminal device 10A to the terminal device 10 of each viewing user executing the video viewing application. As a result, the moving image 402 as shown in FIG. 10 is displayed on the display section 110 of the terminal device 10 of each viewing user, and the step when the server device determines "NO" in ST304 ends.

On the other hand, if server device 20 determines "YES" in ST304 as described above, determination section 240 determines whether or not the combination of the first gifts satisfies the predetermined condition. If the combination of the first gifts satisfies the predetermined condition ("YES" in ST320), server device 20 (determining section 240 of information processing server device 20B) instructs delivery user A in ST321 to Information relating to an inquiry (confirmation) as to whether or not the second gift may be attached to the avatar object 400 is transmitted to the terminal device 10A of the distribution user A. In response to this inquiry, when an answer to the effect that distribution user A is OK is transmitted from terminal device 10A of distribution user A to server device 20, server device 20 (information processing device 20B) responds to the wearing part of avatar object 400 ( For example, information is transmitted to the terminal device 10A of the distribution user A requesting to generate a moving image including an animation in which a second gift (for example, a "100-carat diamond tiara") is attached to the "head"). By the way, referring to FIG. 11 to supplement the specific example of the second gift, for example, when the first gift 420 of "silver fork" is attached to the "left hand" of the avatar object 400, the predetermined condition is satisfied, a second gift 420Z is generated (synthesized) of "Rainbow Big Fork". In this case, the first gift 420 and the second gift 420Z not only have a common mounting part of the corresponding avatar object 400, but also have a common shape, which is one of their characteristics. Thus, the first gift 420 and the second gift 420Z have some common features.

Next, in ST322, terminal device 10A of distribution user A sends a second gift (for example, a 100-carat diamond tiara) to the "head" of avatar object 400 from server device 20 (information processing server device 20B). ) is received, the terminal device 10A generates the moving image (not shown).

Further, the terminal device 10A transmits the generated video to the distribution server device 20C of the server device 20. FIG. In ST323, the distribution server device 20C distributes the video received from the terminal device 10A to the terminal device 10 of each viewing user executing the video viewing application. As a result, the same moving image is displayed on the display unit 110 of the terminal device 10 of each viewing user, and the server device is determined to be "YES" in ST304 and "YES" in ST320. step ends.

In ST320, if the first gift combination does not satisfy the predetermined condition ("NO" in ST320), server device 20 (determining unit 240 of information processing server device 20B) determines in ST330 that Necessary conditions necessary for the combination to satisfy the prescribed conditions (types and numbers of gifts required to satisfy the prescribed conditions, etc.) are calculated. Furthermore, the calculated necessary conditions are converted into comment information and distributed to the terminal devices 10 of the respective viewing users via the comment processing section 250 . As a result, similar comment information is also displayed on the display unit 110 of the terminal device 10 of each viewing user. In this way, the steps when ST320 is judged to be "NO" are completed.

The above steps are executed each time a viewing user performs a gifting act. Therefore, it is possible to timely generate and distribute a moving image including an animation in which the first gift or the second gift is attached to each attachment site of the avatar object 400 for any gifting act.

5. Regarding Modifications In the above-described embodiment, the generation of the moving image (including the moving image including the animation in which the first gift or the second gift is attached to the attachment part of the avatar object) is performed by the terminal device 10 of the distribution user. However, in another embodiment, it may be executed by the server device 20 or the terminal device 10 of the viewing user, for example. Further, each of the distribution user's terminal device 10, the server device 20, and the viewing user's terminal device 10 may generate a part of the video to generate the final video, or devices other than these devices may be used. may also generate part of the animation. Further, in the above-described another embodiment, a rendering unit (not shown) is provided in the server device 20 and/or the terminal device 10 of the viewing user, and the terminal device 10 of the distribution user is the server device 20 and/or For example, the first In addition to the information related to the second gift and the information related to the second gift, only data related to the distribution user's actions and/or data related to the utterances and songs uttered by the distribution user are generated, and these data are stored in the server device 20 and/or may be configured to transmit to the terminal device 10 of the viewing user.

In order to realize such a configuration, another embodiment is adopted in which the functions of the server device 20, the terminal device 10 of the viewing user, and the terminal device 10 of the distribution user are appropriately changed from the above-described embodiment. sell. For example, although the video generation unit 100 is provided in the terminal device 10 in one embodiment, it may be provided in the server device 20, or may be provided in the terminal device 10 or the terminal device 10 of the viewing user.

Further, the table 500 storing gift information and the determination as to whether or not the combination of the first gifts satisfies the predetermined condition by referring to the table 500 is the information processing server in the server device 20 in the above-described embodiment. Although it was performed by the device 20B, in another embodiment it may be performed on the terminal device 10 of the broadcast user. Along with this, although the determination unit 240 was provided in the server device 20 in the above-described embodiment, it may be provided in the distribution user's terminal device 10 .

Furthermore, in the above-described embodiment, the combination However, in another embodiment, for example, based on a combination of a plurality of first gifts given to a plurality of wearing parts of the avatar object, the combination is determined as a predetermined It may be determined whether or not the conditions are satisfied. Specifically, the combination of the first gift given to the "head" of the avatar object and the first gift given to the "neck", or the combination of the first gift given to the "left hand" of the avatar object , the first gift given to the "right hand", the first gift given to the "left foot", and the first gift given to the "right foot".

Furthermore, in another embodiment, the predetermined condition described above may be set to change every predetermined time period (for example, daily, weekly, monthly).

Furthermore, as described with reference to FIG. 11 in the above-described embodiment, the second gift is set so that a predetermined gift is synthesized in accordance with the preset first gift combination. However, in another embodiment, according to a preset combination of first gifts, a plurality of types of second gifts are set to be synthesized, and the plurality of types of second gifts are combined A second gift determined by the distribution user's selection from the gifts may be set to be attached to the avatar object.

Therefore, according to various embodiments, it is possible to provide a moving image processing method, a server device, and a computer program that increase gifting opportunities for viewing users.

6. Various Aspects A moving image processing method according to a first aspect is defined as "a moving image processing method executed by one or more processors executing computer-readable instructions, including animation of a broadcast user's avatar object. A request signal, which is generated based on an operation of a viewing user who watches a moving image and requests that a first gift be given to a part where the avatar object is attached, is sent from the terminal device of the viewing user via a communication line. a receiving step of receiving; and when it is determined that a combination of the plurality of first gifts given to the wearing part of the avatar object based on the plurality of request signals satisfies a predetermined condition, the and a generating step of generating the moving image including an animation in which a second gift having features common to the first gift is attached to the attachment site of the avatar object.

A moving image processing method according to a second aspect is the method according to the first aspect, wherein "the animation is generated based on the motion of the distribution user."

A moving image processing method according to a third aspect is characterized in that, in the first aspect or the second aspect, "the second gift is the size, color, and/or at least a part of the first gift. It changes shape."

A moving image processing method according to a fourth aspect is characterized in that, in any one of the first aspect to the third aspect, "if the combination of the plurality of first gifts does not satisfy the predetermined condition, the combination does not satisfy the predetermined condition. It further includes a step of transmitting comment information indicating necessary conditions for satisfying the conditions to terminal devices of a plurality of viewing users.

A moving image processing method according to a fifth aspect is, in any one of the first aspect to the fourth aspect, "in response to the request signal received from a certain viewing user's terminal device, the avatar object Comment information indicating that the first gift has been given to the attachment part and/or that the first gift has been attached to the attachment part of the avatar object is sent to the terminals of a plurality of viewing users. transmitting to the device."

A moving image processing method according to a sixth aspect is characterized in that, in any one of the first aspect to the fifth aspect, "the determination as to whether or not the combination satisfies the predetermined condition is performed on the attachment site of the avatar object. This is done based on a reference table that stores the type of the first gift given to the customer and the number of gifts given for each type of the first gift in association with each other.

A moving image processing method according to a seventh aspect is characterized in that, in any one of the first aspect to the sixth aspect, "when the combination satisfies the predetermined condition, in the moving image for the second gift setting a duration to last and deleting said second gift from said animation when said duration has passed."

A moving image processing method according to an eighth aspect is characterized in that, in any one of the first aspect to the seventh aspect, "the receiving step and the generating step include the terminal device of the viewing user and/or the terminal of the distribution user. It is executed by a server device connected to the device via a communication line.

A moving image processing method according to a ninth aspect is the eighth aspect, wherein "the server device determines that the combination satisfies the predetermined condition".

A moving image processing method according to a tenth aspect is that in any one of the first aspect to the seventh aspect, "the generating step is executed by the distribution user's terminal device."

A moving image processing method according to an eleventh aspect is the tenth aspect, wherein "it is determined by the server device or the distribution user's terminal device that the combination satisfies the predetermined condition".

A moving image processing method according to a twelfth aspect is that in any one of the first to seventh aspects, "the generating step is executed by the terminal device of the viewing user."

A moving image processing method according to a thirteenth aspect is the above-described twelfth aspect, wherein "it is determined by the server device or the distribution user's terminal device that the combination satisfies the predetermined condition".

A moving image processing method according to a fourteenth aspect is characterized in that, in any one of the first to thirteenth aspects, "the mounting site of the avatar object is part of the avatar object and/or separated from the avatar object. It is in the part.

A moving image processing method according to a fifteenth aspect is the moving image processing method according to any one of the first aspect to the fourteenth aspect, wherein "the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU) is a thing.

A moving image processing method according to a sixteenth aspect is the moving image processing method according to any one of the first to fifteenth aspects, wherein "the communication line includes the Internet."

A server device according to a seventeenth aspect is "comprising one or more processors, the processor being generated based on the operation of a viewing user who watches a moving image including an animation of an avatar object of a distribution user, the avatar object receiving a request signal requesting that the first gift be given to the wearing part of the avatar object from the terminal device of the viewing user via a communication line, and mounting the avatar object based on the plurality of request signals When it is determined that a combination of the plurality of first gifts imparted to parts satisfies a predetermined condition, a second gift having characteristics common to the first gift is attached to the wearing part of the avatar object. generate the animation including an animation in which the gift of is attached.

A server device according to an eighteenth aspect is "comprising one or more processors, wherein the processor is generated based on the operation of a viewing user who views a moving image including an animation of an avatar object of a distribution user, and the avatar object receiving a request signal requesting that the first gift be given to the wearing part of the avatar object from the terminal device of the viewing user via a communication line, and mounting the avatar object based on the plurality of request signals When it is determined that a combination of the plurality of first gifts imparted to parts satisfies a predetermined condition, a second gift having characteristics common to the first gift is attached to the wearing part of the avatar object. to the terminal device of the viewing user or the terminal device of the distribution user that generates the moving image including the animation in which the second gift is attached.

A server device according to a nineteenth aspect is the server device according to the seventeenth aspect or the eighteenth aspect, wherein "the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)." .

A server device according to a twentieth aspect is the server device according to any one of the seventeenth to nineteenth aspects, wherein "the communication line includes the Internet."

A computer program according to a twenty-first aspect is "executed by one or more processors, generated based on an operation of a viewing user who watches a video including an animation of a distribution user's avatar object, A request signal requesting that a first gift be given to a wearing part is received from the terminal device of the viewing user via a communication line, and the wearing part of the avatar object is received based on the plurality of request signals. when it is determined that the combination of the plurality of first gifts given to the avatar object satisfies a predetermined condition, a second gift having features in common with the first gift at the wearing site of the avatar object cause said processor to generate said animation that includes an animation of the gift being worn".

A computer program according to a twenty-second aspect is "executed by one or more processors, generated based on an operation of a viewing user who watches a video including an animation of an avatar object of a distribution user, and A request signal requesting that a first gift be given to a wearing part is received from the terminal device of the viewing user via a communication line, and the wearing part of the avatar object is received based on the plurality of request signals. when it is determined that the combination of the plurality of first gifts given to the avatar object satisfies a predetermined condition, a second gift having features in common with the first gift at the wearing site of the avatar object The processor functions so as to transmit information about the gift to the viewing user's terminal device or server device that generates the moving image including the animation of the second gift being worn."

A computer program according to a twenty-third aspect is the computer program according to the twenty-first aspect or the twenty-second aspect, wherein "the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)." .

A computer program according to a twenty-fourth aspect is the computer program according to any one of the twenty-first to the twenty-third aspects, wherein "the communication line includes the Internet."

A computer program according to a twenty-fifth aspect is "executed by one or more processors, generated based on an operation of a viewing user who watches a video including an animation of a distribution user's avatar object, A request signal requesting that a first gift be given to a wearing part is transmitted via a communication line, and a plurality of gifts are given to the wearing part of the avatar object based on the plurality of request signals. an animation in which a second gift having features common to the first gift is attached to the attachment site of the avatar object when it is determined that the combination of the first gifts satisfies a predetermined condition to generate the moving image containing said processor to receive information relating to said second gift from a distribution user's terminal device or server device."

A computer program according to a twenty-sixth aspect is "executed by one or more processors, generated based on an operation of a viewing user who watches a video including an animation of an avatar object of a distribution user, and the avatar object A request signal requesting that a first gift be given to a wearing part is transmitted via a communication line, and a plurality of gifts are given to the wearing part of the avatar object based on the plurality of request signals. an animation in which a second gift having features common to the first gift is attached to the attachment site of the avatar object when it is determined that the combination of the first gifts satisfies a predetermined condition The processor is made to function so as to receive the moving image including from the distribution user's terminal device or server device.

A computer program according to a twenty-seventh aspect is the computer program according to the twenty-fifth aspect or the twenty-sixth aspect, wherein "the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)." .

A computer program according to a twenty-eighth aspect is "the communication line includes the Internet" in any one of the twenty-fifth to the twenty-seventh aspects.

7. Fields to which the technology disclosed in the present application is applied The technology disclosed in the present application can be applied in, for example, the following fields.
(1) Application services that deliver live videos in which avatar objects appear (2) Application services that enable communication using characters and avatar objects (chat applications, messengers, mail applications, etc.)

1 moving image distribution system 10 (10A to 10D) terminal device 20 server device 20A gift API server device 20B information processing server device 20C distribution server device 20D comment API server device 100 moving image generation unit 220 gift processing unit 230 database unit 240 judgment unit 250 comment processing unit
400 avatar object 401, 402 animation 410, 420 first gift 420Z second gift 500 table

Claims (30)

A video processing method performed by one or more processors executing computer readable instructions, comprising:
A request signal generated based on an operation of a viewing user viewing a moving image including an animation of an avatar object of a distribution user and requesting to give a first gift to the avatar object is sent to a terminal device of the viewing user. a receiving step of receiving via a communication line from
When it is determined that the combination of the plurality of first gifts granted to the avatar object based on the plurality of request signals satisfies a predetermined condition, the number of the first gifts is greater than the total number of the first gifts. a generation step of generating the moving image including an animation in which at least one second gift having a low value is synthesized and one of the at least one second gifts is attached to the avatar object;
video processing methods, including 2. The moving image processing method according to claim 1, wherein said at least one second gift is a plurality of second gifts. 3. The moving image processing method according to claim 2, wherein said one second gift is determined by said distribution user's selection from among said plurality of second gifts. the first gift and the second gift have characteristics in common;
The common feature is a common attachment site to the avatar object.
The moving image processing method according to any one of claims 1 to 3. the first gift and the second gift have characteristics in common;
the common feature is the same color, the same size, or the same type of article;
The moving image processing method according to any one of claims 1 to 3. 6. The moving image processing method according to any one of claims 1 to 5, wherein said combination is a combination of a plurality of said first gifts given to a plurality of wearing parts of said avatar object. 7. The moving image processing method according to any one of claims 1 to 6, wherein said predetermined condition is set to change every predetermined time. When it is determined that the combination satisfies the predetermined condition, a plurality of types of the second gifts are combined, and then the plurality of types of the second gifts are selected by the distribution user. 8. The moving picture processing method according to any one of claims 1 to 7, wherein said moving picture including said animation of wearing said second gift of a kind is generated in said generating step. 9. The moving image processing method according to any one of claims 1 to 8, wherein said animation is generated based on said distribution user's actions. If the combination of the plurality of first gifts does not satisfy the predetermined condition, the step of transmitting comment information indicating necessary conditions for the combination to satisfy the predetermined condition to the terminal devices of the plurality of viewing users. 10. A moving image processing method according to any one of claims 1 to 9, comprising: In response to the request signal received from a certain viewing user's terminal device, the avatar object has been given the first gift and/or the avatar object has received the first gift. 11. The moving image processing method according to any one of claims 1 to 10, further comprising a step of transmitting comment information indicating that the device has been installed to terminal devices of a plurality of viewing users. Determination as to whether or not the combination satisfies the predetermined condition is stored by associating the type of the first gift given to the avatar object and the number of gifts given for each type of the first gift. 12. The moving image processing method according to any one of claims 1 to 11, wherein the moving image processing method is performed based on a lookup table for moving image processing. setting a duration for the second gift to last in the moving image when the combination satisfies the predetermined condition, and erasing the second gift from the moving image when the duration elapses; 13. The moving image processing method according to any one of claims 1 to 12, further comprising an erasing step. 14. The receiving step and the generating step according to any one of claims 1 to 13, wherein a server device connected to the viewing user's terminal device and/or the distribution user's terminal device via a communication line executes the receiving step and the generating step. 1. The moving image processing method according to item 1. 14. The moving image processing method according to any one of claims 1 to 13, wherein said generating step is executed by said distribution user's terminal device. That the combination satisfies the predetermined condition is determined by a server device connected to the terminal device of the viewing user and/or the terminal device of the distribution user via a communication line, or the terminal device of the distribution user. 16. The moving image processing method according to claim 15. 17. A method according to any one of claims 1 to 16, wherein said processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU). 18. A moving image processing method according to any one of claims 1 to 17, wherein said communication line comprises the Internet. comprising one or more processors;
the processor
A request signal generated based on an operation of a viewing user viewing a moving image including an animation of an avatar object of a distribution user and requesting to give a first gift to the avatar object is sent to a terminal device of the viewing user. received over a communication line from
When it is determined that the combination of the plurality of first gifts granted to the avatar object based on the plurality of request signals satisfies a predetermined condition, the number of the first gifts is greater than the total number of the first gifts. at least one second gift with a small number of second gifts is synthesized, and the moving image including an animation in which one of the at least one second gifts is attached to the avatar object is generated. comprising one or more processors;
the processor
A request signal generated based on an operation of a viewing user viewing a moving image including an animation of an avatar object of a distribution user and requesting to give a first gift to the avatar object is sent to a terminal device of the viewing user. received over a communication line from
When it is determined that the combination of the plurality of first gifts granted to the avatar object based on the plurality of request signals satisfies a predetermined condition, the number of the first gifts is greater than the total number of the first gifts. at least one second gift having a low value is synthesized, and one of the at least one second gifts is attached to the avatar object to generate the moving image including the animation attached to the avatar object. A server device that transmits to a device or a terminal device of the distribution user. 21. A server device according to claim 19 or 20, wherein said processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU). 22. The server device according to any one of claims 19 to 21, wherein said communication line includes the Internet. by being executed by one or more processors,
A request signal generated based on an operation of a viewing user viewing a moving image including an animation of an avatar object of a distribution user and requesting to give a first gift to the avatar object is sent to a terminal device of the viewing user. received over a communication line from
When it is determined that the combination of the plurality of first gifts granted to the avatar object based on the plurality of request signals satisfies a predetermined condition, the number of the first gifts is greater than the total number of the first gifts. at least one second gift with less is synthesized, and one of the at least one second gifts is attached to the avatar object to generate the animation including an animation;
A computer program that causes the processor to function as by being executed by one or more processors,
A request signal generated based on an operation of a viewing user viewing a moving image including an animation of an avatar object of a distribution user and requesting to give a first gift to the avatar object is sent to a terminal device of the viewing user. received over a communication line from
When it is determined that the combination of the plurality of first gifts granted to the avatar object based on the plurality of request signals satisfies a predetermined condition, the number of the first gifts is greater than the total number of the first gifts. at least one second gift having a low value is synthesized, and one of the at least one second gifts is attached to the avatar object to generate the moving image including the animation attached to the avatar object. to a device or server device;
A computer program that causes the processor to function as 25. A computer program as claimed in claim 23 or 24, wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU). 26. A computer program product as claimed in any one of claims 23 to 25, wherein the communication line comprises the Internet. by being executed by one or more processors,
Transmitting, via a communication line, a request signal generated based on an operation of a viewing user viewing a moving image including an animation of an avatar object of the broadcasting user and requesting that the avatar object be given a first gift. death,
When it is determined that the combination of the plurality of first gifts granted to the avatar object based on the plurality of request signals satisfies a predetermined condition, the number of the first gifts is greater than the total number of the first gifts. at least one second gift having a low value is synthesized, and one of the at least one second gifts is attached to the avatar object to generate the moving image including an animation in which the second gift is attached to the avatar object; Receive the information related to the gift of 2 from the distribution user's terminal device or server device,
A computer program that causes the processor to function as by being executed by one or more processors,
Transmitting, via a communication line, a request signal generated based on an operation of a viewing user viewing a moving image including an animation of an avatar object of the broadcasting user and requesting that the avatar object be given a first gift. death,
When it is determined that the combination of the plurality of first gifts granted to the avatar object based on the plurality of request signals satisfies a predetermined condition, the number of the first gifts is greater than the total number of the first gifts. at least one second gift with a small number of second gifts is synthesized, and one of the at least one second gifts is distributed to the user's terminal device or server including animation including an animation in which one second gift is attached to the avatar object received from the device,
A computer program that causes the processor to function as 29. A computer program according to claim 27 or 28, wherein said processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU). 30. A computer program product as claimed in any one of claims 27 to 29, wherein the communication line comprises the Internet.

Images