JP2022002113A - Video processing method, server device, and computer program - Google Patents

Abstract

To provide a video processing method, a server device, and a computer program that increases a gifting opportunity for a viewing user.SOLUTION: A video processing method performed by one or more processors that execute computer-readable instructions includes a receiving step of generating a video including an animation of an avatar object of a distribution user on the basis of the operation of a viewing user, and receiving a request signal that requests that a first gift is given to an attachment part of the avatar object from a terminal device of the viewing user through a communication line, and a generation step of generating the video including the animation in which a second gift having the same characteristics as the first gift is attached to the attachment part of the avatar object when it is determined that a combination of a plurality of first gifts given to the attachment part of the avatar object satisfies a predetermined condition on the basis of the plurality of request signals.SELECTED DRAWING: Figure 1

Description

The technology disclosed in the present application relates to a video processing method for a moving image viewed by a viewing user, a server device for controlling the moving image, and a computer program.

Conventionally, a video distribution service that distributes a video to a terminal device via a network has been known. In this type of video distribution service, the avatar (avatar object) of the distribution user who distributes the video is displayed, and the viewing user who watches the video and the distribution user can communicate with each other through messages, chats, etc. An environment where you can do it is provided.

Further, as a communication tool between the viewing user and the distribution user, Patent Document 1 electronically realizes the act (gifting) of providing the item acquired by the viewing user as a gift to the avatar (distribution user) in the video. The fact is disclosed.

Further, in a video distribution service such as REALITY (registered trademark), an environment is provided in which a viewing user can give a gift to each wearing part (for example, head, neck, and hand) of an avatar (distribution user). (Non-Patent Document 1).

The above-mentioned Patent Document 1 and Non-Patent Document 1 are incorporated in the present specification as a whole by citation.

Japanese Unexamined Patent Publication No. 2012-12598

"REALITY", [online], [Search on August 27, 2019], Internet (URL: https://twitter.com/WFLE_REALITY)

The above-mentioned gifting fosters a sense of familiarity and involvement of the viewing user with the avatar through direct communication between the viewing user and the distribution user (avatar). However, in the gifting to each attachment part of the avatar as described in Non-Patent Document 1, one viewing user gives the head of the avatar, for example, and the gift based on the gifting is the head. When a video containing an avatar attached to the head is delivered, even if other viewing users give a gift to the head of the avatar during the specified time until the gift attached to the head is deleted from the video. , Gifts based on the gifting will not be worn on the avatar's head. Therefore, in the case of such gifting control, only a limited gifting action is reflected in the video, the gifting opportunity by the viewing user is limited, and the viewing user's willingness to give is suppressed. There are challenges.

On the other hand, as a method of solving the above-mentioned problem, one viewing user gives a gift A to the head of an avatar, for example, and a video containing the avatar with the gift A based on the gifting attached to the head is delivered. In such cases, an alternative is also proposed in which when another viewing user gives the gift B to the head of the avatar, the gift A is immediately overwritten with the gift B. However, in this case, for the viewing user who has given the gift A, the gift given by himself / herself is suddenly deleted from the video due to the giving by another viewing user, so that the gift is given. There are also issues such as promoting disappointment with the act of ting.

Further, the gifting means a mode in which the viewing user purchases a gift by paying a price to the service provider who provides the video distribution service, and then the gift is given to the distribution user (avatar). Therefore, increasing the gifting opportunities for viewing users can be said to be an issue for service providers.

Accordingly, some embodiments disclosed in this application provide video processing methods, server devices and computer programs that increase the gifting opportunities for viewing users.

The video processing method according to one aspect is a video processing method executed by one or a plurality of processors that execute a command readable by a computer, and is a video processing method for a viewing user who watches a video including an animation of an avatar object of a distribution user. A receiving step of receiving a request signal generated based on an operation and requesting that a first gift is given to a mounting portion of the avatar object from the terminal device of the viewing user via a communication line, and a plurality of times. When it is determined that the combination of the plurality of first gifts given to the wearing portion of the avatar object satisfies a predetermined condition based on the request signal of the above, the wearing portion of the avatar object is used. It includes a generation step of generating the moving image including an animation in which a second gift is attached, which has features in common with the first gift.

The server device according to one embodiment includes one or a plurality of processors, and the processors are generated based on the operation of a viewing user who watches a moving image including an animation of the avatar object of the distribution user, and the mounting portion of the avatar object is generated. A request signal requesting that the first gift be given to the viewer is received from the viewing user's terminal device via a communication line, and the avatar object is attached to the wearing portion based on the plurality of request signals. When it is determined that the combination of the plurality of first gifts given in the above conditions satisfies a predetermined condition, a second gift having the same characteristics as the first gift is attached to the attachment portion of the avatar object. It generates the moving image including the attached animation.

The server device according to one embodiment includes one or a plurality of processors, and the processors are generated based on the operation of a viewing user who watches a moving image including an animation of the avatar object of the distribution user, and the mounting portion of the avatar object is generated. A request signal requesting that the first gift be given to the viewer is received from the viewing user's terminal device via a communication line, and the avatar object is attached to the wearing portion based on the plurality of request signals. When it is determined that the combination of the plurality of first gifts given in the above conditions satisfies a predetermined condition, the second gift having the same characteristics as the first gift at the attachment site of the avatar object is used. Such information is transmitted to the terminal device of the viewing user or the terminal device of the distribution user who generates the moving image including the animation in which the second gift is attached.

The computer program according to one aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or more processors, and is generated on the mounting portion of the avatar object. A request signal requesting that the first gift be given is received from the viewing user's terminal device via a communication line, and the avatar object is attached to the wearing portion based on the plurality of request signals. When it is determined that the combination of the plurality of given first gifts satisfies a predetermined condition, the second gift having the same characteristics as the first gift is attached to the attachment portion of the avatar object. The processor is made to function so as to generate the moving image including the animation.

The computer program according to one aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or more processors, and is generated on the mounting portion of the avatar object. A request signal requesting that the first gift be given is received from the viewing user's terminal device via a communication line, and the avatar object is attached to the wearing portion based on the plurality of request signals. The present invention relates to a second gift having the same characteristics as the first gift in the mounting portion of the avatar object when it is determined that the combination of the plurality of given first gifts satisfies a predetermined condition. The processor is made to function so as to transmit the information to the terminal device or server device of the viewing user who generates the moving image including the animation in which the second gift is attached.

The computer program according to one aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or more processors, and is generated on the mounting portion of the avatar object. A request signal requesting that the first gift be given is transmitted via a communication line, and the plurality of said firsts given to the said mounting portion of the said avatar object based on the plurality of said request signals. The moving image including an animation in which a second gift having characteristics common to the first gift is attached to the attachment portion of the avatar object when it is determined that the combination of the first gifts satisfies a predetermined condition. The processor is made to function so as to receive the information relating to the second gift from the terminal device or the server device of the distribution user in order to generate the second gift.

The computer program according to one aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or more processors, and is generated on the mounting portion of the avatar object. A request signal requesting that the first gift be given is transmitted via a communication line, and the plurality of said firsts given to the said mounting portion of the said avatar object based on the plurality of said request signals. The moving image including an animation in which a second gift having characteristics common to the first gift is attached to the attachment portion of the avatar object when it is determined that the combination of the first gifts satisfies a predetermined condition. Is to be received from the terminal device or server device of the distribution user, so that the processor functions.

FIG. 1 is a block diagram showing an example of a configuration of a video distribution system according to an embodiment. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal device (server device) shown in FIG. 1. FIG. 3 is a block diagram schematically showing an example of the function of the terminal device shown in FIG. FIG. 4 is a block diagram schematically showing an example of the function of the server device shown in FIG. 1. FIG. 5 is a diagram showing an example of a table managed by the database unit. FIG. 6A is a diagram showing an example of a table managed by the database unit, and is a diagram schematically showing an image when the determination unit makes a determination. FIG. 6B is a diagram showing an example of a table managed by the database unit, and is a diagram schematically showing an image when the determination unit makes a determination. FIG. 6C is a diagram showing an example of a table managed by the database unit, and is a diagram schematically showing an image when the determination unit makes a determination. FIG. 6D is a diagram showing an example of a table managed by the database unit, and is a diagram schematically showing an image when the determination unit makes a determination. FIG. 7 is a diagram showing an example of a confirmation screen displayed on the display unit of the terminal device of the distribution user. FIG. 8 is a flow chart showing an example of the operation performed in the moving image distribution system shown in FIG. 1. FIG. 9 is a diagram showing an example of a moving image including an animation of an avatar object of a distribution user. FIG. 10 is a diagram showing an example of a moving image including an animation in which a first gift is attached to a attachment portion of an avatar object of a distribution user. FIG. 11 is a diagram schematically showing an example of an image in which a second gift is attached in place of the first gift at the attachment site of the avatar object of the distribution user.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. The same reference numerals are given to the common components in the drawings. It should also be noted that the components represented in one drawing may be omitted in another drawing for convenience of explanation. Furthermore, it should be noted that the attached drawings are not always drawn to the correct scale. Furthermore, the term application may be referred to as software or a program, as long as it is a command to the computer and is combined so that certain results can be obtained.

1. 1. Configuration of Video Distribution System In short, the video distribution system 1 disclosed in the present application is issued by a distribution user who distributes data and / or by a distribution user using the terminal device. It is possible to deliver a video including an animation of an avatar object generated based on voice data related to the spoken or sung to the terminal device of a viewing user who watches the video via a communication line. ..

FIG. 1 is a block diagram showing an example of the configuration of the video distribution system 1 according to the embodiment. As shown in FIG. 1, the moving image distribution system 1 includes a plurality of terminal devices 10 connected to a communication line (not shown), and one or more server devices 20 connected to the communication line. Can be done. Each terminal device 10 is connected to one or more server devices 20 via a communication line.

The communication line may include, without limitation, a mobile phone network, a wireless LAN, a fixed telephone network, the Internet, an intranet and / or an Ethernet (registered trademark) and the like.

1-1. Terminal device 10
As shown in FIG. 1, the plurality of terminal devices 10 include one or more distribution user terminal devices 10 (here, terminal device 10A) and one or more viewing user terminal devices 10 (here, terminal devices 10). 10B to 10D) and can be included. Since each terminal device 10 has a common configuration, it can be used as either a terminal device for distributing a moving image (terminal device 10 of a distribution user) or a terminal device for viewing a moving image (terminal device 10 of a viewing user). Can also be.

When each terminal device 10 operates as the terminal device 10 of the distribution user, by executing the installed video distribution application, data related to the operation of the distribution user and / or an utterance uttered by the distribution user or the like. A video including an animation of a virtual character (avatar object) changed according to the acquired data is acquired by acquiring voice data related to singing, and the video is transmitted to the server device 20 (distribution server device 20C) via a communication line. Can be sent to. The moving image is distributed to the terminal device 10 (viewing user's terminal device 10) for receiving the moving image, which executes the installed video viewing application by the server device 20 (distribution server device 20C) via the communication line. Will be done.

Further, when each terminal device 10 operates as the terminal device 10 of the distribution user, the server device 20 attaches the distribution user (avatar object) to the attachment portion of the distribution user (avatar object) based on the operation of the viewing user via the communication line. When a request signal requesting to give a gift (first gift) is received from the terminal device 10 of the viewing user who watches the moving image, each terminal device 10 receives the server device 20 (information processing server device). The request signal can be received from the server device 20 from 20B), and a moving image including an animation in which the first gift is attached to the attachment portion of the avatar object can be generated.

By the way, the attachment part of the avatar object is a part of the avatar object such as the head, face, neck, right hand, left hand, waist, right foot, left foot, etc. of the avatar object, and / or the part away from the avatar object (overhead, feet, etc.). It means (including the space surrounding the avatar object, such as the back).

In the above-mentioned gifting, there are a plurality of request signals requesting that the first gift be given to the attachment portion of the avatar object (when a plurality of request signals are transmitted from one viewing user terminal device 10). And when a request signal is transmitted from a plurality of viewing user terminal devices 10), the distribution user's terminal device 10 is an avatar object from the server device 20 (information processing server device 20B). It is possible to receive information requesting that a video including an animation of a state in which a second gift is mounted, which has the same characteristics as the first gift, be generated for the mounting portion of the first gift, and generate the video. ..

A method for determining whether or not to generate a moving image including an animation in which a second gift is attached to the attachment portion of the avatar object will be described later, but the determination is made by the server device 20 (described later). It is executed by the information processing server device 20B).

On the other hand, when each terminal device 10 operates as a terminal device for viewing a moving image (terminal device of a viewing user), the terminal device 10 of the distribution user can be used by executing the installed video viewing application. The delivered moving image can be received via the server device 20 (delivery server device 20C).

Further, when each terminal device 10 operates as a terminal device of the viewing user, the video viewing application is executed, and the gift is given to the wearing portion of the distribution user (avatar object) based on the operation of the viewing user. A request signal requesting that the (first gift) is given can be transmitted to the server device 20 (gift API server device 20A).

Further, when each terminal device 10 operates as a terminal device of a viewing user, the server device 20 (comment) provides information related to a comment from the viewing user to the distribution user (avatar object) by executing a video viewing application. It can be transmitted to the API server device 20D).

The above-mentioned video distribution application and video viewing application can be installed and executed in each terminal device 10 as one integrated application or as separate applications.

Each terminal device 10 is an arbitrary terminal device capable of performing such an operation, and includes, without limitation, a smartphone, a tablet, a mobile phone (feature phone) and / or a personal computer and the like. Can be done.

1-2. Server device 20
As shown in FIG. 1, the server device 20 can also be referred to as a moving image distribution system in which a plurality of server devices described later are combined.

The server device 20 can distribute the moving image transmitted from the terminal device 10 of the distribution user to the terminal device 10 of each viewing user.

Further, the server device 20 can receive a request signal requesting that a gift (first gift) be given (gifting) to the attachment portion of the avatar object from the terminal device 10 of each viewing user. .. Further, after transmitting the information related to the request signal to the terminal device 10 of the distribution user, the gift is attached to the attachment portion of the avatar object generated by the terminal device 10 of the distribution user who received the information. You can also receive videos that include animation.

In the above-mentioned gifting, there are a plurality of request signals requesting that the first gift be given to the attachment portion of the avatar object (when a plurality of request signals are transmitted from one viewing user terminal device 10). In the case of transmission (including both the case where the request signal is transmitted from the plurality of viewing user terminal devices 10), the server device 20 is in a state where the second gift is attached to the attachment portion of the avatar object. It is possible to determine whether or not to generate a moving image including the animation of the above, and if it is determined to generate the moving image, send information requesting the generation of the moving image to the terminal device 10 of the distribution user. can. Then, the server device 20 can receive a moving image including an animation in a state where the second gift is attached to the attachment portion of the avatar object from the terminal device 10 of the distribution user.

Further, the server device 20 can receive information related to a comment from the viewing user to the distribution user (avatar object) from the terminal device 10 of the viewing user, and the comment is given to the viewing user who views the same moving image. Can be delivered.

In order to perform such an operation, the server device 20, in one embodiment, is a gift API server device 20A, which is connected to each other via a communication line (including a wireless line and / or a wired line (not shown)). The information processing server device 20B, the distribution server device 20C, and the comment API server device 20D can be included.

The gift API server device 20A sends a request signal requesting that a gift (first gift) be given (gifting) to the attachment site of the avatar object based on the operation of the viewing user, to the terminal device of each viewing user. It can be received from 10. At this time, the gift API server device 20A receives the identification information of the viewing user (serial number of the terminal device 10 of each viewing user, ID information given to each viewing user, etc.) from the request signal. Information related to the gifted gift (information on what kind of gift corresponds to which attachment part of the avatar object) and identification information of the distribution user who is the avatar object to be gifted (terminal device 10 of the distribution user). (Serial number, ID information given to the distribution user, etc.) is read at least, and the read information is automatically transmitted to the information processing server device 20B when an inquiry is received from the information processing server device 20B. Can be done.

The information processing server device 20B automatically or self-inquires about the information read by the gift API server device 20A, and receives the information from the gift API server device 20A. Further, the information processing server device 20B can have a table (database) for each distribution user, and the information related to the gift read by the gift API server device 20A can be stored in each table.

Furthermore, the information processing server device 20B refers to the information related to the gift stored in the table, and has a plurality of gifting actions (a plurality of gifting actions by one viewing user, and a plurality of gifting actions by a plurality of viewing users. Whether to generate a video containing an animation with a second gift attached to the attachment site of the avatar object with a second gift that has the same characteristics as the first gift in the event of (including both gifting actions). It can be determined whether or not. It should be noted that the determination is determined by whether or not the combination of the plurality of gifting actions (plurality of first gifts) satisfies a predetermined condition set in advance.

Furthermore, the information processing server device 20B requests that the information processing server device 20B refer to the information related to the gift stored in the table and generate a moving image including an animation in which the first gift is attached to the attachment site of the avatar object. Information to be processed can be transmitted to the terminal device 10 of the distribution user. Similarly, when it is determined by the above-mentioned determination to generate a video including an animation in which the second gift is attached, the animation in which the second gift is attached to the attachment portion of the avatar object is included. Information requesting that a moving image be generated can be transmitted to the terminal device 10 of the distribution user.

Furthermore, the information processing server device 20B refers to the identification information of the viewing user and the information related to the gift stored in the table, and which viewing user is what with respect to the attachment site (delivery user) of the avatar object. All or part of the information regarding whether or not the gift has been given can be transmitted to the comment API server device 20D.

Furthermore, if the information processing server device 20B determines that the combination of the plurality of gifting actions (plurality of first gifts) does not satisfy the preset predetermined conditions, what kind of combination is the predetermined combination? After calculating the necessary conditions for satisfying the conditions, the necessary conditions can be transmitted to the comment API server device 20D. The details of the necessary conditions mentioned here will be described later.

The distribution server device 20C can distribute the moving image transmitted from the terminal device 10 of the distribution user to the terminal device 10 of each viewing user.

Further, the distribution server device 20C receives a video including an animation in a state where the first gift is mounted on the mounting portion of the avatar object from the terminal device 10 of the distribution user, and receives the video from the terminal device 10 of each viewing user. Can be delivered to.

Furthermore, the distribution server device 20C receives a video including an animation in a state where the second gift is mounted on the mounting portion of the avatar object from the terminal device 10 of the distribution user, and receives the video from the terminal device of each viewing user. It can be delivered to 10.

The comment API server device 20D can receive the comment of the viewing user from the terminal device 10 of the viewing user, and can distribute the received comment to each viewing user who is viewing the same moving image. ..

Further, the comment API server device 20D corresponds to all or part of the information received from the information processing server device 20B regarding which viewing user has given what gift to the attachment site (delivery user) of the avatar object. The comment to be processed can be distributed to each viewing user who is viewing the same video.

Furthermore, the comment API server device 20D can also deliver comments corresponding to the above-mentioned requirements received from the information processing server device 20B to each viewing user who is watching the same moving image.

In the example shown in FIG. 1, the server device 20 includes a gift API server device 20A, an information processing server device 20B, a distribution server device 20C, and a comment API server device 20D for the purpose of distributing the load and the like. A configuration with four server devices is shown. However, at least one of these four server devices may be integrated with any of the remaining server devices.

2. 2. Hardware Configuration of Each Device Next, an example of the hardware configuration of each of the terminal device 10 and the server device 20 will be described.

2-1. Hardware Configuration of Terminal Devices 10 A hardware configuration example of each terminal device 10 will be described with reference to FIG. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal device 10 (server device 20) shown in FIG. 1. (Note that reference numerals in parentheses in FIG. 2 are as described later. It is described in relation to the server device 20.)

As shown in FIG. 2, each terminal device 10 mainly includes a central processing unit 11, a main storage device 12, an input / output interface device 13, an input device 14, an auxiliary storage device 15, and an output device 16. And can include. These devices are connected to each other by a data bus and / or a control bus.

The central processing unit 11 is called a "CPU", which performs an operation on instructions and data stored in the main storage device 12 and stores the result of the operation in the main storage device 12. be. Further, the central processing unit 11 can control the input device 14, the auxiliary storage device 15, the output device 16, and the like via the input / output interface device 13. The terminal device 10 can include one or more such central processing units 11.

The main storage device 12 is referred to as a "memory", and is a command received from the input device 14, the auxiliary storage device 15, and the communication line 30 (server device 20 or the like) via the input / output interface device 13 and. It stores the data and the calculation result of the central processing apparatus 11. The main storage device 12 can include RAM (random access memory), ROM (read-only memory) and / or flash memory without limitation.

The auxiliary storage device 15 is a storage device having a larger capacity than the main storage device 12. By storing the above-mentioned specific applications (video distribution application, video viewing application, etc.), instructions and data (computer programs) constituting the web browser, etc., and controlling them by the central processing device 11. Instructions and data (computer programs) can be transmitted to the main storage device 12 via the input / output interface device 13. The auxiliary storage device 15 may include, without limitation, a magnetic disk device and / or an optical disk device and the like.

The input device 14 is a device that captures data from the outside, and includes, without limitation, a touch panel, a button, a keyboard, a mouse, and / or a sensor. As will be described later, the sensor may include, without limitation, a sensor including one or more cameras and / or one or more microphones and the like.

The output device 16 can include, but is not limited to, a display device, a touch panel, and / or a printer device.

In such a hardware configuration, the central processing device 11 sequentially loads and loads the instructions and data (computer programs) constituting the specific application stored in the auxiliary storage device 15 into the main storage device 12. The output device 16 is controlled via the input / output interface device 13 by calculating instructions and data, or another device via the input / output interface device 13 and the communication line 30 (communication network 30). Various information can be transmitted / received to / from (for example, the server device 20 and another terminal device 10 etc.).

As a result, the terminal device 10 performs an operation necessary for generating a moving image, an operation necessary for transmitting (delivering) and / or receiving a moving image, and a gifting action by executing a specific installed application. It is possible to perform the actions necessary for sending a comment and the actions necessary for sending a comment (including various other actions described in detail later).

The terminal device 10 may include one or more microprocessors and / or a graphics processing unit (GPU) in place of the central processing unit 11 or together with the central processing unit 11.

2-2. Hardware Configuration of Server Device 20 A hardware configuration example of each server device 20 will be described with reference to FIG. The hardware configuration of each server device 20 (gift API server device 20A, information processing server device 20B, distribution server device 20C, and comment API server device 20D) is, for example, the same as the hardware configuration of each terminal device 10 described above. It is possible to use one. Therefore, reference numerals for the components of each server device 20 are shown in parentheses in FIG.

As shown in FIG. 2, each server device 20 mainly includes a central processing unit 21, a main storage device 22, an input / output interface device 23, an input device 24, an auxiliary storage device 25, and an output device 26. And can include. These devices are connected to each other by a data bus and / or a control bus.

The central processing device 21, the main storage device 22, the input / output interface device 23, the input device 24, the auxiliary storage device 25, and the output device 26 are included in each of the terminal devices 10 described above, respectively. It can be substantially the same as the device 12, the input / output interface device 13, the input device 14, the auxiliary storage device 15, and the output device 16.

In such a hardware configuration, the central processing device 21 sequentially loads and loads the instructions and data (computer programs) constituting the specific application stored in the auxiliary storage device 25 into the main storage device 22. The output device 26 is controlled via the input / output interface device 23 by calculating instructions and data, or another device via the input / output interface device 23 and the communication line 30 (communication network 30). Various information can be transmitted / received to / from (for example, each terminal device 10 or the like).

As a result, the server device 20 operates the operation necessary for distributing the moving image transmitted by the terminal device 10 of each distribution user to the terminal device 10 of each viewing user, and the gift transmitted from the terminal device 10 of each viewing user. Operations required to receive a ting action, operations required to generate request information necessary for the terminal device 10 to generate a moving image, operations required to send (deliver) and / or receive a moving image. Etc. (including various actions described in detail later) can be executed.

The server device 20 may include one or more microprocessors and / or a graphics processing unit (GPU) in place of the central processing unit 21 or together with the central processing unit 21.

3. 3. Functions of Each Device Next, a detailed example of the functions of each of the terminal device 10 and the server device 20 will be described.

3-1. Function of Terminal Device 10 An example of the function of the terminal device 10 will be described with reference to FIG. FIG. 3 is a block diagram schematically showing an example of the function of the terminal device 10 shown in FIG.

As shown in FIG. 3, the terminal device 10 can mainly include a moving image generation unit 100, a display unit 110, a storage unit 120, a user interface unit 130, a gift storage unit 140, and a communication unit 150.

(1) Movie generation unit 100
The moving image generation unit 100 can generate a moving image including an animation of the distribution user's avatar object based on the data related to the operation of the distribution user and / or the voice data related to the utterance or singing uttered by the distribution user. In order to realize this, the moving image generation unit 100 can include, for example, an acquisition unit (not shown) and a processing unit (not shown).

The acquisition unit has one or more first sensors (not shown) that acquire data on the face, limbs, etc. (whole body) of the distribution user, and voice data on utterances and / or singing uttered by the distribution user. A second sensor (not shown), which obtains one or more sensors, can be included.

In a preferred embodiment, the first sensor can include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. As such a camera, for example, the one included in the True Depth camera of iPhone X (registered trademark) can be used. The second sensor can include a microphone that records voice.

First, regarding the first sensor, the acquisition unit captures the face, limbs, etc. of the distribution user by using the first sensor arranged close to the face, limbs, etc. of the distribution user. As a result, the acquisition unit can generate data (for example, an MPEG file) recorded over a unit time by associating an image acquired by the RGB camera with a time code (a code indicating the acquired time). Further, the acquisition unit associates numerical values (for example, floating-point numerical values) indicating a predetermined number (for example, 51) of depths acquired by the near-infrared camera with the time code and records them over a unit time (for example, a TSV file). [File in a format that records multiple data by separating the data with tabs]) can be generated.

Regarding the near-infrared camera, specifically, the dot projector emits an infrared laser forming a dot pattern to the distribution user's face and limbs, and the near-infrared camera projects and reflects the infrared rays on the distribution user's face and limbs. It captures dots and generates an image of infrared dots captured in this way. The acquisition unit compares the image of the dot pattern radiated by the pre-registered dot projector with the image captured by the near-infrared camera, and each point (each feature point) in both images (for example, 51). The depth (distance between each point / feature point and the near-infrared camera) of each point (each feature point) can be calculated by using the position deviation at each point / feature point). The acquisition unit can generate data recorded over a unit time by associating the numerical value indicating the depth calculated in this way with the time code as described above.

Next, with respect to the second sensor, the acquisition unit acquires voices related to utterances and / or singing uttered by the distribution user using the second sensor arranged close to the distribution user. As a result, the acquisition unit can generate data (for example, an MPEG file) recorded over a unit time in association with the time code. In one embodiment, the acquisition unit acquires data on the face and limbs of the distribution user using the first sensor, and at the same time, voice data on the utterance and / or singing made by the distribution user using the second sensor. Can be obtained. In this case, the acquisition unit associates the image acquired by the RGB camera with the voice data related to the utterance and / or singing uttered by the distribution user using the second sensor with the same time code. Data recorded over a unit time (eg, an MPEG file) can be generated.

The acquisition unit generates data related to the face, limbs, etc. of the distribution user (MPEG file, TSV file, etc.) and / or voice data (MPEG file, etc.) related to the utterance and / or singing uttered by the distribution user. ) Can be output to the processing unit.

Although the case where the first sensor includes an RGB camera and an infrared camera has been described here, the first sensor is, for example, (A) infrared rays emitted by an infrared laser and reflected on the face, limbs, etc. of the distribution user. It may include any one of (B) a plurality of RGB cameras that capture visible light, and (C) a single camera that captures visible light. In the case of (A) above, the acquisition unit can calculate the depth for each feature point on the face, limbs, etc. of the distribution user by the same method as described above. In the case of (B) above, the acquisition unit can calculate the depth (depth) of each feature point on the face, limbs, etc. of the distribution user by using a plurality of images captured by a plurality of RGB cameras. .. In the case of (C) above, the acquisition unit calculates the depth (depth) of each feature point on the face, limbs, etc. of the distribution user from the image captured by a single camera by using deep learning or the like. can do. Further, in the case of (C) above, the acquisition unit performs analysis processing (image processing, etc.) on the image captured by a single camera, and the depth (depth) of each feature point on the face, limbs, etc. of the distribution user. May be calculated.

The processing unit can generate a video including an animation of a virtual character (avatar object) based on the data related to the face, limbs, etc. of the distribution user from the acquisition unit. For the moving image of the avatar object itself, the processing unit uses various information (for example, geometry information, bone information, texture information, shader information, blend shape information, etc.) stored in the character data storage unit (not shown) to illustrate the video itself. It is also possible to generate a moving image of an avatar object by causing the rendering part to perform rendering.

It should be noted that any other well-known method for generating a video containing an animation of the distribution user's avatar object based on data on the distribution user's actions and / or audio data on utterances and singing uttered by the distribution user. It is also possible to use the technology.

By the way, the moving image generation unit 100 receives request information that the communication unit 150, which will be described later, generates a moving image including an animation in which a first gift or a second gift is attached to the attachment portion of the avatar object. Upon receiving from (information processing server device 20B), the request information can be received from the communication unit 150 to generate the moving image. In this case, the moving image generation unit 100 has the data related to the moving image including the animation of the avatar object generated in detail as described above, and the data related to the first gift or the second gift (which attachment part of the avatar object). A video containing an animation in which the first gift or the second gift is attached to the attachment part of the avatar object in combination with (data on what shape, size, and color the gift has). Can be generated. Specifically, information (attachment position information) regarding which attachment part of the avatar object is attached to the first gift and the second gift is set in advance, and gifting from the viewing user is performed. Alternatively, when a predetermined condition described later is satisfied, the first gift or the second gift can be displayed on the moving image at the mounting portion based on the mounting position information. For example, if the first gift is a "red school bag", the wearing position information will be "back", and when the "red school bag" is gifted by the viewing user, at least a part of the "back" of the avatar object. The "red school bag" is displayed on the video so as to cover (or touch at least a part of the "back"). Similarly, when the second gift is a "rainbow-colored large fork", the mounting position information is "left hand" (may be "right hand"), and when the predetermined condition described later is satisfied in the "left hand", Display the "rainbow-colored large fork" on the video so that it touches the "left hand" of the avatar object (so that it covers a part of the "left hand"). The position (position information) of each mounting portion of the avatar object in the moving image is detected by, for example, a sensor such as a motion sensor described later. Therefore, when displaying the "red school bag" on the "back" of the avatar object, the position information of the "back" at that time is referred to, and the "red school bag" corresponds to the "back" in the video. It will be displayed above. In addition, the displayed first gift and second gift are displayed on the video so as to accompany the movement of the attached part of the attached avatar object while they are displayed (duration described later). It may be displayed in. Such a method for generating a moving image including an animation in which a first gift or a second gift is attached to an attachment portion of an avatar object is described in the method described in Japanese Patent No. 6431233 and other well-known methods. Technology can be used.

(2) Display unit 110
The display unit 110 displays various information required for distribution and / or viewing of a video (including a video including an animation in which a first gift or a second gift is mounted on a mounting portion of an avatar object). Can be displayed. For example, the display unit 110 can display a delivered moving image, a received moving image, and / or a generated moving image. Further, the display unit 110 can also display various comments delivered from the server device 20 to each terminal device 10 together with the received moving image. Furthermore, the gift information stored in the gift storage unit 140 can be appropriately displayed according to the operation of the viewing user.

(3) Storage unit 120
The storage unit 120 stores various information required for distribution and / or viewing of a video (including a video including an animation in which a first gift or a second gift is mounted on a mounting portion of an avatar object). Can be remembered.

(4) User interface unit 130
The user interface unit 130 is required for various distribution and / or viewing of a video (including a video including an animation in which a first gift or a second gift is mounted on a mounting portion of an avatar object). Information can be entered via the operation of the distribution user or the viewing user. For example, the user interface unit 130 may operate the viewing user for giving a gift to the avatar object (select a predetermined gift from a plurality of first gifts prepared in advance and select a command to be given to the avatar object, or the like. Operation data indicating the contents of (including operation) can be input from the viewing user, and the operation data can be output to the communication unit 150. Here, the above-mentioned operation data can include, for example, information relating to what kind of gift (gift type) the viewing user has given to the distribution user.

Further, as another example, when one or more gifts are given by the viewing user, the user interface unit 130 gives a gift (first gift or second gift) corresponding to the gift as an avatar object. When the server device 20 receives an inquiry about mounting the object on the mounting portion, the distribution user can input the operation data related to the answer to the inquiry, and the operation data can be output to the communication unit 150.

(5) Gift storage unit 140
When the video distribution application and the video viewing application are installed on the terminal device 10, the gift storage unit 140 can store gift information preset in these applications. The gift information can include identification information such as the name, shape, and color of each gift, and the amount of each gift charged to the viewing user when the viewing user gives a gift.

(6) Communication unit 150
The communication unit 150 provides various information required for distribution and / or viewing of a video (including a video including an animation in which a first gift or a second gift is attached to the attachment site of the avatar object). , Can communicate with the server device 20. For example, when the terminal device 10 operates as the terminal device 10 of the distribution user, the communication unit 150 outputs a moving image including an animation in which the first gift or the second gift is attached to the attachment portion of the avatar object. The request information to be generated can be received from the server device 20 (information processing server device 20B), and the generated moving image can be transmitted to the server device 20 (distribution server device 20C). Similarly, when the terminal device 10 operates as the terminal device 10 of the distribution user and one or more gifts are given by the viewing user, the gift corresponding to the gift (first gift or The server device 20 receives an inquiry about attaching the second gift) to the attachment site of the avatar object, outputs the information of the inquiry to the display unit 110, and outputs the operation data related to the answer to the inquiry to the user interface. It is possible to receive from the face unit 130 and transmit the information related to the answer to the server device 20.

On the other hand, when the terminal device 10 operates as the terminal device 10 of the viewing user, the communication unit 150 can receive the moving image generated by the terminal device 10 of the distribution user from the server device 20. Similarly, when the terminal device 10 operates as the terminal device 10 of the viewing user, the information related to the gifting from the viewing user to the distribution user (avatar object) and the comment from the viewing user to the distribution user (avatar object). Information can be transmitted to the server device 20 (comment API server device 20D).

(7) Studio unit A studio unit (not shown) including the above-mentioned moving image generation unit 100, display unit 110, storage unit 120, user interface unit 130, gift storage unit 140, and communication unit 150 is used as the terminal device 10. You can also do it.

The studio unit can be mounted by an information processing device such as a personal computer, and like the terminal device 10 and the server device 20 described above, the studio unit is mainly composed of a central processing device, a main storage device, and an input / output interface. A device, an input device, an auxiliary storage device, and an output device can be included. These devices are connected to each other by a data bus and / or a control bus. In addition, the studio unit functions as an information processing device that executes a specific installed application, so that data and / or a distribution user regarding the operation of the distribution user in the studio room (not shown) in which the studio unit is installed is installed. It is possible to generate a video containing an animation of an avatar object based on the data related to the utterance and singing made by.

Most of the components of the moving image generation unit 100 included in the studio unit are arranged in the studio room. Further, in the studio room, the distribution user performs various performances, and the studio unit detects the movement, facial expression, utterance (including singing) of the distribution user.

The distribution user is targeted for capturing actions, facial expressions, utterances (including singing), and the like by various sensor groups included in the studio unit (moving image generation unit 100). In this case, the distribution user does not necessarily have to be a human being, and may be, for example, a robot capable of independent movement. Further, the number of distribution users in the studio room may be 1, or may be 2 or more.

The moving image generation unit 100 in the studio unit includes various motion sensors (not shown) mounted on the distribution user, a controller (not shown) held in the hands of the distribution user, and a mounting tool (not shown). It may have a camera (not shown) attached to the head of the distribution user via. Further, the studio unit is provided with a microphone at any of the above-mentioned wearing tools and the studio room (for example, a wall, a floor, a ceiling, etc.) in order to acquire voice data of a distribution user. Further, the studio unit can have a plurality of base stations (not shown), tracking sensors (not shown), and displays (not shown) in addition to the above configurations.

The motion sensor described above can detect the position and orientation of the distribution user in cooperation with the base station described above. In one embodiment, the plurality of base stations are multi-axis laser emitters, one base station scanning the laser light, for example, around a vertical axis, after emitting a flashing light for synchronization, the other base station. Is configured to scan the laser beam, for example, around a horizontal axis. The motion sensor is equipped with a plurality of optical sensors that detect the incident of blinking light and laser light from the base station, the time difference between the incident timing of the blinking light and the incident timing of the laser light, the light receiving time at each optical sensor, and each optical sensor. It is possible to detect the incident angle of the laser beam detected by. The motion sensor may be, for example, a Vive Tracker provided by HTC CORPORATION, or ZERO C SEVEN Inc. It may be Xsens MVN Analyze provided by.

The moving image generation unit 100 in the studio unit acquires the detection information indicating the position and orientation of each motion sensor calculated by the motion sensor. The motion sensor can detect the movement of the distribution user's body by detecting the position and orientation of the motion sensor by being attached to a portion such as the wrist, instep, waist, and top of the head of the distribution user.

In one embodiment, a large number of infrared LEDs are mounted on a plurality of motion sensors, and the light from the infrared LEDs is detected by an infrared camera provided on the floor or wall of the studio room, whereby the motion sensor is used. The position and orientation may be detected. Further, a visible light LED may be used instead of the infrared LED, and the position and orientation of the motion sensor may be detected by detecting the light from the visible light LED with a visible light camera.

In one embodiment, a plurality of reflection markers may be used instead of the motion sensor. The reflection marker is attached to the distribution user with an adhesive tape or the like. The distribution user to which the reflection marker is attached may be photographed to generate imaging data, and the imaging data may be image-processed to detect the position and orientation of the reflection marker.

The controller outputs a control signal according to the operation of the distribution user, and the moving image generation unit 100 acquires this.

The tracking sensor generates tracking information for determining the setting information of the virtual camera for constructing the virtual space included in the moving image. The tracking information is calculated as a position in a three-dimensional Cartesian coordinate system and an angle around each axis, and the moving image generation unit 100 acquires the tracking information.

The camera attached to the head of the distribution user is arranged so that the face of the distribution user can be imaged. The camera continuously captures the face of the distribution user to acquire imaging data of the face of the distribution user, and the moving image generation unit 100 acquires the imaging data from the camera. The camera may be a 3D camera capable of detecting the depth of the distribution user's face.

The display functions as a display unit 110, and is arranged at a position visible to the distribution user, and the distribution user can acquire various information and visually recognize the moving image generated by the moving image generation unit 100 through the display. It is possible.

In addition to the components described above, the studio unit also includes the storage unit 120, the user interface unit 130, the gift storage unit 140, and the communication unit 150 described above. Further, the components of the studio unit described above are examples, and may include various components that can be applied to others.

3-2. Function of Server Device 20 An example of the function of the server device 20 will be described with reference to FIGS. 4 to 7. FIG. 4 is a block diagram schematically showing an example of the function of the server device 20 shown in FIG. FIG. 5 is a diagram showing an example of a table managed by the database unit 230. 6A to 6D are diagrams showing an example of a table managed by the database unit 230, and is a diagram schematically showing an image when the determination unit 240 makes a determination. FIG. 7 is a diagram showing an example of a confirmation screen displayed on the display unit 110 of the terminal device 10 of the distribution user.

As shown in FIG. 4, the server device 20 can mainly include a storage unit 200, a communication unit 210, a gift processing unit 220, a database unit 230, a determination unit 240, and a comment processing unit 250.

(1) Storage unit 200
The storage unit 200 stores various information required for distribution and / or viewing of a video (including a video including an animation in which a first gift or a second gift is mounted on a mounting portion of an avatar object). Can be remembered.

(2) Communication unit 210
The communication unit 210 delivers various information required for distribution and / or viewing of a video (including a video including an animation in which a first gift or a second gift is attached to the attachment site of the avatar object). , Communication with the terminal device 10 of the distribution user and / or the terminal device 10 of the viewing user. For example, the communication unit 210 receives a video (including a video including an animation in which a first gift or a second gift is mounted on the mounting portion of the avatar object) from the terminal device 10 of the distribution user. It can be delivered to the terminal device 10 of the viewing user.

Further, the communication unit 210 receives information related to gifting from the viewing user to the distribution user (avatar object) and information related to comments from the viewing user to the distribution user (avatar object) from the viewing user's terminal device 10. Information related to gifting is output to the gift processing unit 220, and information related to comments is output to the comment processing unit 250.

Furthermore, the communication unit 210 transmits request information to generate a moving image including an animation in a state where the first gift or the second gift is attached to the attachment portion of the avatar object to the terminal device 10 of the distribution user. be able to.

Furthermore, when a plurality of gifts are given by the viewing user, and when the determination unit 240 described later determines that the combination of the first gifts satisfies a predetermined condition, the second gift is an avatar object. A request signal related to an inquiry (confirmation) for obtaining confirmation of the distribution user is transmitted to the distribution user's terminal device 10, and information related to an answer to the inquiry is transmitted from the distribution user's terminal device 10. You can also receive.

(3) Gift processing unit 220
When the gift processing unit 220 outputs information related to gifting (request signal related to gifting) from the communication unit 210, the gift processing unit 220 identifies the viewing user who has performed the gifting action (serialization of the terminal device 10 of each viewing user). Number, ID information given to each viewing user, etc.), gifted gift information (information on what kind of gift corresponds to which part of the avatar object is attached, and the name and shape of each gift. -Identification information such as color) and identification information of the distribution user who is the avatar object to be gifted (serial number of the terminal device 10 of the distribution user, ID information given to the distribution user, etc.) are at least read and read information. Is automatically stored in the database unit 230 or in response to an inquiry.

(4) Database unit 230
The database unit 230 can receive various information read by the gift processing unit 220 from the gift processing unit 220 automatically or by inquiring the gift processing unit 220 at predetermined time intervals. Further, as shown in FIG. 5, the database unit 230 has a table (reference table) for each distribution user, and various information received from the gift processing unit 220 is stored in each table of the corresponding distribution user. do.

Next, an example of the information stored in the table will be described with reference to FIG.

The database unit 230 has a table 500 for each distribution user, and each table 500 is provided with distribution user identification information 501 (for example, distribution user ID information). Further, the database unit 230 sequentially distributes the gift information gifted to the corresponding table according to the distribution user identification information 501 received from the gift processing unit 220 (in FIG. 5, the gifted order is taken as an example. However, for example, the order in which the first gift is attached to the avatar object may be used).

To explain in more detail, first, from the state where no gift is attached to the attachment part of the avatar object (initial state), the "red land cell", "diamond crown", and "silver fork" as shown in FIG. , "Golden Harrisen", "Golden Ring", and "White Sneakers", in that order, if one or more viewers perform the first gift gifting, the avatar object will be attached to the attachment site. Is attached to each first gift in that order (a video containing an animation in which the first gift is attached to the attachment site of the avatar object is generated). Therefore, the database unit 230 puts the "red school bag", "diamond crown", "silver fork", "golden harisen", "gold ring", and "white sneaker" in this order on the table 500. (Gifted order or fitted order) is stored in the box 502 of the "attached gift list". Although not shown in FIG. 5, information on the attachment part of the avatar object corresponding to each first gift (the attachment part of the avatar object corresponding to the "red school bag" is the "back") and each second. The identification information (for example, the ID information of the viewing user) of the viewing user who has given the gift of 1 may be stored (displayed) in the box 502 so as to correspond to each first gift.

Next, from the state where the above-mentioned six first gifts are attached to the attachment parts of the avatar object, the "diamond crown", "silver fork", "silver ring", and "copper knife" are further attached. , "Black Rucksack", "White Landsell", "Gold Fork", "Gold Glasses", and "Silver Spoon", in that order, gifting for the first gift from one or more viewers. Is executed. In this case, the above-mentioned six first gifts are already attached to the attachment portion of the avatar object corresponding to these gifts. In other words, "red school bag" for "back", "diamond crown" for "head", "silver fork" for "left hand", "golden harisen" for "right hand", and "fingers" "Golden ring" and "both legs" are equipped with "white sneakers". On the other hand, the corresponding mounting parts such as the "black rucksack" on the "back" and the "silver ring" on the "fingers" overlap. In such a case, the database unit 230 stores the first gifts, which are further gifted, in the box 503 of the "unmounted gift list" in the gifted order, at least temporarily. In this case, as in the box 502, the information related to the mounting portion of the corresponding avatar object and the identification information of the viewing user who gave each first gift are stored in the box 503 so as to correspond to each first gift. You may (display) it.

Based on the information stored as described above, the database unit 230 correlates the type of the first gift given to the attachment site of the avatar object with the number of gifts given for each type of the first gift. It can be said that I remember it. In other words, the database unit 230 manages (stores) how many first gifts of what type have been given to each mounting site using the table 500, and determines the information to be managed (stored). In response to the inquiry of the unit 240, the output is also output to the determination unit 240.

The first gift attached to the avatar object is automatically deleted from the video after a predetermined time (for example, 1 minute or 2 minutes) has elapsed from the time when it was attached to the avatar object. , A video distribution application and a video viewing application are preset. Therefore, if the "black rucksack" is gifted after a predetermined time has passed since the above-mentioned "red school bag" was attached to the avatar object, the "black rucksack" will be attached to the avatar object. (In this case, the database 230 will store the "black rucksack" in the box 502).

(5) Judgment unit 240
The determination unit 240 is a mounting portion of the avatar object when there are a plurality of gifting actions (including both a plurality of gifting actions by one viewing user and a plurality of gifting actions by a plurality of viewing users). On the other hand, it is determined whether or not to generate a moving image including an animation in a state where the second gift is attached, which has the same characteristics as the first gift. This determination is executed with reference to the table 500 managed by the database unit 230 (based on the information output from the database unit 230), and the combination of the plurality of first gifts is used for the video distribution application and the video viewing. It is determined by whether or not a predetermined condition preset in the application is satisfied.

An example of the determination will be described with reference to FIGS. 6A to 6D.

As described above with reference to FIG. 5, focusing on the "head" of the attachment parts of the avatar object, the "diamond crown" is already attached. In this state, if the "diamond crown" is further gifted, the first gift combination will be two identical "diamond crowns" (see FIG. 6A). Here, when at least one of the above-mentioned predetermined conditions is that two identical first gifts are aligned, it is satisfied that two "diamond crowns" are aligned. Such predetermined conditions can be arbitrarily set in advance in the video distribution application and the video viewing application. When the predetermined condition is satisfied in this way, the determination unit 240 includes an animation in which a second gift is attached to the "head" of the avatar object, which has the same characteristics as the first gift "diamond crown". Judge that a moving image is generated. The second gift in this case is one in which the size, color, and / or at least part of the shape of the first gift changes, for example, a "large diamond crown" or a "100 carat diamond tiara". Can be appropriately adopted.

Next, as described above with reference to FIG. 5, focusing on the "finger" among the attachment parts of the avatar object, the "gold ring" is already attached. In this state, if the "silver ring" is further gifted, the first gift combination is the "gold ring" and the "silver ring" (see FIG. 6B). Here, if at least one of the above-mentioned predetermined conditions is that two first gifts having different colors only are available, the combination satisfies the predetermined conditions. When the predetermined condition is satisfied in this way, the determination unit 240 has the same characteristics as the first gift "gold ring", such as the "diamond ring", as in the case described with reference to FIG. 6A. It is determined that a moving image including an animation with the gift of 2 attached is generated.

Next, as described above with reference to FIG. 5, focusing on the "back" of the attachment parts of the avatar object, the "red school bag" is already attached. In this state, when the "black rucksack" and the "white school bag" are further gifted, the first gift combination is a combination of "red school bag", "black rucksack" and "white school bag". (See FIG. 6C). Here, if at least one of the above-mentioned predetermined conditions is that three first gifts are arranged for the "back", the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 is in a state in which the second gift having the same characteristics as the first gift "red school bag" is attached, as in the case described with reference to FIG. 6A. It is determined that a moving image containing the animation of is generated. As a second gift in this case, for example, a "big wing" or the like is set. As described above, the second gift may have the same characteristics as the first gift only by having the first gift and the second gift wearing parts in common. In addition, the second gift is the same color as the first gift, the same size, the same kind of goods (the same kind), etc., so that the second gift is the same as the first gift. It can be said that they have common characteristics.

Next, as described above with reference to FIG. 5, focusing on the "left hand" of the attachment parts of the avatar object, the "silver fork" is already attached. In this state, if the "silver fork", "copper knife", "gold fork", and "silver spoon" are further gifted, the first gift combination is two "silver forks". , "Copper knife", "Gold fork" and "Silver spoon", for a total of five combinations (see Figure 6D). Here, if at least one of the above-mentioned predetermined conditions is that the colors of gold, silver, and copper are aligned and the knife, fork, and spoon are aligned in the "left hand", the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 is equipped with a second gift having the same characteristics as the first gift "silver fork", as in the case described with reference to FIG. 6A. It is determined that a moving image including a state animation is generated. As the second gift in this case, for example, a "rainbow-colored large fork" or the like is set.

As in the above example, the above-mentioned predetermined conditions can be set in any way. If the predetermined conditions are simple (for example, the example described with reference to FIGS. 6A and 6B), many kinds of second gifts can be made to appear, and thus the viewing user's willingness to give gifts. Can be stimulated. On the other hand, even if the predetermined conditions are difficult (for example, the example described with reference to FIG. 6D), what kind of first gift should be combined to make the second gift appear for the viewing user? Interest and curiosity are aroused. Therefore, the gifting opportunity by the viewing user increases.

By the way, when the combination of the plurality of first gifts does not satisfy the predetermined condition, the determination unit 240 determines the necessary conditions necessary for the combination to satisfy the predetermined condition (the gift necessary for satisfying the predetermined condition). Types, numbers, etc.) can be calculated. The determination unit 240 compares the set predetermined condition with the combination of the plurality of first gifts, and what first gift needs to be additionally gifted in order to satisfy the predetermined condition. Calculate the condition that there is. The calculated necessary conditions are output to the comment processing unit 250. Here, a specific example of the necessary conditions will be described. For example, in the above-mentioned case described with reference to FIG. 6C, if the predetermined condition is "the three first gifts are aligned with respect to the back" as described above, the viewing user asks for a "red school bag" (wearing). If only "Done" and "Black Rucksack" are gifted, the requirement is "one first gift corresponding to the back of the avatar object". In the case of such a necessary condition, the comment processing unit 250 synthesizes comment information such as "If there is one more gift to be attached to the back, the gift will change" (displayed on the video). It is transmitted to the terminal device 10 of the distribution user. Further, in the above-mentioned case described with reference to FIG. 6D, it is assumed that the predetermined condition is "the colors of gold, silver, and copper are aligned and the knife, fork, and spoon are aligned with respect to the left hand" as described above. , If only "Silver Fork" (installed), "Gold Fork", and "Silver Poon" are given by the viewer, the requirement is "Copper knife corresponding to the left hand of the avatar object". Will be. In the case of such a necessary condition, comment information such as "Copper knife gifting is being recruited !!" is synthesized from the comment processing unit 250 into the video (combined on the video) of the distribution user. It is transmitted to the terminal device 10.

Further, when the determination unit 240 determines that the combination of the first gifts satisfies a predetermined condition, the determination unit 240 attaches the second gift to the attachment portion of the avatar object (the second gift is attached to the attachment portion of the avatar object). It is possible to output to the communication unit 210 a request signal relating to an inquiry for obtaining confirmation of the distribution user regarding (generating a moving image including the animation). The communication unit 210 transmits the request signal to the distribution user (distribution user's terminal device 10), and receives information related to the answer to the inquiry from the distribution user's terminal device 10. In this case, specifically, the screen 600 as shown in FIG. 7 is displayed on the display unit 110 of the terminal device 10 of the distribution user. In addition, "Do you want to synthesize?" In FIG. 7 can be replaced with the phrase "Do you want to attach the second gift to the avatar object?". In this way, if the distribution user agrees to attach the second gift to the avatar object (when the distribution user selects "Yes" in FIG. 7), the avatar object to which the second gift is attached is attached. Even if the viewing user further gives a gift to the wearing part of the avatar, for a certain period of time (duration described later), for example, in order to notify the viewing user that the gifting is not reflected in the avatar object, for example, "composite already". The determination unit 240 may instruct the comment processing unit 250 to send comment information such as "I can't do it" or "Already wearing the second gift !!" to the terminal device 10 of the distribution user. ..

For the second gift attached to the avatar object, there is a second gift in the video that contains the animation with the second gift attached to the attachment site of the avatar object. ) The duration (for example, 1 minute or 2 minutes) is preset, and when the duration elapses, the second gift is deleted from the video in the video distribution application and the video viewing application. It is set. The duration of the second gift may start from the time when the second gift is attached to the attachment site of the avatar object, or the time of the last gifting performed by the viewing user to meet a predetermined condition. The starting point may be (when a predetermined condition is satisfied). In addition, in order to induce gifting by the viewing user immediately after the second gift is deleted from the video, for example, "the second gift disappears" immediately before the second gift is deleted from the video. The determination unit 240 may instruct the comment processing unit 250 to send comment information such as "A new gifting recruitment !!" to the terminal device 10 of the distribution user.

(6) Comment processing unit 250
The comment processing unit 250 can receive comment information from the viewing user to the distribution user (avatar object) from the viewing user's terminal device 10 via the communication unit 210, and the comment information from the viewing user is the same. It can be distributed to each viewing user who is watching the video.

Further, the comment processing unit 250 refers to the table 500 managed by the database unit 230, and corresponds to all or part of the information regarding which viewing user has given what gift to the attachment site of the avatar object. It is also possible to create comment information to be distributed and distribute the comment information to each viewing user who is viewing the same video.

Furthermore, the comment processing unit 250 refers to the table 500 managed by the database unit 230 to the effect that the first gift and / or the second gift has been given to the attachment site of the avatar object and / Alternatively, it is also possible to create comment information indicating that the video is attached and distribute the comment information to each viewing user who is viewing the same moving image.

Furthermore, the comment processing unit 250 creates comment information corresponding to the above-mentioned necessary conditions calculated by the determination unit, and distributes the comment information to each viewing user who is watching the same video. You can also.

4. Overall Operation of the Video Distribution System 1 Next, the overall operation performed in the video distribution system 1 having the above configuration will be described with reference to FIGS. 8 to 11. FIG. 8 is a flow chart showing an example of the operation performed in the moving image distribution system 1 shown in FIG. FIG. 9 is a diagram showing an example of a moving image including an animation of an avatar object of a distribution user. FIG. 10 is a diagram showing an example of a moving image including an animation in which a first gift is attached to a attachment portion of an avatar object of a distribution user. FIG. 11 is a diagram schematically showing an example of an image in which a second gift is attached in place of the first gift at the attachment site of the avatar object of the distribution user.

First, in step (hereinafter referred to as “ST”) 300, the terminal device 10 (here, the terminal device 10A) activates and executes the video distribution application according to the operation of the distribution user (here, the distribution user A).

Next, in ST301, the terminal device 10A generates a moving image including an animation of the avatar object of the distribution user A based on the data regarding the operation of the distribution user A and / or the voice data regarding the utterance or singing uttered by the distribution user. .. As a result, as illustrated in FIG. 9, the display unit 110 of the terminal device 10A displays the moving image 401 including the animation of the avatar object 400 of the distribution user A.

Further, the terminal device 10A transmits the generated moving image 401 to the distribution server device 20C of the server device 20. The distribution server device 20C distributes the moving image received from the terminal device 10A to the terminal device 10 of each viewing user who is executing the video viewing application. As a result, the moving image 401 as illustrated in FIG. 9 is also displayed on the display unit 110 of the terminal device 10 of each viewing user.

Next, in ST 302, the viewing user's terminal device 10 grants the first gift to the distribution user A (the attachment portion of the avatar object 400) based on the viewing user's operation on the user interface unit 130. Is transmitted to the server device 20 (gift API server device 20A).

Next, in ST 303, the server device 20 (gift API server device 20A) that has received the request signal related to the first gift from the viewing user's terminal device 10 has the identification information and gifting of the viewing user to which the gifting action has been performed. At least the information related to the gift and the identification information of the distribution user who is the avatar object to be given are read out. Then, the various information read out is stored in the table in the information processing server device 20B in the server device 20.

Next, at ST304, the server device 20 (information processing server device 20B) has already received the first gift at each mounting portion of the avatar object 400 of the distribution user A at the time when the information is stored in the table at ST303. Check if it is installed. In ST304, the attachment portion of the avatar object 400 given the gifting by the viewing user is, for example, the "head", and when the information related to the gifting is stored in the table in the ST303, the first "head" is used. If the gift is not attached, the server device 20 (information processing server device 20B) gives a gift from the viewing user to the "head" of the avatar object 400 in order to proceed to ST310 after determining "NO" in ST304. Information requesting the generation of the moving image including the animation with the first gift (for example, "crown of diamond") attached is transmitted to the terminal device 10A of the distribution user A.

On the other hand, in ST304, the attachment portion of the avatar object 400 given gifting by the viewing user is, for example, the "head", and when the information related to the gifting is stored in the table in ST303, the "head" is used. If the "crown of diamonds" is already attached, the server device 20 (information processing server device 20B) is a request signal to give the first gift ("crown of diamonds") to the "head". After understanding that there are a plurality of such items and determining "YES" in ST304, the determination related to the first gift combination is executed in ST320, which will be described later.

Next, as a result of the server device 20 determining "NO" in ST304 as described above, the terminal device 10A of the distribution user A is viewed from the server device 20 (information processing server device 20B) to the "head" of the avatar object 400. Upon receiving information from the user requesting that a video containing an animation with a gifted first gift (eg, a "diamond crown") be generated, the terminal device 10A delivers the video at ST310. Generate. As a result, as illustrated in FIG. 10, an animation in which a first gift 410, which is a “diamond crown”, is attached to the “head” of the avatar object 400 of the distribution user A on the display unit 110 of the terminal device 10A. The moving image 402 including is displayed. Note that the moving image 402 in FIG. 10 shows an example in which the first gift 420, which is a “silver fork”, is attached to the “left hand” of the avatar object 400 in the same step.

Further, the terminal device 10A transmits the generated moving image 402 to the distribution server device 20C of the server device 20. The distribution server device 20C distributes the moving image received from the terminal device 10A in ST311 to the terminal device 10 of each viewing user who is executing the video viewing application. As a result, the moving image 402 as illustrated in FIG. 10 is also displayed on the display unit 110 of the terminal device 10 of each viewing user, and the step when the server device is determined to be "NO" in ST 304 is completed.

On the other hand, if the server device 20 determines "YES" in ST 304 as described above, the determination unit 240 determines whether or not the first gift combination satisfies a predetermined condition. When the combination of the first gifts satisfies a predetermined condition (when "YES" in ST320), the server device 20 (determination unit 240 of the information processing server device 20B) is set to ST321 with respect to the distribution user A. Information relating to an inquiry (confirmation) as to whether or not the second gift may be attached to the avatar object 400 is transmitted to the terminal device 10A of the distribution user A. In response to this inquiry, when a reply to the effect that the distribution user A is OK is transmitted from the terminal device 10A of the distribution user A to the server device 20, the server device 20 (information processing device 20B) causes the attachment portion of the avatar object 400 (the attachment site (information processing device 20B)). For example, information requesting the generation of a moving image including an animation in which a second gift (for example, a “100 carat diamond tiara”) is attached to the “head”) is transmitted to the terminal device 10A of the distribution user A. By the way, to supplement the specific example of the second gift with reference to FIG. 11, for example, when the first gift 420, which is a "silver fork", is attached to the "left hand" of the avatar object 400, a predetermined condition is given. When is satisfied, a second gift 420Z called a "big rainbow-colored fork" is generated (synthesized). In this case, the first gift 420 and the second gift 420Z not only have the same mounting portion of the corresponding avatar object 400, but also have a common shape, which is one of the features. As described above, the first gift 420 and the second gift 420Z have some common characteristics.

Next, in ST322, the terminal device 10A of the distribution user A receives a second gift (for example, "100 carat diamond tiara" from the server device 20 (information processing server device 20B) to the "head" of the avatar object 400. ) Is attached, the terminal device 10A generates the moving image (not shown) upon receiving the information requesting that the moving image including the animation is generated.

Further, the terminal device 10A transmits the generated moving image to the distribution server device 20C of the server device 20. The distribution server device 20C distributes the moving image received from the terminal device 10A to the terminal device 10 of each viewing user who is executing the video viewing application in ST323. As a result, the same moving image is displayed on the display unit 110 of the terminal device 10 of each viewing user, and it is determined that the server device is "YES" in ST304 and "YES" in ST320. If so, the step ends.

In ST320, when the combination of the first gifts does not satisfy the predetermined condition (when "NO" in ST320), the server device 20 (determination unit 240 of the information processing server device 20B) is the same in ST330. Calculate the necessary conditions for the combination to satisfy the predetermined conditions (type and number of gifts required to satisfy the predetermined conditions, etc.). Further, the calculated necessary conditions are converted into comment information and distributed to the terminal device 10 of each viewing user via the comment processing unit 250. As a result, the same comment information is displayed on the display unit 110 of the terminal device 10 of each viewing user. In this way, the step when it is determined as "NO" in ST320 is completed.

The above steps are executed every time the viewing user performs a gifting action. Therefore, for any gifting action, a moving image including an animation in which the first gift or the second gift is attached can be generated and distributed in a timely manner at each attachment portion of the avatar object 400.

5. Modification Example In the above-described embodiment, the generation of the moving image (including the moving image including the animation including the animation in which the first gift or the second gift is attached to the attachment portion of the avatar object) is generated by the terminal device 10 of the distribution user. However, in another embodiment, it may be executed by, for example, the server device 20 or the terminal device 10 of the viewing user. Further, each of the distribution user's terminal device 10, the server device 20, and the viewing user's terminal device 10 may generate a part of the moving image to generate the final moving image, or a device other than these devices. May also generate part of the video. Further, in another embodiment described above, the server device 20 and / or the viewing user's terminal device 10 is provided with a rendering unit (not shown), and the distribution user's terminal device 10 is the server device 20 and / or. For example, first, the terminal device 10 of the viewing user can generate a moving image (including a moving image including an animation in which a first gift or a second gift is attached to the attachment portion of the avatar object). In addition to the information related to the gift and the information related to the second gift, only the data related to the operation of the distribution user and / or the data related to the speech and singing uttered by the distribution user are generated, and these data are used as the server device 20. And / or may be configured to transmit to the terminal device 10 of the viewing user.

In order to realize such a configuration, another embodiment is adopted in which the functions of the server device 20, the viewing user's terminal device 10, and the distribution user's terminal device 10 are appropriately modified from the above-described one embodiment. sell. For example, although the moving image generation unit 100 is provided in the terminal device 10 in one embodiment, it may be provided in the server device 20, the terminal device 10 or the terminal device 10 of the viewing user.

Further, in the above-described embodiment, the information processing server in the server device 20 determines whether or not the first gift combination satisfies a predetermined condition by referring to the table 500 for storing gift information and the table 500. It was executed by the device 20B, but in another embodiment, it may be executed by the terminal device 10 of the distribution user. Along with this, the determination unit 240 is provided in the server device 20 in the above-described embodiment, but may be provided in the terminal device 10 of the distribution user.

Furthermore, in the above-mentioned embodiment, the combination is based on the combination of the first gift given to each mounting part of the avatar object (for example, the combination of the first gift given to the "head"). However, in another embodiment, the combination is determined based on, for example, a combination of a plurality of first gifts given to a plurality of attachment sites of the avatar object. It may be determined whether or not the condition is satisfied. Specifically, a combination of the first gift given to the "head" of the avatar object and the first gift given to the "neck", or the first gift given to the "left hand" of the avatar object. , The first gift given to the "right hand", the first gift given to the "left foot", and the first gift given to the "right foot" may be a combination.

Furthermore, the predetermined conditions described above may be set to change every predetermined time (for example, every day, every week, every month) in another embodiment.

Furthermore, as described with reference to FIG. 11 in one embodiment described above, the second gift is set so that a predetermined gift is synthesized according to a preset combination of the first gifts. However, in another embodiment, a plurality of types of second gifts are set to be synthesized according to a preset combination of first gifts, and the plurality of types of second gifts are combined. A second gift determined by the delivery user's choice from the gift may be set to be attached to the avatar object.

Therefore, according to various embodiments, it is possible to provide a moving image processing method, a server device, and a computer program that increase the gifting opportunity by the viewing user.

6. Various Aspects The moving image processing method according to the first aspect is "a moving image processing method executed by one or a plurality of processors that execute a computer-readable instruction, and includes an animation of an avatar object of a distribution user. A request signal generated based on the operation of the viewing user who watches the video and requesting that the first gift be given to the wearing portion of the avatar object is transmitted from the viewing user's terminal device via a communication line. When it is determined that the combination of the receiving step to be received and the plurality of the first gifts given to the wearing portion of the avatar object based on the plurality of request signals satisfies a predetermined condition, the said A generation step of generating the moving image including an animation in which a second gift having the same characteristics as the first gift is attached to the attachment portion of the avatar object is included. "

The moving image processing method according to the second aspect is the one in which "the animation is generated based on the action of the distribution user" in the first aspect.

The moving image processing method according to the third aspect is described in the first aspect or the second aspect, "the second gift is the size, color, and / or at least a part of the first gift. The shape changes. "

The moving image processing method according to the fourth aspect is described in any one of the first to third aspects, "when a combination of a plurality of the first gifts does not satisfy a predetermined condition, the combination is the predetermined combination. It further includes a step of transmitting comment information indicating a necessary condition for satisfying the condition to the terminal devices of a plurality of viewing users. "

The moving image processing method according to the fifth aspect is the above-mentioned avatar object in any one of the above-mentioned first aspect to the above-mentioned fourth aspect, "in response to the request signal received from the terminal device of a certain viewing user. Terminals of a plurality of viewing users that indicate that the first gift has been given to the wearing portion and / or that the first gift has been attached to the wearing portion of the avatar object. It further includes the step of transmitting to the device. "

The moving image processing method according to the sixth aspect is described in any one of the first to fifth aspects, "a determination as to whether or not the combination satisfies the predetermined condition is made on the mounting portion of the avatar object. It is performed based on a reference table that stores the type of the first gift given to the gift and the number of gifts given for each type of the first gift in association with each other. "

The moving image processing method according to the seventh aspect is described in any one of the first to sixth aspects, "when the combination satisfies the predetermined condition, the moving image is for the second gift. It further comprises the step of setting a duration and erasing the second gift from the moving image when the duration has elapsed. "

The moving image processing method according to the eighth aspect is described in any one of the first to seventh aspects, "the receiving step and the generating step are the terminal device of the viewing user and / or the terminal of the distribution user. It is executed by a server device connected to the device via a communication line. "

The moving image processing method according to the ninth aspect is the one in which "it is determined by the server device that the combination satisfies the predetermined condition" in the eighth aspect.

The moving image processing method according to the tenth aspect is the one in which "the generation step is executed by the terminal device of the distribution user" in any one of the first aspect to the seventh aspect.

The moving image processing method according to the eleventh aspect is the one in the tenth aspect, "it is determined by the server device or the terminal device of the distribution user that the combination satisfies the predetermined condition".

The moving image processing method according to the twelfth aspect is one in which "the generation step is executed by the terminal device of the viewing user" in any one of the first aspect to the seventh aspect.

The moving image processing method according to the thirteenth aspect is the one in the twelfth aspect, "it is determined by the server device or the terminal device of the distribution user that the combination satisfies the predetermined condition".

The moving image processing method according to the fourteenth aspect is described in any one of the first to thirteenth aspects, wherein the mounting portion of the avatar object is separated from a part of the avatar object and / or the avatar object. It's in the part. "

The moving image processing method according to the fifteenth aspect is "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)" in any one of the first to the fourteenth aspects. It is a thing.

The moving image processing method according to the sixteenth aspect is that "the communication line includes the Internet" in any one of the first aspect to the fifteenth aspect.

The server device according to the seventeenth aspect is "equipped with one or a plurality of processors, the processor being generated based on the operation of a viewing user who watches a moving image including an animation of an avatar object of a distribution user, and the avatar object. A request signal requesting that the first gift is given to the wearing portion of the avatar object is received from the terminal device of the viewing user via a communication line, and the mounting of the avatar object is based on the plurality of request signals. When it is determined that the combination of the plurality of first gifts given to the parts satisfies a predetermined condition, the second wearing part of the avatar object has the same characteristics as the first gift. Generates the video containing the animation with the gift attached. "

The server device according to the eighteenth aspect is "equipped with one or more processors, the processor being generated based on the operation of a viewing user who watches a moving image including an animation of an avatar object of a distribution user, said avatar object. A request signal requesting that the first gift is given to the wearing portion of the avatar object is received from the terminal device of the viewing user via a communication line, and the mounting of the avatar object is based on the plurality of request signals. When it is determined that the combination of the plurality of first gifts given to the parts satisfies a predetermined condition, the second wearing part of the avatar object has the same characteristics as the first gift. The information related to the gift is transmitted to the terminal device of the viewing user or the terminal device of the distribution user who generates the moving image including the animation in which the second gift is attached. "

The server device according to the nineteenth aspect is the one in the seventeenth aspect or the eighteenth aspect, wherein the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU). ..

The server device according to the twentieth aspect is one in which "the communication line includes the Internet" in any one of the 17th aspect to the 19th aspect.

The computer program according to the twenty-first aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or a plurality of processors, and the avatar object of the distribution user. A request signal requesting that the first gift be given to the wearing portion is received from the terminal device of the viewing user via a communication line, and the wearing portion of the avatar object is based on the plurality of request signals. When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies a predetermined condition, the second attachment portion of the avatar object has the same characteristics as the first gift. The processor is made to function to generate the moving object including the animation with the gift attached. "

The computer program according to the 22nd aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or a plurality of processors, and the avatar object of the distribution user. A request signal requesting that the first gift is given to the wearing portion is received from the terminal device of the viewing user via a communication line, and the wearing portion of the avatar object is based on the plurality of request signals. When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies a predetermined condition, the second attachment portion of the avatar object has the same characteristics as the first gift. The processor is made to function so as to transmit information relating to the gift to the terminal device or server device of the viewing user who generates the moving image including the animation in which the second gift is attached. "

The computer program according to the 23rd aspect is "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)" in the 21st aspect or the 22nd aspect. ..

The computer program according to the 24th aspect is "the communication line includes the Internet" in any one of the 21st aspect to the 23rd aspect.

The computer program according to the 25th aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or a plurality of processors, and the avatar object of the distribution user. A plurality of request signals requesting that the first gift be given to the wearing part are transmitted via a communication line, and a plurality of request signals given to the wearing part of the avatar object based on the plurality of request signals. When it is determined that the combination of the first gifts of the above satisfies a predetermined condition, an animation in which a second gift having the same characteristics as the first gift is attached to the attachment portion of the avatar object is performed. In order to generate the moving object including the moving object, the processor is made to function so as to receive the information relating to the second gift from the terminal device or the server device of the distribution user. "

The computer program according to the 26th aspect is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user by being executed by one or a plurality of processors, and the avatar object of the distribution user. A plurality of request signals requesting that the first gift be given to the wearing part are transmitted via a communication line, and a plurality of request signals given to the wearing part of the avatar object based on the plurality of request signals. When it is determined that the combination of the first gifts of the above satisfies a predetermined condition, an animation in which a second gift having the same characteristics as the first gift is attached to the attachment portion of the avatar object is performed. The processor is made to function so as to receive the moving image including the moving object from the terminal device or the server device of the distribution user. "

The computer program according to the 27th aspect is that in the 25th aspect or the 26th aspect, "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)". ..

The computer program according to the 28th aspect is "the communication line includes the Internet" in any one of the 25th aspect to the 27th aspect.

7. Fields to which the technology disclosed in the present application applies The technology disclosed in the present application can be applied, for example, in the following fields.
(1) Application service that delivers live videos in which avatar objects appear (2) Application services that can communicate using characters and avatar objects (chat applications, messengers, mail applications, etc.)

1 Video distribution system 10 (10A-10D) Terminal device 20 Server device 20A Gift API server device 20B Information processing server device 20C Distribution server device 20D Comment API server device 100 Video generation unit 220 Gift processing unit 230 Database unit 240 Judgment unit 250 Comment Processing unit
400 Avatar Object 401, 402 Video 410, 420 First Gift 420Z Second Gift 500 Table

Claims (31)

A video processing method performed by one or more processors that execute computer-readable instructions.
The terminal device of the viewing user is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user, and requests the viewing user to give the first gift to the avatar object. The receiving process of receiving from the communication line and
When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies the predetermined condition based on the plurality of request signals, the avatar object is common with the first gift. A generation step of generating the video, including an animation fitted with a second gift with the characteristics of
Video processing methods including. The moving image processing method according to claim 1, wherein the combination is a combination of a plurality of the first gifts given to a plurality of wearing parts of the avatar object. The moving image processing method according to claim 1 or 2, wherein the predetermined condition is set so as to change every predetermined time. When it is determined that the combination satisfies the predetermined condition, a plurality of types of the second gifts are combined, and the selection of the distribution user among the plurality of types of the second gifts is determined. The moving image processing method according to any one of claims 1 to 3, wherein the moving image including the animation to which a kind of the second gift is attached is generated in the generation step. The moving image processing method according to any one of claims 1 to 4, wherein the animation is generated based on the operation of the distribution user. The moving image according to any one of claims 1 to 5, wherein the second gift changes the size, color, and / or shape of at least a part of the first gift. Processing method. When the combination of the plurality of first gifts does not satisfy the predetermined condition, a step of transmitting comment information indicating the necessary conditions for the combination to satisfy the predetermined condition to the terminal devices of the plurality of viewing users is further added. The moving image processing method according to any one of claims 1 to 6, which includes. In response to the request signal received from the terminal device of a viewing user, the first gift is given to the avatar object and / or the first gift is given to the avatar object. The moving image processing method according to any one of claims 1 to 7, further comprising a step of transmitting comment information indicating that the device is attached to terminal devices of a plurality of viewing users. The determination as to whether or not the combination satisfies the predetermined condition is stored in association with the type of the first gift given to the avatar object and the number of gifts given for each type of the first gift. The moving image processing method according to any one of claims 1 to 8, which is performed based on the reference table. When the combination satisfies the predetermined condition, the duration of the second gift is set in the moving image, and when the duration elapses, the second gift is deleted from the moving image. The moving image processing method according to any one of claims 1 to 9, further comprising an erasing step. One of claims 1 to 10, wherein the receiving step and the generating step are executed by a server device connected to the viewing user's terminal device and / or the distribution user's terminal device via a communication line. The video processing method described in item 1. The moving image processing method according to claim 11, wherein it is determined by the server device that the combination satisfies the predetermined conditions. The moving image processing method according to any one of claims 1 to 10, wherein the generation step is executed by the terminal device of the distribution user. It is determined by the server device connected to the viewing user's terminal device and / or the distribution user's terminal device via a communication line, or the distribution user's terminal device that the combination satisfies the predetermined condition. , The moving image processing method according to claim 13. The receiving step is executed by the server device connected to the viewing user's terminal device and / or the distribution user's terminal device via a communication line, or the distribution user's terminal device.
It is determined by the server device or the terminal device of the distribution user that the combination satisfies the predetermined condition.
The method according to any one of claims 1 to 10, wherein in the generation step, the generation of the moving image including the animation to which the second gift is attached is executed by the terminal device of the viewing user. Video processing method. The fifteenth aspect of claim 15, wherein when the server device or the terminal device of the distribution user determines that the combination satisfies the predetermined condition, the information relating to the second gift is transmitted to the terminal device of the viewing user. Video processing method. The moving image processing method according to claim 2, wherein the mounting portion of the avatar object is located in a part of the avatar object and / or a portion away from the avatar object. The moving image processing method according to any one of claims 1 to 17, wherein the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU). The moving image processing method according to any one of claims 1 to 18, wherein the communication line includes the Internet. Equipped with one or more processors,
The processor
The terminal device of the viewing user is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user, and requests the viewing user to give the first gift to the avatar object. Received from via a communication line,
When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies the predetermined condition based on the plurality of request signals, the avatar object is common with the first gift. A server device that produces the video containing an animation fitted with a second gift that has the characteristics of Equipped with one or more processors,
The processor
The terminal device of the viewing user is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user, and requests the viewing user to give the first gift to the avatar object. Received from via a communication line,
When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies the predetermined condition based on the plurality of request signals, the avatar object is common with the first gift. A server device that transmits information relating to a second gift having the characteristics of the second gift to the terminal device of the viewing user or the terminal device of the distribution user that generates the moving image including the animation to which the second gift is attached. The server device according to claim 20 or 21, wherein the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU). The server device according to any one of claims 20 to 22, wherein the communication line includes the Internet. By being run on one or more processors
The terminal device of the viewing user is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user, and requests the viewing user to give the first gift to the avatar object. Received from via a communication line,
When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies the predetermined condition based on the plurality of request signals, the avatar object is common with the first gift. Generate the video containing an animation fitted with a second gift with the characteristics of
A computer program that causes the processor to function. By being run on one or more processors
The terminal device of the viewing user is generated based on the operation of the viewing user who watches the video including the animation of the avatar object of the distribution user, and requests the viewing user to give the first gift to the avatar object. Received from via a communication line,
When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies the predetermined condition based on the plurality of request signals, the avatar object is common with the first gift. Information relating to the second gift having the characteristics of the second gift is transmitted to the terminal device or server device of the viewing user who generates the moving image including the animation to which the second gift is attached.
A computer program that causes the processor to function. 25. The computer program of claim 24 or 25, wherein the processor is a central processing unit (CPU), microprocessor or graphics processing unit (GPU). The computer program according to any one of claims 24 to 26, wherein the communication line includes the Internet. By being run on one or more processors
A request signal generated based on the operation of the viewing user who watches the video including the animation of the distribution user's avatar object and requesting that the first gift be given to the avatar object is transmitted via the communication line. death,
When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies the predetermined condition based on the plurality of request signals, the avatar object is common with the first gift. In order to generate the moving image including the animation in which the second gift is attached, the information relating to the second gift is received from the terminal device or the server device of the distribution user.
A computer program that causes the processor to function. By being run on one or more processors
A request signal generated based on the operation of the viewing user who watches the video including the animation of the distribution user's avatar object and requesting that the first gift be given to the avatar object is transmitted via the communication line. death,
When it is determined that the combination of the plurality of first gifts given to the avatar object satisfies the predetermined condition based on the plurality of request signals, the avatar object is common with the first gift. The video including the animation with the second gift attached is received from the terminal device or the server device of the distribution user.
A computer program that causes the processor to function. 28. The computer program of claim 29, wherein the processor is a central processing unit (CPU), microprocessor or graphics processing unit (GPU). The computer program according to any one of claims 28 to 30, wherein the communication line includes the Internet.

Images