JP7244450B2 - Computer program, server device, terminal device, and method - Google Patents

Description

The technology disclosed in the present application relates to computer programs, server devices, terminal devices and methods.

In recent years, there are games, animations, moving images, etc. in which a distributor acts as an avatar object in a virtual space. In such a virtual space, an avatar object played by a distributor is distributed as a video in the virtual space.

JP 2018-74294 A JP 2019-37549 A Japanese Patent Application Laid-Open No. 2002-271693 Japanese Patent No. 6543403

The technique described in Patent Literature 1 synthesizes a background and a 3DCG space image. Also, the technique described in Patent Document 2 allows the player and the participants to interact with each other. Further, the technique described in Patent Document 3 combines a photographed image and a virtual image. Also, the technique described in Patent Document 4 relates to moving image distribution.

The entirety of Patent Literatures 1 to 4 is incorporated herein by reference.

Some embodiments disclosed in the present application provide a computer program, a server device, a terminal device, and a method capable of reproducing a performance of an avatar object played by a distributor that has been distributed in the past.

A computer program according to one aspect, when executed by one or more processors,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information relating to a second gift different from the information relating to the first gift;
receive the
generating a first animation using information necessary for generating the first animation;
and displaying the first animation.

Also, a computer program according to another aspect is executed by one or more processors,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
It is a thing that transmits sounds and , which were delivered in the past.

Also, a computer program according to another aspect is executed by one or more processors,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information relating to a second gift different from the information relating to the first gift;
is a thing that sends a

A server device according to one aspect comprises one or more processors, and the one or more processors execute computer-readable instructions to:
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information relating to a second gift different from the information relating to the first gift;
is a thing that sends a

Also, according to one aspect, a method is performed by one or more processors executing computer readable instructions, the one or more processors executing the instructions to:
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information relating to a second gift different from the information relating to the first gift;
receive the
generating a first animation using information necessary for generating the first animation;
and displaying the first animation.

According to another aspect, a method is performed by one or more processors executing computer-readable instructions, the one or more processors executing the instructions to:
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information relating to a second gift different from the information relating to the first gift;
is to be sent.

According to another aspect, a method is performed by one or more processors executing computer-readable instructions, the one or more processors executing the instructions to:
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
is a thing that sends a

A terminal device according to one aspect comprises one or more processors, and the one or more processors execute computer-readable instructions to:
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information relating to a second gift different from the information relating to the first gift;
receive the
generating a first animation using information necessary for generating the first animation;
and displaying the first animation.

A terminal device according to another aspect comprises one or more processors, and the one or more processors execute computer-readable instructions,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
is a thing that sends a

FIG. 1 is a block diagram showing an example of the configuration of a system according to one embodiment. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the server device 20 (terminal device 30) shown in FIG. FIG. 3 is a block diagram that schematically shows an example of the functions of the system according to one embodiment. FIG. 4 is an example of data possessed by the system according to one embodiment. FIG. 5 is an example of data possessed by the system according to one embodiment. FIG. 6 is an example of data possessed by the system according to one embodiment. FIG. 7 is an example of statistical information that may be displayed by the system according to one embodiment. FIG. 8 is an example of statistical information that may be displayed by the system according to one embodiment. FIG. 9 is a block diagram showing an example of the system configuration according to one embodiment. FIG. 10 is an example of a flow processed by a system according to one embodiment. FIG. 11 is an example of a flow processed by a system according to one embodiment. FIG. 12 is an example of a flow processed by a system according to one embodiment.

Various embodiments of the present invention will now be described with reference to the accompanying drawings. Note that components depicted in one drawing may be omitted in another drawing for convenience of explanation. Furthermore, it should be noted that the attached drawings, while disclosing one embodiment of the present invention, are not necessarily drawn to scale. Also, in this document, the object indicated by the term application may be referred to as software or a program, and may be instructions to a computer that are combined so as to obtain a result.

1. System Example FIG. 1 is a block diagram showing an example of a system configuration according to an embodiment. As shown in FIG. 1 , system 1 may include one or more server devices 20 connected to communication network 10 and one or more terminal devices 30 connected to communication network 10 . In FIG. 1, three server devices 20A to 20C are illustrated as examples of the server device 20, and three terminal devices 30A to 30C are illustrated as examples of the terminal device 30. , one or more server devices 20 other than these may be connected to the communication network 10 , and one or more terminal devices 30 other than these may be connected to the communication network 10 as terminal devices 30 . In this application document, the term "system" may include both a server and a terminal device, and may also be used as a term indicating only a server or only a terminal device. In other words, the system may be in any form of a server only, a terminal device only, or both a server and a terminal device.

Also, the system may be an information processing device on the cloud. Further, the system constitutes a virtual information processing device, and may be logically configured with one information processing device. Also, the system owner and administrator may be different.

The communication network 10 may be, but is not limited to, a mobile telephone network, a wireless LAN, a fixed telephone network, the Internet, an intranet, Ethernet, and/or combinations thereof. In communication network 10, various data disclosed in this document may be communicated.

By executing a specific application installed on the server device 20, the movement of the avatar object is combined with the information related to the avatar object related to the distributor terminal as the information necessary for generating the first animation. and information related to the previously distributed first gift, given from the viewer terminal viewing the animation representing the movement of the avatar object, and , transmitting the sound and the information related to the second gift, which is different from the information related to the first gift, which has been distributed in the past.

Alternatively, the terminal device 30 executes an installed web browser or a specific application to combine the information necessary for generating the first animation with the information related to the avatar object related to the distributor terminal. , previously distributed information related to motion capable of expressing the movement of the avatar object, and previously distributed information given from a viewer terminal viewing animation expressing the movement of the avatar object; Receive information related to one gift, previously delivered sound, and information related to a second gift that is different from the information related to the first gift, and use the information necessary to generate the first animation. , to generate a first animation and display the first animation.

Alternatively, the terminal device 30 executes an installed web browser or a specific application to combine the information necessary for generating the first animation with the information related to the avatar object related to the distributor terminal. , previously distributed information related to motion capable of expressing the movement of the avatar object, and previously distributed information given from a viewer terminal viewing animation expressing the movement of the avatar object; It may be possible to execute an operation such as transmitting information related to one gift and a sound delivered in the past.

The terminal device 30 is any terminal device capable of executing such operations, and may be, but is not limited to, a smart phone, tablet, mobile phone (feature phone) and/or personal computer.

2. Hardware Configuration of Each Device Next, an example of the hardware configuration of the server device 20 will be described.

2-1. Hardware Configuration of Server Device 20 An example of hardware configuration of the server device 20 will be described with reference to FIG. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the server device 20 (terminal device 30) shown in FIG. It is described in relation to each terminal device 30.)

As shown in FIG. 2 , the server device 20 can mainly include an arithmetic device 21 , a main storage device 22 and an input/output interface device 23 . Server device 20 may further include input devices 24 and auxiliary output devices 26 . These devices may be connected by a data bus and/or a control bus.

The arithmetic device 21 performs arithmetic operations using instructions and data stored in the main memory device 22 and causes the main memory device 22 to store the results of the arithmetic operations. Further, the computing device 21 can control an input device 24, an auxiliary storage device 25, an output device 26, and the like via an input/output interface device 23. FIG. The server device 20 may include one or more computing devices 21 . Computing device 21 may include one or more central processing units (CPUs), microprocessors, and/or graphics processing units (GPUs).

The main storage device 22 has a storage function, and receives instructions and data from the input device 24, the auxiliary storage device 25, the communication network 10, etc. (server device 20, etc.) via the input/output interface device 23, and It stores the calculation result of the calculation device 21 . Main memory 22 may include, but is not limited to, RAM (random access memory), ROM (read only memory), and/or flash memory.

The auxiliary storage device 25 is a storage device. Instructions and data (computer programs) that constitute the above-mentioned specific applications, web browsers, etc. may be stored. may be loaded into the main memory 22 via the . The auxiliary storage device 25 may be a magnetic disk device and/or an optical disk device, a file server, etc., but is not limited to these.

The input device 24 is a device that takes in data from the outside, and may be a touch panel, buttons, keyboard, mouse and/or sensor.

Output devices 26 may include, but are not limited to, display devices, touch panels, and/or printer devices. Alternatively, the input device 24 and the output device 26 may be integrated.

In such a hardware configuration, the arithmetic unit 21 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 25 into the main storage device 22, and loads the loaded instructions. and data to control the output device 26 via the input/output interface device 23, or to control other devices (for example, the server device 20 and It may be possible to transmit and receive various information to and from other terminal devices 30, etc.).

When the server device 20 has such a configuration and executes a specific installed application, the information necessary for generating the first animation defined below is combined with the information related to the avatar object related to the distributor terminal. previously distributed motion-related information capable of expressing the movement of the avatar object, and previously distributed information provided from the viewer terminal viewing the animation expressing the movement of the avatar object. An operation of transmitting the information related to the first gift received, the sound delivered in the past, and the information related to the second gift that is different from the information related to the first gift (described in detail later). various operations) may be performed. Further, such operations may be performed by the user using the input device 24 or an input device 34 associated with the terminal device 30, which will be described later, to give instructions to the system of the example of the invention disclosed in this document. Further, when the program is executed on the arithmetic device 21, it may be displayed by the output device 26 of the server device 20 as the system used by the user, or the output device of the terminal device 30 as the system used by the user. 36 may be used. Note that the server device is sometimes referred to as a management server in the documents of the present application.

2-2. Hardware Configuration of Terminal Device 30 An example of hardware configuration of the terminal device 30 will be described with reference to FIG. As the hardware configuration of each terminal device 30, for example, the same hardware configuration as that of each server device 20 described above can be used. Therefore, the reference numerals for the components of each terminal device 30 are shown in parentheses in FIG.

As shown in FIG. 2, each terminal device 30 mainly includes an arithmetic device 31, a main storage device 32, an input/output interface device 33, an input device 34, an auxiliary storage device 35, and an output device 36. , can be included. These devices are connected to each other by a data bus and/or a control bus.

Arithmetic device 31, main storage device 32, input/output interface device 33, input device 34, auxiliary storage device 35, and output device 36 are included in each server device 20 described above, respectively. , the input/output interface device 23, the input device 24, the auxiliary storage device 25, and the output device 26, or may be different. Also, the capacities and capabilities of the computing devices and storage devices may be different. Input device 34 and output device 36, in particular, are described in greater detail below.

In such a hardware configuration, the arithmetic unit 31 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 35 into the main storage device 32, and loads the loaded instructions. and data to control the output device 36 via the input/output interface device 33, or to control other devices (for example, each server device 20) via the input/output interface device 33 and the communication network 10 etc.).

The terminal device 30 has such a configuration, and by executing the installed web browser or a specific application, the information necessary for generating the first animation is combined with the information related to the avatar object related to the distributor terminal. By means of, previously distributed information related to the motion that can express the movement of the avatar object, and given from the viewer terminal viewing the animation that expresses the movement of the avatar object, receiving information about a first gift, previously distributed sound, and information about a second gift different from the information about the first gift, and generating information necessary for generating the first animation; may be used to perform some or all of operations such as generating a first animation and displaying the first animation (including various operations described in detail later).

Alternatively, the terminal device 30 executes an installed web browser or a specific application to synthesize the information necessary for generating the first animation with the information related to the avatar object related to the distributor terminal. , previously distributed information related to motion capable of expressing the movement of the avatar object; It may be possible to execute some or all of operations such as transmitting information related to one gift and sounds distributed in the past (including various operations described in detail later). Also, by executing the installed web browser, it is possible to receive and display web pages from the server device 20 and perform similar operations. Also, such operations may be performed by the user using the input device 34 to give instructions to the system of the example of the invention disclosed in this document. Further, when the program is executed on the arithmetic device 31, it may be configured to be displayed on the output device 36 of the terminal device 30 as a system used by the user.

In the present document, there may be two types of terminal devices, a "distributor terminal" and a "viewer terminal". These may be names given to the roles of terminals, and one terminal device may be a viewer terminal or a distributor terminal, and may be a viewer terminal and a distributor terminal at the same time. may be a user terminal. The distributor terminal may be a terminal used by a distributor who appears as a character such as an avatar in what is distributed. On the other hand, the viewer terminal may be a terminal primarily used by viewers who watch what is distributed. In addition, viewers can also give a certain amount of influence to what is distributed by giving gifts to characters such as avatars in such a way that gifts appear in what is distributed. good too. Similarly, viewers may influence what is delivered in the form of audio, comments, and the like. What is distributed may be a video or an animation, as long as a character such as an avatar played by the distributor appears in a part of them. The above description is merely an example to which one embodiment of the present invention is applied, and each embodiment of the present invention may be applied even in a virtual space in which characters without such assumptions appear.

The viewer terminal may be configured to allow voice input, comment input, gifting, etc., as described above. For example, the viewer terminal may have, as the input device 34, a keyboard, a touch panel, or the like that can input comments and obtain comments that are text information. Also, the viewer terminal may have a function of generating a certain comment by means of the computing device 34 . These acquired comments may be similarly transmitted to the communication network 10 via the input/output interface device 23 .

Note that the comments according to the present invention may be those automatically generated by the system in addition to the comments input by the viewer terminal. Such comments may be sent to the viewer terminal and displayed at the viewer terminal.

Also, the viewer terminal may include a microphone capable of acquiring sound as the input device 34 . The human voice may be acquired by the microphone as the input device 34 and treated as sound, or after being acquired by the microphone as the input device 34, converted into text by voice recognition by the arithmetic unit 31 and used as a comment. can handle. Note that the viewer terminal may generate sound using the arithmetic unit 31 . These acquired sounds or comments may be similarly transmitted to the communication network 10 via the input/output interface device 23 .

On the other hand, the distributor terminal may include a motion sensor capable of detecting human movement as the input device 34 . The motion sensor may be attached to the body of the broadcaster and have a function capable of detecting movements of each part of the body. Each part of the body can include various parts such as the head, face, upper arm, forearm, hand, thigh, lower leg, foot, trunk, etc., but not limited to some or all of these, body movement It may be something that can be attached to a detectable position. Motion sensors may include accelerometers, gyro sensors, geomagnetic sensors, and the like. These acquired information may be similarly transmitted to the communication network 10 via the input/output interface device 23 .

Also, the distributor terminal may include, as the input device 34, an imaging device capable of capturing moving images. The imaging device may capture an image of the distributor's head, face, eyes, part of the body, the whole body, or the like. The imaging device can detect the direction of the face when imaging the head or face, can detect facial expressions when imaging the face, and can detect the line of sight when imaging the eyes. , and it may be possible to detect body movement in conjunction with or in place of the motion sensors described above when imaging a portion of the body or the entire body. The distributor terminal may generate information related to these motions from motion sensors or moving images. Also, from such a motion sensor or video, information regarding face rotation may be generated. Information related to face rotation may include face orientation. Also, the distributor terminal may generate information on the position of the face from the video. That is, the distributor terminal may generate motion-related information from the video, and the motion-related information may include facial expression information and/or facial position and rotation information. . In addition, the distributor terminal may be equipped with an imaging device capable of capturing facial expressions, and the distributor terminal that has captured the facial expressions may select one of a plurality of pieces of information that identify the facial expressions from the moving image of the face. Alternatively, information identifying a plurality may be generated. A plurality of divisions specifying facial expressions may be determined in advance. In addition, the identification of the facial expression is identified as one of the predetermined facial expressions when the movement of a part of the face such as each position of the eyebrows, the outline of the eyes, nose, and lips is a predetermined movement. It can be anything. Information for setting such facial expressions may be set for the distributor using parameters and the like set by calibration. Also, the distributor terminal may transmit information related to motion based on the image information to the communication network 10 via the input/output interface device 23 . Further, the distributor terminal may also include a microphone capable of acquiring sound as the input device 34, and may acquire the voice when the distributor performs. After being acquired by the microphone as the input device 34, it may be converted into text by speech recognition by the computing device 31 and treated as a comment. Note that the distributor terminal may also generate sound using the arithmetic device 31 . These acquired sounds or comments may be similarly transmitted to the communication network 10 via the input/output interface device 23 .

Also, the output device 36 in the viewer terminal and distributor terminal may be a display device or a sound generator. The display device may be various devices as long as it has a displayable function, and examples thereof include liquid crystal displays, plasma displays, organic EL displays, micro LED displays, head-mounted displays, etc. It can be a device. The sound-producing device may be a speaker, headphones, earphones, or the like. The information output by the output device 36 may be information generated by the arithmetic device 31 or information received from the communication network 10 .

In the present document, the terminal device may also be an "administrator terminal", and the administrator terminal may have the functions that the viewer terminal has. The administrator terminal may be connectable with the management server or the distributor terminal. The administrator terminal may be used as the operator of the system to check and review information distributed from the management server or the distributor terminal.

3. Functions of Each Apparatus Next, an example of functions of the system according to the present invention will be described with reference to FIG. FIG. 3 is a block diagram schematically showing an example of functions of the system shown in FIG. As shown in FIG. 3, an example system includes a switching unit 41 that acquires information selected from either a first mode or a second mode, and a transmission unit that transmits at least information corresponding to the acquired mode. 42, a receiving unit 43 that receives at least information corresponding to the acquired mode, a generating unit 44 that generates animation when the acquired mode is the second mode, and statistics using information related to viewers It may have a part or all of the statistical processing unit 45 that performs the processing. For example, the distributor terminal includes a switching unit 41 that acquires information selected from one of the first mode and the second mode, a transmission unit 42 that transmits at least information corresponding to the acquired mode, and statistical processing. It may have a part or all of the statistical processing unit 45 that performs In addition, the management server includes a switching unit 41 that acquires information selected from either the first mode or the second mode, a transmission unit 42 that transmits at least information corresponding to the acquired mode, and statistical processing. It may have a part or all of the statistical processing unit 45 that performs Also, the management server may have a receiving unit 43 that receives information transmitted from the distributor terminal. In addition, the administrator terminal or the viewer terminal includes a switching unit 41 that acquires information selected from either the first mode or the second mode, and a receiving unit 43 that receives at least information corresponding to the acquired mode. , a generating unit 44 that generates an animation when the obtained mode is the second mode, and a statistical processing unit 45 that performs statistical processing.

2.1. Switching unit 41
The switching unit 41 has a function of managing changes in the mode of distribution to the viewer terminals. The switching unit 41 may have a function of switching between a first mode, a second mode, a third mode, and a fourth mode. Here, the first mode is a mode for images in which the distributor is performing in the same time zone using an avatar object in the virtual space. The second mode is a mode in which an animation in which the broadcaster performs in the virtual space using an avatar object at the same time is generated in a terminal device having a display screen. In this case, information necessary for animation generation is transmitted to the terminal device, and animation is generated within the terminal device. The same time period in the first mode and the second mode means that the time period in which the broadcaster is performing and the time period in which the viewer is watching are the same or very close, and the latter means that the video or animation It may include the case where there is a time lag such as the delay time of the generation or distribution of The term "same time zone" is sometimes referred to as "real time" in the documents of the present application. A third mode is a mode for images of a state in which the broadcaster performed in the past using an avatar object in the virtual space. The third mode differs from the first mode in that it may have been performed in the past and delivered in the past by the first mode, but it is possible for the viewer to view and listen to gifts, sounds, comments, etc. The effect added by may be different. It should be noted that, in the present document, videos with different effects that are added depending on how viewers view them may also be referred to as videos distributed in the past. A fourth mode is a mode in which an animation performed in the past by the distributor using an avatar object in the virtual space is generated in a terminal device having a display screen. In this case, information necessary for animation generation is transmitted to the terminal device, and animation is generated within the terminal device. Unlike the second mode, the fourth mode may be performed in the past and distributed by the second mode in the past, but there are things such as gifts, sounds, comments, etc. that the viewer can see and hear. The effect added by may be different. In addition, in this document, the addition of different effects depending on the viewing by the viewer may also be referred to as information necessary for generating animations distributed in the past and animations displayed in the past. . By being able to switch between the first to fourth modes, there is an advantage that a more appropriate selection can be made according to the situation related to viewing. In particular, as will be described later, the second and fourth modes have the advantage of being able to distribute processing because animation is generated at the viewer terminal. In addition, in this document, the animation generated on the viewer terminal by synthesizing the avatar object related to the distributor terminal and the information related to the motion that can express the movement of the avatar object may be simply referred to as "animation". be. On the other hand, a video using such an avatar object is sometimes simply called a "video." A "program" is sometimes used as a superordinate concept of such animation or video. In addition, as described above, "animation" means that an avatar is generated based on an object. Alternatively, it may be something like a game video created with human involvement in real time or in the past. In addition, the program may include animations and videos that have been distributed in the past, and may include animations and videos that have been performed and distributed by the distributor in the same time slot. Also, the switching unit 41 may have a function of selecting another mode.

The switching unit 41 may have a function of acquiring information on the selected first to fourth modes. When the first mode is selected, the switching unit 41 is set to transmit the video or receive the video and display the video in the same time slot as the broadcaster is performing. , you may When the second mode is selected, the switching unit 41 generates the information necessary for generating the animation in the same time period as the time period during which the distributor performs, or changes the information necessary for generating the animation. may be received and an animation may be generated and displayed from the information necessary to generate such animation. When the third mode is selected, the switching unit 41 may be set to transmit the image distributed in the past, or set to receive the image and display the image. When the fourth mode is selected, the switching unit 41 transmits previously distributed information necessary for animation generation, or receives previously distributed information necessary for animation generation. Animations displayed in the past may be generated and displayed from the information necessary for generating such animations.

The switching unit 41 may acquire information on the first to fourth modes from the viewer terminal, from the distributor terminal, or from a server or the like that manages such distribution. good. Information on the first to fourth modes may be acquired from the same information processing device as the information processing device provided with the switching unit 41, or may be obtained from an information processing device different from the information processing device provided with the switching unit 41. may be obtained from the device. The information on the selection of the first to fourth modes may be acquired by the viewer's selection at the viewer terminal, or may be acquired by the distributor's selection at the distributor's terminal. In the server, it may be obtained by the administrator's selection.

In particular, the switching unit 41 may switch between the third mode and the fourth mode by acquiring information to the effect that the switching between the third mode and the fourth mode was performed in the past. Specifically, at the stage of transmitting the video delivered in the past or receiving the video delivered in the past in the third mode, the animation corresponding to the video delivered in the past is generated respectively. Information necessary for switching to a fourth mode, which is transmission of information necessary for transmission and reception of information necessary for generating an animation corresponding to a previously distributed video, may be acquired. Similarly, in the fourth mode, at the stage of transmitting information necessary for generating the animation distributed in the past or receiving such information, respectively, the video corresponding to the animation distributed in the past Information on switching to a third mode of transmitting and receiving video corresponding to previously delivered animations may be obtained. That is, in one embodiment of the present invention, the motion of the avatar object can be expressed by synthesizing the information necessary for generating the first animation with the information related to the avatar object related to the distributor terminal. Distributed information related to motion, information related to the first gift distributed in the past, which is given from a viewer terminal viewing animation expressing the movement of the avatar object, and distributed in the past, receiving a sound and information relating to a second gift different from the information relating to the first gift, generating a first animation using the information necessary for generating the first animation, and generating the first animation; a computer program characterized by: acquiring information indicating switching to a video corresponding to the first animation, receiving the video, and displaying the video It can be a program.

In addition, the switching unit 41 switches from the third mode or the fourth mode that was distributed in the past to the first mode or the second mode that is currently performed by the distributor. you can That is, in one embodiment of the present invention, the motion of the avatar object can be expressed by synthesizing the information necessary for generating the first animation with the information related to the avatar object related to the distributor terminal. Distributed information related to motion, information related to the first gift distributed in the past, which is given from a viewer terminal viewing animation expressing the movement of the avatar object, and distributed in the past, receiving a sound and information relating to a second gift different from the information relating to the first gift, generating a first animation using the information necessary for generating the first animation, and generating the first animation; receiving information necessary for generating a second animation related to video being distributed in real time, and using the information necessary for generating the second animation , generating a second animation and displaying said second animation. In this case, the viewer has the advantage of being able to enjoy viewing by simply switching to viewing the currently distributed program in addition to viewing the past program. Further, the information necessary for generating the second animation is combined with information related to the avatar object related to the distributor terminal, and information related to motion capable of expressing the movement of the avatar object, and the avatar object. It may include information and sound relating to the third gift given from the viewer terminal viewing the animation expressing the movement of the player.

Note that the switching between the fourth mode, which is the animation distributed and displayed in the past, and the third mode, which is the video corresponding to the animation distributed and displayed in the past, may be switched manually. , may be switched automatically. Manual switching information may be input in the viewer terminal, the distributor terminal, and the management server. On the other hand, automatic switching may depend on the number of viewer terminals, the degree of functionality of the viewer terminals, the latency with respect to the viewer terminals, and the like. The degree of function of the viewer terminal includes information such as the CPU function of the viewer terminal, the memory function of the viewer terminal, or the number of applications running on the viewer terminal and the degree of load. good. In the case of past distribution, unlike real-time distribution, information newly generated as data to be synchronized is limited to information related to gifts, comments, and the like. Also, the possibility that past deliveries are being delivered at the same time is less likely than the case where the delivery itself is performed in real time. As such, there is generally less emerging information than real-time delivery as information that needs to be synchronized. Therefore, as will be described later, by storing the information necessary for animation generation on multiple servers, the fourth mode can be used for a large number of viewer terminals compared to real-time distribution. It has the advantage of being able to deliver the information necessary to generate the animation delivered to the . In addition, the distribution in the fourth mode is the distribution of information necessary for animation generation, and the amount of information is small compared to the amount of video information corresponding to the information necessary for animation generation. There is an advantage that the storage capacity can be reduced. Furthermore, distribution in the fourth mode has the advantage of being able to reduce the amount of information to be communicated compared to video distribution in the third mode. In addition, since the switching unit 41 can switch between the third mode and the fourth mode, there is an advantage that a better mode can be selected.

Also, the switching unit 41 may function in the distributor terminal, may function in the management server, or may function in the viewer terminal. The switching unit 41 in the distributor terminal or the management server selects the first mode or the second mode, or selects the transmission of video and animation in both modes according to the communication situation and the situation of the viewer terminal. There are advantages to be had. For example, when the viewer terminal has a large processing load for animation generation, it is possible to select the first mode and transmit the video.

2.2. Transmitter 42
The transmission unit 42 has a function of transmitting video or information necessary for generating animation. Various modes of transmission may be used, and there are no restrictions on the method. For example, it may voluntarily transmit information, or it may passively transmit other information in a format corresponding to the receipt of one piece of information. Alternatively, information may be transmitted in response to access from another information processing apparatus. It should be noted that, in the present document, transmission of information between information processing apparatuses with respect to information and video necessary for generating an animation may be referred to as "distribution" or "transmission".

The transmitter 42 may transmit corresponding information according to the selection of the first to fourth modes. That is, when the switching unit 41 acquires the first mode, the transmitting unit 42 transmits the video in real time, and when the switching unit 41 acquires the second mode, the transmission unit 42 transmits the video in real time. When the switching unit 41 acquires the third mode, the video transmitted in the past is transmitted, and when the switching unit 41 acquires the fourth mode, the animation distributed in the past is transmitted. You may send the information necessary for the generation of

In the first mode, the transmission unit 42 may transmit video based on information acquired by the distributor terminal. The video may be generated based on the appearance of the distributor as an avatar on the distributor terminal. Such videos may be videos generated based on the behavior of the distributor at one or more distributor terminals. Such video may be generated in a management server or the like based on information acquired from each distributor terminal in one or more distributor terminals, or may be generated in each distributor terminal in one or more distributor terminals A video synthesized and generated in a management server or the like based on the generated video may also be used. Note that the transmission unit 42 may store such transmitted video. By retransmitting such stored video, there is an advantage that the video that was originally distributed can be redistributed in real time. In addition, the transmitting unit 42 may store information about viewers of the video in association with the transmitted video. For example, information about viewers of a video may include the number of viewers at the time of distribution, the number of gifts given at the time of distribution, and/or the number of comments made at the time of distribution. By storing such information, there is an advantage that viewer reactions such as the number of viewers, the number of gifts, or the number of comments to the originally distributed video can be stored together with the video. Also, such viewer-related information may be included in association with information about the time at which the corresponding information was detected. The temporal information may be the elapsed time from the start of the video or the time information of the video. By storing such information, there is an advantage that it is possible to store the information at which point in the video including the chronological element the reaction of the viewer is. FIG. 4 is an example of stored data of information related to viewers.

In the case of the second mode, the transmission unit 42 may transmit information necessary for animation generation based on information acquired by the distributor terminal. The information necessary for animation generation includes at least motion information capable of expressing the movement of the avatar object and the movement of the avatar object by being combined with information concerning the avatar object associated with the distributor terminal. It may include information about a gift given from a viewer terminal that watches the animation, and sound. The transmitting unit 42 may store information necessary for generating the transmitted animation. The information necessary for generating such transmitted and stored animation may be referred to as an "archive", and the animation generated using the information necessary for generating such stored animation may be referred to as an "archived Also known as "animation". By retransmitting the information necessary for generating the stored animation, there is an advantage that the animation originally displayed can be redisplayed in real time. In addition, the transmitting unit 42 may store information related to viewers of the animation that was given to the animation at the time of initial distribution and/or redistribution, in association with the transmitted information necessary for generating the animation. For example, information about viewers of an animation may include the number of viewers at the time of distribution, the number of gifts given at the time of distribution, and/or the number of comments made at the time of distribution. By storing such information, there is an advantage that viewer reactions such as the number of viewers, the number of gifts, or the number of comments to the originally distributed and/or redistributed animation can be stored. Also, such viewer-related information may be included in association with information about the time at which the corresponding information was detected. The temporal information may be the elapsed time from the start of the video or the time information of the video. By storing such information, there is an advantage that it is possible to store the information at which point in the video including the chronological element the reaction of the viewer is. An example of stored data for viewer information of archived animations in the second mode may be FIG.

In the case of the third mode, the transmission section 42 may transmit the video transmitted in the first mode. Alternatively, the transmission unit 42 may transmit video corresponding to the animation generated based on the information necessary for generating the animation transmitted in the fourth mode. In this case, the video corresponding to the animation may be a video generated using information relating to the second gift, which will be described later, and including the display of the second gift. In addition, the transmission unit 42 transmits the information related to the viewer associated with the video or the statistical information based on the information related to the viewer at the same time as the transmission of the video or in a time period different from the transmission of the video. you can Statistical information based on information related to viewers associated with such video includes the total number of viewers, the number of gifts, and/or the number of comments regarding the information related to viewers within a predetermined period OK. Also, the statistical information may limit the number of viewers, the number of gifts, and/or the number of comments to a predetermined number or more, or may include a predetermined number for such limitation. An example of transmitted data for viewer information associated with a video in the third mode may be FIG.

In the case of the fourth mode, the transmission section 42 may transmit the information necessary for generating the animation transmitted in the second mode. In addition, the transmission unit 42, at the same time as the transmission of the information necessary for generating the animation or at a different time period, transmits information related to the viewer associated with the information necessary for generating the animation, or to the viewer. Statistical information based on such information may be transmitted. Statistical information based on information related to viewers associated with information necessary for generating such animations is the number of viewers, the number of gifts, and/or the number of comments on the information related to viewers within a predetermined period. , may include the total number of In addition, the statistical information may limit the number of viewers, the number of gifts, and/or the number of comments to a predetermined number or more, or may include a predetermined number for such limitation. In the fourth mode, an example of transmitted data for viewer information associated with an animation may be FIG.

Further, in the case of the fourth mode, the transmitting unit 42 transmits information ("second gift information") related to the gift given to the initially displayed animation or the animation displayed after the initially displayed animation. ) may be transmitted as one of the information necessary for animation generation. In addition, in the present application documents, the information about the gift given to the animation initially generated by the distributor using the avatar object in real time is referred to as "information about the first gift". Sometimes. On the other hand, since the second gift in the information relating to the second gift complies with the above definition, it is different from the first gift displayed in the first animation that was originally distributed in the past, and It is a gift newly given for distribution of 1 animation. Thus, in the fourth mode, by transmitting the information about the second gift as the information necessary for generating the animation, the information about the gift given after the original real-time animation is also used for generating the animation. and will be displayed in the generated animation, which has the advantage of incentivizing gift giving for sending archives. Note that the above-mentioned "archive" may include information about the second gift, and "archived animation" may include the display of the second gift based on the information about the second gift. Further, the information processing device to which the information related to the second gift is input may be of various kinds, and the viewer terminal may be the same viewer terminal as the information processing device on which the animation is displayed, or may be different. It may be a viewer terminal. That is, the information related to the second gift may include information based on the gift input from the terminal device displaying the first animation. That is, when the viewer provides a gift while viewing the archived animation, the gift is displayed as the second gift in the archived animation being viewed. Further, the information related to the second gift may include information based on the gift input from a terminal device different from the terminal device displaying the first animation. In this case, for example, the first viewer may offer the gift while watching the archived animation. This gift is displayed as the second gift in the animation viewed by the first viewer. Subsequently, when the second viewer views the archived animation, the gift provided by the first viewer is displayed as the second gift. In this way, gifts provided by third parties to archived animations may also become displayed as part of archived animations.

Note that the transmission unit 42 may receive and store information related to a gift provided for an archived animation from the viewer terminal. With such storage, when transmitting the information necessary for generating the animation of the archived animation, the information related to the gift can be transmitted as the information related to the second gift, as one of the information necessary for generating the animation. Also, such gift information may be stored in association with the time information provided in the archived animation. The time information may be the elapsed time from the start time of the archived animation. By being associated with such time information, when sending information necessary for generating an animation about an archived animation, it is sent as a gift at the corresponding time, and is sent within the animation according to the time of the given gift You have the advantage of being able to display your gift at

As mentioned above, in this document, in order to handle transmission of real-time animation in the second mode and retransmission of animation (information necessary for generation) delivered in the past in the fourth mode, Information related to gifts in real-time animation generation may be distinguished as "information related to third gifts".

In addition, to supplement the distinction between the information related to the first gift, the information related to the second gift, and the information related to the third gift, the information related to the third gift is referred to as being transmitted in real time. and the information related to the first gift is the name used when referring to the information related to the third gift transmitted in real time later, such as at the time of redistribution, so it is substantially the same. point to On the other hand, the information about the second gift is the name of the gift given to the archived animation. Although the first to third names have been described here only for information related to gifts, the same concept can be applied to comments and sounds, so comments and sounds may also be similar. .

The transmission unit 42 may transmit the information necessary for generating the video in the third mode or the animation in the fourth mode to the viewer terminal. You can send it to your terminal. When the transmission unit transmits such video or information to the viewer terminal, viewers who overlooked the display of the real-time video or animation or viewers who became interested later can also view the video or animation on the viewer terminal. There are benefits that you can enjoy. In addition, when the transmission unit transmits to the administrator terminal, there is an advantage that the administrator terminal can confirm how the video or animation transmitted and displayed in real time was displayed. To explain the latter specifically, there are complaints about the content and error reports from viewers regarding the display of video or animation displayed in real time. In such a case, there is an advantage of being able to check what kind of video or animation has been provided as a person who provides and manages the video or animation. In addition, as information necessary for animation generation, it is possible to verify what kind of information is specifically sent and how the animation was generated. There is an advantage that can be an opportunity to consider. In addition, in the fourth mode, the transmission unit 42 may transmit all information necessary for animation generation, or may transmit a part of the information. For example, the information necessary for animation generation includes motion-related information, sound, comments, gift-related information, camerawork-related information, etc., and part of the information may be transmitted. For example, when the transmission unit 42 transmits information related to motion and information related to camerawork, an animation generated using such information on the administrator terminal does not include sound, comments, or gifts. However, using information related to motion, it is possible to confirm what kind of movement the broadcaster made as an avatar, so if, for example, a viewer reports an error in the movement of the avatar, the It has the advantage of being able to check for errors. In this case, by not transmitting part of the information necessary for generating the animation, such as comments and gifts, which may appear in large numbers in the display, the screen is not unnecessarily blocked by the comments and gifts, and the motion related to the motion is prevented. It has the advantage of being able to check for errors by focusing on the movement of the avatar based on the information. As another example, when the transmission unit 42 sends a comment to the administrator terminal, the viewer of the administrator terminal can confirm the contents of the comment. Even if the comment contains slander, there is an advantage that the user can concentrate on the comment and check it without being disturbed by the motions, sounds, gifts, etc. of other avatars. Therefore, the transmission unit 42 obtains a request to transmit a part or all of the information necessary for animation generation, and transmits a part or all of the information necessary for animation generation in response to the request. may have a function to As a result, as described above, the viewer of the animation generated based on part of the information necessary for generating the animation is not bothered by information other than the target information, and can concentrate on the target information. , has the advantage of being browsable.

The information about the gift may include the position of the gift and/or the rotation angle of the displayed gift. Such gifts may be those that viewers can provide to specific broadcasters or for certain occasions. In the former case, the information may be information specifying a specific avatar, and the position of the gift may be specified based on such information. This has the advantage of making it clear that the gift is for a specific distributor. Also, the gift may be rotatable, and in the case of a rotatable gift, information about the gift may include the rotation angle of the gift. In particular, when a gift based on information about the gift is displayed using the laws of physics, the information about the gift includes the position at which the gift is displayed and/or the rotation angle of the displayed gift. can be

The information about the gift may include the type of gift. The kind of gift may be various, and the kind is not limited. In particular, when the gift based on the gift information is displayed using pseudo-randomness, the gift information may include the gift type. Further, when the gift based on the gift information is displayed using pseudo-randomness, the gift information may be only the type of the gift. Further, when the gift based on the gift information is displayed using pseudorandomness, the gift information may include the gift type and the pseudorandomness seed. Pseudo-randomness and pseudo-randomness seeds are described below.

Since the information about the gift is based on the viewer terminal, it may be directly transmitted from the viewer terminal, or may be indirectly transmitted via the management server or the like.

The sound may be based on the terminal of the distributor or may be based on the terminal of the viewer, and may or may not be transmitted through the management server.

In addition, in the second mode or the fourth mode, the transmission unit 42 may transmit information specifying identification information specifying the avatar played by the distributor. The side that receives such identification information applies the information related to the motion to the model data corresponding to the received identification information among the 3D model data that has been received in advance. There is an advantage that processing is possible so that the avatar played by will also perform correspondingly in the animation.

The transmission unit 42 may function in the distributor terminal and/or the management server.

2.3. Receiver 43
The receiving unit 43 has a function of receiving video or information necessary for generating animation. Various modes of reception may be used, and there are no restrictions on the method. For example, it may receive transmitted information, or it may access information to another information processing apparatus and receive information transmitted in response to the access.

The receiver 43 may correspond to the transmitter 42 and receive the information transmitted by the transmitter 42 . That is, the receiving section 43 may receive corresponding information according to the selection of the first to fourth modes. The receiving unit 43 receives real-time video when the switching unit 41 acquires the first mode, and receives information necessary for generating real-time animation when the switching unit 41 acquires the second mode. When the switching unit 41 acquires the third mode, it receives the image distributed in the past, and when the switching unit 41 acquires the fourth mode, it corresponds to the animation distributed in the past. It may receive information necessary to generate the animation. However, in the fourth mode, as described above, the information regarding the second gift may also be received as one of the information necessary for generating the animation.

In the first mode, the receiver 43 may receive video in real time. Such videos may be videos generated based on the behavior of the distributor at one or more distributor terminals. Such video may be generated in a management server or the like based on information acquired from each distributor terminal in one or more distributor terminals, or may be generated in each distributor terminal in one or more distributor terminals A video synthesized and generated in a management server or the like based on the generated video may also be used.

In the case of the second mode, the receiving unit 43 may receive information necessary for animation generation in real time. The information necessary for generating the animation includes at least motion information capable of expressing the movement of the avatar object and the movement of the avatar object by being combined with information concerning the avatar object associated with the distributor terminal. It may include information and sound related to the third gift given from the viewer terminal watching the animation. Information and sound relating to the third gift may be the same as described above. Note that such a real-time animation is sometimes referred to as a "second animation" in this document.

In the case of the third mode, the receiving unit 43 may receive images distributed in the past, or may receive images corresponding to the animation generated based on the information necessary for generating the animation described above. You may In the latter case, as described above, the image may include a display of the second gift based on information relating to the second gift. Such videos may be videos generated based on the behavior of the distributor at one or more distributor terminals. Such video may be generated in a management server or the like based on information acquired from each distributor terminal in one or more distributor terminals, or may be generated in each distributor terminal in one or more distributor terminals A video synthesized and generated in a management server or the like based on the generated video may also be used.

In the case of the fourth mode, the receiving unit 43 may receive information necessary for generating an animation distributed in the past. The information necessary for animation generation includes at least motion information capable of expressing the movement of the avatar object and the movement of the avatar object by being combined with information concerning the avatar object associated with the distributor terminal. It may include information about the third gift given from the viewer terminal that watches the animation and the sound. Information and sound related to the third gift may be the same as described above. It should be noted that such an archived animation distributed in the past may be referred to as a "first animation" in the present document.

As described above, in the first to fourth modes, the receiving section 43 may correspond to the transmission of the transmitting section 42 and acquire information about the viewer. In particular, in the fourth mode, the receiving unit 43 may receive information about viewers related to the first animation distributed in the past. Receiving information about such viewers has the advantage of receiving information about archived animations. Also, the information about the viewers may include the number of viewers at the time of past distribution. The number of viewers has the advantage of receiving information on the number of viewers who were interested in such animation, and when such information is displayed on the viewer terminal, the number of viewers who were interested in such animation can be reported to viewers. has understandable advantages. Also, the information about the viewer may include the number of gifts at the time of distribution in the past. According to the number of gifts, it is possible to receive information that a gift was provided with interest in such animation, that is, the animation was successful, and if such information is displayed on the viewer terminal, the animation is successful. There is an advantage that the reader can understand the situation that has become. The information about the viewers may include the number of comments at the time of distribution in the past. According to the number of comments, there is an advantage that the viewer is interested in the animation and provides a comment, that is, the information that caused the viewer's interest in the animation can be received, and if such information is displayed on the viewer terminal, There is an advantage that the viewer can understand the situation in which interest is generated in such animation.

The receiving unit 43 may function in the management server, administrator terminal, or viewer terminal.

2.4. Generation unit 44
The generator 44 has a function of generating an animation using the received information necessary for generating the animation. The generator 44 may function within the viewer terminal.

The generation unit 44 generates the animation using the information necessary for generating the animation described above. The generation unit 44 generates information related to the motion that can express the movement of the avatar object, which is acquired as information necessary for generating animation, and model data corresponding to the received identification information among the 3D model data received in advance. and may be used to represent the movement of the avatar object and generate animation. That is, the generation unit 44 combines information related to the motion that can express the movement of the avatar object by combining with information related to the avatar object related to the distributor terminal, and the 3D model data received in advance, An animation may be generated by applying the information about the motion to the model data corresponding to the received identification information.

Also, the generating unit 44 may generate an animation using the sound received by the receiving unit 43 . The sound may include the sound performed by the distributor obtained from the distributor terminal, or may include the sound provided by the viewer for the presentation of the avatar object obtained from the viewer terminal. Any sounds may be received at the viewer terminal and used to generate an animation.

Also, the generation unit 44 may generate an animation using the received information about the gift. A gift may be provided for a scene in which a viewer performs one avatar object associated with one distributor or a plurality of avatar objects associated with a plurality of distributors. That is, the information about the gift may be given from the viewer terminal viewing the animation representing the movement of the avatar object.

The gift may be of various forms, but in the virtual space where the avatar object acts and the gift is provided, the gift may be produced by applying physical laws in the virtual space. For example, the laws of physics in virtual space include Newtonian mechanics, where objects fall from top to bottom, objects moving at a certain speed undergo inertial motion, and objects move due to friction and resistance. The speed of movement is reduced, and so on. When the gift based on the gift information is displayed using the laws of physics, the gift information includes the position at which the gift is displayed and/or the rotation angle of the displayed gift. In the generation of the animation, as the information related to the gift, the animation is generated using the laws of physics from the position where the gift is displayed, and if the displayed gift is rotated, The rotation angle, which is the initial position of that rotation, may be used to generate the animation. In addition, as information related to the gift, the position where the gift is displayed, the size of the gift to be displayed, the orientation of the gift such as up, down, left and right directions, the initial speed of movement of the gift, the movement of the gift It may include part or all of the orientation such as up, down, left, and right, the acceleration of movement of the gift, and the like. By including information related to such gifts, it may be possible to increase the types of representations of gifts within the distributor terminal.

Also, the animation of the gift may be generated using pseudo-randomness. Here, since true randomness cannot be realized mathematically, pseudo-randomness means the property of imitating true randomness as a presentation in a computer. It may be realized by using various functions modeled on . If the animation of the gift has pseudo-randomness, the position where the gift is displayed, the size of the gift to be displayed, the orientation of the gift such as the up, down, left, and right directions in which the gift is displayed, the initial movement of the gift, etc. Some or all of the speed, orientation such as up, down, left, or right of movement of the gift, acceleration of movement of the gift, etc. may be determined by pseudo-randomness. In this case, there is no need to communicate such information in detail from the distributor terminal or the management server to the viewer terminal, so there is an advantage that the amount of communication information is reduced. In particular, since only the type of gift is communicated to the viewer terminal, there is an advantage that the amount of communication can be reduced. Note that the use of pseudo-randomness has the advantage that different animations can be created for each viewer terminal. Also, if a seed of pseudo-randomness is sent to the viewer terminal, there is the advantage that variations can be applied to the pseudo-randomness. As described above, since true randomness cannot be expressed mathematically, continued use of the same function results in repeated display of animations without randomness, resulting in a lack of variety. By using a pseudo-random seed, there is an advantage that the randomness in the pseudo-randomness is improved and more variety of animation becomes possible. A seed may be assigned to each type of gift. The seed itself may also be calculated by a pseudo-random function. Such a pseudo-randomness seed may be transmitted from the management server or distributor's terminal to the viewer's terminal and used as one parameter when the pseudo-randomness function is applied.

In addition, in the above description, the case where the gift has physical laws within the viewer terminal has been described, but the gift may also exist without physical laws within the viewer terminal. In this case, the location information and rotation information of the gift are transmitted from the distributor terminal or the administrator server. The drawing of the gift may be done at the distributor's terminal. In this case, there is an advantage that the terminal of the distributor does not need to perform processing related to the laws of physics.

Note that the generating unit 44 may perform processing such that, in a predetermined case, the information related to the received gift is not used for generating the animation. Such information may not be received, or the transmitting unit 42 may not transmit information related to gifts in a predetermined case. For example, when a certain gift is displayed for 3 seconds, the information may be such that the gift is not displayed on the viewer terminal that has started viewing the animation with 0.1 seconds remaining. This is because, if the drawing time does not remain longer than the predetermined time, it is considered that the process of actually drawing and effecting is of little significance. Therefore, the predetermined case may be, for example, the case where the drawing time of the gift in the gift-related information is shorter than the predetermined time.

The information necessary for animation generation may include information related to service data and/or information related to camerawork. The generation unit 44 may generate an animation using information regarding service data and/or information regarding camerawork.

Information related to service data may include broadcaster comments, viewer comments, and/or the number of viewers of the animation. The distributor's comment may be a comment issued by the distributor. Also, the viewer's comment may be a comment of a viewer viewing the animation.

The distributor's comment may be a comment entered or generated at the distributor's terminal. Such comments may be directly or indirectly communicated from the distributor terminal in which they are input or generated to the viewer terminal having the generator 44 in which the animation is generated. Indirect communication may be, for example, communication via a management server. When there are one or more distributors, comments from one or more distributor terminals based on the one or more distributors may be communicated to the viewer terminals as information related to service data. Such comments by the distributor may be associated with the distributor who issued the comment and communicated to the viewer terminal, and the comment may be displayed in the viewer terminal in association with information indicating the associated distributor. you can

Viewer comments may similarly be comments entered or generated at the viewer terminal. Such comments may be directly or indirectly communicated from the viewer terminal in which they are input or generated to the viewer terminal having the generator 44 in which the animation is generated. Indirect communication may be, for example, communication via a management server. For one or more viewers viewing the animation, comments from one or more viewer terminals based on such one or more viewers may be communicated to the viewer terminals as information related to service data.

If the viewer terminal in which the viewer's comment is input and the viewer terminal that displays the animation generated based on the viewer's comment are different, the viewer's comment is input. Sending such viewer's comments, directly or indirectly, from the viewer's terminal to a viewer's terminal that will display an animation generated based on such viewer's comments, and The generation unit 44 may generate an animation including the viewer's comment and the viewer who created the comment as information related to the service data from the received viewer's comment, and display the animation on the viewer's terminal. . In this case, viewers can understand comments input by other viewers by displaying them in the animation.

In addition, if the viewer terminal in which the viewer's comment is input and the viewer terminal that displays the animation generated based on the viewer's comment are the same viewer terminal, the viewer terminal The generation unit 44 generates an animation including the input viewer's comment and the viewer who created the comment as information related to the service data, and displays it on the viewer terminal. you can In this case, the viewer can understand that the comment entered by the viewer is displayed within the animation.

In addition, the viewer's comment may be associated with the distributor who entered the comment and communicated to the viewer terminal, and in the viewer terminal, the viewer's comment may be associated with information indicating the associated distributor and associated with the comment. Information may be displayed that indicates the broadcaster that was sent.

The number of viewers of the animation can be any number that can estimate the number of viewers watching the animation. For example, the number of viewer terminals displaying the generated animation and the information necessary for animation generation or the number of viewer terminals transmitting a request signal requesting the management server or the distributor terminal to receive the information necessary for generating the animation.

When the management server obtains a request for information necessary for animation generation from a viewer terminal, the management server may calculate the number of viewers by totaling the number of viewer terminals that make such requests. .

In addition, when a distributor terminal obtains a request for information necessary for animation generation from a viewer terminal, the number of viewer terminals that make such requests shall be determined between distributor terminals that distribute the same animation. The number of viewers may be calculated by sharing or by contacting one broadcaster terminal.

Also, the number of viewers of an animation may be calculated in real time for one animation. As a result, the ever-changing number of viewers of the animation can be calculated and displayed in real time, and there is an advantage that viewers can understand the number of viewers of the animation. Note that the number of viewers of such animation may be ranked on the viewer terminal. For example, by associating the number of viewers with each animation, the animations may be displayed in descending order of the number of viewers or in ascending order of the number of viewers. This has the advantage that viewers can evaluate animations based on the popularity of the number of viewers.

Also, the information related to the service data may include actions of the distributor for viewers. For example, information related to service data may include an action by a broadcaster to view a viewer's profile. In this case, the distributor selects one viewer among the plurality of viewers who watch the distribution of the distributor, and the action of viewing the selected viewer is to view the avatar object related to the distributor. may be conveyed to the viewer terminal that This has the advantage of allowing other viewers to share which viewer the distributor is interested in. In particular, when generating animations on the terminal of the distributor, the delay is reduced and, for example, it can be displayed within a few seconds. There is an advantage that it can be shared at a timing closer to the same time.

Information related to camerawork may be information related to a method of capturing an image of a distributor. The information about the imaging method may be, for example, the angle at which the distributor is imaged, the distance at which the distributor is imaged, the imaging technique for imaging the distributor, and the like. The angle at which the distributor is imaged may be specified by various methods of indicating the shooting angle. Also, the distance at which the image of the distributor is captured may be specified by various methods of indicating the distance, and may be specified by a predetermined absolute distance, or may be specified by a relative distance with respect to a predetermined reference distance. . Also, techniques such as panning and tilting may be used as techniques for imaging the distributor. Information related to such camera work may be used when generating an animation in the viewer terminal. In particular, the avatar object played by the distributor on the viewer terminal is created using the information related to the camera work transmitted from the distributor terminal so that the camera work on the viewer terminal can imitate the camera work on the distributor terminal. You may specify how to display it.

Information about the method of capturing the image of the distributor is defined in advance by the distributor terminal, the server, and the viewer terminal according to rules. , the method of capturing images of the distributor at the distributor terminal may be used at the viewer terminal side when creating animation.

The generating unit 44 may generate animations using information necessary for generating various animations as described above. FIG. 5 generally shows an example of various information necessary for animation generation. In generating the animation, information from one or more distributor terminals may be used, and information from one or more viewer terminals may be used. Also, such generation may occur in real time. Also, the generated animation may be displayed at the generated viewer terminal.

2.5. Statistical processing unit 45
The statistical processing unit 45 may display information about viewers. Also, the statistical processing unit 45 may have a function of performing statistical processing using information about viewers. Moreover, the statistical processing unit 45 may have a function of displaying the results of the statistical processing.

FIG. 6 is an example of displaying information about viewers. Here, as an example, a plurality of archived animations 61 and viewer numbers 62 for each animation are associated and stored and displayed. Here, the number of viewers may be the maximum number of viewers within a certain period of time, or the minimum number of viewers within such certain period of time, in an animation with a certain length of time. Alternatively, it may be the average number of viewers within such a certain period of time. In addition, in this example, a total of 63 gifts provided in each animation and a total of 64 comments provided in each animation are also stored in association with each animation. are attached and displayed. By displaying the number of viewers, the number of gifts, and the number of comments in this way, it is possible to obtain information about each archived animation, and the viewer has the advantage of viewing the desired animation. In addition, in such a display, there may be a function of sorting the information regarding these viewers. For example, there may be a function of sorting in descending order of the number of viewers, sorting in descending order of the number of gifts, or sorting in descending order of the number of comments. Such sorting may also be a sorting function for a predetermined time period. For example, the past day, the past week, the past month, the past six months, and the like. In addition, the number of viewers, the number of gifts, and the number of comments may be the number when the animation was originally distributed in real time, but after that, when it is archived and transmitted as an archived animation, It may be the number of viewers, the number of gifts, or the number of comments. In this case, it is possible to acquire information from the viewpoint of animations whose popularity increased or decreased after being archived, in addition to the original animations. Also in this case, the number of viewers, the number of gifts, and the number of comments may be sorted in the same manner as described above. Further, it may be the number of viewers, the number of gifts, and the number of comments in the sum of the display of these real-time animations and the display of archived animations. In this case, in addition to the original real-time display, it is possible to display the total number of viewers, the number of gifts, and the number of comments, which are displayed as an archived animation, thus increasing the overall popularity of such animations. Or there is an advantage that the number of viewers, the number of gifts, and the number of comments can be displayed based on the decline. Also in this case, the number of viewers, the number of gifts, and the number of comments may be sorted in the same manner as described above.

The statistical processing unit 45 may function in the distributor terminal, the management server, the administrator terminal, or the viewer terminal. The statistical processing unit 45 may complete the various functions described below in one of these information processing devices to generate and display display information, or may generate and display information in a plurality of information processing devices. Display may be distributed and processed. For example, from the distributor terminal or the management server, information about the viewer is sent to the viewer terminal or administrator terminal, and the information about the viewer is used in the viewer terminal, and the one animation that was distributed in the past Statistical information about viewers may be generated and the statistical information may be displayed on the viewer terminal or administrator terminal, or in the distributor terminal or management server, using information about viewers, distributed in the past Statistical information relating to the viewer of the one animation thus generated may be generated, the statistical information may be transmitted to the viewer terminal or the administrator terminal, and the statistical information may be displayed on the viewer terminal or the administrator terminal. In these cases, the statistical information may include the total number of viewers, gifts, and/or comments within a predetermined period. Moreover, the above-described display may display a portion of the statistical information in which the number of views, the number of gifts, and/or the number of comments is equal to or greater than a predetermined number. For example, only the number of viewers, the number of gifts, and the number of comments above a certain threshold may be displayed as the predetermined numbers on the viewer terminal or the administrator terminal.

Also, the statistical processing unit 45 may generate and display a graph using the statistical information. For example, FIG. 7 is an example of a graph created by the statistical processing section 45. In FIG. For a particular archived animation, the number of viewers 71, the number of gifts 73, and the number of comments 72 are displayed on the vertical axis against the passage of time on the horizontal axis. With such a graph, it is possible to understand the number of viewers, the number of gifts, and the number of comments corresponding to the time transition of an archived animation, so the number of gifts increased in addition to the overall transition of viewers in this animation. The viewer can understand the degree of popularity of the animation as a time period and a time period in which the number of comments increases.

Further, in the statistical information, information specifying a predetermined range in which the number of viewers, the number of gifts, and/or the number of comments is equal to or greater than a predetermined number may be displayed. For example, in FIG. 8, in addition to displaying a location 84 where the number of comments 82 has increased, a location 85 where the number of gifts 83 has increased may be displayed. In this figure, the information for specifying the predetermined range of numbers equal to or greater than the predetermined number is indicated by squares, but such indication may be of various types. It is sufficient if it is displayed in a manner that can be understood by a person. With this display, the viewer can see in which time zone the number of viewers, the number of gifts, and/or the number of comments are greater than or equal to a predetermined number in the display of the animation. It has the advantage of being able to understand what a part is.

Also, the statistical processing unit 45 may generate a digest of one animation. A digest of one animation may be, for example, a combination of parts where the number of viewers, the number of gifts, and/or the number of comments is equal to or greater than a predetermined number. As a result, the digest is composed only of portions of the animation that can be evaluated as successful, and there is an advantage that the viewer can view the essence of the animation in a short time. In this case, the statistical processing unit 45, in the animation, the number of viewers, the number of gifts, and / or the number of comments, the number of viewers, via the transmission unit 42, for the portion of the portion of the predetermined number or more, the viewer terminal , the receiving unit may generate an animation from the information necessary for generating an animation based on such a portion, and display it as a digest on the viewer terminal. In this case, among the information necessary for generating the animation corresponding to one animation, the information necessary for generating the animation corresponding to the digest is transmitted and received, so there is an advantage that the amount of communication is small. On the other hand, instead of such a configuration, the statistical processing unit 45 determines the number of viewers, the number of gifts, and/or Animation may be generated by the generation unit only for portions where the number of comments is equal to or greater than a predetermined number, and may be displayed as a digest on the viewer terminal.

Also, in the above description, the digest is described as being based on one animation, but it may be a digest based on a plurality of animations. In this case, there is an advantage that the viewer can watch the essence of a plurality of animations in a short time. In this case, similarly, in a plurality of animations, a digest summarizing a plurality of animations is generated for portions where the number of viewers, the number of gifts, and/or the number of comments is equal to or greater than a predetermined number. , may be configured to be displayed on the viewer terminal. In this case, the digest may be generated by transmitting and receiving only the information necessary for generating the animation necessary for the digest, as described above, or by generating multiple animations related to the digest. After the information is transmitted, the statistical processing unit 45 obtains the information necessary for generating the animation corresponding to the part where the number of viewers, the number of gifts, and/or the number of comments is equal to or greater than a predetermined number. may be used to generate and display an animation at the viewer terminal.

4. embodiment
4-1. Embodiment 1
In Embodiment 1, first, focusing on the first mode and the second mode, an embodiment of real-time distribution will be described. This embodiment is an example of operations processed in the entire system including distributor terminals 91A and 91B, a server device 90, an administrator terminal 93A, and viewer terminals 92A and 92B, as shown in FIG. . Note that there may be a plurality of administrator terminals. The flow of this embodiment will be described below with reference to FIG.

step one
The distributor terminal and the switching unit 41 in the management server acquire information on either the first mode or the second mode (step 001). Information about mode selection may be obtained from a server, a distributor's terminal, or a viewer's terminal.

step 2
One or more distributors act as avatars in the virtual space using avatar objects (step 002). It should be noted that the above-described mode information may be acquired while the avatar is performing.

step 3
The distributor terminal associated with each distributor acquires information related to the situation in which the distributor plays (step 003). The distributor terminal may acquire information about the distributor who will perform by using the above-described various sensors, imaging devices, and the like.

step 4
The distributor terminal transmits information corresponding to the mode to the management server (step 004). That is, in the first mode, an image in which the movement of the avatar object played by the distributor is embedded is transmitted, and in the second mode, the motion related to the motion that can express the movement of the avatar object played by the distributor is transmitted. Information and information about sounds made by such distributors may be transmitted.

step 5
The management server receives the information corresponding to the mode, processes it so that it can be transmitted to the viewer terminal, transmits the information to the viewer terminal, and stores the transmitted information (step 005). The management server may store the information after transmitting it, or may transmit the information after storing the information. In any case, by storing the transmitted information in the viewer terminal, there is an advantage that the transmitted content can be reproduced in real time by transmitting the stored information.

step 6
The switching unit 41 of the viewer terminal acquires the information of the first mode or the second mode, and also receives the information received corresponding to the mode from the management server (step 006). That is, in the first mode, the viewer terminal in the first mode receives the embedded image of the avatar object played by the distributor, and the viewer terminal in the second mode receives the motion. Information necessary for generating animation such as related information and sound is received.

step 7
The viewer terminal displays the received video in the first mode, and generates and displays an animation from the received information necessary for generating the animation in the second mode (step 007). Here, when the viewer indicates sound, comment, gift, etc. to the video or animation, such information is acquired at the viewer terminal, transmitted from the viewer terminal to the management server, and sent to the management server. , using such sounds, comments, gifts, etc., may be transmitted to the viewer terminal in real time as part of the information necessary for generating a video or generating an animation. In this case, the sound, comments, and gifts given to the video or animation being distributed from the viewer terminal and the distributor terminal are managed as sound information, comment information, and gift-related information, respectively. may be stored on the server. In this case, the sound information, the comment information, and the gift-related information may be stored in the management server in association with the video or animation being distributed, and also in association with the given time-related information.

In the above description, the original information that becomes the video or animation displayed on the viewer terminal is transmitted from the distributor terminal to the viewer terminal via the management server. A configuration of transmitting from the terminal to the viewer terminal may be employed. In such a case, the distributor terminal may have the functions of the management server described above. In addition, when there are multiple distributor terminals, both of the multiple distributor terminals may perform the function of the management server by synchronizing, or one distributor terminal among the multiple distributor terminals may Some distributor terminals may function as the management server. In such a case, the information transmitted to the viewer terminal and necessary for generating the video or animation may be stored in the distributor terminal or in a different server. In any case, the information necessary for generating the video or animation transmitted to the terminal of the distributor is stored in some information processing device, and such information is transmitted to the terminal of the viewer or the terminal of the administrator. can reproduce real-time video or animation (this reproduction may include the addition of gifts, sounds, comments, etc.).

4-2. Embodiment 2
Embodiment 2 is mainly an embodiment in which the third or fourth mode, that is, the video or animation distributed in the past is viewed on the viewer terminal. The flow of this embodiment will be described with reference to FIG.

step one
The viewer terminal transmits information about the program to be viewed to the management server (step 001). Such programs may be selected from among a plurality of programs. Such a plurality of programs may be selected from, for example, those ranked in terms of the number of viewers, the number of comments, the number of gifts, etc. of each program, as described above. In order for the viewer terminal to be provided with viewable program candidates, information indicating one or more viewable programs is provided to the viewer terminal in advance from the management server. One or more programs available for viewing may be displayed. Information indicating one or more viewable programs from the management server to the viewer terminal may be transmitted in response to a request from the viewer terminal, or may be transmitted without a request from the viewer terminal. You may It should be noted that the program may include real-time video or animation currently being delivered instead of or in addition to past animation or video.

step 2
The viewer terminal and management server acquire information on the third or fourth mode (step 002). Information about mode selection may be acquired from the management server, may be acquired from the distributor terminal, or may be acquired from the viewer terminal. Also, the mode information may be obtained before step 1 above.

step 3
The management server transmits information corresponding to the mode to the viewer terminal (step 003). That is, in the third mode, the video embedding the avatar object played by one or more distributors distributed in the past is transmitted, and in the fourth mode, the motion related to the motion distributed in the past is transmitted. Sends information, sounds, and other information needed to generate animations. In the third mode, the video may be exactly the same as the video that was originally distributed, or if the video that was originally distributed is subsequently provided with sound, gifts, comments, etc., It may be a newly generated image including such provided sounds, gifts, and comments. In this case, in terms of sound, gift, comment, etc., the video is different from the originally distributed video, and the sound, comment, gift, etc. added by subsequent viewing are added, but the viewer after the initial distribution There is an advantage that it becomes an image that also takes into account the reaction of Similarly, in the fourth mode, the information necessary for generating the animation may be exactly the same as the information necessary for generating the originally distributed animation, or the information necessary for generating the originally displayed animation. , and then, if a sound, gift, comment, etc. is provided, the information about the provided sound, gift, comment, etc. may be the information necessary for generating the animation to which the information is added. In this case, unlike the originally displayed animation in terms of sound, gift, comment, etc., the sound, comment, gift, etc. added by subsequent viewing are added, but the viewer after the initial delivery There is an advantage that it becomes an animation that also takes into account the reaction of That is, in this case, the information necessary for generating the animation may include information regarding the first gift and information regarding the second gift.

step 4
The viewer terminal displays the received video in the third mode, and generates and displays an animation from the received information necessary for generating the animation in the fourth mode (step 004). Here, as described above, in the fourth mode, information related to the second gift may or may not be included as the information necessary for animation generation. When the information about the second gift is included, there is an advantage that the reaction of the viewer who watched the animation after the display of the original animation is also added to the animation. That is, an embodiment of the present invention is a computer program, which is executed by one or a plurality of processors to generate information necessary for generating a first animation, including information related to an avatar object related to a distributor terminal and Information related to motion distributed in the past, capable of expressing the movement of the avatar object, and the past provided from the viewer terminal viewing the animation expressing the movement of the avatar object by being combined. Receiving information related to a first gift that has been delivered, sound that has been delivered in the past, and information related to a second gift that is different from the information related to the first gift, and generating the first animation The computer program may be characterized by generating a first animation and displaying the first animation using necessary information.

step 5
When a viewer performs an operation to provide a gift to an animation that was distributed in the past and is currently being viewed, the viewer terminal that has performed the operation to provide the gift will receive information that the gift is provided. is used as information related to the second gift as part of the information necessary to generate the received animation, generate the animation, and display it on the viewer terminal that has been operated to provide the gift. (step 005). In this example, in the viewer terminal operated to provide the gift, the information related to the gift is stored in the viewer terminal operated to provide the gift directly without going through the management server. describes a mode in which the information necessary for generating the animation is used to generate the animation. The viewer terminal operated to provide the gift using the information related to the second gift via the communication path that is transmitted as a part of the information necessary for generating the animation to the viewer terminal that was sent to the viewer terminal An animation may be generated and displayed. The former has the advantage that the gift can be displayed with less delay than the latter. On the other hand, the latter case has the advantage of being able to be handled in the same way as gifts from other viewer terminals, as in the example below. That is, when the viewer performs an operation to provide a gift, the viewer terminal A that has been operated by the viewer to provide the gift acquires the information that the gift will be provided, and the viewer terminal A An operation of transmitting information that the gift will be provided to the management server, and the management server that has obtained the information provides the gift as information related to the second gift as part of the information necessary for generating the animation. is sent to a viewer terminal B different from the viewer terminal A where the second gift was received, and the animation is generated at the viewer terminal B using the information necessary for generating the animation including the information related to the second gift, and the viewing is performed. This is an example of displaying an animation on the user terminal B. FIG. In this case, the gift provided by the viewer terminal A can be displayed on the viewer terminal B. In the above description, only gifts have been described, but the same applies to sounds and comments.

Thus, in this embodiment, the viewer has the advantage of being able to view videos and animations that have been distributed in the past. In addition, even if the video or animation has been distributed in the past, the viewer may not be able to use the video or animation as a result of manipulating his own gifts, comments, sounds, etc. By being reflected in , there is an advantage that even if it is an archive of the past, you can get the feeling of watching it in real time. As a result, in addition to being viewed in the same time slot as the broadcaster's performance, there is an increased possibility that the program will be viewed continuously, which has the advantage of improving the value of the program. In addition, by storing the gifts, comments, sounds, etc. added when viewing the archive, the distributor can obtain not only the original video and animation, but also the viewer's response in subsequent redistributions. There are advantages.

It should be noted that instead of or in addition to the one or more programs described above, digests of one or more programs may be selectable. In the case of such a digest, similarly, information necessary for generating an image or animation may be transmitted from the management server to the viewer terminal, and the image or animation may be generated and displayed on the viewer terminal.

Also, in the above step 2, the third mode and the fourth mode have been explained, but if a video or animation performed in real time by the distributor is selected as the program, the third mode or the fourth mode may be used. mode may be the first mode or the second mode. That is, in one embodiment of the present invention, the motion of the avatar object can be expressed by synthesizing the information necessary for generating the first animation with the information related to the avatar object related to the distributor terminal. Distributed information related to motion, information related to the first gift distributed in the past, which is given from a viewer terminal viewing animation expressing the movement of the avatar object, and distributed in the past, receiving a sound and information relating to a second gift different from the information relating to the first gift, generating a first animation using the information necessary for generating the first animation, and generating the first animation; receiving information necessary for generating a second animation related to video being distributed in real time, and using the information necessary for generating the second animation , generating a second animation and displaying said second animation.

4-3. Embodiment 3
Embodiment 3 is mainly an embodiment in which the third or fourth mode, that is, the video or animation distributed in the past is viewed on the administrator terminal. The flow of this embodiment will be described with reference to FIG.

step one
The manager terminal transmits information about the program to be viewed to the management server (step 001). A specific configuration may be such that step 1 in the above-described second embodiment, which is described as a viewer terminal, is replaced with an administrator terminal.

step 2
The management server and administrator terminal acquire information on the third or fourth mode (step 002). Information on mode selection may be acquired from the management server or from the distributor terminal. Alternatively, it may be acquired from the viewer terminal. In accordance with the first mode or the second mode, the viewer terminal in the first mode receives the embedded image of the avatar object played by the distributor, and the viewer terminal in the second mode receives , information related to motion and information necessary for generating animation such as sound (step 002).

step 3
In the case of the fourth mode, the administrator terminal selects information indicating information used for animation generation from among the information necessary for animation generation, and transmits this information to the management server (step 003). ). For example, only motion information, sound only, gift information only, comments only, some of them, or all of them may be included. Only such corresponding information is used as the information necessary for generating the animation, and the animation is generated. , there are advantages that can be considered. For example, as described above, when only information related to motion is selected, the administrator terminal receives the information related to motion from the management server, and the administrator terminal determines the movement of the avatar object corresponding to the information related to motion. can generate animations for avatar objects. This has the advantage that gifts, sounds, comments, etc. do not become part of the animation, and the movement of the avatar object can be considered without being distracted by these displays.

step 4
The management server transmits the video to the administrator terminal in the third mode, and receives information indicating the information used to generate the selected animation in the fourth mode, Information necessary for generating animation corresponding to the indicated information is transmitted (step 004). In steps 3 and 4 described above, the information indicating the information used for animation generation has been described as a function of the fourth mode, but may be a function added in the third mode. In this case, the video in the third mode may be video generated within the management server based on the selected information. Further, when the management server receives the information on the second gift as in the third embodiment, that is, when the information on the gift that is not displayed in the initial animation or video is given to the initial animation or video. If the gift is selected, the video is generated and transmitted using the information related to the second gift, or the information related to the second gift is used as one of the information necessary to generate the animation may be configured to be sent as one. Also, only the gift has been explained here, but comments and sounds may be the same.

step 5
The viewer terminal displays the received video in the third mode, and generates and displays an animation from the received information necessary for generating the animation in the fourth mode (step 005). Note that the administrator terminal may select information necessary for generating the above-described animation even while the video or animation is being displayed. In this case, information indicating the selected information is transmitted to the management server. Information necessary for animation generation may be selected based on such information, and animation may be generated by selecting information necessary for animation generation at the viewer terminal based on information indicating the selected information. may be generated and displayed.

As described above, images and animations distributed in the past in the first or second mode can be displayed in the third or fourth mode on the administrator terminal, so that the images and animations displayed in the past can be confirmed. , there are advantages that can be considered. In addition, by being able to select the information used in the displayed images and animations, there is an advantage that you can check and examine the images and animations by concentrating on the selected information without being distracted by other information. be.

In the above description, animations and images were mainly described for the virtual space in which the avatar operates, but the place where the avatar performs may be a virtual space with a specific configuration.

For example, the virtual space including a specific configuration may be a virtual space including a game screen. In the case of a virtual space including a game screen, there is an advantage that the avatar can explain the game. Also, in the first and second modes, there is an advantage that the avatar can broadcast the game live when the game progresses in real time. In this case, the game screen may be a game played by the distributor, or may be a game screen of a game played by someone other than the distributor. In the case of a game screen played by a distributor, the game screen may also be transmitted from the distributor terminal and transmitted to the viewer terminal with or without the management server. In the case of a game screen played by someone other than the distributor, the game screen may be transmitted from the player's information processing device and transmitted to the viewer terminal with or without the management server. In these cases, in the above-described second and fourth modes, the information necessary for animation generation may include a game screen played by the distributor or a person other than the distributor. An animation may be generated at the viewer terminal using a game screen played by a person other than the user, and such animation may be displayed at the viewer terminal. In addition, in the first and third modes, a video including a game screen may be generated in the management server or the distributor terminal, and such video is transmitted to the viewer terminal, and the viewer terminal includes the game screen. A video may be displayed. Switching among the first to fourth modes may be the same as described above.

Also, the virtual space including a specific configuration may be a virtual space including a photograph of the real world. In the case of a virtual space containing a photograph of the real world, there is an advantage that it is possible to realize a situation in which the avatar explains phenomena in the real world and visits specific places in the real world. In addition, in the first and second modes, when real-world shooting progresses in real time, there is an advantage that the avatar can relay the progress of real-world incidents. In this case, the information necessary for generating the animation may include a photograph of the real world. A photograph of the real world may be a photograph of nature or a photograph of a city, and there is no limitation to the subject. Such photographed images may be photographed in advance or may be photographed in real time. These shots may be sent to the viewer terminal with or without the management server. In the above-described second and fourth modes, the information necessary for animation generation may include such photographed information, and the viewer terminal may use such photographed information to generate animation. , such animation may be displayed at the viewer terminal. In addition, in the first and third modes, a video including such shots may be generated in the management server or the distributor terminal, and such video is transmitted to the viewer terminal, and the shot is taken in the viewer terminal. A video containing what was done may be displayed. Switching among the first to fourth modes may be the same as described above.

The systems and information processing described herein may also be implemented by software, hardware, or a combination thereof, and some or all of such systems and information processing may implement processes and procedures as computer programs, These computer programs may be executed by various computers, and may be stored in storage media. Also, these programs may be stored in a non-transitory or temporary storage medium.

What is described in this document is not limited to what is described in this document, and can be applied to various examples within the scope of various technical ideas having various technical advantages and configurations described in this document. It goes without saying that we can.

1 System 10 Communication Network 20 (20A to 20C) Server Device 30 (30A to 30C) Terminal Device 21 (31) Arithmetic Device 22 (32) Main Storage Device 23 (33) Input/Output Interface 24 (34) Input Device 25 ( 35) Auxiliary storage device 26 (36) Output device 41 Switching unit 41
42 transmitter 42
43 Receiving unit 43
44 generator 44
45 statistical processing unit 45
90 server device 91A, 91B distributor terminal 92A, 92B viewer terminal 93A administrator terminal

Claims (28)

A computer program,
by being executed by one or more processors,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Unlike the information related to the first gift, information related to the second gift given after the delivery of the original animation delivered in the past ;
receive the
generating a first animation using information necessary for generating the first animation; displaying the first animation;
Receive information about viewers related to the first animation delivered in the past,
The information about the viewer includes the number of gifts and / or the number of comments at the time of past distribution,
A computer program characterized by: Acquiring information to the effect of switching to the video corresponding to the first animation,
receiving the video;
displaying said video;
A computer program according to claim 1, characterized in that: Receive information about viewers related to the first animation delivered in the past,
The information about the viewer includes at least the number of gifts and the number of comments,
Using the information about the viewer, displaying a graph showing at least the number of gifts and the number of comments at the time of past distribution in correspondence with time transition;
A computer program according to claim 1, characterized in that: wherein the graph identifies and displays a portion where the number of gifts and the number of comments are equal to or greater than a predetermined number;
4. A computer program as claimed in claim 3. Receive information about viewers related to the first animation delivered in the past,
The information about the viewer includes at least the number of viewers, the number of gifts, and / or the number of comments,
Displaying a digest of the first animation only at locations where the number of viewers, the number of gifts, and/or the number of comments is equal to or greater than a predetermined number;
5. A computer program according to any one of claims 1-4. Receive information necessary for generating the second animation related to the video being distributed in real time,
generating a second animation using information necessary for generating the second animation, and displaying the second animation;
3. A computer program according to claim 1 or 2. The information related to the second gift includes information based on the gift input from the viewer terminal device displaying the first animation,
5. A computer program according to any one of claims 1-4. The information related to the second gift includes information based on the gift input from a viewer terminal device different from the viewer terminal device that displays the first animation,
A computer program according to any one of claims 1-5. The information about the viewer includes the number of viewers at the time of past distribution,
9. A computer program as claimed in any one of claims 1 to 8, characterized in that: Using the information about the viewer, generating statistical information about the viewer related to the previously delivered first animation;
10. A computer program as claimed in any one of claims 1 to 9, characterized in that: wherein the processor is a central processing unit (CPU), microprocessor or graphics processing unit (GPU);
Computer program according to any one of claims 1 to 10 . The processor is installed in a smartphone, tablet, mobile phone or personal computer,
A computer program according to any one of claims 1-11 . A computer program,
by being executed by one or more processors,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Unlike the information related to the first gift, information related to the second gift given after the delivery of the original animation delivered in the past;
and send
Sending information about viewers related to the first animation delivered in the past,
The information about the viewer includes the number of gifts and / or the number of comments at the time of past distribution,
A computer program characterized by: Acquiring information to the effect of switching to the video corresponding to the first animation,
transmitting said video;
14. A computer program as claimed in claim 13 , characterized by: wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU);
15. A computer program according to any one of claims 13-14. the processor has computing capabilities,
16. A computer program according to any one of claims 13-15. comprising one or more processors;
The processor executing computer readable instructions to
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information about a second gift that is different from the information about the first gift and that is given after the distribution of the original animation that was distributed in the past ;
and send
Sending information about viewers related to the first animation delivered in the past,
The information about the viewer includes the number of gifts and / or the number of comments at the time of past distribution,
A server device characterized by: Acquiring information to the effect of switching to the video related to the first animation,
transmitting said video;
18. The server device according to claim 17 , characterized by: wherein the processor is a central processing unit (CPU), microprocessor or graphics processing unit (GPU);
The server apparatus according to any one of claims 17-18. the processor has computing capabilities,
The server device according to any one of claims 17 to 19. 1. A method performed by one or more processors executing computer readable instructions, comprising:
By the processor executing the instructions,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information about a second gift that is different from the information about the first gift and that is given after the distribution of the original animation that was distributed in the past ;
receive the
generating a first animation using information necessary for generating the first animation; displaying the first animation;
Receive information about viewers related to the first animation delivered in the past,
The information about the viewer includes the number of gifts and / or the number of comments at the time of past distribution,
A method characterized by: Acquiring information to the effect of switching to the video corresponding to the first animation,
receiving the video;
22. The method of claim 21 , wherein: wherein the processor is a central processing unit (CPU), microprocessor or graphics processing unit (GPU);
23. A method according to claim 21 or 22. the processor has computing capabilities,
24. The method of any one of claims 21-23. 1. A method performed by one or more processors executing computer readable instructions, comprising:
By the processor executing the instructions,
As information necessary for generating the first animation,
Information related to motion, distributed in the past, capable of representing the movement of the avatar object by being synthesized with information related to the avatar object related to the distributor terminal;
Information related to a first gift distributed in the past, which is given from a viewer terminal viewing an animation expressing the movement of the avatar object;
With the sound delivered in the past,
Information about a second gift that is different from the information about the first gift and that is given after the distribution of the original animation that was distributed in the past ;
send
Sending information about viewers related to the first animation delivered in the past,
The information about the viewer includes the number of gifts and / or the number of comments at the time of past distribution,
A method characterized by: Acquiring information to the effect of switching to the video corresponding to the first animation,
transmitting said video;
26. The method of claim 25, wherein: wherein the processor is a central processing unit (CPU), microprocessor or graphics processing unit (GPU);
27. A method according to claim 25 or 26. the processor has computing capabilities,
28. The method of any one of claims 25-27.

Images