JP7429930B2 - Computer program, method and server device - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act 1. Facts of disclosure (1) Date of disclosure August 19, 2020 Location of disclosure The disclosure was carried out on the live distribution application "REALITY" exclusively for Vtubers operated by Wright Flyer Live Entertainment Co., Ltd. The above application "REALITY" can be downloaded from the website specified by the address below. https://le. wrightflyer. net/reality/ https://itunes. apple. com/us/app/reality/id1404176564? l=ja&ls=1&mt=8 https://play. google. com/store/apps/details? id=net. wrightflyer. le. reality https://apps. apple. com/jp/app/reality-vtuber%E5%B0%82%E7%94%A8%E3%83%A9%E3%82%A4%E3%83%96%E3%82%A2%E3%83% 97%E3%83%AA/id1404176564 Publisher: Wright Flyer Live Entertainment Co., Ltd. Contents of the disclosed invention: Wright Flyer Live Entertainment Co., Ltd. has released the "REALIT", which can be downloaded from the website specified by the above address provided by the company. Y” In the application, the contents related to the invention related to the application were made public.

Application of Article 30, Paragraph 2 of the Patent Act (2) Website publication date August 19, 2020 Website address https://le. wrightflyer. net/reality/ https://itunes. apple. com/us/app/reality/id1404176564? l=ja&ls=1&mt=8 https://play. google. com/store/apps/details? id=net. wrightflyer. le. reality https://apps. apple. com/jp/app/reality-vtuber%E5%B0%82%E7%94%A8%E3%83%A9%E3%82%A4%E3%83%96%E3%82%A2%E3%83% 97%E3%83%AA/id1404176564 Publisher: Wright Flyer Live Entertainment Co., Ltd. Contents of the disclosed invention: Wright Flyer Live Entertainment Co., Ltd. has released the "REALIT", which can be downloaded from the website specified by the above address provided by the company. Y” The content related to the invention of the application was provided through the browser function activated by the application.

Article 30, Paragraph 2 of the Patent Act applies (3) Website publication date August 19, 2020 Website address https://reality. wrightflyer. net/notice/page/z43ZfZfD6whD Publisher: Wright Flyer Live Entertainment Co., Ltd. Contents of the disclosed invention: Wright Flyer Live Entertainment Co., Ltd. has filed an application on the website specified by the above address. The content related to the invention was made public. .

The present disclosure relates to a computer program, a method, and a server device.

A service called Mirative (Non-Patent Document 1) is known as a service used to distribute videos related to games from a distributor's terminal to each viewer's terminal.

With this service, a broadcaster uses a terminal to create a video containing avatar animation generated based on behavioral data regarding the broadcaster's movements, and a video containing an avatar animation generated based on operation data regarding the broadcaster's operations. Videos related to games can be distributed to multiple viewers' terminals. Note that the above Non-Patent Document 1 is incorporated herein by reference in its entirety.

"Mirrativ", [online], August 16, 2019, Mirrativ, Inc., [searched on December 23, 2019], Internet (https://apps.apple.com/jp/app/mirrativ -Mirative-Easy game distribution on smartphone/id1028944599)

However, Non-Patent Document 1 does not describe the distribution method during game distribution and the distribution method before and after game distribution, and does not describe the distribution method during game distribution and the distribution method before and after game distribution. was also not mentioned.

Therefore, the technology of the present disclosure provides a computer program, method, and server device that enable highly flexible distribution even when the distribution method during game distribution and the distribution method before and after distribution of the game are different. do.

According to one embodiment, the computer program is executed by at least one processor, and includes a first broadcaster that includes motion data regarding a first broadcaster's motion or an animation of an avatar of the first broadcaster that is generated based on the motion data. 1 video and a second video related to a game executed by a computer, which is generated based on operation data related to the operation of the first distributor, to a viewer terminal of at least one viewer via a communication line. performs a first determination to determine whether there is a request to execute the game when distribution of the first video has started, and if it is determined in the first determination that there is a request to execute the game, The processor is operated to distribute the second video using the second distribution method, which has a relatively large amount of distribution data among the first distribution method and the second distribution method.

The method according to one aspect is a method performed by at least one processor that executes computer-readable instructions, wherein the processor executes the instructions to generate operational data regarding the operation of a first distributor. or relating to a first video including an animation of the avatar of the first distributor generated based on the operation data, and a game executed by a computer, generated based on operation data regarding the operation of the first distributor. a step of distributing a second video to a viewer terminal of at least one viewer via a communication line; and determining whether or not there is a request to execute the game when distribution of the first video has started. A step of making a first determination;
If it is determined in the first determination that the request is present, distributing the second video using a second distribution method that has a relatively larger amount of distribution data among the first distribution method and the second distribution method; including.

The method according to one aspect is a method performed by at least one processor that executes computer-readable instructions, wherein the processor executes the instructions to generate operational data regarding the operation of a first distributor. or relating to a first video including an animation of the avatar of the first distributor generated based on the operation data, and a game executed by a computer, generated based on operation data regarding the operation of the first distributor. a step of receiving a second video; and when it is determined that there is a request to execute the game in a first determination of determining whether there is a request to execute the game when distribution of the first video has started; The method includes the step of receiving distribution of the second moving image executed by a second distribution method having a relatively large amount of distribution data among the first distribution method and the second distribution method.

The server device according to one embodiment includes at least one processor, and the processor includes behavior data regarding the behavior of a first distributor or an animation of an avatar of the first distributor generated based on the behavior data. A first video and a second video related to a game executed by a computer, which is generated based on operation data regarding operations of the first distributor, are transmitted to at least one viewer's viewer terminal via a communication line. perform a first determination to determine whether there is a request to execute the game when distribution of the first video has started, and if it is determined in the first determination that there is a request to execute the game; , the second moving image is distributed using a second distribution method that has a relatively large amount of distribution data among the first distribution method and the second distribution method.

This [Summary of the Invention] column is written to introduce various selected concepts in a simplified form, and these various concepts are described in the [Detailed Description of the Invention] column. This will be described later in . All trademarks used herein are the property of their respective owners. The statements in this [Summary of the Invention] column are not intended to identify important or essential features of the claimed invention, nor are they intended to identify important or essential features of the claimed invention. Nor is it intended to limit the technical scope. The above-mentioned and other objects, features, and effects of the claimed invention will become clearer from the description in the Detailed Description section below with reference to the accompanying drawings. Become.

FIG. 1 is a block diagram showing an example of the configuration of a video distribution system 1 according to an embodiment. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal 10 and server device 20 shown in FIG. 1. FIG. 3 is a block diagram schematically showing an example of the functions of the terminal 10 shown in FIG. 1. FIG. 4 is a block diagram schematically showing an example of the functions of the server device 20 shown in FIG. 1. FIG. 5 is a flowchart showing an example of operations performed in the video distribution system 1 shown in FIG. FIG. 6 shows an example of characteristics of two different distribution methods. FIG. 7 is a block diagram illustrating a computing environment 1400.

This specification is described in terms of various representative embodiments that are not intended to be limited in any way. As used in this application, singular forms such as "a", "said", "above", "said", "the", "this", "the" do not clearly indicate that they are not plural. may include plural forms. Also, the term "comprising" can mean "comprising" or "having." Further, the terms "coupled", "combined", "tied", "tied", "connected" or "connected" refer to the terms "coupled", "coupled", "tied", "tied", "connected" or "connected" to each other, connecting, connecting or linking objects together; including mechanical, electrical, magnetic and optical methods, together with other methods, between objects so connected, connected, connected, linked, connected or connected Does not exclude the presence of intermediate elements.

The various systems, methods, and apparatus described herein are not to be construed as limited in any way. In fact, this disclosure covers each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. All novel features and aspects are directed. The various systems, methods, and apparatus described herein are not limited to the particular aspects, particular features, or combinations of particular aspects and particular features described herein. The articles and methods described in the present invention do not require that one or more particular advantages be present or that a problem be solved. Furthermore, various features or aspects, or portions of such features or aspects, of the various embodiments described herein may be used in combination with each other.

The operations of some of the various methods disclosed herein are described in a particular order for convenience; It should be understood to include rearranging the order of the above operations unless otherwise required by the text. For example, operations listed in order are sometimes reordered or performed simultaneously. Furthermore, for purposes of brevity, the accompanying drawings do not depict the various ways in which the various matter and methods described herein may be used in conjunction with other matter and methods. Additionally, this specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "distribute." These terms are high-level descriptions of the various actual operations that are performed. The actual various operations corresponding to these terms may vary depending on the particular implementation and can be readily appreciated by those skilled in the art having the benefit of this disclosure.

Any theory of operation, scientific principle, or other theoretical description presented herein in connection with the disclosed apparatus or method is provided for the purpose of better understanding and to limit the technical scope. not intended. The apparatus and methods in the appended claims are not limited to apparatus and methods that operate in accordance with such theories of operation.

Any of the various methods disclosed herein may include one or more computer readable media (e.g., one or more optical media disks, one or more volatile memory components, or one or more non-volatile memory components). The method may be implemented using a plurality of computer-executable instructions stored in a non-transitory computer-readable storage medium (such as a non-transitory computer-readable storage medium) and executed in a computer. Here, the plurality of volatile memory components include, for example, DRAM or SRAM. Further, the plurality of nonvolatile memory components include, for example, a hard drive and a solid state drive (SSD). Furthermore, the computer includes any computer available on the market, including, for example, smart phones and other mobile devices that have hardware to perform calculations.
Any of a plurality of such computer-executable instructions for implementing the techniques disclosed herein may be generated and used during implementation of the various embodiments disclosed herein. It may be stored along with any data on one or more computer readable media (eg, non-transitory computer readable storage media). Such computer-executable instructions may be part of a separate software application, for example, or may be accessed or downloaded via a web browser or other software application (such as a remote computing application). It may be part of a software application that is Such software may be implemented in a networked environment, for example on a single local computer (e.g. as an agent running on any suitable computer available on the market) or using one or more networked computers. (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network).

For clarity, only certain selected aspects of the various software-based implementations are described. Other details well known in the art are omitted. For example, the techniques disclosed herein are not limited to any particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to any particular computer or type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.

Furthermore, various such software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) Any of the above may be uploaded, downloaded, or accessed remotely by any suitable communication means. Such suitable communication means include, for example, the Internet, the World Wide Web, intranets, software applications, cables (including fiber optic cables), magnetic communications, electromagnetic communications (including RF communications, microwave communications, infrared communications), including electronic communications or other such means of communication.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. Note that common components in the drawings are given the same reference numerals. Also, it should be noted that components depicted in one drawing may be omitted from another drawing for convenience of explanation. Furthermore, it should be noted that the attached drawings are not necessarily drawn to scale.
1. Video distribution system configuration
In the video distribution system of the present disclosure, a user who performs distribution (hereinafter referred to as a "distributor") uses his or her terminal to create an animation of an avatar (avatar object) that is generated based on motion data regarding the behavior of the distributor. A user (hereinafter referred to as a "viewer") who views a first video containing a video and a second video related to a game generated based on operation data regarding the distributor's operation via a communication line. It enables distribution to terminals. The first example will be described below with reference to FIGS. 1 to 6.

FIG. 1 is a block diagram showing an example of the configuration of a video distribution system according to an embodiment. As shown in FIG. 1, the video distribution system 1 may include a plurality of terminals 10 connected to a communication line (communication network) not shown, and one or more server devices 20 connected to the communication line. can. Each terminal 10 may be connected to one or more server devices 20 via a communication line. Each terminal 10 operates, for example, as a terminal for distributing videos (hereinafter sometimes referred to as a distributor terminal) or a terminal for viewing videos (hereinafter sometimes referred to as a viewer terminal). do. Note that the communication line may be a mobile phone network, a wireless network (e.g., Bluetooth, WiFi (such as IEEE 802.11a/b/n), RF connection via WiMax, cellular, satellite, laser, infrared, etc.), or a fixed line. May include, without limitation, a telephone network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and/or an Ethernet network.

Note that FIG. 1 shows a plurality of terminals 10, for example, a distributor terminal 11 (first distributor terminal 11), a viewer terminal 12A, a viewer terminal 12B, and a viewer terminal 12C. , one or more terminals 10 other than these may be used as well. Furthermore, in the following description, the viewer terminals 12A to 12C may be collectively referred to as the viewer terminal 12. Further, although FIG. 1 shows, for example, server devices 20A and 20B as one or more server devices 20, one or more server devices 20 other than these may be used in the same way. Furthermore, the communication lines (not shown) may include, but are not limited to, a mobile phone network, a wireless LAN, a fixed telephone network, the Internet, an intranet, and/or an Ethernet (registered trademark).

Furthermore, in one embodiment, the video distribution system 1 may also include one or more studio units 30 connected to a communication network. Each studio unit 30 can be connected to one or more server devices 20 or multiple terminals 10 via a communication line. Although FIG. 1 shows, for example, studio units 30A and 30B as one or more studio units 30, one or more studio units 30 other than these may be used in the same way. Each studio unit 30 can have the same functions as the terminal 10 or server device 20 described later.

Hereinafter, to simplify the explanation, we will focus on the case where one or more server devices 20 transmit and receive videos and the like with each terminal 10. Alternatively or in addition to this, it is also possible for one or more server devices 20 to send and receive videos and the like to and from each studio unit 30, as will be described later. Furthermore, instead of or in addition to this, the studio unit 30 can also transmit and receive videos and the like with each terminal 10, as will be described later.

1-1. Terminal 10
The plurality of terminals 10 include, for example, a plurality of distributor terminals (for example, the distributor terminal 11 and a second distributor terminal (not shown)) and one or more viewer terminals 12 (for example, viewer terminals 12A to 12). 12C). Note that the distributor corresponding to the distributor terminal 11 may be referred to as a first distributor. Each terminal 10 may have a configuration in which at least some features are common, for example.

When the terminal 10 operates as a distributor terminal 11, by executing an installed video distribution application (which may be middleware or a combination of an application and middleware; the same applies hereinafter). , acquires motion data regarding the distributor's motions, and transmits a first video including an animation of a virtual character (avatar/avatar object) changed according to the acquired data to the server device 20 (distribution server) via a communication line. system 20A1). The first video is distributed by the server device 20 (distribution server system 20A1) to a terminal (viewer terminal 12) for receiving the video via a communication line. The viewer terminal 12 can receive videos by executing an installed video viewing application (which may be middleware or a combination of an application and middleware; the same applies hereinafter).

In addition, each terminal 10 executes a browser function incorporated in an installed video distribution application and/or by executing an installed web browser application, the server device 20 (web server device 20B ) can receive a web page (HTML document) and execute a game program included in this web page. Thereby, each terminal 10 receives a web page (for example, an HTML document, in some examples, an HTML document encoded with executable code such as JavaScript or PHP code) from the server device 20 (web server device 20B). can be received. By executing this game program, each terminal 10 can generate a second moving image in which at least one game object is operated based on operation data regarding the distributor's operation. The user can start a browser using his or her own terminal 10, receive game drawing data from the server device 20, and view the game via the game screen (WebView).

Further, when the terminal 10 operates as a distributor terminal 11, the second video generated in this way is transmitted to the server device 20 (distribution server system) via a communication line by executing the video distribution application described above. 20A). Such a second video is also transmitted via a communication line by the server device 20 (distribution server system 20A) to a terminal for receiving the video (viewer terminal 12) that executes the installed video viewing application. It will be delivered.

In addition, when the terminal 10 operates as the distributor terminal 11, by executing the video distribution application described above, the viewer terminal 12 that views the second video (distributed by the distributor terminal 11) can Receive gift data indicating that a gift will be given to this distributor and/or comment data indicating that a comment will be sent to this distributor via the device 20 (distribution server system 20A). be able to.

In addition, when the terminal 10 operates as the viewer terminal 12, by executing the installed video viewing application, the first video and/or the second video distributed by the distributor terminal 11 is transmitted to the server. It can be received via the device 20 (distribution server system 20A).

In addition, when the terminal 10 operates as the viewer terminal 12, by executing the video viewing application, gift data indicating that a gift is to be given to the distributor and/or gift data to the distributor can be generated. Comment data indicating that a comment is to be transmitted can be transmitted to the distributor terminal 11 via the server device 20 (distribution server system 20A).

Note that the video distribution application and the video viewing application described above can be installed and executed on each terminal 10 as one integrated application or as separate applications.

Each terminal 10 is any terminal capable of performing such operations, and may include, but is not limited to, a smartphone, a tablet, and/or a personal computer. Furthermore, each terminal 10 is configured to be able to perform collaborative distribution (joint distribution/collaboration distribution), for example.

Note that in the following explanation, collaborative distribution means, for example, that a plurality of distributors jointly perform distribution using their respective terminals. Note that the collaboration distribution may include, for example, video distribution using an avatar of the first distributor and an avatar of another distributor. Furthermore, in the case of performing collaborative distribution, for example, each of a plurality of distributors may be treated separately. For example, one of the multiple distributors may be treated as a host, and the remaining distributors may be treated as guests. Specifically, for example, when two distributors (a first distributor and a second distributor) execute a collaborative distribution, the first distributor is treated as a host, and the second distributor is treated as a guest. can be treated. In this case, once the collaborative distribution ends, the first distributor will continue the distribution, but the second distributor will no longer be able to continue the distribution. Note that the second distributor may be configured to be able to view the distribution as a viewer, for example, when the second distributor is unable to continue the distribution.

In addition, if multiple broadcasters are treated separately, for example, the content displayed on the display screen of the terminal operated by the host may be different from the display content displayed on the display screen of the terminal operated by the guest. may be configured differently. Further, in the case where each of a plurality of distributors is treated separately, for example, the number of commands that can be operated by the host may be greater than the number of commands that can be operated by a guest.

The term "gift" used in this application means a concept similar to the term "token". Therefore, it is also possible to understand the technology described in the present application by replacing the term "gift" with the term "token."

1-2. Server device 20
As shown in FIG. 1, the server device 20 includes, for example, a distribution server system 20A and a web server device 20B.

The distribution server system 20A can distribute the first video and/or the second video transmitted by the distributor terminal 11 to the viewer terminal 12. The distribution server system 20A also transmits gift data sent by the viewer terminal 12 indicating that a gift will be given to a certain distributor and/or gift data indicating that a comment will be sent to a certain distributor. Comment data indicating this can be transmitted to the distributor terminal 11.

In order to perform such operations, the distribution server system 20A, in one embodiment, connects a distribution server device 20A1 and a distribution server device 20A1, which are connected to each other via a communication line (including a wireless line and/or a wired line not shown). , a database (DB) server device 20A2, and a game API server device 20A3.

The distribution server device 20A1 can distribute the first video and/or the second video transmitted by the distributor terminal 11 to each terminal 10. Further, the distribution server device 20A1 can store gift data and/or comment data transmitted by each viewer terminal 12 in the DB server device 20A2.

The DB server device 20A2 stores the gift data and/or comment data received from the distribution server device 20A1, reads out the gift data and/or comment data queried by the game API server device 20A3, and sends the gift data and/or comment data to the game API server device 20A3. Can be sent.

When the game API server device 20A3 receives an inquiry about the gift data and/or comment data from the distributor terminal 11, the game API server device 20A3 reads the gift data and/or comment data for the distributor terminal 11 from the DB server device 20A2, and It can be transmitted to the terminal 11.

In the example shown in FIG. 1, for the purpose of distributing the load, the distribution server system 20A includes three server devices including a distribution server device 20A1, a DB server device 20A2, and a game API server device 20A3. A configuration with . However, at least one of these three server devices may be integrated with at least one of the remaining server devices.

1-3. studio unit 30
The studio unit 30 may be placed in a studio, room, hall, or the like where a performer (distributor) distributes a moving image. As described above, the studio unit 30 is capable of performing the same functions as the terminal 10 and/or the server device 20. In FIG. 1, broken lines indicate that data can be communicated between the studio unit 30 and other devices, and solid lines indicate that data can be communicated between other devices.

2. Hardware Configuration of Each Device Next, an example of the hardware configuration of each of the terminal 10, server device 20, and studio unit 30 will be described.

2-1. Hardware Configuration of Terminal 10 An example of the hardware configuration of each terminal 10 will be described with reference to FIG. 2. FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the terminal 10 (server device 20) shown in FIG. (described in connection with device 20).

As shown in FIG. 2, each terminal 10 includes, for example, a central processing unit 14, a main storage device 15, an input/output interface device 16, an input device 17, an auxiliary storage device 18, and an output device 19. can be included. These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 14 is referred to as a "CPU" and performs calculations on instructions and data stored in the main storage device 15, and stores the results of the calculations in the main storage device 15. be. Further, the central processing unit 14 can control the input device 17, the auxiliary storage device 18, the output device 19, etc. via the input/output interface device 16. Terminal 10 may include one or more such central processing units 14.

The main storage device 15 is referred to as a "memory" and stores commands and data received from the input device 17, auxiliary storage device 18, and communication line 30 (server device 20, etc.) via the input/output interface device 16. , as well as the calculation results of the central processing unit 14. The main storage device 15 includes volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive). computer readable media such as, but not limited to, hard drives (HDDs), solid state drives (SSDs), magnetic tape, optical media). As will be readily understood, the term "computer-readable recording medium" refers to a transmission medium such as a modulated or transitory data signal, and not a transmission medium such as a modulated data signal or a transitory signal, but rather a data storage medium such as a memory and a storage medium. A medium can be included.

The auxiliary storage device 18 is a storage device that has a larger capacity than the main storage device 15. Instructions and data (computer programs) constituting the above-mentioned specific applications (video distribution application, video viewing application, etc.), web browser application, etc. can be stored. Further, the auxiliary storage device 18 can transmit these instructions and data (computer programs) to the main storage device 15 via the input/output interface device 16 by being controlled by the central processing unit 14 . The auxiliary storage device 18 can include, but is not limited to, a magnetic disk device and/or an optical disk device.

The input device 17 is a device that takes in data from the outside, and includes, but is not limited to, a touch panel, a button, a keyboard, a mouse, and/or a sensor.

The output device 19 can include, but is not limited to, a display device, a touch panel, a printer device, and the like.

In such a hardware configuration, the central processing unit 14 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 18 into the main storage device 15, and By operating commands and data, the output device 19 is controlled via the input/output interface device 16, or other devices (for example, the server device 20, etc.) are controlled via the input/output interface device 16 and the communication line 2. Various data can be sent and received between the terminal 10 and/or the studio unit 30, etc.).

Thereby, the terminal 10 can perform at least one of the operations exemplified in (a) to (d) below, for example, by executing the installed specific application.
(a) Appropriate operation for distributing the first video and/or second video (b) Appropriate operation for receiving gift data and/or comment data sent to the own terminal 10 by another terminal 10 (c) Appropriate operation for receiving the first video and/or second video distributed by another terminal 10 (d) Sending gift data and/or comment data to another terminal 10 proper operation of

Note that the terminal 10 may include one or more microprocessors and/or graphics processing units (GPUs) instead of or in addition to the central processing unit 14.

2-2. Hardware Configuration of Server Apparatus 20 An example of the hardware configuration of each server apparatus 20 will be described with reference to FIG. 2 as well. As for the hardware configuration of each server device 20 (distribution server device 20A1, DB server device 20A2, game API server device 20A3, game server device 20B1, and content server device 20B2), for example, each of the above-mentioned terminals 10 It is possible to use the same hardware configuration. Therefore, reference numerals for components included in each server device 20 are shown in parentheses in FIG. 2.

As shown in FIG. 2, each server device 20 includes, for example, a central processing unit 24, a main storage device 25, an input/output interface device 26, an input device 27, an auxiliary storage device 28, an output device 29, can include. These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 24, the main memory 25, the input/output interface device 26, the input device 27, the auxiliary storage 28, and the output device 29 are the central processing unit 14, the main memory included in each terminal 10 described above, respectively. The device 15, input/output interface device 16, input device 17, auxiliary storage device 18, and output device 19 can be substantially the same.

In such a hardware configuration, the central processing unit 24 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 28 into the main storage device 25, and By operating instructions and data, the output device 29 is controlled via the input/output interface device 26, or alternatively, via the input/output interface device 26 and the communication line 2, other devices (for example, each terminal 10 and/or or the studio unit 30, etc.).

Thereby, the server device 20 performs an appropriate operation for distributing the first video and/or second video transmitted by the distributor terminal 11 to each viewer terminal 12, and performs a certain distribution by each viewer terminal 12. Appropriate operations (including various operations to be described in detail later) can be performed to transmit the gift data and/or comment data sent to the sender terminal 11 to the sender terminal 11.

Note that the server device 20 may include one or more microprocessors and/or graphics processing units (GPUs) instead of or together with the central processing unit 24.

2-3. Hardware Configuration of Studio Unit 30 As described above, the studio unit 30 is capable of performing the same functions as the terminal 10 and/or the server device 20. Therefore, the studio unit 30 can have the same hardware configuration as the terminal 10 or server device 20 described above.

3. Functions of Each Device Next, an example of the functions each of the terminal 10, server device 20, and studio unit 30 have will be described.

3-1. Functions of terminal 10 An example of the functions of terminal 10 will be described with reference to FIG. 3. FIG. 3 is a block diagram schematically showing an example of the functions of the terminal 10 shown in FIG. 1.

As shown in FIG. 3, the terminal 10 includes, for example, a first video generation section 100, a second video generation section 110, a communication section 120, a display section 130, a storage section 140, a user interface section 150, A gift processing unit 160 may be included.

(1) First video generation unit 100
The first video generation unit 100 can generate a first video including an animation of the distributor's avatar object based on motion data regarding the distributor's actions. In order to realize this, the first moving image generation section 100 can include, for example, an acquisition section 102 and a processing section 104. Note that, for example, the motion data may be acquired using a motion capture system. As will be readily appreciated by those skilled in the art having the benefit of this disclosure, some examples of suitable motion capture systems that may be used with the apparatus and methods disclosed in this application include those using passive or active markers. or optical motion capture systems that do not use markers, and inertial and magnetic non-optical systems. The motion data is captured using an image capture device (such as a CCD (charge coupled device) or CMOS (complementary metal oxide semiconductor) image sensor) coupled to a computer that converts the motion data into video or other image data. It can be obtained by

The acquisition unit 102 includes one or more first sensors 102a that acquire data regarding the distributor's body, and one or more second sensors 102a that acquire audio data regarding speech and/or singing uttered by the distributor. The sensor 102b can be included.

The first sensor 102a is connected to, for example, a camera 102c. The camera 102c can include, for example, an RGB camera that captures images of visible light, and a near-infrared camera that captures images of near-infrared rays. As the camera 102c, for example, one included in the True Depth camera of iPhone X (registered trademark) can be used. The second sensor 102b is connected to the microphone 102d, for example, and acquires and records the audio input to the microphone 102d. Note that the first sensor 102a and the camera 102c may be provided as one structure. Moreover, the second sensor 102b and the microphone 102d may be provided as one structure.

First, regarding the first sensor 102a, the acquisition unit 102 images the distributor's body using the first sensor 102a placed close to the distributor's body. Thereby, the acquisition unit 102 can generate data (for example, an MPEG file) in which an image acquired by an RGB camera is recorded over a unit time in association with a time code (a code indicating the time of acquisition). Furthermore, the acquisition unit 102 stores data (for example, TSV files) can be generated. Note that the TSV file is a file in which a plurality of pieces of data are recorded with data separated by tabs.

Regarding the near-infrared camera, specifically, a dot projector emits an infrared laser that forms a dot pattern onto the performer's body, and the near-infrared camera captures the infrared dots that are projected onto the performer's body and reflected. Generates an image of the infrared dots captured in this way. The acquisition unit 102 compares the image of the dot pattern emitted by the dot projector registered in advance and the image captured by the near-infrared camera, and extracts each point (each feature point) (for example, 51 points) in both images. The depth of each point (each feature point) (the distance between each point/feature point and the near-infrared camera) can be calculated using the positional shift at each point (each feature point). The acquisition unit 102 can generate data recorded over a unit time by associating the numerical value indicating the depth calculated in this manner with the time code as described above.

Next, regarding the second sensor 102b, the acquisition unit 102 acquires audio related to speech and/or singing uttered by the distributor using the second sensor 102b placed close to the distributor's body. . Thereby, the acquisition unit 100 can generate data (for example, an MPEG file) recorded over a unit time in association with the time code. In one embodiment, the acquisition unit 102 uses the first sensor 102a to acquire data regarding the distributor's body, and at the same time uses the second sensor 102b to acquire data regarding the utterances and/or songs uttered by the distributor. It is possible to obtain audio data related to In this case, the acquisition unit 102 corresponds to the same time code the image acquired by the RGB camera and the audio data related to speech and/or singing uttered by the distributor using the second sensor 102b. data (for example, an MPEG file) recorded over a unit time can be generated.

The acquisition unit 102 acquires data related to the distributor's body (MPEG file, TSV file, etc.) and/or audio data related to speech and/or singing uttered by the distributor (MPEG file, etc.) generated in this way. , and can be output to the processing unit 104.

Note that although a case has been described here in which the first sensor 102a includes an RGB camera and an infrared camera, the first sensor 102a may include, for example, any one of the following (A) to (C). is also possible.
(A) A camera that detects infrared light emitted by an infrared laser and reflected on the performer's face. (B) Multiple RGB cameras that capture visible light. (C) A single camera that captures visible light.

In the case of (A) above, the acquisition unit 102 can calculate the depth of each feature point on the distributor's body using a method similar to that described above. In the case of (B) above, the acquisition unit 102 can calculate the depth of each feature point on the distributor's body using a plurality of images captured by a plurality of RGB cameras. In the case of (C) above, the acquisition unit 102 uses deep learning or the like to calculate the depth of each feature point on the distributor's body from an image captured by a single camera. I can do it. In the case of (C) above, the acquisition unit 102 calculates the depth of each feature point on the performer's body by analysis processing (image processing, etc.) on the image captured by a single camera. It's okay.

The processing unit 104 can generate a video including an animation of a virtual character (the broadcaster's avatar object) based on the data regarding the distributor's body from the acquisition unit 102 . Regarding the virtual character video itself, the processing unit 104 uses various data (for example, geometry data, bone data, texture data, shader data, blend shape data, etc.) stored in a character data storage unit (not shown). By causing a rendering unit (not shown) to perform rendering, a moving image of a virtual character can be generated.

Furthermore, the processing unit 104 uses the data regarding the distributor's body (data regarding the depth of each feature point on the performer's body) from the acquisition unit 102 to create a video (for example, the avatar object's A variety of well-known technologies are used to create videos in which the facial expressions of the avatar object change in synchronization with the movements of the performer's mouth and eyes, i.e. videos in which the facial expressions of the avatar object change by lip-syncing and following the performer's gaze. can be generated.

Note that any other known technique may be used to generate the first video including the animation of the broadcaster's avatar object based on the motion data regarding the broadcaster's movements.

(2) Second video generation unit 110
The second video generation unit 110 can generate a second video related to the game based on the operation data regarding the distributor's operation using the web page received from the web server device 20B.

Specifically, the second video generation unit 110 executes a game program embedded in a web page received from the web server device 20B. Thereby, the second video generation unit 110 draws a second video (game video) related to a game in which at least one game object operates, based on the operation data indicating the distributor's operation input by the user interface unit 150. can do. Note that, for example, the operation data can include one or more of the following data.
・Data showing how the broadcaster swiped the touchpad display ・Data showing which objects the broadcaster tapped or clicked ・Data showing how the broadcaster dragged the touchpad display・Other such operational data

Further, the second video generation unit 110 causes the second video to be displayed based on the gift data generated by the viewer terminal 12 of each viewer who views the second video and transmitted to the distributor terminal 11. At least one game object can be controlled. Note that the gift data is data indicating that a gift will be given to the distributor.

(3) Communication department 120
The communication unit 120 can communicate various information required for video distribution and/or viewing with the distribution server system 20A and the web server device 20B. For example, when the terminal 10 operates as the distributor terminal 11, the communication unit 120 accesses the web server device 20B to create a web page (HTML document) containing a game program necessary for executing the game, etc. can be received. Further, when the terminal 10 operates as the distributor terminal 11, the communication unit 120 transmits the first video and/or the second video to the distribution server system 20A, and the gift data and the gift data sent to the distributor. /Or comment data can be received from the distribution server system 20A.

Furthermore, when the terminal 10 operates as the viewer terminal 12, the communication unit 120 receives the first video and/or the second video transmitted by the distributor terminal 11 from the distribution server system 20A, and sends it to the distributor. In response, gift data and/or comment data can be transmitted to the distribution server system 20A.

(4) Display section 130
The display unit 130 can display various data required for video distribution and/or viewing. For example, the display unit 130 can display the distributed first video and/or second video, the received first video and/or second video, and the like.

(5) Storage unit 140
The storage unit 140 can store various data required for distributing and/or viewing videos.

(6) User interface section 150
The user interface unit 150 can input various data required for video distribution and/or viewing through user operations. For example, the user interface unit 150 can input operation data indicating the content of the distributor's operation when executing the game from the distributor, and output it to the second video generation unit 110.

(7) Gift processing section 160
The gift processing unit 160 can process gift data transmitted and received regarding video distribution and/or viewing. For example, when the terminal 10 operates as the distributor terminal 11, the gift processing unit 160 can process gift data sent to the distributor. Furthermore, when the terminal 10 operates as the viewer terminal 12, the gift processing unit 160 can process gift data to be transmitted by this viewer. For example, when gift data (identification information that specifies a gift) is transmitted from the viewer terminal 12, the gift data is transmitted to the target distributor terminal 11 via the server 20. Then, the target distributor terminal 11 reads the drawing data from the gift data transmitted from the viewer terminal 12 and displays a display related to the gift on the display unit 130.

3-2. Functions of the server device 20 An example of the functions of the server device 20 will be described with reference to FIG. 4. FIG. 4 is a block diagram schematically showing an example of the functions of the server device 20 shown in FIG. 1. As shown in FIG. 4, the server device 20 includes, for example, a communication section 200, a storage section 210, a gift processing section 220, and a determination section 230.

(1) Communication department 200
The communication unit 200 can communicate various data required for video distribution and/or viewing with the distributor terminal 11 and/or the viewer terminal 12. For example, when operating as the distribution server system 20A, the server device 20 can receive the first video and/or the second video from the distributor terminal 11 and distribute it to each viewer terminal 12. Further, when operating as the web server device 20B, the server device 20 can transmit a web page in which a game program is installed to the distributor terminal 11 that has accessed the server device 20B.

(2) Storage unit 210
The storage unit 210 stores, for example, various data required for video distribution and/or viewing. The data stored in the storage unit 210 includes, for example, data related to "gift data." The data stored in the storage unit 210 is updated, for example, each time the terminal 10 executes a distribution and/or views the distribution.

The "gift data" includes, for example, the number of gifts, gift value, gift type, gift level, etc., which are digitized according to a predetermined table, and the total numerical value of each gift is written. Furthermore, for example, the "gift data" may include at least one of the time, frequency, and number of times a gift was given (sent) from the viewer terminal 12 to the distributor terminal 11. Note that the number of gifts is the number given by the viewer terminal 12 to the distributor terminal 11. Here, "gift value" means, for example, if the gift is paid, the price of the gift corresponds to the value, and if the gift is free, the consumption points of the gift correspond to the value. do. In addition, the "value of a gift" is determined based on, for example, the usage time of the gift, the display time of the gift, and/or the number of people who can use the gift at the same time, and the total number of gifts available in the game. It may be something that is done. Note that the fact that the usable time of the gift is short means that the value of the gift is high. Furthermore, if the usable time of the gift is long, it means that the value of the gift is low. Furthermore, a long display time of the gift means that the gift is of high value. Furthermore, a short display time of the gift means that the gift is of low value. Furthermore, the fact that the number of people who can use the gift at the same time is small means that the gift is of high value. Furthermore, the fact that the number of people who can use the gift at the same time is large means that the value of the gift is low. Furthermore, the fact that the total number of gifts available in the game is small means that the gifts are rare and valuable. Furthermore, the fact that the total number of gifts that can be obtained in the game is large means that the gifts are rare and have a low value rather than being rare.

(3) Gift processing section 220
The gift processing unit 220 can process gift data sent from each viewer to each distributor. Note that if the server device 20 operates as the web server device 20B, the gift processing unit 220 may be omitted.

(4) Determination unit 230
The determination unit 230 determines various conditions, and performs processing such as S314 in FIG. 5, which will be described later.

3-3. Functions of Studio Unit 30 As described above, the studio unit 30 is capable of performing the same functions as the terminal 10 and/or the server device 20. Therefore, the studio unit 30 can have the functions of the terminal 10 described with reference to FIG. 3 and/or the functions of the server device 30 described with reference to FIG. 4.

4. Overall Operation of Video Distribution System 1 Next, the overall operation performed in the video distribution system 1 having the above configuration will be described with reference to FIG. 5. FIG. 5 is a flowchart showing an example of operations performed in the video distribution system 1 shown in FIG. The processing of S302 to S316 shown in FIG. 5 will be described below.

In S302, the distributor terminal 11 starts and executes the video distribution application according to the operation of the first distributor. Note that in the following description, the distributor terminal 11 may be simply referred to as the distributor terminal 11.

In S304, the distributor terminal 11 generates data used to distribute the first video. The data is, for example, data for causing the viewer terminal 12 to perform rendering. Further, the first video is distributed using the first distribution method. The first distribution method is, for example, a distribution method in which data that causes the viewer terminal 12 to perform rendering is distributed to the viewer terminal 12. For example, the distributor terminal 11 transmits data that causes the viewer terminal 12 to perform rendering to the distribution server device 20A1 of the distribution server system 20A. The distribution server device 20A1 distributes the data received from the distributor terminal 11 to the viewer terminal 12 running the video viewing application. The viewer terminal 12 displays the first video on the display unit 130 of the viewer terminal 12 by performing rendering processing based on the data received from the distribution server device 20A1. Note that the viewer terminal 12 may receive data used for rendering from the distributor terminal 11 and perform the rendering process.

In S306, when the first distributor selects, for example, a "game" icon (not shown) displayed on the display unit 130 of the distributor terminal 11, the distributor terminal 11 selects the "game" icon (not shown) displayed on the display unit 130 of the distributor terminal 11. Perform browser functions. Note that the server device 20 performs a first determination to determine whether there is a request to run the game when distribution of the first video has started, and in the first determination, it is determined that there is a request. In this case, the distributor terminal 11 causes the process of S308 to be performed. Here, the request is included in data transmitted from the distributor terminal 11 to the server device, for example. The request is, for example, when the first distributor selects the "game" icon (not shown) displayed on the display unit 130 of the distributor terminal 11, as described above.

In S308, the distributor terminal 11 executes the video distribution application (that is, distributes the first video to each viewer terminal 12) and accesses the web server device 20B to download the game program. Receive an embedded HTML5 document.

In S310, the distributor terminal 11 can generate a video (second video) related to the game by executing the game program incorporated in the received HTML5 document.

In S312, the first distributor uses the distributor terminal 11 to distribute the second video. Here, the second distribution method is, for example, an RTMP (Real Time Messaging Protocol) distribution method. Note that in S312, the distribution server device 20A1 distributes the second video received from the first distributor terminal 11A to each viewer terminal 12 running the video viewing application. Thereby, the second moving image can be displayed on the display unit 130 of each viewer terminal 12.

In S314, the server device 20 determines whether distribution of the second video has ended. When the server device 20 determines whether or not the distribution of the second video has ended (YES in S314), the process of S316 is performed. On the other hand, if the server device 20 determines that it has not yet determined whether the distribution of the second video has ended (NO in S314), the process of S314 is repeated.

In S316, the server device 20 switches from the second distribution method to the first distribution method and distributes the first video. Note that after the processing in S316, the first determination regarding the determination of the presence or absence of a request to execute the game may be performed again.

Note that the conditions for ending the game in S314 include, for example, when the distributor instructs a request to end the game and data corresponding to the request is transmitted from the distributor terminal 11, or when the conditions for the game are satisfied. The game ends in either of the following cases: , and when a predetermined period of time has elapsed since the start of the game. Here, the above-mentioned "game conditions" include, for example, defeating a character other than the character operated on a stage prepared in the game, obtaining a predetermined item on the stage, or defeating a character other than the character operated on the stage prepared in the game. The conditions include that the character is moved to a predetermined position, or that the parameters of the character operated on the stage are greater than or equal to a predetermined value or less than a predetermined value. Note that defeating a character different from the character you are controlling on a stage prepared in the game, obtaining a certain item on that stage, or moving the character you are controlling on that stage to a specified position means This can be equivalent to clearing the .

As described above, according to the present disclosure, a first determination is made to determine whether there is a request to run the game when distribution of the first video has started, and it is determined in the first determination that there is a request. In this case, the second video can be distributed using the second distribution method, which has a relatively larger amount of distribution data among the first distribution method and the second distribution method. Therefore, even if the distribution method during game distribution and the distribution method before and after game distribution are different, the distribution method can be dynamically switched. Therefore, it is possible to perform distribution with a higher degree of freedom than in the past.

Note that the first distribution method is not limited to being a distribution method in which data to be rendered on the viewer terminal 12 is distributed to the viewer terminal 12. Further, the second distribution method is not limited to the RTMP distribution method, and for example, video data regarding a display screen displayed on the distributor terminal 11 at the viewer terminal 12 is distributed to the viewer terminal 12. Any distribution method is fine. Each of the first distribution method and the second distribution method includes, for example, the features described in FIG. 6 .

FIG. 6 shows an example of the characteristics of the first distribution method and the second distribution method. As shown in FIG. 6, in the distribution using the first distribution method, the amount of distributed data is smaller and the delivery delay is smaller than in the distribution using the second distribution method. That is, in the distribution by the second distribution method, the amount of distribution data is larger and the delivery delay is larger than that in the distribution by the first distribution method. Furthermore, in the case of distribution using the first distribution method, a display data generation module on the terminal 10 is required, and rendering processing is required on the terminal 10 side, whereas in the case of distribution according to the second distribution method, the terminal A display data generation module on the terminal 10 is unnecessary, and rendering processing on the terminal 10 side is unnecessary. Moreover, the distribution data distributed by the first distribution method includes motion data, whereas the distribution data distributed by the second distribution method does not include motion data. Furthermore, in distribution using the first distribution method, the content displayed on the terminal 10 can be changed for each user, whereas in distribution using the second distribution method, the content displayed on the terminal 10 is the same for each user. It is.

FIG. 7 is a generalization of a suitable computing environment 1400 in which the embodiments, techniques, and techniques described herein may be implemented, including transmitting and using tokens to render video in a computing environment. Here is an example. For example, computing environment 1400 may implement any of a terminal device (or broadcaster or viewer), a distribution server system, etc., as described herein.

Computing environment 1400 is not intended to suggest any limitation as to the scope of use or functionality of the technology, as the technology may be implemented in a wide variety of general purpose or special purpose computing environments. For example, the technology disclosed herein can be applied to a variety of portable devices, a variety of multiprocessor systems, a variety of microprocessor-based or programmable consumer electronics products, a variety of networked PCs, a variety of minicomputers, a variety of It may also be implemented with a variety of other computer system configurations, including mainframe computers and the like. The techniques disclosed herein may be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Referring to FIG. 7, computing environment 1400 includes at least one central processing unit 1410 and memory 1420. In FIG. 7, this most basic configuration 1430 is included within the dashed line. Central processing unit 1410 executes computer-executable instructions, and central processing unit 1410 may be a real processor or a virtual processor. In a multi-processing system, multiple processors can operate simultaneously because multiple processing units execute computer-executable instructions to increase processing power. Memory 1420 may be volatile memory (eg, registers, cache, RAM), non-volatile memory (eg, ROM, EEPROM, flash memory, etc.), or some combination of the two. Memory 1420 stores, for example, software 1480 and various images and videos that can implement the techniques described herein. The computing environment may have a variety of additional features. For example, computing environment 1400 includes storage 1440, one or more input devices 1450, one or more output devices 1460, and one or more communication connections 1470. An interconnection mechanism (not shown), such as a bus, controller, or network, interconnects the various components of computing environment 1400. Typically, operating system software (not shown) provides an operating environment for other software running on computing environment 1400 and coordinates various activities of various components of computing environment 1400.

Storage 1440 may be removable or non-removable, and may include magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or other devices used to store information. and any other media that can be stored and accessed within computing environment 1400. Storage 1440 stores instructions for software 1480, plug-in data, and messages that may be used to implement the techniques described herein.

The one or more input devices 1450 may include a touch input device, such as a keyboard, keypad, mouse, touch screen display, pen, or trackball, an audio input device, a scanning device, or another device that provides input to the computing environment 1400. It may be a device. In the case of audio, the one or more input devices 1450 may be a sound card or similar device that accepts audio input in analog or digital format, or a CD-ROM reader that provides various audio samples to the computing environment 1400. good. One or more output devices 1460 may be a display, printer, speaker, CD writer, or another device that provides output from computing environment 1400.

One or more communication connections 1470 enable communication to another computing entity via a communication medium (eg, a connection network). Communication media convey information such as computer-executable instructions, compressed graphics information, video, or other data in a modulated data signal. The one or more communication connections 1470 are not limited to wired connections (e.g., Megabit or Gigabit Ethernet, InfiniBand, or Fiber Channel via electrical or fiber optic connections), but can also include wireless technologies (e.g., Bluetooth, WiFi). (IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared, etc.), as well as various agents, various bridges, and various destination agents disclosed herein. including various other suitable communication connections for providing network connectivity to data consumers. In a virtual host environment, one or more communication connections may be virtualized network connections provided by a virtual host.

Various embodiments of the various methods disclosed herein are performed in the computational cloud 1490 using instructions executable by a computer implementing all or a portion of the techniques disclosed herein. It can be done. For example, different agents may perform different vulnerability scanning functions in the compute environment, while agent platforms (e.g., bridges) and destination agent data consumer services may be located within the compute cloud 1490. It can be executed on any server.

Computer readable media are any available media that can be accessed within computing environment 1400. By way of example and not limitation, with respect to computing environment 1400, computer readable media includes memory 1420 and/or storage 1440. As will be readily understood, the term computer readable medium includes data storage media such as memory 1420 and storage 1440 and does not include transmission media such as modulated various data signals.

5. Modifications In the above description, an example has been described in which steps S302 to S312 shown in FIG. 5 are sequentially executed, but the present invention is not limited to this. For example, at least a part of the processing from S302 to S310 described in FIG. 5 may be omitted. For example, after the flowchart in FIG. 5 starts, by performing an operation to select one game icon from among at least one executable game icon displayed on the home screen of the display unit 130 of the terminal 10, The second video may be distributed using the second distribution method described in S312. Thereby, distribution of the second video can be started without distributing the first video. Note that if the distribution of the second video is stopped after the second video is distributed by the second distribution method described in S312 by selecting the icon of the one game, the second video is distributed from the second distribution method. 1 distribution method, and distribution using the first distribution method is performed.

Further, for example, the server device 20 performs a second determination to determine whether or not the first video is distributed only by the first distributor, and depending on the result of the second determination, the server device 20 It may be determined whether or not the icon for executing the game displayed on the display unit 130 of is to be made selectable. For example, if it is determined in the second determination that the first video is distributed only by the first distributor, the icon is configured to be selectable. Further, for example, when it is determined in the second determination that the distribution of the first video includes the first distributor and other distributors, the icon is configured to be unselectable.

Note that if data related to a gift transmitted from the viewer terminal 12 is transmitted during distribution using the first distribution method, for example, the data related to the gift may be transmitted during distribution using the first distribution method. The information may be distributed to the viewer terminal 11 and/or the viewer terminal 12.

Furthermore, when data related to a gift transmitted from the viewer terminal 12 is transmitted during distribution using the second distribution method, for example, the data related to the gift is transferred from the second distribution method to the first distribution method. In this case, the content may be distributed to the distributor terminal 11 and/or the viewer terminal 12 during distribution using the first distribution method.

In addition, when receiving data related to a gift from any viewer's terminal in the game, the data related to the gift transmitted from the viewer terminal 12 during distribution using the second distribution method is, for example, It may be distributed to the distributor terminal 11 and/or the viewer terminal 12 during distribution using the second distribution method.

Further, in the case where the first video includes audio and is distributed by the first distribution method, the first video is displayed on the display screen of the viewer terminal 12 while the audio is being distributed to the viewer terminal 12. If the display does not include animation, the viewer terminal 12 may issue a notification when switching from the first distribution method to the second distribution method. Here, the display that does not include animation in the first video is, for example, a display indicating whether the first video is being played or not, and a display indicating the elapsed time since distribution of the first video started. , including at least one of the following.

Further, the above-mentioned notification is, for example, an audio output from the viewer terminal 12 and/or a display on the display screen of the viewer terminal 12, and the display is a display of at least one character and/or at least one character. There may be. The at least one character is, for example, "Audio is not played in some games" and is displayed in the distribution name frame.

Further, the above-mentioned notification is, for example, to notify the viewer terminal 12 that audio will not be distributed during distribution of the second video.

Note that after switching from the first distribution method to the second distribution method and distributing the second video, the audio is no longer distributed to the viewer terminal 12, and then the distribution of the second video is stopped and the second distribution is started. When the system is switched to the first distribution system, the audio may be distributed to the viewer terminal 12 again.

In addition, in the various embodiments described above, when the distributor terminal 11 receives an HTML (particularly HTML5) document in which a game program is embedded from the web server device 20B in order to generate a video related to the game (second video), has been described, but is not limited thereto. For example, instead of having a configuration in which the distributor terminal 11 receives an HTML document in which a game program is incorporated from the web server device 20B, the distributor terminal 11 executes an installed video distribution application and receives an HTML document from the data server device (not shown). It is also possible to generate a second video including a screen related to the game by receiving appropriate data from the game.

In the various embodiments described above, the distributor terminal 11 may be a smartphone or the like, or may be a dedicated terminal installed in a studio or the like. In this case, at least one server device among the distribution server device 20a, DB server device 20b, and game API server device 20c included in the distribution server system 20A is installed alongside the above-mentioned dedicated terminal in the studio or the like. You can also do this.

In the various embodiments described above, the operations of each terminal 10 described above can be similarly executed by the studio unit 30 having the same configuration as this terminal 10. In this case, the studio unit 30A illustrated in FIG. 1 can have the same functions as the terminal 10 for distributing moving images. Similarly, the studio unit 30B illustrated in FIG. 1 can have the same functions as the terminal 10 for viewing videos. Furthermore, the operations of each server device 20 described above can also be executed by a studio unit 30 having a similar configuration to this server device 20.

The various embodiments described above can be used in combination with each other as long as no contradiction or inconvenience occurs. Given the many possible embodiments to which the principles of the invention disclosed herein may be applied, the various illustrated embodiments are merely preferred examples, and the techniques of the claimed invention It should be understood that the scope should not be considered limited to these preferred examples. In fact, the scope of the claimed invention is defined by the appended claims. Therefore, we request that a patent be granted for all inventions that fall within the technical scope of the claimed inventions as inventions of the present inventors.

In addition, the games in the present disclosure include, for example, role-playing games, simulation games, shooting games, action games, card games, mahjong, Go, Othello, puzzle games, quiz games, sports games, and/or board games, etc. It is executed by

In the second example, the distributor terminal 11 executes the installed game application and accesses the distribution server system 20A, which also functions as a game server device, to display the screen of the game being executed. It is also possible to distribute to each viewer's terminal 10 via the distribution server system 20A. Also in these first and second examples, the distributor terminal 11 can generate the second video using the viewing parameters received from the distribution server system 20A, as in the various embodiments described above. It is.

Furthermore, in the third example, in the first example or the second example, the distributor terminal 11 transmits the operation data of the first distributor to the web server device 20B or the distributor without generating a game screen. It can be transmitted to the server system 20A. In this case, the web server device 20B or the distribution server system 20A generates a game screen using the operation data, and the distribution server system 20A transmits the second video including the generated game screen to each viewer's terminal 10. Can be delivered. In this third example, when the web server device 20B generates a game screen, the web server device 20B can use the viewing parameters received from the distribution server system 20A. When the distribution server system 20A generates a game screen, the distribution server system 20A can use viewing parameters that it manages itself.

In this way, the technology of the present disclosure can provide a computer program, a method, and a server device that improve the game's interest by expanding the aspect of game distribution compared to the past.

The computer program according to the first aspect includes: ``by being executed by at least one processor, motion data regarding the motion of the first broadcaster or an animation of the avatar of the first broadcaster generated based on the motion data; and a second video related to a game executed by a computer, which is generated based on operation data regarding the operations of the first distributor, to at least one viewer via a communication line. A first determination is made to determine whether there is a request to execute the game when the first video is distributed to a terminal and distribution of the first video is started, and it is determined in the first determination that there is a request. In this case, the processor is made to function to distribute the second video using the second distribution method, which has a relatively large amount of distribution data among the first distribution method and the second distribution method.

A computer program according to a second aspect is such that, in the first aspect, "the first determination is performed when distribution of the first video using the first distribution method has started."

In the computer program according to the third aspect, in the first aspect or the second aspect, "the first distribution method transmits data to be rendered on the viewer terminal of the at least one viewer". This is a distribution method in which the content is distributed to the viewer terminals of the following viewers.

A computer program according to a fourth aspect is a computer program according to any one of the first aspect to the third aspect, in which "the second distribution method is configured such that the first distributor's This is a distribution method in which video data related to a display screen displayed on a distributor terminal is distributed to the viewer terminal of the at least one viewer.

A computer program according to a fifth aspect includes, in any one of the first aspect to the fourth aspect, "When stopping the distribution of the second video, the second distribution method is changed to the first distribution method." ``operating the processor to switch to the specified state.''

A computer program according to a sixth aspect provides, in any one of the first to fifth aspects, "If it is determined that there is a request in the first determination, the distribution of the first moving image is A second determination is made to determine whether or not the first video is distributed only by the first distributor, and when it is determined in the second determination that the first video is distributed only by the first distributor, the processor functions to distribute the second moving image using the second distribution method.''

A computer program according to a seventh aspect includes, in any one of the first to sixth aspects, "the request is included in data transmitted from a distributor terminal of the first distributor to a server device. ” is a thing.

A computer program according to an eighth aspect is characterized in that in any one of the second aspect or the third aspect dependent on the second aspect to the seventh aspect, "during distribution by the first distribution method, The data related to the gift transmitted from the terminal of any one of the viewers of at least one viewer may be sent to the distributor terminal of the first distributor and/or the at least one viewer during distribution according to the first distribution method. ``distributed to viewers' terminals''.

A computer program according to a ninth aspect is a computer program according to any one of the first aspect to the seventh aspect: Data related to the gift to be sent may be transmitted to the first distributor's distributor terminal and/or the first distributor during distribution by the first distribution method when the second distribution method is switched to the first distribution method. "distributed to the viewer terminal of at least one viewer."

A computer program according to a tenth aspect is a computer program according to any one of the first aspect to the seventh aspect, wherein, in any one of the first to seventh aspects, "data related to a gift is transmitted from the terminal of any one of the at least one viewer in the game." If the transmission is accepted, the data related to the gift transmitted from the terminal of any of the at least one viewer during the distribution using the second distribution method is "distributed to the distributor terminal of the first distributor and/or the viewer terminal of the at least one viewer."

A computer program according to an eleventh aspect is a computer program product according to any one of the second aspect or the third aspect dependent on the second aspect to the tenth aspect. The audio is distributed by a first distribution method, and while the audio is being distributed to the viewer terminal of the at least one viewer, the audio is displayed on the display screen of the viewer terminal of the at least one viewer. If the first video is displayed without the animation, a notification is made from the viewer terminal of the at least one viewer when switching from the first distribution method to the second distribution method. "to cause the processor to function in such a way."

The computer program according to the twelfth aspect is the computer program according to the eleventh aspect, in which “the display that does not include the animation in the first video is a display indicating whether or not the first video is being played; The display includes at least one of the following: a display indicating the elapsed time since the distribution of the first video started.

A computer program according to a thirteenth aspect is a computer program according to the eleventh aspect or the twelfth aspect, in which "the notification includes an audio output from the viewer terminal of the at least one viewer and/or a sound output from the viewer terminal of the at least one viewer. A display on a display screen of a viewer terminal, and the display is a display of characters and/or characters.

A computer program according to a fourteenth aspect is a computer program according to any one of the eleventh to thirteenth aspects, in which "the notification is made to the viewer terminal of the at least one viewer during distribution of the second video. "This is a notification that the audio will not be distributed."

A computer program according to a fifteenth aspect is one in which "the communication line includes the Internet" in any one of the first to fourteenth aspects.

A computer program according to a sixteenth aspect is a computer program product according to any one of the first to fifteenth aspects, in which "the at least one processor is a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU).

A computer program according to a seventeenth aspect is a computer program product according to any one of the first to sixteenth aspects, in which the at least one processor is installed in a server device, a smartphone, a tablet, a mobile phone, or a personal computer. It is something that

The method according to the eighteenth aspect is "a method performed by at least one processor that executes computer-readable instructions, wherein the processor executes the instructions so that the first distributor operates or an animation of the avatar of the first distributor generated based on the operational data; a second video related to the game to be distributed to the viewer terminal of at least one viewer via a communication line; and a request to execute the game when distribution of the first video has started. a step of making a first determination to determine the presence or absence of the request; and when it is determined in the first determination that there is a request, a second distribution method having a relatively larger amount of distribution data among the first distribution method and the second distribution method is selected. and a step of distributing the second moving image using a distribution method.

A method according to a nineteenth aspect is a method performed by at least one processor that executes computer-readable instructions, wherein the processor executes the instructions to cause the first distributor to perform an action. or an animation of the avatar of the first distributor generated based on the operational data; a step of receiving a second video related to the game, and a first determination of determining whether or not there is a request to execute the game when distribution of the first video has started, and it is determined that there is a request to execute the game. , the step of receiving distribution of the second moving image performed by a second distribution method having a relatively large amount of distribution data among the first distribution method and the second distribution method.

A method according to a 20th aspect is that in the 18th aspect or the 19th aspect, "the communication line includes the Internet."

The method according to the twenty-first aspect is the method according to any one of the eighteenth aspect to the twentieth aspect, in which “the at least one processor is a central processing unit (CPU), a microprocessor, and/or a graphics processing unit. (GPU)”.

The server device according to the twenty-second aspect is characterized in that the server device “includes at least one processor, and the processor generates behavior data regarding the behavior of the first distributor or an avatar of the first distributor generated based on the behavior data. A first video including an animation and a second video related to a game executed by a computer, generated based on operation data regarding the operation of the first distributor, are viewed by at least one viewer via a communication line. perform a first determination to determine whether there is a request to execute the game when distribution of the first video has started, and it is determined in the first determination that there is a request to execute the game. In this case, the second moving image is distributed using the second distribution method which has a relatively larger amount of distribution data among the first distribution method and the second distribution method.

A server device according to a twenty-third aspect is one in which “the communication line includes the Internet” in the twenty-second aspect.

The server device according to the twenty-fourth aspect is characterized in that in any one of the twenty-second to twenty-third aspects, “the at least one processor is a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU).

1 Video distribution system 2 Communication network 10 Terminal 11 First distributor terminal (distributor terminal)
12, 12A, 12B, 12C Viewer terminal 14, 24 Central processing unit 15, 25 Main storage device 16, 26 Input/output interface 17, 27 Input device 18, 28 Auxiliary storage device 19, 29 Output device 20 Server device 20A Distribution server System 20A1 Distribution server device 20A2 DB server device 20A3 Game API server device 20B Web server device 30, 30A Studio unit 100 First video generation section 102 Acquisition section 102a First sensor 102b Second sensor 102c Camera 102d Microphone 104 Processing section 110 Second Video generation section 120 Communication section 130 Display section 140 Storage section 150 User interface section 160 Gift processing section 210 Communication section 220 Storage section 230 Control section 1400 Computation environment 1410 Processing unit 1420 Memory 1430 Configuration 1440 Storage 1450 Input device 1460 Output device 1470 Communication connection 1480 Software instructions 1490 Computation cloud

Claims (16)

being executed by at least one processor;
A first video including motion data regarding the motion of the first distributor or an animation of the avatar of the first distributor generated based on the motion data, and operation data regarding the operation of the first distributor. and delivering a second video relating to a game executed by a computer to a viewer terminal of at least one viewer via a communication line;
When stopping the distribution of the second video by the second distribution method, which has a relatively large amount of distribution data between the first distribution method and the second distribution method, the second distribution method is switched to the first distribution method. causing the processor to function to distribute the first video by
computer program. The first distribution method is
A distribution method that distributes data that causes rendering to be performed on the viewer terminal of the at least one viewer to the viewer terminal of the at least one viewer,
The computer program according to claim 1. The second distribution method is
A distribution method in which video data related to a display screen displayed on a distributor terminal of the first distributor is distributed to the viewer terminal of the at least one viewer on the viewer terminal of the at least one viewer.
The computer program according to claim 1 or claim 2. The gift-related data transmitted from the terminal of any of the at least one viewer during the distribution using the first distribution method is distributed by the first distributor during the distribution using the first distribution method. and/or a viewer terminal of the at least one viewer.
A computer program according to any one of claims 1 to 3. Data related to a gift transmitted from the terminal of any one of the at least one viewer during distribution using the second distribution method is switched from the second distribution method to the first distribution method. and distributed to a distributor terminal of the first distributor and/or a viewer terminal of the at least one viewer during distribution according to the first distribution method.
A computer program according to any one of claims 1 to 3. In the case where the transmission of gift-related data is accepted from the terminal of any of the at least one viewer in the game, data related to the gift is received from any of the at least one viewer during distribution using the second distribution method. Data related to the gift transmitted from the viewer's terminal is distributed to the distributor terminal of the first distributor and/or the viewer terminal of the at least one viewer during distribution by the second distribution method. ,
A computer program according to any one of claims 1 to 3. the communication line includes the Internet;
A computer program according to any one of claims 1 to 6. the at least one processor,
including a central processing unit (CPU), microprocessor, and/or graphics processing unit (GPU);
A computer program according to any one of claims 1 to 7. the at least one processor is installed in a server device, a smartphone, a tablet, a mobile phone, or a personal computer;
A computer program according to any one of claims 1 to 8. A method performed by at least one processor executing computer readable instructions, the method comprising:
By the processor executing the instructions,
A first video including motion data regarding the motion of the first distributor or an animation of the avatar of the first distributor generated based on the motion data, and operation data regarding the operation of the first distributor. and a step of distributing a second video related to a game executed by a computer to a viewer terminal of at least one viewer via a communication line;
When stopping the distribution of the second video by the second distribution method, which has a relatively large amount of distribution data between the first distribution method and the second distribution method, the second distribution method is switched to the first distribution method. distributing the first video ;
method including. A method performed by at least one processor executing computer readable instructions, the method comprising:
By the processor executing the instructions,
A first video including motion data regarding the motion of the first distributor or an animation of the avatar of the first distributor generated based on the motion data, and operation data regarding the operation of the first distributor. and a step of receiving, via a communication line, a second video related to a game executed by the computer;
When stopping the distribution of the second video by the second distribution method, which has a relatively large amount of distribution data between the first distribution method and the second distribution method, the second distribution method is switched to the first distribution method. receiving distribution of the first video according to the first distribution method;
method including. the communication line includes the Internet;
The method according to claim 10 or claim 11. the at least one processor,
including a central processing unit (CPU), microprocessor, and/or graphics processing unit (GPU);
The method according to any one of claims 10 to 12. comprising at least one processor;
The processor,
A first video including motion data regarding the motion of the first distributor or an animation of the avatar of the first distributor generated based on the motion data, and operation data regarding the operation of the first distributor. and delivering a second video relating to a game executed by a computer to a viewer terminal of at least one viewer via a communication line;
When stopping the distribution of the second video by the second distribution method, which has a relatively large amount of distribution data between the first distribution method and the second distribution method, the second distribution method is switched to the first distribution method. delivering the first video ,
server equipment. the communication line includes the Internet;
The server device according to claim 14. the at least one processor,
including a central processing unit (CPU), microprocessor, and/or graphics processing unit (GPU);
The server device according to claim 14 or claim 15.

Images