JP2020166559A - Server system and video distribution system - Google Patents

Abstract

To provide a technique that brings new interest using tipping in video distribution.SOLUTION: A contributor video data acquisition control unit 205 acquires contributor video data in image generation space from a contributor terminal. An event area setting unit 211 sets an event area in the image generation space. A moving body control unit 207 makes a moving body appear and move in the image generation space based on an action operation input accepted by a viewer terminal. A distribution video generation control unit 209 generates distribution video obtained by synthesizing an image based on the contributor video data, an identification display of the event area, and a movement display of the moving body. A privilege granting control unit 215 performs processing for granting a given privilege to the contributor of the contributor terminal and/or a viewer who has input the action operation based on whether the moving body satisfies a given positional relation condition with respect to the event area.SELECTED DRAWING: Figure 14

Description

The present invention relates to a server system or the like that is connected to a poster terminal and a viewer terminal by communication to deliver moving images.

As a technology for live video distribution these days, viewers add comments and provide items to posters in the sense of praising the video and supporting the poster of the video. The technology that can take action in is known. In particular, the provision of items from viewers to posters is called "throwing money" or "gifts" because of the donations from the audience to street performers. Hereinafter, it is collectively referred to as "throwing money".

Patent Documents 1 and 2 also describe techniques focusing on throwing money.

Japanese Unexamined Patent Publication No. 2012-121998 Japanese Patent No. 6430059

There is a known mechanism for throwing money to the poster according to the item used by the viewer, and according to this mechanism, the poster has the effect of encouraging further posting. In addition, for viewers, it is expected to bring the joy of self-expression, such as praise and support, to publicize one's will and position to other viewers, and to have the effect of enlivening the place by throwing money. To. And above all, it enhances the empathy between posters and viewers and brings a great user experience through the same video. Therefore, not only the operators of video distribution systems but also users are demanding further enhancement of services using throwing money.

An object to be solved by the present invention is to provide a technique that brings about a new interest using throwing money in video distribution.

The first invention for solving the above-mentioned problems is a server system that is connected to a poster terminal and a viewer terminal by communication to distribute a moving image, and generates an image that is a virtual space or an extended real space from the poster terminal. A poster video data acquisition means for acquiring the poster video data in the space (for example, the poster video data acquisition control unit 205 in FIG. 14) and an event area setting means for setting an event area in the image generation space (for example, FIG. 14 event area setting unit 211) and a moving body control means (for example,) that receives an action operation input from the viewer terminal and causes a moving body to appear and move in the image generation space based on the action operation input. A moving body control unit 207) of FIG. 14, an image based on the poster video data, an identification display of the event area, and a moving display of the moving body are combined to generate a video for distribution in the image generation space. A given privilege is given to the distribution video generation means (for example, the distribution video generation control unit 209 of FIG. 14), the poster of the poster terminal, and / or the viewer who has input the action operation. A privilege granting control means (for example, privilege granting control unit 215 of FIG. 14) that executes processing based on whether or not the moving body satisfies a given positional relationship condition with respect to the event area is provided. It is a server system (for example, the server system 1100 in FIG. 1).

The "server system" referred to here may be composed of not only a single computer but also a plurality of computers in cooperation with each other.

According to the first invention, when a viewer inputs an action operation using the viewer terminal, a moving body based on the action operation input appears in the image generation space of the poster video data acquired from the poster terminal. To do. Then, when the moving body satisfies a given positional relationship condition such as approach, arrival, contact, passage, etc. with respect to the event area set in the image generation space, the poster and / or the viewer performing the action operation. Benefits are given to. Therefore, in video distribution, it is possible to provide a new hobby based on the cooperation between the poster and the viewer. In addition, a mini-game-like element can be added to the cooperation between the poster and the viewer.

Further, as a second invention, a given area attribute is set in the event area, and the privilege granting control means grants the event area based on the area attribute of the event area satisfying the positional relationship condition. The server system of the first invention may be configured to variably control the benefits.

According to the second invention, when the moving body satisfies the positional relationship condition with respect to the event area, it is possible to give a privilege according to the area attribute of the event area.

Further, as a third invention, a given area attribute is set in the event area, and a given attribute is set in the moving body or the viewer who has performed the action operation input. The second invention, wherein the privilege granting control means variably controls the privilege to be granted based on the area attribute of the event area satisfying the positional relationship condition and the attribute related to the moving body. A server system may be configured.

According to the third invention, when the moving body satisfies the positional relationship condition with respect to the event area, a privilege corresponding to the area attribute of the event area and the attribute related to the moving body can be given. ..

Further, as a fourth invention, when the plurality of moving bodies that have moved based on the action operation input by the same viewer continuously satisfy the positional relationship condition by a predetermined number, the privilege giving control means The server system of any one of the first to third inventions may be configured to give a privilege different from the case where the condition is not satisfied.

According to the fourth invention, when the moving body related to the action operation input of the same viewer continuously satisfies the positional relationship condition, the content of the privilege can be changed and given.

Further, as a fifth invention, the privilege granting control means variably controls the privilege to be granted based on the quantity of the action operation input received, the server system of any one of the first to fourth inventions. It may be configured.

According to the fifth invention, it is possible to give a privilege according to the number of action operation inputs.

Further, as a sixth invention, when the moving body has a plurality of types of moving bodies having different consideration and a given consideration payment operation for designating a plurality of the moving bodies is performed from the viewer terminal. The action operation consideration collecting means (for example, the online shopping management unit 203 of FIG. 14) that can accept the action operation input of the moving body is further provided, and the privilege granting control means satisfies the positional relationship condition. The server system of any one of the first to fifth inventions may be configured which variably controls the privilege to be given based on the type of the moving body.

According to the sixth invention, it is possible to give a privilege according to the consideration paid at the time of inputting the action operation.

Further, as a seventh invention, the distribution moving image generating means further synthesizes a display and / or an audio that notifies a viewer who has performed the action operation input on the moving body that satisfies the positional relationship condition. The server system according to any one of the first to sixth inventions may be configured to generate the video for distribution.

According to the seventh invention, it is possible to notify the viewer who has input the action operation in the moving image for distribution in the image generation space.

Further, as an eighth invention, the event area setting means variably sets at least one of the number, size, and position of the event area based on the operation input of the poster. ~ The server system of any of the seventh invention may be configured.

According to the eighth invention, the number, size, and position of the event areas set in the image generation space can be changed.

Further, as a ninth invention, the event area setting means variably sets at least one of the number, size, and position of the event area based on the number of viewers. The server system of any of the inventions of 8 may be configured.

According to the ninth invention, the number, size, and position of the event area set in the image generation space can be changed according to the number of viewers.

Further, as a tenth invention, the moving body control means determines the flight distance and / or the trajectory of the moving body based on the action operation input, and controls the movement of the moving body. A server system according to any one of the ninth inventions may be configured.

According to the tenth invention, the moving body can be moved according to the flight distance and the trajectory according to the action operation input.

Further, as an eleventh invention, the moving body control means changes the reachable distance and / or the trajectory of the moving body that can be operated and input in the action operation input based on the number of viewers. The server system of the tenth invention may be configured.

According to the eleventh invention, the reachable distance and the trajectory of the moving body can be changed according to the number of viewers.

Further, as a twelfth invention, a poster terminal (for example, the user terminal 1500a of the posting user 2a in FIG. 1), a viewer terminal (for example, the user terminal 1500b of the viewing user 2b in FIG. 1), and the poster terminal. And a video distribution system (for example, the moving image of FIG. 1) including the server system according to any one of the first to eleventh items (for example, the server system 1100 of FIG. 1) that is communication-connected to the viewer terminal. The distribution system 1000) may be configured.

According to the twelfth invention, it is possible to realize a moving image distribution system having the same effect as that of any one of the first to eleventh inventions.

The figure which shows the configuration example of a video distribution system. The front view which shows the configuration example of a user terminal. Diagram to explain video posting for live distribution. The figure for demonstrating the uploading of the poster video data to the server system by the poster terminal. The figure for demonstrating the generation and distribution of the video for distribution. The figure which shows the example of the video for distribution which concerns on a mini game. The figure which shows the display example of a menu window. The figure which shows an example of the action operation of input execution. The figure for demonstrating the positional relationship condition. The figure for demonstrating the calculation of the reference input point. The figure for demonstrating the calculation of the attribute matching bonus. The figure for demonstrating the calculation of the continuous input bonus. The figure for demonstrating the calculation of the total number of times bonus. A functional block diagram showing an example of functional configuration of a server system. The figure which shows the example of the program and data which the server storage part stores. The figure which shows the data structure example of the event area object definition data. The figure which shows the data structure example of the point calculation table data. The figure which shows the data structure example of the item definition data. The figure which shows the data structure example of the user management data. The figure which shows the data structure example of the distribution management data. A function block diagram showing an example of a function configuration of a user terminal. A flowchart for explaining the processing flow of the server system related to live distribution. The flowchart which continues from FIG. The figure which shows the example of the moving image for distribution in the modification 1. FIG. The figure which shows the data structure example of the play data. The figure which shows the data structure example of the transformation example of the posted material data. The figure which shows the example of the object which arranges in the virtual 3D space for generating the moving image for distribution.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. It should be noted that the embodiments described below do not limit the present invention, and the embodiments to which the present invention can be applied are not limited to the following embodiments. Further, in the description of the drawings, the same parts are designated by the same reference numerals.

[overall structure]
FIG. 1 is a diagram showing a configuration example of the moving image distribution system 1000 of the present embodiment. The video distribution system 1000 includes a server system 1100 connected to each other via a network 9 so as to enable data communication, and a plurality of user terminals 1500 (1500a, 1500b).

The network 9 means a communication path capable of data communication. That is, the network 9 means a telephone communication network, a cable network, a communication network such as the Internet, as well as a LAN (Local Area Network) using a dedicated line (dedicated cable) for direct connection and Ethernet (registered trademark). In addition, the communication method may be wired or wireless.

The server system 1100 has, for example, a keyboard 1106, a touch panel 1108, and a storage 1140, and a control board 1150 is mounted on the main body device 1101.

The control board 1150 is equipped with various microprocessors such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor), various IC memories 1152 such as VRAM, RAM, and ROM, and a communication device 1153. Has been done. A part or all of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a SoC (System on a Chip).

Then, in the server system 1100, the control board 1150 performs arithmetic processing based on a predetermined program and data.
1) User registration and user management function to manage information for each user,
2) Online shopping function for thrown items and
3) A game providing function that enables online games to be played on the user terminal 1500,
4) A posting function that acquires data of the poster video from the user terminal 1500a (viewer terminal) of the posting user 2a who is the user who is the poster, and
5) A live distribution function that generates a distribution video based on the data of the poster video and distributes it to the user terminal 1500b (viewer terminal) of the viewing user 2b who is the viewer.
To realize.

In FIG. 1, the server system 1100 is depicted as one server device, but a plurality of server devices connected online have a user management function, an online shopping function, a game providing function, a posting function, and a live distribution function. It may be configured to share one or more of the functions. Further, the server system 1100 may have a configuration in which a plurality of blade servers sharing each function are mounted and connected to each other via an internal bus so that data communication is possible. A plurality of independent server devices installed at remote locations may be configured to function as the server system 1100 as a whole by performing data communication via the network 9.

The user terminal 1500 (1500a, 1500b) is a computer system individually used by the user 2 (2a, 2b, ...) For posting a video or watching a video, and is a server system 1100 via a network 9. It is an electronic device (electronic device) that can access. The user terminal 1500 of the present embodiment is a device called a so-called smartphone, but may be a portable game device, a tablet computer, a personal computer, or the like.

In FIG. 1, one user terminal 1500a (viewer terminal) of the posting user 2a and one user terminal 1500b (viewer terminal) of the viewing user 2b are shown, but in actual operation, they are shown. , There are a plurality of posting users, and each of them accesses the server system 1100 using the posting terminal. Similarly, in actual operation, there are a plurality of viewing users, each of whom accesses the server system 1100 using the viewer terminal.

FIG. 2 is a front view showing a configuration example of the user terminal 1500 according to the present embodiment. As shown in FIG. 2, the user terminal 1500 includes a direction input key 1502, a button switch 1504, a touch panel 1506 that functions as an image display device and a contact position input device, a built-in battery 1509, a speaker 1510, and a microphone 1512. A camera 1520, a control board 1550, and a memory card reader 1542 capable of reading and writing data to and from a memory card 1540 which is a computer-readable storage medium. In addition, a power button, a volume control button, and the like (not shown) are provided. An IC card reader or the like that can read and write data in a non-contact manner may be provided for an IC card type credit card or a prepaid card that can pay for game play or the like.

The control board 1550 includes 1) CPU 1551, various microprocessors such as GPU and DSP, 2) various IC memories such as VRAM, RAM and ROM 1552, 3) mobile phone base station and wireless LAN base station connected to network 9. It is equipped with a wireless communication module 1553, 4) interface circuit 1557, etc. for wireless communication with.

The interface circuit 1557 includes a driver circuit of the touch panel 1506, a circuit for receiving signals from the direction input key 1502 and the button switch 1504, an output amplifier circuit for outputting an audio signal to the speaker 1510, and an audio signal collected by the microphone 1512. It includes an input signal generation circuit to be generated, a circuit for inputting image data of an image taken by the camera 1520, a signal input / output circuit to a memory card reader 1542, and the like.

Then, these elements mounted on the control board 1550 are electrically connected via a bus circuit or the like, and are connected so as to be able to read / write data and transmit / receive signals. A part or all of the control board 1550 may be composed of ASIC, FPGA, or SoC. Then, the control board 1550 stores the program and various data for realizing the function as the user terminal of the game of the present embodiment in the IC memory 1552.

In the present embodiment, the user terminal 1500 is configured to download programs and various setting data from the server system 1100, but it may be configured to be read from a storage medium such as a separately obtained memory card 1540.

[About video posting]
FIG. 3 is a diagram for explaining video posting for live distribution in the present embodiment. In the live distribution, the posting user 2a registers the user terminal 1500a (poster terminal) and the distribution date and time in advance. Before the delivery date and time, the posting user 2a accesses the server system 1100 as a posting user reserved on the poster terminal (user terminal 1500a).

The posting user 2a holds the wireless controller 3 of the poster terminal (user terminal 1500a) in his hand, stands in front of a blue back or the like, and plays the poster character who is the program host in the live distribution.

On the poster terminal (user terminal 1500a), a predetermined program is executed and is operating in the posting mode for live distribution. The poster terminal (user terminal 1500a) is fixed to a tripod or the like, and the live image 10 of the posting user 2a is captured by the built-in camera 1520, and the live audio 12 of the posting user 2a is taken by the mounted microphone 1512. Pick up.

The posting user 2a may wear a head-mounted display or headphones for monitoring live images and live sounds.

The poster terminal (user terminal 1500a) constantly executes the motion capture process, and creates the poster motion data 712 of the posting user 2a in real time from the live video 10. Further, the poster terminal (user terminal 1500a) constantly executes the voice capture process, and creates the poster voice data 713 from the live voice 12 in real time.

When the live distribution is an image of the augmented reality space, in other words, when the image generation space is the augmented reality space, an AR marker 5 is appropriately prepared and the camera 1520 shoots the image together with the posting user 2a. In this case, the poster motion data 712 includes information on the relative position, relative posture, and shooting angle of view of the AR marker 5 and the camera 1520, and image data in the real space. When the live distribution is a video in a virtual reality space, in other words, when the image generation space is a virtual space, the AR marker 5 does not necessarily have to be used.

FIG. 4 is a diagram for explaining uploading of poster video data to the server system 1100 by the poster terminal (user terminal 1500a). The poster terminal (user terminal 1500a) constantly uploads the poster video data 710 to the server system 1100 during the live distribution.

The poster video data 710 is data related to the video posted by the posting user 2a, and is for displaying the poster character 4 corresponding to the avatar at the time of posting by the posting user 2a as a virtual space image or an augmented reality space image. Includes data for. In other words, the poster video data 710 is the latest state related to the poster character in the image generation space, which is a virtual space or augmented reality space in which the poster character 4 operated by the poster terminal (user terminal 1500a) can act. It is the data to describe.

Specifically, the poster video data 710 includes, for example, the poster motion data 712, the poster audio data 713, and the posted material data 714. In the present embodiment, the poster motion data 712 and the poster audio data 713 are used as the main material for live distribution, and the posted material data 714 is used as a sub-material for live distribution. The posted material data 714 is, for example, a separately recorded game play moving image, a background image, material data for superimpose, sound effect data, a screen layout for live distribution, and the like. The type and number of posted material data 714 are not limited to the illustrated examples, and the posted user 2a can be freely determined.

FIG. 5 is a diagram for explaining generation and distribution of a moving image for distribution. When the server system 1100 receives the poster video data 710 from the poster terminal (1500a), the server system 1100 generates a distribution video 22 for live distribution based on the poster video data 710. Specifically, the server system 1100 sets a virtual three-dimensional space for generating the video 22 for distribution, arranges an object of the poster character 4 registered in advance by the posting user 2a, and places the poster motion. The operation of the poster character 4 is controlled in real time according to the data 712. Further, in the virtual three-dimensional space, an object of the viewer character 6 registered in advance by the viewing user 2b of the live distribution and a virtual camera serving as a viewpoint for image generation are arranged.

When the distribution moving image 22 for live distribution is only a virtual space image, or simply, when the image is composed of only 3DCG, the virtual camera is fixedly arranged at a predetermined initial position. Then, the server system 1100 renders an image of the situation taken by the virtual camera and uses it as a base image of the moving image for distribution.

When the video 22 for live distribution is used as an augmented reality space image, the virtual camera reproduces the relative position and posture of the AR marker 5 and the poster terminal (1500a), and sets the shooting angle of view of the camera 1520. Reproduce and place. Then, the server system 1100 renders the poster character 4 and the viewer character 6 taken by the virtual camera, synthesizes them with the image in the real space included in the poster video data 710, and bases the video 22 for distribution. It is an image.

Then, the server system 1100 synthesizes the posted material data 714 with the base image and voice-synthesizes the poster voice data 713 to generate the distribution moving image 22. Then, the live distribution is performed to the viewer terminal (user terminal 1500b).

Since it is a live distribution, the distribution moving image 22 is also distributed to the poster terminal (user terminal 1500a) for monitoring.

[About cooperation between posting users and viewing users]
1. 1. Overview The video distribution system 1000 is configured so that the posting user 2a and the viewing user 2b can cooperate in the image generation space. Specifically, the viewing user 2b can throw money at the event area set in the image generation space by the posting user 2a, and can play a mini-game like a ball.

FIG. 6 is a diagram showing an example of a distribution video 22 related to a mini game, in which (1) an example of an image before the event area is set and (2) an event area is set and the mini game is played. An example of the image inside and each are shown.

When the server system 1100 receives a predetermined event area setting request from the poster terminal (user terminal 1500a), the server system 1100 posts the position of the virtual camera arranged in the image generation space (virtual three-dimensional space) and the layout in the screen. The space for playing the mini game is created in the distribution moving image 22 by automatically changing the shooting angle of view setting to the wide-angle side so as to be separated from the person character 4.

Next, the server system 1100 performs the event area setting process to set the event area in the image generation space. In the event area setting process, first, the poster terminal (user terminal 1500a) presents the options of the event area object 30. Then, the event area object 30 is arranged at a designated position in the image generation space according to the event area selection operation and the arrangement operation (for example, the drag and drop operation from the menu) by the posting user 2a, and the event area is set.

The event area object 30 is an object that defines an event area. A plurality of types of event area objects 30 having different shapes, sizes, and actions are prepared in advance. In the example of FIG. 6, a ring-shaped event area object 30a that functions as a basket for a ball and rotates so as to change the opening direction, and cup-shaped event area objects 30b and 30c having different opening sizes are exemplified. are doing. Of course, the shape can be appropriately set according to the content of the mini game.

More specifically, in each event area object 30, the area attribute of the mini-game with high success difficulty is "S", the area attribute of low success difficulty is "B", and the area of the medium one in between. The area attribute is preset with the attribute set to "A" (see FIG. 11). That is, in the mini-game of the present embodiment, when the throwing item used as the throwing money enters the opening of the event area object 30, a privilege is given as a successful insertion (to be exact, the positional relationship condition is satisfied). "S" is set as an area attribute for the event area object 30a, which is difficult to enter into the opening due to its size and movement. Area attributes "A" and "B" are also set from the same viewpoint. The type and number of area attributes are an example, and may be four or more types, or two types.

By the event area setting process here, the type, number, and position of the event area are variably set. It should be noted that the event area selection operation and the arrangement operation may be accompanied by an operation of resizing the event area object 30 by the posting user 2a, and the size thereof may be variably set.

After that, when the posting user 2a urges the viewing user 2b to play the mini game by voice or by inserting a telop or the like, the viewing user 2b responds by prompting the viewing user 2b to "throw money" at the event area object 30. Start.

Money can be thrown by inputting a money request operation and then an action operation. Then, the throwing request operation is performed by touching the screen to display the menu window, selecting the throwing item there, and selecting the type of the trajectory of the throwing item.

FIG. 7 is a diagram showing a display example of the menu window. As shown in FIG. 7, in the menu window, an item menu M11 that presents a list of selectable change items and accepts the selection, and an orbit menu M13 that presents a list of selectable orbit types and accepts the selection. And. The viewing user 2b selects a throwing item to be used for throwing money from the item menu M11, selects a throwing trajectory type from the trajectory menu M13, and inputs a throwing money request operation.

Here, the item menu M11 presents a list of throwing items 8 owned by the viewing user 2b of the viewer terminal (user terminal 1500) displaying the menu window. The viewing user 2b purchases the tossed item 8 in advance, selects it from the item menu M11, and uses it for tossed.

More specifically, in the tossed item 8, any one of "S", "A", and "B" corresponding to the event attribute is preset as the item attribute. For example, in FIG. 7, the throwing item "S ball" having the item attribute "S", the throwing item "A ball" having the item attribute "A", and the throwing item "B ball" having the item attribute "B" Three types are illustrated. Then, each of these thrown items 8 is individually set with a consideration to be paid at the time of purchase. In the present embodiment, the unit price is set according to the item attribute, and is set to the highest price in the order of "S", "A", and "B".

The action operation of input execution can be set as appropriate. FIG. 8 is a diagram showing an example of an action operation of input execution. In FIG. 8, in order to facilitate understanding of the operation, those other than those related to the action operation are shown by broken lines. As shown in FIG. 8, the action operation of the input execution is, for example, a flick operation (shaded arrow in FIG. 8) performed from the viewer character 6 in the distribution moving image 22 toward the event area object 30. The object.

Then, the server system 1100 sets the throwing direction of the tossed item 8 in the direction of the flick operation, and sets the flight distance (moving distance) by the speed of the flick or the length of the flick. Then, the injection point is set to the viewer character 6, and the trajectory (movement path) thereof is set according to the trajectory type selected in the trajectory menu M13 (see FIG. 7).

Of course, the action operation of input execution is not limited to the flick operation. For example, the action operation may be performed by drawing the trajectory of the throwing item 8 with a finger starting from the viewer character 6 in the distribution moving image 22. In that case, since the trajectory is determined according to the action operation, it is not necessary to select the trajectory menu M13.

Alternatively, slide the screen in the direction opposite to the direction in which you want to move it along the desired insertion direction, and then release your finger from the screen (pull and release in the direction opposite to the insertion direction of the tossed item 8). , May be accepted as an action operation input. Further, if the touch panel 1506 is a type capable of detecting pressing, the throwing direction of the tossed item 8 can be set at a relative position between the display position and the touch position of the viewer character 6, and the flight distance can be set by pressing pressure. it can. In addition, the action operation input may be accepted by the voice input of the viewing user 2b. For example, the microphone 1512 may collect the voice of the viewing user 2b and analyze the voice to detect the action operation input.

Then, when the server system 1100 detects the input of the action operation of the input execution, the selected throwing item 8 is made to appear in the vicinity of the viewer character 6 in the image generation space, and the set trajectory is performed based on the action operation. Move with the set input specifications.

In the present embodiment, in the mini game, the viewing user 2b inputs an action operation to input and execute the throwing item 8, and the throwing item 8 has a given positional relationship condition with respect to the event area object 30. When the above conditions are satisfied, the privilege granting process of granting the privilege to the posting user 2a and / or the viewing user 2b who has input the action operation is executed.

2. About the positional relationship condition FIG. 9 is a diagram for explaining the positional relationship condition. The server system 1100 determines whether or not the tossed item 8 moved based on the action operation satisfies a given positional relationship condition with respect to any event area object 30. In the present embodiment, it is determined as the positional relationship condition that the tossed item 8 enters the opening of the event area object 30. Specifically, FIG. 9 (1) shows an example in which the throwing item 8 enters the opening of the rotating ring-shaped event area object 30a, and FIG. 9 (2) shows a cup-shaped event area object 30b. An example is shown in the case where the thrown item 8 is inserted in the opening of the or 30c.

Then, when the positional relationship condition is satisfied (specifically, if the throwing item 8 enters the opening of the event area object 30), the server system 1100 executes the privilege granting process.

The thrown item 8 that appears in the image generation space is deleted from the image generation space after a predetermined time. That is, the tossed item 8 that is deemed not to have entered the opening of the event area object 30 remains on the floor for a while in the image generation space and eventually disappears.

3. 3. About the privilege granting process In the privilege granting process of the present embodiment, the server system 1100 grants the privilege to both the posting user 2a and the viewing user 2b who has input the action operation (the money is thrown using the throwing item 8). To do. Of course, it is also possible to give a privilege to either the posting user 2a or the viewing user 2b.

Specifically, in the privilege granting process, the input points based on the unit price (hereinafter referred to as "input amount") are obtained for each thrown item 8 that satisfies the above positional relationship conditions (it can be said that the input is successful). The total input points are calculated by accumulating the input points. In addition, the input points are accumulated for each viewing user 2b to calculate the input points for each viewer. Then, for example, after the live distribution is finished, the posting user 2a is given a privilege by giving the final total input points. On the other hand, the viewing user 2b is given a privilege by giving a final input point for each viewer.

The points granted will later be used in exchange for various rewards. For example, in addition to objects that can be used in the video distribution system 1000 such as throwing item 8, poster character 4, and viewer character 6, characters and items that can be used in other games and the like can be prepared as rewards. .. Of course, these items and the like may be given as a privilege at the timing when the thrown money item 8 is inserted into the event area object 30.

The input points are calculated by adding various bonus points to the standard input points. First, as shown in FIG. 10, the reference input point also includes the area attribute of the event area object 30 (event area object 30 containing the throwing item 8) in which the tossed item 8 to be calculated satisfies the positional relationship condition. And, it is calculated by adjusting the input amount. That is, the reference input point is obtained by multiplying the adjustment value according to the area attribute based on the amount of consideration paid to the tossed item 8 to be calculated. In the example of FIG. 10, the higher the success difficulty level indicated by the area attribute, the higher the input amount is adjusted.

Next, as bonus points to be added to the reference input points, an attribute matching bonus and a continuous input bonus are calculated.

The attribute matching bonus is calculated based on the match / mismatch between the item attribute of the tossed item 8 to be calculated and the area attribute of the event area object 30 that satisfies the positional relationship condition with the tossed item 8 to be calculated. That is, for example, if the event area object 30a having the area attribute "S" contains the S ball 8a which is the throwing item 8 having the same item attribute "S", the attribute matching bonus will be added. Similarly, if the event area object 30b contains the A ball 8b and the event area object 30c contains the B ball 8c, the attribute matching bonus is added. Then, as shown in FIG. 11, for example, the attribute matching bonus is calculated as the ratio of the input amount by using the ratio corresponding to the matched attribute. More specifically, the ratio is predetermined, for example, as the higher the success difficulty indicated by the area attribute, the larger the value. As a result, the privilege to be given is variably controlled according to the match / mismatch between the item attribute of the tossed item 8 and the area attribute of the event area object 30 containing the item attribute.

In the continuous input bonus, the number of consecutive successes Na in which the same viewing user 2b succeeds in continuously throwing money is counted, and the ratio of the input amount is calculated using the current numerical value of the number of consecutive successes Na. For example, in the example of FIG. 12, when the viewing user 2b succeeds in throwing money and the number of consecutive successes Na is 3, 3% of the input amount at that time is calculated as the continuous input bonus. As a result, different benefits can be given depending on whether the same viewing user 2b succeeds in continuously throwing money or not.

After calculating each bonus point as described above, they are added to the reference input points to be the input points related to the tossed item 8 to be calculated. After that, the input points are added to the total input points, and the total input count Nb is updated.

Then, in the present embodiment, the total number of inputs bonus, which is a bonus point to be added to the total input points, is calculated based on the updated total number of inputs Nb. For example, as shown in FIG. 13, the total input count bonus is added in advance for each number of arrivals (Ta, Tb, Tc, ...) Of the total input count Nb in stages. Bonus points (Pa, Pb, Pc, ...) ...) Is set, and the total number bonus calculation table 535 (see FIG. 17) is prepared for calculation. As a result, the privilege to be given is variably controlled according to the number of times the action operation input is accepted.

4. About the event area As described above, the event area is set by arranging the event area object 30 in the image generation space according to the area selection operation and the arrangement operation by the posting user 2a. Therefore, at the beginning of the mini-game, the event area object 30 selected by the posting user 2a is displayed in a specified size at the designated position.

However, in the present embodiment, the server system 1100 performs an event area setting change process that changes the number, size, and position of the server system 1100 at any time according to the number of viewers of the distribution moving image 22. For example, change control is performed such as enlarging the event area object 30 to widen the opening or moving the position in the image generation space toward the center so that the thrown item 8 can be easily inserted as the number of viewers increases. Further, depending on the number of viewers reached, change control for increasing or decreasing the number of event areas, such as adding and arranging event area objects 30 that did not initially exist, or deleting event area objects 30 that originally existed. I do.

5. Flying distance and trajectory of the throwing item As described above, the flying distance of the throwing item 8 is determined based on the action operation input, and the trajectory type is selected by the viewing user 2b from the trajectory menu M13 (see FIG. 7). To do.

However, in the present embodiment, the server system 1100 changes the reachable distance as a reference when determining the flight distance according to the number of viewers at the time of inputting the action operation. For example, the larger the number of viewers, the longer the reachable distance (the smaller the number of viewers, the shorter the reachable distance). The reachable distance is the maximum distance that can be flown by inputting an action operation. Then, based on the action operation input (flick speed or length), the flight distance is set within the determined reachable distance. Further, the server system 1100 changes the trajectory type that can be selected in the trajectory menu M13 according to the number of viewers at the time of inputting the action operation. For example, as the number of viewers increases, the number of orbit types presented as options in the orbit menu M13 increases.

6. Notification of high-priced thrower In the present embodiment, the server system 1100 has succeeded in throwing the throwing item 8 into the event area object 30 of the viewing user 2b who has input an action operation for the throwing item 8 satisfying the positional relationship condition. Notify user 2b). In the present embodiment, the server system 1100 determines that the viewing user 2b is a high-priced input user when the viewer-specific input points exceed a predetermined threshold value. Then, the viewing user 2b determined to be a high-priced input person is targeted for notification, and the viewer information such as the user name is displayed on the distribution moving image 22 for notification. For example, the viewer information is displayed on the costume portion of the poster character 4.

The notification method is not particularly limited. For example, the viewer information may be displayed as a banner or a telop on the screen. Alternatively, the notification may be performed by sound-outputting the reading voice of the viewer information. In addition, a plurality of threshold values for determining a high-priced input person are set in stages, and the character size and display time at the time of display, the volume at the time of sound output, the number of times the read-aloud voice is repeatedly output, etc. It is also possible to change and notify. For example, the viewer information is displayed for a long time so as to reach a higher threshold value for each viewer input point.

[Functional configuration]
1. 1. Server system FIG. 14 is a block diagram showing an example of the server system 1100. As shown in FIG. 14, the server system 1100 of the present embodiment includes an operation input unit 100s, a server processing unit 200s, an image display unit 390s, a sound output unit 392s, a communication unit 394s, and a server storage unit 500s. To be equipped.

The operation input unit 100s is for inputting various operations for system management, maintenance, and the like, and can be realized by, for example, a keyboard, a mouse, a touch panel, or the like. In FIG. 1, the keyboard 1106 and the touch panel 1108 correspond to this.

The server processing unit 200s can be realized by, for example, a processor that is an arithmetic circuit such as a CPU, GPU, ASIC, or FPGA, or an electronic component such as an IC memory, and can be connected to each unit including the operation input unit 100s and the server storage unit 500s. Controls data input / output. Then, various arithmetic processes are performed based on a predetermined program and data, an operation input signal from the operation input unit 100s, data received from the user terminal 1500, and the like, and the operation of the server system 1100 is collectively controlled. In FIG. 1, the control board 1150 and its CPU 1151 correspond to this.

The server processing unit 200s includes a user management unit 201, an online shopping management unit 203, a game management unit 204, a poster video data acquisition control unit 205, a moving body control unit 207, and a distribution video generation control unit 209. The event area setting unit 211, the privilege grant control unit 215, the ranking display control unit 219, the timekeeping unit 280s, the image generation unit 290s, the sound generation unit 292s, and the communication control unit 294s are provided.

The user management unit 201 performs processing related to the user registration procedure and management of data of each user associated with the user account. In the present embodiment, the user management unit 201 1) assigns a unique user account to a registered user, 2) manages registration information for registering and managing personal information (for example, an account name) for each user account, and 3) billing. It has the functions of book management of electronic payment media consumed by payment of elements (online shopping, etc. in this embodiment) and 4) usage history management. Of course, other data management functions associated with accounts other than these can be included as appropriate.

The online shopping management unit 203 is responsible for controlling online shopping. This can be achieved by appropriately using known online shopping technology. In the present embodiment, the user can purchase the tossed item 8 by online shopping. Of course, the sales target in online shopping can be set as appropriate in addition to these.

The game management unit 204 performs various controls for executing an online game on the user terminal 1500.

The poster video data acquisition control unit 205 acquires the poster video data 710 in the image generation space, which is a virtual space or augmented reality space in which the poster character 4 operated by the poster terminal can act, from the poster terminal. Control is performed (see FIG. 4).

The moving body control unit 207 receives an action operation input from the viewer terminal and controls the appearance and movement of the moving body in the image generation space. This is the control related to "throwing money" using the throwing money item 8 in the present embodiment. A new arrangement control of the throwing item 8 in the image generation space and a movement control of the throwing item 8 correspond to this (see FIGS. 6 to 8).

More specifically, the mobile control unit 207 determines the reachable distance of the throwing item 8 based on the number of viewers at the time of inputting the action operation, and determines the trajectory type of the throwing item 8 that can be selected by the posting user 2a. To do. Then, using the determined reachable distance, the throwing direction and the flight distance of the moving body are set based on the action operation input, and the trajectory is set based on the trajectory type selected by the posting user 2a, and the throwing item 8 is used. Move control is performed.

The distribution video generation control unit 209 controls to generate the distribution video 22 in the image generation space in which the image based on the poster video data 710 and the moving body are combined (see FIG. 5). Further, the distribution video generation control unit 209 is an image or an image that notifies the viewer information of the corresponding viewing user 2b when the input point 742 for each viewer calculated by the input point calculation unit 217 exceeds a predetermined threshold value. The audio is included in the distribution moving image 22 and generated. The display of viewer information on the costume portion of the poster character 4 in the present embodiment corresponds to this.

The event area setting unit 211 performs an event area setting process for setting an event area in which the area attribute is set in the image generation space. At that time, at least one of the number, size, and position of the event area is variably set based on the operation input of the posting user 2a. One or more event area objects 30 are arranged at a designated position in the image generation space based on a predetermined event area setting request from the poster terminal and the event area selection operation and arrangement operation in the present embodiment. Control (see FIG. 6) corresponds to this.

The event area setting unit 211 includes a setting change unit 213. The setting change unit 213 performs an event area setting change process for variably setting at least one of the number, size, and position of the event area based on the number of viewers 705. In the present embodiment, the event area setting change table 560 is used to control the number, size, and position of the event area objects 30 arranged in the image generation space.

The privilege granting control unit 215 gives the privilege given to the posting user 2a and / or the viewing user 2b who has input the action operation based on whether or not the moving body satisfies the given positional relationship condition with respect to the event area. Executes the privilege granting process for granting.

The "positional relationship condition" can be described by combining one or more of the approach, arrival, contact, and passage of the moving object to the event area by AND or OR. In the present embodiment, the fact that the tossed item 8 enters the event area object 30 corresponds to satisfying the positional relationship condition (see FIG. 9). Then, the granting of the total input points to the posting user 2a and the granting of the input points for each viewer to the viewing user 2b correspond to the granting of the privilege.

The privilege grant control unit 215 includes an input point calculation unit 217. The input point calculation unit 217 includes a reference input point, an attribute matching bonus, based on the area attribute of the event area object 30 that satisfies the positional relationship condition, the item attribute of the throwing item 8, the viewing user 2b that has input the action operation, and the like. And the continuous input bonus is calculated, the input points are calculated, the total input count bonus is calculated, and the total input points and the viewer-specific points are updated. Then, after the end of the live distribution, the privilege grant control unit 215 grants the final total input points to the posting user 2a as the poster privilege points. In addition, the final input points for each viewer are given to the corresponding viewing user 2b as viewer privilege points.

After the live distribution of the distribution video 22 is completed, the ranking display control unit 219 performs a ranking process for ranking the viewing users 2b in descending order of input points for each viewer, and controls to display the ranking on each viewer terminal. I do.

The timekeeping unit 280s uses the system clock to measure the current date and time, the time limit, and the like.

The image generation unit 290s generates images, synthesizes images, and outputs an image signal for displaying them on the image display unit 390s. In this embodiment, it plays a part of a function of generating various images / videos such as images related to the system management of the server system 1100. In addition, the image generation unit 290s generates a moving image 22 for distribution by rendering an image taken by a virtual camera installed in the image generation space, performing image composition processing, and the like. The image signal related to system management is output to the image display unit 390s.

The sound generation unit 292s is realized by executing IC or software that generates and decodes audio data, and generates or decodes operation sounds related to system management of the server system 1100, video viewing, etc., and audio data such as BGM. .. In addition, the sound generation unit 292s executes a voice synthesis process for superimposing and synthesizing a plurality of voices. The audio signal related to system management is output to the sound output unit 392s.

The communication control unit 294s performs communication connection and data processing for data communication with an external device (for example, user terminal 1500) via the communication unit 394s, and realizes data exchange with the external device.

The image display unit 390s displays various images for system management and the like based on the image signal input from the image generation unit 290s. For example, it can be realized by an image display device such as a flat panel display, a projector, or a head-mounted display. In FIG. 1, the touch panel 1108 corresponds to this.

The sound output unit 392s emits an audio signal input from the sound generation unit 292s. In FIG. 1, a speaker (not shown) included in the main device 1101 and the touch panel 1108 corresponds to this.

The communication unit 394s connects to the network 9 to realize communication. For example, it is realized by a wireless communication device, a modem, a TA (terminal adapter), a jack of a wired communication cable, a control circuit, and the like. In FIG. 1, the communication device 1153 corresponds to this.

In the server storage unit 500s, a program for operating the server system 1100 and realizing various functions included in the server system 1100, data used during the execution of this program, and the like are stored in advance, or each time processing is performed. Temporarily stored. For example, it can be realized by an IC memory such as RAM or ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, or online storage. In FIG. 1, the IC memory 1152 and the storage 1140 correspond to this.

FIG. 15 is a diagram showing an example of a program and data stored in the server storage unit 500s in the present embodiment. The server storage unit 500s in the present embodiment includes the server program 501, the distribution client program 503, the character definition data 510, the event area object definition data 520, the point calculation table data 530, the item definition data 540, and the trajectory. The definition data 550 and the event area setting change table 560 are stored.

Further, the server storage unit 500s stores user management data 600, distribution management data 700, and current date and time 800 as data that are sequentially generated and managed. Of course, the server storage unit 500s can appropriately store other programs and data (for example, timers, counters, various flags, etc.).

The server program 501 uses the server processing unit 200s as the user management unit 201, the online shopping management unit 203, the poster video data acquisition control unit 205, the mobile control unit 207, the distribution video generation control unit 209, and the event area setting unit 211. This is a program for functioning as a privilege grant control unit 215 and a ranking display control unit 219.

The distribution client program 503 is the original of the client program 502 (see FIG. 21) provided to the user terminal 1500. In the present embodiment, the distribution client program 503 includes a distribution posting client program 503b for making the user terminal 1500 function as a poster terminal, and a distribution viewing client program 503c for making the user terminal 1500 function as a viewer terminal. And, including. It should be noted that these may be separately delivered to the user terminal 1500.

The character definition data 510 is prepared for each character that can be selected by the posting user 2a as the poster character 4 corresponding to his / her avatar, and stores various initial setting data related to the character. For example, it includes a character type, an ability parameter value, model data, an action pattern definition data that defines an action that the character can perform, and the like.

The event area object definition data 520 is prepared for each type of the event area object 30, and stores various initial setting data for the object. For example, as shown in FIG. 16, one event area object definition data 520 includes an area type 521 of the corresponding event area object 30, an area attribute 523 of the object, an object model data 525 of the object, and the object. Includes event area motion data 527 that defines the content of the automatic motion (eg, motion that randomly moves from the initially determined placement position, reciprocating motion, rotational motion, shape variation that repeats enlargement / reduction, etc.).

Return to FIG. The point calculation table data 530 stores various table data used for calculating the total input points and the input points for each viewer. In the present embodiment, as shown in FIG. 17, the point calculation table data 530 includes a reference input point calculation table 531, an attribute matching bonus calculation table 533, and a total number of times bonus calculation table 535.

The reference input point calculation table 531 is a data table in which an adjustment value (see FIG. 10) to be multiplied by the input amount when calculating the input point is set in association with the type of area attribute. The attribute matching bonus calculation table 533 is a data table in which the ratio (see FIG. 11) used for calculating the attribute matching bonus when the item attribute matches with the type of the area attribute is set. In the total number of times bonus calculation table 535, the correspondence between the number of times the total number of input times Nb is reached (Ta, Tb, Tc, ...) And the bonus points (Pa, Pb, Pc, ...) As the total number of times of input bonus. It is a data table in which a relationship (see FIG. 13) is set.

Return to FIG. The item definition data 540 is prepared for each type of the tossed item 8 and stores various initial setting data for the item. For example, as shown in FIG. 18, one item definition data 540 includes an item type 541 of the corresponding throwing item 8, an item attribute 543 of the item, and an item display for displaying the item in the distribution video 22. Includes body data 545.

Return to FIG. The trajectory definition data 550 is prepared for each trajectory type used for movement control of the throwing item 8, and stores the movement pattern data and the like.

The event area setting change table 560 is a data table in which change control contents for changing the number, size, and position of the event area object 30 are set in association with the number of a plurality of reached viewers that gradually increases. .. Each time the number of viewers 705 increases to the number of reached viewers set in the event area setting change table 560, the setting change unit 213 increases the number of event area objects 30 in the image generation space according to the corresponding change control content. Control to change at least one of, size, and position. In the change control content, the control content for changing the size and position of the event area object 30 and the control content for adding or deleting the event area object 30 are appropriately set.

The user management data 600 is prepared for each registered user of the video distribution system 1000, and stores various data related to the user. For example, as shown in FIG. 19, one user management data 600 includes a user account 601 of the corresponding user, owned item management data 603, user attribute 605, privilege point data 607, and game save data 608. Includes poster character setting data 609 and viewer character setting data 611.

The owned item management data 603 is prepared for each type of the thrown item 8 that is owned (synonymous with having the right to use), and stores the item type, the remaining number of possessed items, and the like.

The user attribute 605 is an attribute selected by the user at the time of user registration.

The privilege point data 607 includes total input points given as privilege points when the user is the posting user 2a, and viewer-specific input points given as privilege points when the user is the viewing user 2b. Is accumulated and stored. When award points are used in exchange for a separately prepared reward, that amount will be deducted and renewed.

The game save data 608 is save data of game play by the user. The game save data 608 includes play history data 6081 that records the progress of each play.

The poster character setting data 609 is the setting data of the poster character 4 used when the user makes a post. For example, the character type, various parameter values set in the poster character 4, and the like are stored.

The viewer character setting data 611 is the setting data of the viewer character 6 used by the user when viewing. For example, the character type and various parameter values set for the viewer character 6 are stored.

Return to FIG. The distribution management data 700 is created for each live distribution and stores various data describing the latest state of the distribution. For example, as shown in FIG. 20, one distribution management data 700 includes a distribution ID 701, a posting user account 702, a viewing user account list 703, a number of viewers 705, a poster video data 710, and an image generation space. It includes management data 730, input point management data 740, distribution video data 750, and ranking data 760.

The poster video data 710 includes a posting user account 711, a poster motion data 712, a poster audio data 713, and a posting material data 714.

The image generation space management data 730 stores various data describing the state of the virtual space or the augmented reality space for generating the moving image for live distribution. In the present embodiment, since the video for live distribution is a 3DCG video, the image generation space management data 730 has the same meaning as the management data of the image generation space.

The image generation space management data 730 includes the image generation space ID 731, the base post ID 732 indicating the post that is the base of the live distribution, the poster character control data 733, the virtual camera control data 734, and each event area setting. It includes event area object control data 735 to be created, viewer character control data 736, and item control data 737 to be created each time a throwing money is inserted (input of an action operation).

The poster character control data 733 includes data representing the state of the poster character 4 in the user account of the posting user 2a and the image generation space (for example, position coordinates, posture, movement speed, motion control data, etc.).

The virtual camera control data 734 stores information such as a position, a posture, and an angle of view that serve as a viewpoint when rendering a video for live distribution.

The event area object control data 735 includes an event area ID of the corresponding event area object 30, an event area object type, and state data representing the state of the object in the image generation space (for example, size, position coordinates, posture, movement speed, and so on. Includes motion control data, etc.).

The viewer character control data 736 includes data representing the character ID of the viewer character 6, the user account of the viewer user 2b, and the state of the viewer character 6 in the image generation space (for example, position coordinates, posture, movement speed, motion control). Data etc.) is included.

The item control data 737 is the control data of the throwing item 8 that receives the action operation input from the viewer terminal and causes it to appear in the image generation space based on the action operation input. For example, the item ID of the corresponding thrown item 8, the user account (account of the viewing user 2b using the thrown item 8), the date and time of appearance, the position coordinate history in the image generation space, the speed history, the history of other hit objects, etc. including.

The input point management data 740 stores the current values of the total input points 741 and the input points 742 for each viewer, which are calculated and updated at any time by the input point calculation unit 217. In addition, the number of consecutive successes Na counted for calculating the continuous input bonus, the total number of inputs Nb counted for calculating the total input bonus, the calculation history of the input points up to the present, etc. are stored. ..

The ranking data 760 stores the ranking processing result by the ranking display control unit 219. In the present embodiment, the ranking of the viewing user 2b ranked by the final input points for each viewer after the end of the live distribution is stored.

2. User terminal FIG. 21 is a functional block diagram showing a functional configuration example of the user terminal 1500 according to the present embodiment. As shown in FIG. 21, the user terminal 1500 includes an operation input unit 100, a voice input unit 102, an imaging unit 104, a terminal processing unit 200, an image display unit 390, a sound output unit 392, and a communication unit 394. And a terminal storage unit 500.

The operation input unit 100 outputs an operation input signal corresponding to various operation inputs made by the user to the terminal processing unit 200. For example, it can be realized by a push switch, a joystick, a touch pad, a trackball, an acceleration sensor, a gyro, a CCD module, or the like. In FIG. 2, the direction input key 1502, the button switch 1504, the touch panel 1506, and the camera 1520 correspond to this.

The voice input unit 102 collects voice (user voice) and environmental sound emitted by the user, and outputs a voice signal to the terminal processing unit 200. In FIG. 2, the microphone 1512 corresponds to this.

The imaging unit 104 receives the light from the imaging target, converts it into an electric signal, generates digital image data, and outputs the digital image data to the terminal processing unit 200. For example, it is realized by a lens, a mechanical shutter, a shutter driver, a photoelectric conversion element such as a CCD image sensor module or a CMOS image sensor module, a digital signal processor (DSP) that reads the amount of charge from the photoelectric conversion element and generates image data, an IC memory, or the like. Ru. In FIG. 2, the camera 1520 corresponds to this.

The terminal processing unit 200 can be realized by, for example, a microprocessor such as a CPU or GPU, or an electronic component such as an IC memory, and can control data input / output with each functional unit including the operation input unit 100 and the terminal storage unit 500. Do. Then, various arithmetic processes are performed based on predetermined programs and data, operation input signals from the operation input unit 100, and various data received from the server system 1100 to control the operation of the user terminal 1500. In FIG. 2, the control board 1550 and its CPU 1551 correspond to this. The terminal processing unit 200 in the present embodiment includes a client control unit 260, a timekeeping unit 280, an image generation unit 290, a sound generation unit 292, and a communication control unit 294.

The client control unit 260 realizes functions as a poster terminal and a viewer terminal. Specifically, it is activated in either the poster terminal or the viewer terminal mode in response to the user's mode selection operation input, accesses the server system 1100, and processes the login procedure.

When started in the poster terminal mode, the client control unit 260 functions as the posting client control unit 261. The posting client control unit 261 performs various processes for realizing the function as a poster terminal. Specifically, it has a poster video data generation unit 262 and executes various processes related to the generation and provision of the poster video data 710 (see FIGS. 3 and 4). In addition, the posting client control unit 261 executes a process related to the event area setting request (see FIG. 6).

When activated in the viewer terminal mode, the client control unit 260 functions as the viewing client control unit 263. The viewing client control unit 263 executes various processes for realizing the function as a viewer terminal and processes related to the execution of throwing money (see FIGS. 6 to 8).

The image generation unit 290 controls the generation of various image data and the generation and output of image signals for displaying those images on the image display unit 390.

The sound generation unit 292 is realized by, for example, a digital signal processor (DSP), a processor such as a voice synthesis IC, an audio codec capable of reproducing a voice file, or the like, and generates sound signals such as sound effects, operation sounds, and BGM. It is output to the sound output unit 392.

The communication control unit 294 performs communication connection and data processing for data communication with an external device (for example, a server system 1100) via the communication unit 394, and realizes data exchange with the external device.

The image display unit 390 displays various images based on the image signal input from the image generation unit 290. For example, it can be realized by an image display device such as a flat panel display, a projector, or a head-mounted display. In FIG. 2, the touch panel 1506 corresponds to this.

The sound output unit 392 is realized by a device that outputs sound based on a sound signal input from the sound generation unit 292. In FIG. 2, the speaker 1510 corresponds to this.

The communication unit 394 connects to the network 9 to realize communication. For example, it can be realized by a wireless communication device, a modem, a TA (terminal adapter), a jack of a wired communication cable, a control circuit, or the like. In FIG. 2, the wireless communication module 1553 corresponds to this.

The terminal storage unit 500 stores in advance a program for operating the user terminal 1500 and realizing the functions provided by the user terminal 1500, data used during the execution of this program, or is temporarily stored each time the processing is performed. Stored in. For example, it can be realized by an IC memory such as RAM or ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, or the like. In FIG. 2, the IC memory 1552 and the memory card 1540 correspond to this. It is also possible to configure using online storage.

In addition, the terminal storage unit 500 stores the client program 502, the original poster video data 710, and the live distribution data 582 which is the data for viewing the live video and audio. Of course, programs and data other than these can be stored as appropriate.

The client program 502 is application software for realizing the function as the client control unit 260 by being read and executed by the terminal processing unit 200. In this embodiment, the client program 502 is a copy of the distribution client program 503 (see FIG. 15) provided by the server system 1100. The client program 502 may be a dedicated client program, or may be configured by a web browser program, a plug-in that realizes an interactive image display, or the like.

[Processing flow]
Next, the operation of the moving image distribution system 1000 of the present embodiment will be described. 22 and 23 are flowcharts for explaining the processing flow of the server system 1100 related to live distribution.

As shown in FIG. 22, first, the server system 1100 (poster video data acquisition control unit 205) prepares the distribution management data 700 and starts acquiring the poster video data 710 from the poster terminal (step). S6).

Next, the server system 1100 arranges the poster character 4 and the virtual camera in the image generation space (virtual three-dimensional space) based on the acquired poster video data 710 (step S8), and the poster from the poster terminal. The operation control of the character 4 is started (step S10). Then, the server system 1100 (distribution video generation control unit 209) starts generation of the distribution video 22 for live distribution and live distribution (step S12).

If the posting user 2a wants to carry out an event, he / she inputs a predetermined event area setting request operation on the poster terminal. The poster terminal transmits an event area setting request to the server system 1100 with the input.

When the request is received by receiving the event area setting request from the poster terminal (YES in step S14), the server system 1100 changes the angle of the virtual camera to a predetermined value in order to secure the event space (step S16). .. After that, the server system 1100 (event area setting unit 211) performs the event area setting process, and arranges the event area object 30 in the image generation space based on the operation input of the posting user 2a (step S18). After that, if the operation pattern is set in the arranged event area object 30, the automatic control of the operation is started.

Subsequently, the server system 1100 (setting change unit 213) starts an event area setting change process for changing the number, size, and position of the event area objects 30 arranged in step S18 at any time according to the number of viewers 705. (Step S20).

After that, it waits for a viewing request. Then, when the server system 1100 receives the viewing request (YES in step S40), the server system 1100 registers the user of the viewer terminal who sent the request as the viewing user 2b (step S42), and also registers the viewing character of the viewing user 2b. 6 is arranged in the image generation space (step S44). At that time, the number of viewers 705 is updated.

If the viewing user 2b wants to throw money during viewing, he / she inputs an action operation on the viewer terminal. When the viewer terminal detects the action operation, the viewer terminal sends an action request corresponding to the action operation to the server system 1100. In the present embodiment, the throwing money request is transmitted together with the item type information of the throwing money item 8 used as the throwing money.

When the server system 1100 (mobile control unit 207) accepts the request for throwing money by receiving the money throwing request from the viewer terminal (YES in step S50), the money throwing item 8 to be used as the money throwing is arranged in the image generation space. (Step S52), and start the movement control of the spawned money item 8 (step S54).

Further, the server system 1100 (input point calculation unit 217) calculates the input point when there is a transfer item 8 that satisfies the positional relationship condition among the appearing transfer items 8 (YES in step S70). The total input point 741 and the input point 742 for each viewer are updated (step S72).

Steps S14 to S72 are repeated until the live distribution is completed (NO in step S80). Then, when the live distribution is completed (YES in step S80), the server system 1100 (privilege grant control unit 215) grants the total input points 741 as the poster privilege points to the posting user 2a, and by viewer. The input point 742 is given to the corresponding viewing user 2b as a viewer privilege point (step S82). Further, the server system 1100 (ranking display control unit 219) performs ranking processing, ranks the viewing users 2b based on the input points 742 for each viewer, and controls the display on each viewer terminal (step S84). .. Then, the server system 1100 ends a series of processes.

As described above, according to the present embodiment, it is possible to bring about a new service using throwing money in live video distribution. That is, if the action operation of inserting the tossed money is input on the viewer terminal, the tossed item 8 appears in the live-distributed video and is moved and displayed as if it was inserted. Then, when the throwing item 8 satisfies the given positional relationship condition for the event area set by the poster in the video, the poster of the video and / or the viewer who input the action operation is given a privilege. be able to. According to this, it is possible to bring the cooperation between the poster and the viewer to the live video distribution. Therefore, it is possible to enhance the sympathy between the poster and the viewer in the video distribution, and to provide a new user experience (interesting interest) through the same video.

The mode to which the present invention can be applied is not limited to the above-described embodiment, and components can be added, omitted, or changed as appropriate.

[Modification 1]
For example, the event area object 30 may have an advertiser information such as a company name displayed on its surface, and the advertiser may be set as an area attribute. For example, in FIG. 24, the event area objects 30d and 30e having "Company A" as an area attribute (advertiser) and the event area objects 30f having "Company B" as an area attribute (advertiser) are image generation spaces. The distribution moving image 22 arranged in is shown.

Further, in this case, it is possible to manage which area attribute event area object 30 the thrown item 8 has entered and to charge the advertiser the advertising cost. Therefore, in this modification, the input points calculated for each throwing item 8 that satisfies the positional relationship condition are accumulated for each area attribute (for each advertiser in this example), and the input points for each area attribute are calculated. To do. Then, the advertiser company is billed for the advertising cost according to the final input point for each area attribute. For example, the amount obtained by subtracting the collected amount of the viewing user 2b (the consideration paid by the viewing user 2b as the input amount) from the input point for each area attribute is charged to the advertiser indicated by the area attribute as the advertising expense.

Further, the input points for each area attribute may be accumulated for each viewing user 2b. Then, the final input points for each viewing user 2b for each area attribute can be given to each viewing user 2b as points that can be exchanged for the reward prepared for each area attribute. Specifically, among the accumulated input points by area attribute for a certain viewing user 2b, the input points by area attribute related to "Company A" are used as points to be exchanged for the reward prepared for Company A, "Company B". The input points for each area attribute related to "" are given to the viewing user 2b as exchange points for the reward prepared for company B. In that case, the viewing user 2b can also enjoy throwing the tossed item 8 by focusing on the event area objects 30d and 30e labeled "Company A" if he / she wants points to be exchanged for the reward for company A. it can. Redeemable rewards include throwing items with item attributes set for "Company A", characters and items that can be used in other games related to "Company A", and the like.

[Modification 2]
Further, the movement instruction operation of the event area object 30 by the viewing user 2b may be accepted. For example, the server system 1100 accepts the selection operation of the event area object 30 to be moved and the operation of designating the movement direction and the movement amount as the movement instruction operation on the viewer terminal (user terminal 1500a). Then, when the movement instruction operation is received, the event area object 30 to be moved in the image generation space is moved based on the movement instruction operation. According to this, the viewing user 2b can move the position of the target event area object 30 so that the thrown item can easily enter the opening.

[Modification 3]
Further, in the above embodiment, an example of calculating the attribute match bonus based on the match / mismatch between the item attribute of the thrown item 8 and the area attribute of the event area object 30 satisfying the positional relationship condition is shown. User attributes may be used instead of attributes. Specifically, when the throwing item 8 enters the event area object 30, it is based on the match / mismatch between the area attribute and the user attribute of the viewing user 2b who input the action operation to insert the throwing item 8. The attribute matching bonus may be calculated. In that case, the user selects his / her own user attribute from the list of area attributes that can be set in the event area object 30 at the time of user registration. As a result, the privilege to be given is variably controlled according to the match / mismatch between the user attribute of the viewing user 2b who has thrown the thrown item 8 and the area attribute of the event area object 30 containing the item 8.

[Modification example 4]
Further, in the above embodiment, the total number of input bonuses, which are bonus points to be added to the total input points, are calculated based on the updated total number of input Nb. On the other hand, the number of times the thrown item 8 is inserted may be counted for each viewing user 2b, and bonus points to be added to the input points for each viewer may be added. According to this, the privilege given to the viewing user 2b is variably controlled according to the number of times that the tossed item 8 is successfully inserted.

[Modification 5]
Further, in the above embodiment, an example of changing the number, size, and position of the event area according to the number of viewers is shown. On the other hand, the number, size, and position of the event area may be changed according to the elapsed time from the start of the live distribution of the distribution moving image 22. For example, the number, size, and position of the event area object 30 are changed and controlled in the same manner as the event area setting change process. According to this, for example, it is possible to increase the event area object 30, which was small at the initial stage of live distribution, with the passage of time.

Similarly, the reachable distance of the tossed item 8 and the trajectory type that can be selected by the viewing user 2b may be changed according to the elapsed time from the start of live distribution. In that case, it is possible to increase the reachable distance according to the elapsed time from the start of live distribution, or to change the orbit type that could not be selected at the initial stage of live distribution so that it can be selected with the passage of time.

In addition, when the distribution video 22 is distributed at the timing of the playback operation of the viewing user 2b, the number of so-called "likes" attached to the distribution video 22 and the posting date and time (new distribution video 22). The number, size, and position of the event area may be changed, the reachable distance of the tossed item 8, and the trajectory type that can be selected by the viewing user 2b may be changed according to the number of times of reproduction and the like. For example, you can set a large number of event areas for items with many likes or new posting dates.

[Modification 6]
Further, in the above embodiment, the distribution video 22 is created by synthesizing the video of the poster character 4 with the posted material data 714, but when the posted material data 714 is used as a game play video, another method is used. Can be created with.

Specifically, the server system 1100 stores and manages play data 770 as shown in FIG. 25 for each game play. The play data 770 stores data describing the progress of the game play, data for displaying the game screen, and the like. Then, the play data 770 includes the player account 771 and the original play reproduction data 772 that can reproduce all the events in the virtual three-dimensional space related to the game play. The original play reproduction data 772 includes, for example, game object control history data 773, virtual camera control history data 774, and operation input history data 775.

The original play reproduction data 772 is separately saved at the end of the game play and becomes available to the player. Specifically, the server system 1100 prepares a virtual three-dimensional space for reproduction in response to a given request from the user terminal 1500, and arranges a game object or the like in the virtual three-dimensional space based on the original play reproduction data 772. .. Then, the server system 1100 creates a play video of the original play by reproducing the movement in the original play on the arranged game object and rendering the virtual camera used in the original play as a viewpoint. Then, the server system 1100 displays the play moving image on the user terminal and shows it to the player.

FIG. 26 is a diagram showing a data configuration example of the posted material data 714 in the configuration.
By appropriately editing the play video reproduced as described above, the posted material data 714 of the game play video can be created. Specifically, the server system 1100 displays a video editing screen on the user terminal 1500, and among the reproduced play videos (videos of all game play), which time range is connected in what order to make one. Create editing information 715 as a moving image. For example, the editing information 715 stores information on a time range in which the time elapsed in the original play is adopted for each cut in the order of cutting the moving image.

Therefore, the editing information 715 and the original play reproduction data (copy) 716 copied from the play data 770 can be used as the posting material data 714 of the game play video. A virtual three-dimensional space is prepared for reproduction, information for the time range of the cut is read from the original play reproduction data (copy) 716 in the order of cuts according to the edit information 715, and the game object or the original is based on the read information. Place a virtual camera. Then, motion control and rendering are performed for the time range of the cut. By continuously executing this over all cuts, a gameplay video is generated from the posted material data 714.

It is preferable to include the material provider account 717 in the posted material data 714 as appropriate, because information on the origin of the posted material can be referred to.

As shown in FIG. 27, when the distribution video 22 is distributed, the server system 1100 displays the edit information 715 of the posted material data 714 and the edit information 715 of the posted material data 714 in the virtual three-dimensional space prepared for generating the distribution video 22. Based on the original play reproduction data (copy) 716, the game objects (character objects of the player character 40 and the enemy character 42 in the example of FIG. 27) and the original virtual camera CM0 are arranged and the operation is controlled.

At the same time, the server system 1100 posts the character object of the poster character 4 and the posting in the virtual three-dimensional space based on the poster video data 710 (see FIG. 4) transmitted from the user terminal 1500 of the posting user 2a. A comment object 44 for displaying the text comment of the user 2a, an additional virtual camera CM1, and other new objects (live objects) related to the live commentary are additionally arranged and controlled together with the objects related to the original game play. Further, the server system 1100 additionally arranges and controls the event area object 30 in the virtual three-dimensional space in accordance with an event area setting request or the like transmitted from the user terminal 1500 of the posting user 2a.

Then, the server system 1100 creates the distribution moving image 22 by rendering the state of the virtual three-dimensional space using the original virtual camera CM0 and the additional virtual camera CM1. As for the voice, the live voice is superimposed on the voice of the original game play.

Further, when the distribution moving image 22 is distributed, the viewer character 6 of the viewing user 2b and the object of the throwing item 8 may be arranged in a virtual three-dimensional space for generating the distribution moving image 22.

When the video 22 for distribution is generated and distributed with this configuration, the poster character 4, the event area object 30, etc. appear in the game world of the original game play, and the viewer character 6 and the throwing item 8 of the viewing user 2b appear. Will also appear, so it is as if the poster character 4 is playing live from the game play site, and the viewing user 2b is also playing a mini game at the game play site. Can be shown.

[Modification 7]
Assuming the modification 6, the server system 1100 is involved in the storage control of the distribution management data 700 (see FIG. 20), for example.
1) The poster motion data 712 is recorded in a history format in which all motion data of the posting user being distributed is saved in chronological order.
2) The poster voice data 713 is stored in a history format that saves all the voices of the posting users being delivered in chronological order.
3) The viewer character control data 736 is stored in a history format in which all the control data of the viewer character 6 being distributed is stored in chronological order.
4) The item control data 737 of the thrown item 8 used during distribution is saved without being erased.
5) Save the distribution management data 700 at the end of distribution,
If it is configured, it becomes possible to analyze the influence of the distribution on the viewing user 2b.

That is, by referring to the stored distribution management data 700, the server system 1100 refers to which original play (found from the posted material data 714), who (found from the posted user account 702), and what kind of actual situation after distribution. (Revealed from the poster motion data 712 and the audio analysis of the poster audio data 713) can be analyzed.

Then, the server system 1100 identifies the viewing user 2b who has viewed the distribution by referring to the viewer character control data 736 and the item control data 737, and the game save data 608 of the viewing user (FIG. 19). By referring to (see), it is possible to know which viewing user 2b performed what kind of action after viewing the distribution video 22 (found from the play history data 6081). In other words, the server system 1100 can infer the influence of viewing the distribution moving image 22 on the behavior of the viewing user 2b.

1000 ... Video distribution system 1100 ... Server system 100s ... Operation input unit 200s ... Server processing unit 201 ... User management unit 203 ... Online shopping management unit 204 ... Game management unit 205 ... Poster video data acquisition control unit 207 ... Mobile control unit 209 ... Video generation control unit for distribution 211 ... Event area setting unit 213 ... Setting change unit 215 ... Bonus grant control unit 217 ... Input point calculation unit 219 ... Ranking display control unit 290s ... Image generation unit 292s ... Sound generation unit 294s ... Communication Control unit 390s ... Image display unit 392s ... Sound output unit 394s ... Communication unit 500s ... Server storage unit 501 ... Server program 503 ... Distribution client program 503b ... Distribution posting client program 503c ... Distribution viewing client program 510 ... Character definition data 520 ... Event area object definition data 523 ... Area attribute 530 ... Point calculation table data 531 ... Reference input point calculation table 533 ... Attribute matching bonus calculation table 535 ... Total number of times bonus calculation table 540 ... Item definition data 543 ... Item attribute 550 ... Orbit Definition data 560 ... Event area setting change table 600 ... User management data 603 ... Owned item management data 605 ... User attributes 607 ... Bonus point data 700 ... Distribution management data 705 ... Number of viewers 710 ... Poster video data 730 ... Image generation space Management data 740 ... Input point management data 741 ... Total input point 742 ... Input point for each viewer 750 ... Video data for distribution 760 ... Ranking data 1500 ... User terminal 1500a ... User terminal (poster terminal)
1500b ... User terminal (viewer terminal)
9 ... Network 2 ... User 2a ... Posting user 2b ... Viewing user 4 ... Poster character 6 ... Viewer character 8 ... Money item 22 ... Distribution video 30 (30a, 30b, 30c, 30d, 30e, 30f) ... Event area object

Claims (12)

It is a server system that distributes videos by communicating with the poster terminal and the viewer terminal.
A poster video data acquisition means for acquiring poster video data in an image generation space that is a virtual space or an augmented reality space from the poster terminal, and
An event area setting means for setting an event area in the image generation space, and
A mobile body control means that receives an action operation input from the viewer terminal and causes a moving body to appear and move in the image generation space based on the action operation input.
A distribution video generation means for generating a distribution video in the image generation space, which is a combination of an image based on the poster video data, an identification display of the event area, and a movement display of the moving body.
The moving body satisfies a given positional relationship condition with respect to the event area in a process of giving a given privilege to the poster of the poster terminal and / or the viewer who has input the action operation. Bonus grant control means to be executed based on whether or not
Server system with. A given area attribute is set in the event area.
The privilege grant control means variably controls the privilege to be granted based on the area attribute of the event area that satisfies the positional relationship condition.
The server system according to claim 1. A given area attribute is set in the event area.
A given attribute is set to the moving body or the viewer who has input the action operation.
The privilege granting control means variably controls the privilege to be granted based on the area attribute of the event area satisfying the positional relationship condition and the attribute related to the moving body.
The server system according to claim 2. When a plurality of the moving bodies moved based on the action operation input by the same viewer continuously satisfy the positional relationship condition by a predetermined number, the privilege granting control means provides a privilege different from the case where the positional relationship condition is not satisfied. Give,
The server system according to any one of claims 1 to 3. The privilege grant control means variably controls the privilege to be granted based on the quantity of the action operation input received.
The server system according to any one of claims 1 to 4. There are multiple types of mobiles with different prices,
An action operation consideration collecting means that enables acceptance of the action operation input of the moving body when there is a given consideration payment operation for which a plurality of the moving bodies are specified from the viewer terminal.
With more
The privilege granting control means variably controls the privilege to be granted based on the type of the moving body that satisfies the positional relationship condition.
The server system according to any one of claims 1 to 5. The distribution video generation means generates the distribution video by further synthesizing a display and / or an audio that notifies the viewer who has performed the action operation input on the moving body that satisfies the positional relationship condition. To do
The server system according to any one of claims 1 to 6. The event area setting means variably sets at least one of the number, size, and position of the event area based on the operation input of the poster.
The server system according to any one of claims 1 to 7. The event area setting means variably sets at least one of the number, size, and position of the event area based on the number of viewers.
The server system according to any one of claims 1 to 8. The mobile body control means determines the flight distance and / or trajectory of the mobile body based on the action operation input, and controls the movement of the mobile body.
The server system according to any one of claims 1 to 9. The mobile body control means changes the reachable distance and / or the trajectory of the mobile body that can be operated and input in the action operation input based on the number of viewers.
The server system according to claim 10. With the poster terminal
With the viewer terminal
The server system according to any one of claims 1 to 11, which is communication-connected to the poster terminal and the viewer terminal.
Video distribution system equipped with.

Images