JP2020167526A - Server system and moving image distribution system - Google Patents

Abstract

To provide a technique that brings new interests using money throwing in live video distribution.SOLUTION: Contributor moving image data of an image space which is a virtual space or an augmented reality space where a contributor character operated by a contributor terminal can act is acquired. An action operation input from a viewer terminal is received and a display body is made to appear in the image space on the basis of the action operation input. Action impact control is performed that changes a display position of the display body that is made to appear on the basis of an action of the contributor character in the image space. A distribution moving image in the image space, integrating the image based on the contributor moving image data and the display body, is generated and distributed.SELECTED DRAWING: Figure 9

Description

The present invention relates to a server system or the like that is connected to a poster terminal and a viewer terminal by communication to deliver moving images.

As a technology for live video distribution these days, viewers add comments and provide items to posters in the sense of praising the video and supporting the poster of the video. The technology that can take action in is known. In particular, the provision of items from viewers to posters is called "throwing money" or "gifts" because of the donations from the audience to street performers. Hereinafter, it is collectively referred to as "throwing money".

Patent Documents 1 and 2 also describe techniques focusing on throwing money.

Japanese Unexamined Patent Publication No. 2012-121998 Japanese Patent No. 6430059

It is known that throwing money is given to posters with income according to the items used, and according to this mechanism, it has the effect of encouraging posters to post further. In addition, for viewers, it is expected to bring the joy of self-expression, such as praise and support, to publicize one's will and position to other viewers, and to have the effect of enlivening the place by throwing money. .. And above all, it enhances the empathy between posters and viewers and brings a great user experience through the same video. Therefore, not only the operators of video distribution systems but also users are demanding further enhancement of services using throwing money.

An object to be solved by the present invention is to provide a technique for bringing about a new interest by using throwing money in live video distribution.

The first invention for solving the above-mentioned problems is a server system that is connected to a poster terminal and a viewer terminal by communication and distributes a moving image.
Poster video data acquisition means (for example, FIG. 13) for acquiring poster video data in an image space that is a virtual space or an extended real space in which a poster character operated by the poster terminal can act. Server processing unit 200s, poster video data acquisition control unit 210, distribution management data 700 in FIG. 20, poster video data 710, step S6) in FIG.
Display body appearance control means (for example, item 8 in FIG. 6 and server processing unit 200s in FIG. 13) that receives an action operation input from the viewer terminal and causes the display body to appear in the image space based on the action operation input. , Display body appearance control unit 212, item control data 738 in FIG. 20, step S52 in FIG. 23),
Behavioral influence control means (for example, server processing unit 200s, behavioral influence control unit 214, FIG. 13) that performs behavioral influence control that changes the display position of the display body based on the behavior of the poster character in the image space. Step S64) in FIG. 23 and
Distribution video generation means (for example, distribution video 22 in FIG. 5 and server processing unit 200s in FIG. 13) that generates a distribution video in the image space in which an image based on the poster video data and the display body are combined. , Distribution video generation control unit 216, image generation unit 292s, distribution video data 744 of FIG. 20, step S12 of FIG. 22).
It is a server system equipped with.

The "server system" referred to here may be composed of not only a single computer but also a plurality of computers in cooperation with each other.

According to the first invention, when the viewer inputs an action operation using the viewer terminal, a display body based on the action operation appears in the image space of the poster moving image data in which the poster character exists. Then, the poster and the viewer can see how the position of the display body changes according to the behavior of the poster character. In other words, it is possible to bring the link between the behavior of the viewer and the behavior of the poster to the live video distribution. Therefore, according to the first invention, it is possible to enhance the sympathy between the poster and the viewer as compared with the conventional case, and to provide an unprecedented excellent user experience through the same moving image.

In the second invention, the display body appearance control means determines the insertion direction of the display body based on the action operation input, and causes the display body to appear and move in the image space along the insertion direction. The server system of the first invention that controls (for example, step S54 in FIG. 23).

According to the second invention, the same effect as that of the first invention can be obtained even in the display control such as the conventional "throwing money".

According to the third aspect of the present invention, event area setting means for setting an event area in the image space (for example, server processing unit 200s in FIG. 13, behavior influence control unit 214, event area setting unit 218, event area object control data in FIG. 20). 735, step S18) in FIG. 22 and
An activation event control means (for example, the server processing unit 200s of FIG. 13) that controls the activation of a given activation event based on whether or not the display body satisfies a given positional relationship condition with respect to the event area. It is a server system of the second invention including the activation event control unit 220, the activation event definition data 570 of FIG. 18, and step S72) of FIG. 23.

According to the third invention, when the event area is set and the display body satisfies a given positional relationship condition such as contact, passage, and approach to the event area, the activation event is activated. Therefore, it is possible to provide a new hobby based on the cooperation between the poster and the viewer. In addition, a mini-game-like element can be added to the cooperation between the poster and the viewer.

A fourth invention is a process in which the activation event control means grants a given privilege to a poster of the poster terminal and / or a viewer who has performed the action operation input (for example, activation of FIG. 18). The server system of the third invention, which controls the activation of the event content data 573 and step S72) of FIG. 23 as the activation event.

According to the fourth invention, it is possible to provide an incentive for the poster and the viewer to cooperate with each other.

The fifth invention is based on the compatibility of the activation event control means with the attribute set for the poster character and the attribute set for the display body or the viewer who has performed the action operation input. This is the server system of the fourth invention, wherein the privilege is changed and given (for example, the attribute-related condition 572c in FIG. 18).

Further, in the sixth invention, the activation event control means grants different benefits based on whether or not the display body satisfying the above is a display body whose display position has been changed by the action influence control (for example, FIG. 18 behavioral influence conditions 572d), the server system of the fourth or fifth invention.

Further, in the seventh invention, the behavioral influence control is performed by controlling the ratio of the privilege given to the poster of the poster terminal by the activation event control means to the privilege given to the viewer who has input the action operation. The server system according to any one of the fourth to sixth inventions, which is variably controlled based on the presence or absence of (for example, the first grant ratio 573c and the second grant ratio 573d in FIG. 18).

In any of the fifth, sixth, and seventh inventions, various variations can be provided in the way in which the privilege is given. The incentive for collaboration between posters and viewers can be further enhanced, and the interest in collaboration can be further enhanced.

In the eighth invention, the event area setting means controls to change the set position of the event area based on the behavior of the poster character in the image space (see, for example, FIG. 12, FIG. 22). Step S20), the server system according to any one of the third to seventh inventions.

Further, in the ninth invention, the event area setting means sets a plurality of the event areas, and the activation event control means activates different activation events according to the event area satisfying the positional relationship condition. The poster video data acquisition means acquires data indicating a specific event area among the plurality of event areas from the poster terminal (for example, step S30 in FIG. 22), and the distribution video generation means. Is a server system according to any one of the third to eighth inventions, which generates an image or a sound for notifying the specific event area in the distribution moving image.

Further, in the tenth invention, the server of any one of the second to ninth inventions, wherein the display body appearance control means changes the flight distance of the display body based on the parameter defined for the poster character. It is a system.

Further, in the eleventh invention, a given area attribute is set in the event area, and the activation event control means has the area attribute of the event area satisfying the above and the attribute related to the moving body. Based on the above, the server system according to any one of the second to tenth inventions, which variably controls the activation event to be activated (for example, the attribute relation condition 572c in FIG. 18).

According to the twelfth invention, when the behavior influence control means satisfies the transport behavior condition for transporting the display body, the poster character transports the display body to a given transport destination. The server system according to any one of the first to eleventh inventions, wherein the display position of the display body is changed (for example, the behavioral influence condition 572d in FIG. 18).

In any of the eighth to twelfth inventions, the elements related to the cooperation between the viewer and the poster can be increased, and the events caused by the cooperation can be made more diverse.

In the thirteenth invention, the behavioral influence control means changes the content of the behavioral influence control based on the parameters defined for the poster character (for example, the activation requirement 522 in FIG. 15), the first to twelfth. The server system of any of the inventions.

According to the thirteenth invention, by appropriately setting the parameter value, it is possible to provide a mechanism for limiting the content of the behavioral influence control or opening the behavioral influence control with respect to the poster character.

The fourteenth invention is an evaluation aggregation means that aggregates viewer evaluations for the distribution video (for example, the server processing unit 200s in FIG. 13, the evaluation aggregation unit 222, the evaluation aggregation data 742 in FIG. 20, and step S12 in FIG. 22). And the parameter value change control means for changing the parameter value of the poster character based on the viewer evaluation (for example, the server processing unit 200s in FIG. 13, the poster character parameter value change control unit 224, and the poster in FIG. 19). Character parameter value 612, step S82) in FIG. 23,
The server system according to any one of the first to thirteenth inventions.

According to the fourteenth invention, it is possible to change the behavioral influence control based on the viewer's evaluation by interposing the parameter value of the poster character.

In the fifteenth invention, the poster video data includes data of a plurality of poster characters operated by the poster terminal, and the distribution video generation means is based on the poster video data. The server system according to any one of the first to fourth inventions, which generates the video for distribution including the image of the poster character of the above.

According to the fifteenth invention, it is possible to generate a moving image for distribution including images of a plurality of contributor characters.

The sixteenth invention is a video distribution system including a poster terminal, a viewer terminal, and a server system according to any one of the first to fifteenth inventions, which is communication-connected to the poster terminal and the viewer terminal. Is.

According to the sixteenth invention, it is possible to realize a moving image distribution system having the same effect as that of any one of the first to fifteenth inventions.

The figure which shows the configuration example of a video distribution system. The front view which shows the configuration example of a user terminal. Diagram to explain video posting for live distribution. The figure for demonstrating the uploading of the poster video data to the server system by the poster terminal. The figure for demonstrating the generation and distribution of the video for distribution. The figure which shows the example of the video for distribution which concerns on a mini game. The figure which shows an example of the action operation of input execution. The figure for demonstrating the privilege grant to throw money. The figure (1) for explaining an example of cooperation between a poster and a viewer. The figure (2) for explaining an example of cooperation between a poster and a viewer. The figure (3) for explaining an example of cooperation between a poster and a viewer. The figure for demonstrating the setting change of the event area object by a poster character. A functional block diagram showing an example of functional configuration of a server system. The figure which shows the example of the program and data which the server storage part stores. The figure which shows the data structure example of the character definition data. The figure which shows the data structure example of the event area object definition data. The figure which shows the data structure example of the item definition data. The figure which shows the data structure example of the activation event definition data. The figure which shows the data structure example of the user management data. The figure which shows the data structure example of the distribution management data. The functional block diagram which shows the functional configuration example of the user terminal 1500. A flowchart for explaining the processing flow of the server system related to live distribution. The flowchart which continues from FIG. The figure which shows the modification of the video for distribution. The figure which shows the data structure example of the play data. The figure which shows the data structure example of the transformation example of the posted material data. The figure which shows the example of the object which arranges in the virtual 3D space for generating the moving image for distribution.

Hereinafter, an example of the embodiment of the present invention will be described, but it goes without saying that the embodiment to which the present invention can be applied is not limited to the following embodiment.

FIG. 1 is a diagram showing a configuration example of the moving image distribution system 1000 of the present embodiment. The video distribution system 1000 includes a server system 1100 connected to each other via a network 9 so as to enable data communication, and a plurality of user terminals 1500 (1500a, 1500b).

The network 9 means a communication path capable of data communication. That is, the network 9 means a telephone communication network, a cable network, a communication network such as the Internet, as well as a LAN (Local Area Network) using a dedicated line (dedicated cable) for direct connection and Ethernet (registered trademark). In addition, the communication method may be wired or wireless.

The server system 1100 has, for example, a keyboard 1106, a touch panel 1108, and a storage 1140, and a control board 1150 is mounted on the main body device 1101.

The control board 1150 is equipped with various microprocessors such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor), various IC memories 1152 such as VRAM, RAM, and ROM, and a communication device 1153. Has been done. A part or all of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a SoC (System on a Chip).

Then, in the server system 1100, the control board 1150 performs arithmetic processing based on a predetermined program and data.
1) User registration and user management function to manage information for each user,
2) Online shopping function for thrown items and
3) A game providing function that enables online games to be played on the user terminal 1500,
4) A posting function that acquires data of posted videos from the user terminal 1500a (viewer terminal) of the posting user 2a who is the user who is the poster, and
5) A live distribution function that generates a distribution video based on the posted video data and distributes it to the user terminal 1500b (viewer terminal) of the viewing user 2b who is the viewer.
To realize.

In FIG. 1, the server system 1100 is depicted as one server device, but a plurality of server devices connected online have a user management function, an online shopping function, a game providing function, a posting function, and a live distribution function. It may be configured to share one or a plurality of functions. Further, the server system 1100 may have a configuration in which a plurality of blade servers sharing each function are mounted and connected to each other via an internal bus so that data communication is possible. A plurality of independent server devices installed at remote locations may be configured to function as the server system 1100 as a whole by performing data communication via the network 9.

The user terminal 1500 (1500a, 1500b) is a computer system individually used by the user 2 (2a, 2b, ...) For posting a video or watching a video, and accesses the server system 1100 via the network 9. It is an electronic device (electronic device) that can be used. The user terminal 1500 of the present embodiment is a device called a so-called smartphone, but may be a portable game device, a tablet computer, a personal computer, or the like.

In FIG. 1, the user terminal 1500a (viewer terminal) of the posting user 2a who is the poster user and the user terminal 1500b (viewer terminal) of the viewing user 2b who is the viewer user are shown. Although the figures are shown one by one, in actual operation, there are a plurality of posting users, each of whom accesses the server system 1100 using the posting terminal. Similarly, in actual operation, there are a plurality of viewing users, each of whom accesses the server system 1100 using the viewer terminal.

FIG. 2 is a front view showing a configuration example of the user terminal 1500 according to the present embodiment.
The user terminal 1500 includes a direction input key 1502, a button switch 1504, a touch panel 1506 that functions as an image display device and a contact position input device, a speaker 1510, a built-in battery 1509, a microphone 1512, a camera 1520, and a control board. It includes a 1550 and a memory card reader 1542 that can read and write data from a memory card 1540, which is a computer-readable storage medium. In addition, a power button, a volume control button, etc. (not shown) are provided. Further, an IC card reader or the like capable of reading and writing data in a non-contact manner with respect to an IC card type credit card or a prepaid card capable of paying for game play or the like may be provided.

The control board 1550 includes 1) CPU 1551, various microprocessors such as GPU and DSP, 2) various IC memories such as VRAM, RAM and ROM 1552, 3) mobile phone base station and wireless LAN base station connected to network 9. It is equipped with a wireless communication module 1553, 4) interface circuit 1557, etc. for wireless communication with.

The interface circuit 1557 includes a driver circuit of the touch panel 1506, a circuit for receiving signals from the direction input key 1502 and the button switch 1504, an output amplifier circuit for outputting an audio signal to the speaker 1510, and an audio signal collected by the microphone 1512. It includes an input signal generation circuit to be generated, a circuit for inputting image data of an image taken by the camera 1520, a signal input / output circuit to a memory card reader 1542, and the like.

These elements mounted on the control board 1550 are electrically connected via a bus circuit or the like, and are connected so as to be able to read / write data and send / receive signals. A part or all of the control board 1550 may be composed of ASIC, FPGA, or SoC. Then, the control board 1550 stores the program and various data for realizing the function as the user terminal of the game of the present embodiment in the IC memory 1552.

In the present embodiment, the user terminal 1500 is configured to download programs and various setting data from the server system 1100, but it may be configured to be read from a storage medium such as a separately obtained memory card 1540.

FIG. 3 is a diagram for explaining video posting for live distribution in the present embodiment. In the live distribution, the posting user 2a registers the user terminal 1500a (poster terminal) and the distribution date and time. Before the delivery date and time, the posting user 2a accesses the server system 1100 as a posting user reserved on the poster terminal (user terminal 1500a).

The posting user 2a holds the wireless controller 3 of the poster terminal (user terminal 1500a) in his hand, stands in front of a blue back or the like, and plays the poster character who is the program host in the live distribution.

On the poster terminal (user terminal 1500a), a predetermined program is executed and is operating in the posting mode for live distribution. The poster terminal (user terminal 1500a) is fixed to a tripod or the like, and the live image 10 of the posting user 2a is captured by the built-in camera 1520, and the live audio 12 of the posting user 2a is taken by the mounted microphone 1512. Pick up.

The posting user 2a may wear a head-mounted display or headphones for monitoring live images and live sounds.

The poster terminal (user terminal 1500a) constantly executes the motion capture process, and creates the poster motion data 712 of the posting user 2a in real time from the live video 10. Further, the poster terminal (user terminal 1500a) constantly executes the voice capture process, and creates the poster voice data 713 from the live voice 12 in real time.

When the live distribution is an image of the augmented reality space, in other words, when the image space is the augmented reality space, an AR marker 5 is appropriately prepared and the camera 1520 shoots the image together with the posting user 2a. In this case, the poster motion data 712 includes information on the relative position, relative posture, and shooting angle of view of the AR marker 5 and the camera 1520, and image data in the real space. When the live distribution is a video in a virtual reality space, in other words, when the image space is a virtual space, the AR marker 5 does not necessarily have to be used.

As shown in FIG. 4, the poster terminal (user terminal 1500a) constantly uploads the poster video data 710 to the server system 1100 during the live distribution.

The poster video data 710 is data related to the video posted by the posting user 2a, and is data for displaying the poster character 4 corresponding to the avatar at the time of posting by the posting user 2a as a virtual space image or an augmented reality image. including. In other words, the poster video data 710 describes the latest state related to the poster character in the virtual space or the augmented reality space in which the poster character operated by the poster terminal (user terminal 1500a) can act. It is data.

Specifically, the poster video data 710 includes, for example, the poster motion data 712, the poster audio data 713, and the posted material data 714. In the present embodiment, the poster motion data 712 and the poster audio data 713 are used as the main material for live distribution, and the posted material data 714 is used as a sub-material for live distribution. The posted material data 714 is, for example, a separately recorded game play moving image, a background image, material data for superimpose, sound effect data, a screen layout for live distribution, and the like. The type and number of posted material data 714 are not limited to the illustrated examples, and the posted user 2a can be freely determined.

As shown in FIG. 5, when the server system 1100 receives the poster video data 710 from the poster terminal (1500a), the server system 1100 generates a distribution video 22 for live distribution based on the poster video data 710. Specifically, the server system 1100 sets a virtual three-dimensional space for generating the video 22 for distribution, arranges an object of the poster character 4 registered in advance by the posting user 2a, and poster motion data. The operation is controlled in real time according to 712. Further, an object of the viewer character 6 registered in advance by the viewing user 2b of the live distribution and a virtual camera serving as a viewpoint of image generation are arranged in the virtual three-dimensional space.

When the distribution moving image 22 for live distribution is only a virtual space image, or simply an image composed of only 3DCG, the virtual camera is fixedly arranged at a predetermined initial position. Then, the server system 1100 renders an image of the situation taken by the virtual camera and uses it as a base image of the moving image for distribution.

When the live distribution video 22 is used as an augmented reality image, the virtual camera reproduces the relative position and posture of the AR marker 5 and the poster terminal (1500a), and reproduces the shooting angle of view of the camera 1520. And place it. Then, the server system 1100 renders the poster character 4 and the viewer character 6 taken by the virtual camera, synthesizes them with the image in the real space included in the poster video data 710, and distributes the video 22 for distribution. Use as a base image.

Then, the server system 1100 synthesizes the posted material data 714 with the base image and voice-synthesizes the poster voice data 713 to generate the distribution moving image 22. Then, the live distribution is performed to the viewer terminal (user terminal 1500b).

Since it is a live distribution, the distribution moving image 22 is also distributed to the poster terminal (user terminal 1500a) for monitoring.

By the way, the video distribution system 1000 is configured so that the poster and the viewer can cooperate in the image space. Specifically, in the image space, the viewer can throw money at the event area set by the poster and play a mini-game like a ball.

FIG. 6 is a diagram showing an example of a distribution video 22 related to a mini game, in which (1) an example of an image before the event area is set, and (2) an event area is set and the mini game is being played. An example of the image of is shown respectively.

When the server system 1100 receives a predetermined event area setting request from the poster terminal (user terminal 1500a), the position of the virtual camera arranged in the virtual three-dimensional space and the layout in the screen are changed from the poster character 4. It is automatically changed so that it is separated, or the setting of the shooting angle of view is automatically changed to the wide-angle side to create a space in the distribution video 22 for playing the mini game.

Next, the server system 1100 presents the options of the event area object 30 on the poster terminal (user terminal 1500a), and the event area selection operation and arrangement operation (for example, drag and drop operation from the menu) by the posting user 2a. ), The event area objects 30 (30a, 30b, ...) Are arranged in the virtual three-dimensional space to set the event area.

The event area object 30 is an object that defines an event area. A plurality of types of event area objects 30 having different shapes, sizes, and movements are prepared. In the example of FIG. 6, the event area object 30 has a ring type or a cup type that functions as a basket for a ball case but rotates so as to change the opening direction. Of course, the shape can be appropriately set according to the content of the mini game.

When the posting user 2a urges the viewing user 2b to play the mini-game by voice or by inserting a telop, the viewing user 2b responds by making a "throwing money" toward the event area object 30. Start.

When the server system 1100 detects the input of a predetermined throwing request operation on the viewer terminal (user terminal 1500b), the server system 1100 presents a list of items 8 owned by the viewing user 2b of the terminal, and uses the list for throwing money. Accepts the selection of items to do. Then, the viewer terminal (user terminal 1500b) accepts a predetermined action operation input for executing the input.

The action operation of input execution can be set as appropriate.
For example, FIG. 7 is a diagram showing an example of an action operation of input execution. In addition, in order to facilitate understanding of the operation, items other than those related to the action operation are shown by broken lines. The action operation of the input execution is, for example, a flick operation (shaded arrow in FIG. 7) performed from the viewer character 6 in the distribution moving image 22 toward the event area object 30.

In the server system 1100, the ejection point is the viewer character 6, and the movement path is a pseudo parabola. The direction of the flick operation is determined by the injection direction, and the injection speed or the emission output is determined by the speed of the flick or the length of the flick. At that time, the injection speed or the emission output is determined based on the value of the parameter (for example, character level) defined for the poster character 4, and the flight distance (movement distance) of the item 8 (display body) is changed. ..

Of course, the action operation of input execution is not limited to the flick operation. If the touch panel 1506 is of a type capable of detecting pressing, the injection direction may be determined by the relative position between the display position and the touch position of the viewer character 6, and the injection speed or the emission output may be determined by the pressing force.

When the server system 1100 detects the input of the action operation of the input execution, the selected item 8 appears in the vicinity of the viewer character 6 in the virtual three-dimensional space, and the input specifications determined based on the action operation are used as pseudo. Pseudo parabolic motion is performed by physical calculation processing.

FIG. 8 is a diagram for explaining the granting of benefits related to throwing money.
The item 8 that appears in the virtual three-dimensional space is erased from the virtual three-dimensional space after a predetermined time. That is, the item 8 deemed to have not entered the event area (such as the opening of the event area object 30) remains on the floor for a while in the virtual three-dimensional space, and then disappears.

However, when the item 8 satisfies a predetermined positional relationship condition with any of the event area objects 30 (specifically, if the item 8 enters the event area object 30), the server system 1100 determines the item 8 and the event area object. Trigger an activation event based on 30 and. In the present embodiment, as an activation event, a privilege is given to one or both of the posting user 2a and the viewing user 2b who has thrown money using the item 8.

In the example of FIG. 8, the server system 1100 gives a privilege by giving points set for each event area object 30. This point is cumulatively managed for each user and later used in exchange for benefits. Of course, the item for privilege may be given at the timing when the thrown item 8 enters the event area object 30.

The server system 1100 changes / sets and grants the privilege content each time.
Specifically, the server system 1100 changes and sets the privilege based on the combination of the item 8 satisfying the positional relationship condition and the event area object 30 containing the item 8. Due to the size and shape of the item 8, the event area object 30, which is difficult to put into the intended purpose, is set so as to be highly evaluated even if the same number of coins are thrown. In the present embodiment, this is realized by giving higher points to one thrown money.

Further, the server system 1100 has performed the attributes defined for the poster character 4 and the attributes set for the item 8 satisfying the positional relationship condition (attributes set for the item 8 and the money for the item 8). The privilege is changed / set based on the compatibility with the viewing user 2b or the attribute set in the viewer character 6 of the viewing user 2b). In this embodiment, this is achieved by increasing or decreasing the points given.

Further, the server system 1100 changes / sets the privilege based on the area attribute set in the event area object 30 and the attribute set in relation to the item 8 satisfying the positional relationship condition.

Further, in the server system 1100, if the posting user 2a satisfies the positional relationship condition for the specific event area object 30 designated and operated from among the plurality of event area objects 30, the privilege is added.

FIG. 8 (1) shows an example in which the item 8 is included in the event area object 30 specified by the posting user 2a. In FIG. 8 (2), the item 8 other than the event area object 30 specified by the posting user 2a is shown. An example is shown when is entered. In the former case, special addition is added to the points given.

It should be noted that which event area object 30 is a specific event area object 30 may be indicated by the posting user 2a by voice or by the action of the poster character 4. The viewing user 2b may be notified by a change in the display form such as blinking the object. In this embodiment, the latter is used.

By the way, while the event area is set, that is, while the mini game referred to in the present embodiment is playable, the action performed by the posting user 2a in the virtual three-dimensional space via the posting character 4 is , Affect mini-games and create collaboration between posters and viewers.

FIG. 9 is a diagram for explaining an example of cooperation between the poster and the viewer, and is an example of an action in which the poster character 4 transports the item 8 that did not enter the event area object 30 to the event area object 30. Is shown.

When the posting user 2a inputs a special action operation, the server system 1100 controls the operation of the poster character 4 so as to perform an action associated with the special action operation.

In the example of FIG. 9 (1), the posting user 2a executes an action associated with the start operation of the carrying action. In this action, the poster terminal (user terminal 1500a) converts the poster motion data 712 and provides it to the server system 1100. When the server system 1100 detects this action from the poster motion data 712, it determines that there is an operation input for starting the carrying action, and causes the poster character 4 to perform a "picking action". The "pick-up action" is an action of picking up an item 8 that has fallen in front of the poster character 4 while automatically moving in the forward direction of the poster character 4, which is a direction corresponding to the front direction Df of the posting user 2a. Is.

In the example of FIG. 9 (2), the posting user 2a executes the action associated with the end operation of the carrying action. When the server system 1100 detects this action from the poster motion data 712, the server system 1100 causes the poster character 4 to perform an "input action". The “input action” is an action in which the item 8 picked up in the “picking action” is put into the nearest event area object 30 and automatically returned to the position P0 at the time of the start operation of the carrying action.

Then, when the item 8 enters the event area object 30 by the carrying action, a privilege based on the carrying action is given to one or both of the viewing user 2b and the posting user 2a who input the item 8 (FIG. The description of the evaluation points in 9 corresponds to this).

When the server system 1100 detects the input of the start operation of the transport action, it shall not accept other operation inputs until it detects the input of the end operation of the transport action or the predetermined time elapses. Further, the start operation and the end operation of the carrying action are not limited to the motion input method of the posting user 2a as shown in FIG. 9, and may be a command input method using the controller 3. Similarly, for other operations of the carrying action, the operation input related to the poster character 4 may be a command input method as well as a motion input method.

FIG. 10 is a diagram for explaining an example of cooperation between the poster and the viewer, and shows an example in which the poster character 4 changes the movement of the item 8.

In the example of FIG. 10 (1), the viewing user 2b executes the throwing money and the item 8 is moved. Here, the server system 1100 causes the poster character 4 to perform an "attack action" when a special action operation associated with the "attack action" is input to the poster terminal (user terminal 1500a). The "attack action" is a hand that the poster character 4 automatically moves in the forward direction of the poster character 4 corresponding to the front direction Df of the posting user 2a and flies near the poster character 4. It is an action to play with.

The server system 1100 constantly monitors hits (collisions) between objects arranged in a virtual three-dimensional space. Then, as shown in FIG. 10 (2), when the hand of the poster character 4 collides with the item 8 due to the "attack action", the server system 1100 changes the moving direction and the moving speed of the item 8. The moving direction and moving speed after the change may be determined physically by a pseudo-physical calculation, or may be randomly determined within a predetermined range from the moving direction and moving speed before the change.

The server system 1100 controls the item 8 whose movement has been changed due to the attack action so as to move by the pseudo-physical calculation as before until it is erased. As a result, when the item 8 enters the event area object 30, the server system 1100 grants one or both of the viewing user 2b and the posting user 2a who input the item 8 a privilege based on the attack behavior. (The description of the evaluation points in FIG. 10 corresponds to this).

FIG. 11 is a diagram for explaining an example of cooperation between the poster and the viewer, and is an example in which the poster character 4 performs a “throwing action” on the item 8 which has stopped and remains undisappeared. Is shown.

When the poster terminal (user terminal 1500a) is input with the special action operation associated with the "throw-back action", the server system 1100 causes the poster character 4 to take the "throw-back action". The "throwing action" means that the poster character 4 automatically moves in front of the poster character 4 corresponding to the front direction Df of the posting user 2a, and does not disappear in a state of being stopped in the vicinity of the poster character 4. It is an action of picking up the item 8 remaining in the item 8 and throwing it toward the viewer character 6 of the viewing user 2b who has thrown the item 8.

The server system 1100 performs display control in which the item 8 picked up during the control of the "throwing action" is replaced with another item 8n having a higher value than the item 8. Then, the movement control of another item 8n by the throwing of the poster character 4 is controlled to move so as to make a parabolic movement by a pseudo-physical calculation. When another item 8n reaches the vicinity of the viewer character 6, it is deleted from the virtual three-dimensional space. Then, the server system 1100 gives the erased another item 8n to the viewing user 2b of the viewer character 6 to be thrown back.

Then, the server system 1100 grants a privilege based on the throwing action to one or both of the viewing users 2b who input the item 8 (the description of the "privilege point" in FIG. 11 corresponds to this).

It should be noted that the control of replacing the item with another item 8n at the time of throwing back can be omitted as appropriate. Further, the other item 8n may be randomly selected from the preset candidate items.

FIG. 12 is a diagram for explaining a setting change of the event area object 30 by the poster character 4.
As shown in FIG. 12 (1), when the poster character 4 comes into contact with the event area object 30, the server system 1100 changes the set position of the event area object 30. Specifically, the position of the event area object 30 is changed so as to be pushed and moved by the poster character 4. It should be noted that the possibility of movement associated with such contact may be set depending on the type of the event area object 30.

The poster character 4 and the event area object 30 are set with movement limits in the virtual three-dimensional space. That is, the movable range of the poster character 4 is limited, and the server system 1100 automatically reverses the direction when the poster character 4 reaches the boundary of the movable range, and changes the direction to another direction.

Next, the functional configuration of the video distribution system 1000 will be described.
FIG. 13 is a functional block diagram showing a functional configuration example of the server system 1100. The server system 1100 includes an operation input unit 100s, a server processing unit 200s, a sound output unit 390s, an image display unit 392s, a communication unit 394s, and a server storage unit 500s.

The operation input unit 100s is a means for inputting various operations for managing the server. The keyboard 1106 of FIG. 1 corresponds to this.

The server processing unit 200s is realized by electronic components such as an IC memory in addition to a processor that is an arithmetic circuit such as a CPU, GPU, ASIC, and FPGA, and is associated with each functional unit including an operation input unit 100s and a server storage unit 500s. Data input / output control is performed between. Then, various arithmetic processes are executed based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from the user terminal 1500 and the like, and the operation of the server system 1100 is controlled in an integrated manner. To do.

The server processing unit 200s includes a user management unit 202, an online shopping management unit 204, a game management unit 206, a poster video data acquisition control unit 210, a display body appearance control unit 212, and an action influence control unit 214. , Video generation control unit 216 for distribution, event area setting unit 218, activation event control unit 220, evaluation aggregation unit 222, poster character parameter value change control unit 224, timekeeping unit 280s, and sound generation unit. 290s, an image generation unit 292s, and a communication control unit 294s are included. Of course, functional parts other than these can be included as appropriate.

The user management unit 202 performs processing related to the user registration procedure and management of data of each user associated with the user account. In the present embodiment, the user management unit 202 1) assigns a unique user account to a registered user, 2) manages registration information for registering and managing personal information (for example, an account name) for each user account, and 3) billing. It has the functions of book management of electronic payment media consumed for payment of elements (online shopping, etc. in this embodiment) and 4) usage history management. Of course, other data management functions associated with accounts other than these can be included as appropriate.

The online shopping management unit 204 is responsible for controlling online shopping. This can be achieved by appropriately using known online shopping technology. In the present embodiment, the user can purchase the item 8 to be thrown by online shopping. Of course, the sales target in online shopping can be set as appropriate in addition to these.

The game management unit 206 performs various controls for executing an online game on the user terminal 1500.

The poster video data acquisition control unit 210 controls to acquire the poster video data 710 in the virtual space or the augmented reality space in which the poster character operated on the poster terminal can act, from the poster terminal. Do (see Figure 4). In addition, the poster video data acquisition control unit 210 acquires data indicating a specific event area among the plurality of event areas from the poster terminal. In the present embodiment, when a plurality of event area objects 30 are arranged, a specification operation of which event area object 30 is set as a specific event area is accepted (see FIG. 8).

The display body appearance control unit 212 receives an action operation input from the viewer terminal and controls the display body to appear in the image space based on the action operation input. Then, the display body appearance control unit 212 determines the input direction of the display body based on the action operation input, and performs input control to make the display body appear and move in the image space along the input direction.

This is the control related to the "throwing money" using the item 8 in the present embodiment. This corresponds to the new arrangement control of the item 8 in the virtual three-dimensional space and the movement control of the item 8 (see FIG. 6).

The behavioral influence control unit 214 performs behavioral influence control that changes the display position of the display body based on the behavior of the poster character in the image space. In addition, when the behavior of the poster character satisfies the transport behavior condition for transporting the display body, the behavior influence control unit 214 displays the display body so that the poster character transports the display body to a given transport destination. To change. Then, the behavioral influence control unit 214 changes the content of the behavioral influence control based on the parameters set for the poster character.

The control for changing the display position of the picked-up item 8 in relation to the "carrying behavior" in the present embodiment corresponds to this (see FIG. 9). Further, the control of the change in the display position when the moving item 8 is flipped by the poster character 4 due to the "attack action" of the poster character 4 and the movement direction is changed corresponds to this (FIG. 10). reference). In addition, the change control of the display position when the item 8 that has stopped and remains due to the "throwing action" of the poster character 4 is thrown back by the poster character 4 corresponds to this (see FIG. 11). ).

The distribution video generation control unit 216 controls to generate a distribution video 22 in an image space in which an image based on the poster video data 710 and a display body are combined (see FIG. 5). Further, the distribution moving image generation control unit 216 generates the distribution moving image 22 including an image or sound for notifying a specific event area among the plurality of event areas.

The event area setting unit 218 sets a single or a plurality of event areas in which the area attributes are set, respectively, in the image space. This corresponds to the control of arranging the event area object 30 in the virtual three-dimensional space based on the predetermined event area setting request from the poster terminal and the event area selection operation and arrangement operation in the present embodiment. (See FIG. 6).

In addition, the event area setting unit 218 controls to change the setting position of the event area based on the behavior of the poster character in the image space. The control in which the poster character 4 in the present embodiment pushes and moves the event area object 30 corresponds to this (see FIG. 12).

The activation event control unit 220 determines whether or not the display body satisfies a given positional relationship condition with respect to the event area, and controls the activation of different activation events according to the event area satisfying the positional relationship condition. Then, the activation event control unit 220 controls the activation as an activation event, which is a process of giving a given privilege to the poster of the poster terminal and / or the viewer who has input the action operation.

The "positional relationship condition" can be described by combining one or more of the approach / arrival / contact / passage of the display body to the event area by AND or OR. The fact that the item 8 is included in the event area object 30 in the present embodiment corresponds to satisfying the positional relationship condition (see FIG. 8). Then, the granting of the privilege corresponds to the activation of the activation event.

More specifically, the activation event control unit 220 has 1) attributes set for the poster character and 2) attributes set for the display body, or attributes set for the viewer who has input the action operation. And, the privilege is changed and given based on the compatibility.

Further, the activation event control unit 220 grants different benefits depending on whether or not the display body satisfying the positional relationship condition is a display body whose display position has been changed by the action influence control. As the item 8 is moved by the "carrying action", "attacking action", and "throwing action" of the poster character 4 in this embodiment, the points that are considered as benefits are more than in other cases. This corresponds to being granted (see FIGS. 9, 10, and 11).

Further, the activation event control unit 220 variably controls the activation event to be activated based on the area attribute of the event area satisfying the positional relationship condition and the attribute related to the item 8 (moving body). This corresponds to the fact that the benefits given by the combination of these attributes change according to the present embodiment.

The evaluation totaling unit 222 totalizes the viewer's evaluation of the video for distribution.

The poster character parameter value change control unit 224 changes the parameter value of the poster character based on the viewer evaluation. Specifically, the poster character parameter value change control unit 224 changes the parameter value of the poster character to a higher value as the viewer evaluation is higher.

The timekeeping unit 280s uses the system clock to measure the current date and time, the time limit, and the like.

The sound generation unit 290s is realized by executing an IC or software that generates and decodes audio data, and generates or decodes operation sounds related to system management of the server system 1100, video viewing, and audio data such as BGM. In addition, the sound generation unit 290s executes a voice synthesis process for superimposing and synthesizing a plurality of voices. Then, the audio signal related to the system management is output to the sound output unit 390s.

The sound output unit 390s emits sound with the input audio signal. In the example of FIG. 1, a speaker (not shown) included in the main unit and the touch panel 1108 corresponds to this.

The image generation unit 292s generates an image, synthesizes an image, and outputs an image signal for displaying them on the image display unit 392s. In this embodiment, it plays a part of a function of generating various images / videos such as images related to system management of the server system 1100. In addition, the image generation unit 292s generates a moving image 22 for distribution by rendering an image taken by a virtual camera installed in a virtual three-dimensional space, performing image composition processing, and the like.

The communication control unit 294s executes data processing related to data communication, and realizes data exchange with an external device via the communication unit 394s.

The communication unit 394s connects to the network 9 to realize communication. For example, it is realized by a wireless communication device, a modem, a TA (terminal adapter), a jack of a wired communication cable, a control circuit, and the like. In the example of FIG. 1, the communication device 1153 corresponds.

The server storage unit 500s stores programs, various data, and the like for realizing various functions for making the server processing unit 200s control the server system 1100 in an integrated manner. Further, it is used as a work area of the server processing unit 200s, and temporarily stores the calculation results and the like executed by the server processing unit 200s according to various programs. This function is realized by, for example, an IC memory such as RAM or ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, or online storage. In the example of FIG. 1, the IC memory 1152 mounted on the main unit, a storage medium such as a hard disk, and the storage 1140 correspond to this.

FIG. 14 is a diagram showing an example of a program and data stored in the server storage unit 500s in the present embodiment. The server storage unit 500s in the present embodiment includes the server program 501, the distribution client program 503, the character definition data 510, the event area object definition data 530, the specific event area notification object data 540, and the item definition data 550. , The activation event definition data 570 and the data are stored.

Further, the server storage unit 500s stores user management data 600, distribution management data 700, and current date and time 800 as data that are sequentially generated and managed. Of course, the server storage unit 500s can appropriately store other programs and data (for example, timers, counters, various flags, etc.).

The server program 501 is a program for realizing the functions as the user management unit 202 to the poster character parameter value change control unit 224 (see FIG. 13) by reading and executing the server processing unit 200s.

The distribution client program 503 is an original client program provided to the user terminal 1500. In the present embodiment, one distribution client program 503 has a distribution posting client program 503b for making the user terminal 1500 function as a poster end, and a distribution viewing client for making the user terminal 1500 function as a viewer terminal. Includes program 503c and. These may be separately delivered to the user terminal 1500.

The character definition data 510 is prepared for each character that can be selected by the posting user 2a as the poster character 4 corresponding to his / her avatar, and stores various initial setting data related to the character. As shown in FIG. 15, for example, one character definition data 510 includes a unique character type 511, a character attribute 513, model data 515, an ability parameter value 517, and an operation pattern definition data 520.

As the model data 515, the model data prepared by the posting user 2a may be used.

The operation pattern definition data 520 is prepared for each operation that can be executed by the poster character, and stores various data related to the operation. One operation pattern definition data 520 includes a unique operation type 521, an activation requirement 522, an activation command definition data 523, motion data 524, an operation restriction type 525, and an operation limit value determination function 526. Of course, data other than these can be included as appropriate.

The activation requirement 522 is a condition to which the operation pattern is applied. For example, it is a condition regarding a parameter value (for example, a poster level, a poster character level, etc.) set in the posting user 2a or the poster character 4.

The activation command definition data 523 defines an operation input for activating the operation pattern. In the present embodiment, since the poster character 4 is operated by the motion of the posting user 2a, motion dictionary data for recognizing a specific motion is set. Of course, in the case of the command input method of inputting using the specific button switch of the controller 3, the type of the corresponding button switch and the combination thereof are set.

The operation restriction type 525 defines the type of restriction applied during execution of the operation pattern. For example, the movement distance, the time limit, the total number of items that can be carried in the case of "transportation action", the maximum number of times to play in the case of "attack action", and the like are set.

The operation limit value determination function 526 is a function or table data that determines a threshold value or an upper limit value of the limit indicated by the operation restriction type 525. As the variables, parameter values set in the posting user 2a or the poster character 4 (for example, the poster level, the poster character level, etc.), the number of viewers of the live distribution, and the like can be used.

Returning to FIG. 14, the event area object definition data 530 is prepared for each type of the event area object 30, and stores various initial setting data for the object.

As shown in FIG. 16, for example, one event area object definition data 530 includes a unique event area type 531, an event area attribute 533, an object model data 535, and an automatic operation of the event area object 30 (for example, first). It includes event area motion data 537 that defines the contents of randomly moving motion, reciprocating motion, rotational motion, shape variation that repeats expansion / contraction, etc. from the determined arrangement position. Of course, data other than these can be included as appropriate.

Returning to FIG. 14, the specific event area notification object data 540 is attached and displayed in order to notify the viewing user 2b of the specific event area designated by the viewing user among the event area objects 30 set by the posting user 2a. It is the definition data of the object.

Item definition data 550 is prepared for each type of item 8 and stores various initial setting data related to the item. As shown in FIG. 17, for example, one item definition data 550 includes a unique item type 551, an item attribute 552, an item display body data 553 for displaying the item 8 in the distribution image, and the item 8. Includes item motion pattern control data 555 that defines motion patterns in the delivered image. Of course, data other than these can be included as appropriate.

The activation event definition data 570 is prepared for each type of activation event that is activated when the item 8 (display body) satisfies a given positional relationship condition with respect to the event area object 30, and various types related to the activation event. Stores initialization data.

One trigger event definition data 570 includes, for example, as shown in FIG. 18, a unique trigger event ID 571, a trigger requirement 572, and a trigger event content data 573. Of course, data other than these can be included as appropriate.

Trigger requirement 572 indicates the conditions that must be met in order for the trigger event to be triggered. The activation requirement 572 is described by combining one or more of the positional relationship condition 572a, the combination condition 572b, the attribute relationship condition 572c, and the behavioral influence condition 572d by AND or OR.

The combination condition 572b is a condition for combining the type of the poster character 4, the type of the event area object 30, and the type of the item 8. The "type" mentioned here includes "no setting" and "all types".

The attribute-related condition 572c includes 1) a condition for combining the event area attribute 533 of the event area object 30 (see FIG. 16) and the item attribute 552 of the item 8 (see FIG. 17), and 2) the event of the event area object 30. It is a condition for one or both of the combination of the area attribute 533 (see FIG. 16) and the item attribute 552 (see FIG. 17) of the item 8 (display body) which is the judgment target of the activation requirement 57 2. ..

The behavioral influence condition 572d is a condition regarding the behavioral influence received by the item 8.
For example, if you want to include in the activation requirement 572 that the item 8 is affected by the action of "carrying action", the item 8 that was in the stopped state has been moved to any of the event area objects 30. It may be a condition. If it is desired to include in the activation requirement 572 that the item is influenced by the action of the "attack action", the contact with the poster character 4 and the speed change before and after the contact may be conditioned. Of course, only the presence or absence of contact with the poster character 4 may be a condition.

The positional relationship condition 572a, the combination condition 572b, the attribute relationship condition 572c, and the behavioral influence condition 572d can be set to "no setting".

The activation event content data 573 is the content of the activation event, and stores the data for executing the activation event. In the present embodiment, the activation event is the granting of benefits to the user. Therefore, the activation event content data 573 includes the privilege type 573a, the privilege grant number 573b, the first grant ratio 573c, and the second grant ratio 573d. Of course, data other than these can be included as appropriate.

In this embodiment, points are given as a privilege. Therefore, the privilege type 573a is set to "points", and the privilege grant number 573b defines the total number of points granted at the activation event.

The first grant ratio 573c and the second grant ratio 573d both define a ratio in which the points indicated by the privilege grant number 573b are distributed between the posting user 2a and the viewing user 2b who has input the item 8 related to the activation event. There is.

Returning to FIG. 14, the user management data 600 is prepared for each registered user of the video distribution system 1000, and stores various data related to the user.
As shown in FIG. 19, for example, one user management data 600 includes a unique user account 601, owned item management data 602, user attribute 603, cumulative privilege points 604, user level 606, and game save data 607. , The poster character setting data 610, and the viewer character setting data 615 are stored. Of course, data other than these may be stored as appropriate.

The owned item management data 602 is prepared for each type of item 8 owned (synonymous with having the right to use), and stores the item type and the remaining number of possessed items, respectively.

The user attribute 603 is an attribute selected by the user at the time of user registration. It is preferable that the attributes that can be selected by the user are the same as the plurality of types of attributes that can be set in the character attribute 513 (see FIG. 15) and the item attribute 552 (see FIG. 17). The user attribute 603 is regarded as a posting user attribute when the user is a posting user 2a, and is regarded as a viewing user attribute when the user is a viewing user 2b.

The game save data 607 is save data of game play by the user. The game save data 607 includes play history data 608 that records the progress of each play.

The poster character setting data 610 is the setting data of the poster character 4 used when the user makes a post. For example, it includes a poster character type 611 and a poster character parameter value 612 that stores various parameter values set in the poster character 4. Of course, data other than these can be included as appropriate.

The viewer character setting data 615 is the setting data of the viewer character 6 that the user uses when viewing. For example, it includes a viewer character type 616 and a viewer character parameter value 617 that stores various parameter values set in the viewer character 6. Of course, data other than these can be included as appropriate.

Returning to FIG. 14, the distribution management data 700 is created for each live distribution and stores various data describing the latest state of the distribution.
As shown in FIG. 20, for example, one distribution management data 700 includes a unique posting ID 701, a posting user account 702, a viewing user account list 703, a poster video data 710, an image space management data 730, and a privilege. Includes historical data 740, evaluation aggregate data 742, and video data for distribution 744. Of course, data other than these can be included as appropriate.

The poster video data 710 includes a posting user account 711, a poster motion data 712, a poster audio data 713, and a posting material data 714.

The image space management data 730 stores various data describing the state of the virtual space or the augmented reality space for generating the moving image for live distribution. In the present embodiment, since the moving image for live distribution is a 3DCG image, the image space management data 730 has the same meaning as the management data in the virtual three-dimensional space.

The image space management data 730 includes a unique image space ID 731, a base post ID 732 indicating a post that is a base for live distribution, a poster character control data 733 created for each poster character 4, and virtual camera control data 734. The event area object control data 735 created for each event area setting, the specific event area ID 736, and the viewer character control data 737 created for each viewing user 2b are created each time a change is made. Includes item control data 738 and. Of course, data other than these can be included as appropriate.

The poster character control data 733 includes a posting user account and data representing the state of the poster character 4 in the virtual three-dimensional space (for example, position coordinates, posture, movement speed, motion control data, etc.). Of course, data other than these can be included as appropriate.

The virtual camera control data 734 stores information such as a position, a posture, and an angle of view, which are viewpoints when rendering a video for live distribution.

The event area object control data 735 includes an event area ID, an event area object type, and data representing a state in a virtual three-dimensional space (for example, position coordinates, posture, movement speed, motion control data, and the like). Of course, data other than these can be included as appropriate.

The viewer character control data 737 includes a character ID, a viewing user account, and data representing the state of the viewer character 6 in the virtual three-dimensional space (for example, position coordinates, posture, movement speed, motion control data, etc.). Including. Of course, data other than these can be included as appropriate.

The item control data 738 is control data of a display body that receives an action operation input from the viewer terminal and appears in the image space based on the action operation input. In the present embodiment, it is the control data of the item 8 that has been thrown. Specifically, the item control data 738 includes a unique item ID, a user account (viewing user account using the item), an appearance date and time, a position coordinate history in a virtual three-dimensional space, a speed history, and a hit. Includes history of other objects, etc. Of course, data other than these can be included as appropriate.

The privilege history data 740 is data in which the information given in relation to the live distribution and the information of the grant destination are associated and stored in a time series.

The evaluation aggregated data 742 is data that aggregates the viewer evaluations for the live distribution. The initial value is "0". A predetermined evaluation operation input performed by the viewing user 2b during viewing is counted. The distribution moving image data 744 is data related to the distribution moving image 22 (see FIG. 5).

FIG. 21 is a functional block diagram showing a functional configuration example of the user terminal 1500 according to the present embodiment. The user terminal 1500 includes an operation input unit 100, a voice input unit 102, an imaging unit 104, a terminal processing unit 200, a sound output unit 390, an image display unit 392, a communication unit 394, and a terminal storage unit 500. To be equipped.

The operation input unit 100 outputs an operation input signal corresponding to various operation inputs made by the player to the terminal processing unit 200. For example, it can be realized by a push switch, a joystick, a touch pad, a trackball, an acceleration sensor, a gyro, a CCD module, or the like. The direction input key 1502, the button switch 1504, the touch panel 1506, and the camera 1520 in FIG. 2 correspond to this.

The voice input unit 102 collects voice (user voice) and environmental sound emitted by the user, and outputs a voice signal to the terminal processing unit 200. In the example of FIG. 2, the microphone 1512 corresponds to this.

The imaging unit 104 receives the light from the imaging target, converts it into an electric signal, generates digital image data, and outputs the digital image data to the terminal processing unit 200. For example, it is realized by a lens, a mechanical shutter, a shutter driver, a photoelectric conversion element such as a CCD image sensor module or a CMOS image sensor module, a digital signal processor (DSP) that reads the amount of charge from the photoelectric conversion element and generates image data, and an IC memory. Ru. The camera 1520 of FIG. 2 corresponds to this.

The terminal processing unit 200 is realized by, for example, a microprocessor such as a CPU or GPU, or an electronic component such as an IC memory, and controls data input / output with each functional unit including an operation input unit 100 and a terminal storage unit 500. Do. Then, various arithmetic processes are executed based on predetermined programs and data, operation input signals from the operation input unit 100, and various data received from the server system 1100 to control the operation of the user terminal 1500. The control board 1550 of FIG. 2 corresponds to this. The terminal processing unit 200 in the present embodiment includes a client control unit 260, a timekeeping unit 280, a sound generation unit 290, an image generation unit 292, and a communication control unit 294.

The client control unit 260 realizes functions as a posting terminal device and a viewing terminal device.
Specifically, it starts in either the posting terminal device or the viewing terminal device mode in response to the user's mode selection operation input, accesses the server system 1100, and processes the login procedure.

When started in the posting terminal mode, the client control unit 260 functions as the posting client control unit 261. The posting client control unit 261 performs various processes for realizing the function as a poster terminal. Specifically, it has a poster video data generation unit 262 and executes various processes related to the generation and provision of the poster video data 710 (see FIGS. 3 and 4). In addition, the posting client control unit 261 executes a process related to the event area setting request (see FIG. 6).

When activated in the viewer terminal mode, the client control unit 260 functions as the viewing client control unit 263. The viewing client control unit 263 executes various processes for realizing the function as a viewer terminal and processes related to the execution of throwing money (see FIGS. 6 and 7).

The sound generation unit 290 is realized by, for example, a digital signal processor (DSP), a processor such as a voice synthesis IC, an audio codec capable of reproducing a voice file, or the like, and generates sound signals such as sound effects, operation sounds, and BGM to generate sounds. Output to the output unit 390.

The sound output unit 390 is realized by a device that outputs sound based on a sound signal input from the sound generation unit 290. The speaker 1510 in FIG. 2 corresponds to this.

The image generation unit 292 controls the generation of various image data and the generation and output of image signals for displaying those images on the image display unit 392.

The image display unit 392 displays various images based on the image signal input from the image generation unit 292. For example, it can be realized by an image display device such as a flat panel display, a projector, or a head-mounted display. In this embodiment, the touch panel 1506 of FIG. 2 corresponds to this.

The communication control unit 294 executes data processing related to data communication, and realizes data exchange with an external device via the communication unit 394. The communication unit 394 connects to the network 9 to realize communication. For example, it is realized by a wireless communication device, a modem, a TA (terminal adapter), a jack or a control circuit of a wired communication cable, and the wireless communication module 1553 of FIG. 2 corresponds to this.

The terminal storage unit 500 stores programs, various data, and the like for realizing various functions for causing the terminal processing unit 200 to control the user terminal 1500 in an integrated manner. Further, it is used as a work area of the terminal processing unit 200, and temporarily stores the calculation result executed by the terminal processing unit 200 according to various programs, the input data input from the operation input unit 100, and the like. Such a function is realized by, for example, an IC memory such as RAM or ROM, a magnetic disk such as a hard disk, an optical disk such as a CD-ROM or DVD, or the like. The IC memory 1552 and the memory card 1540 mounted on the control board 1550 of FIG. 2 correspond to this. It is also possible to configure using online storage.

The terminal storage unit 500 of the present embodiment stores the client program 502, the original poster video data 710, and the live distribution data 582 which is the data for viewing the live video and audio. Of course, programs and data other than these can be stored as appropriate.

The client program 502 is application software for realizing the function as the client control unit 260 by being read and executed by the terminal processing unit 200. In this embodiment, the client program 502 is a copy of the distribution client program 503 (see FIG. 14) provided by the server system 1100. The client program 502 may be a dedicated client program, or may be configured by a web browser program, a plug-in that realizes an interactive image display, or the like.

Next, the operation of the moving image distribution system 1000 of the present embodiment will be described.
22 to 23 are flowcharts for explaining the processing flow of the server system 1100 related to live distribution.

As shown in FIG. 22, first, the server system 1100 prepares the distribution management data 700 (see FIG. 20) and starts acquiring the poster video data 710 from the poster terminal (step S6).

Next, the server system 1100 arranges the poster character 4 and the virtual camera in the virtual three-dimensional space based on the acquired poster video data 710 (step S8), and controls the operation of the poster character 4 from the poster terminal. Is started (step S10). Then, the generation and live distribution of the distribution video 22 for live distribution and the evaluation aggregation of the viewers related to the live distribution are started (step S12).

If the posting user 2a wants to carry out an event, he / she inputs a predetermined event area setting request operation on the poster terminal. The poster terminal transmits an event area setting request to the server system 1100 with the input.

When the request is received by receiving the event area setting request from the poster terminal (YES in step S14), the server system 1100 changes the angle of the virtual camera to a predetermined value in order to secure the event space (step S16). , The event area object 30 is additionally arranged in the virtual three-dimensional space (step S18). After that, if the operation pattern is set for the additionally arranged event area object 30, the server system 1100 starts the automatic control of the operation.

Further, the server system 1100 starts control to change the set position of the additionally arranged event area object 30 based on the action of the poster character 4 (step S20; see FIG. 12). ).

Further, if the posting user 2a wants to set any one of the plurality of event area objects 30 in the specific event area, he / she inputs a predetermined designated operation on the poster terminal. The contributor terminal sends a designated request to the server system 1100 with the input.

When the server system 1100 accepts the designated request by receiving the designated request from the poster terminal (YES in step S30), the designated event area object 30 is set as a specific event area (step S32), and the virtual 3 An object that notifies a specific event area is arranged in the dimensional space (step S34).

When the server system 1100 receives the viewing request (YES in step S40), the server system 1100 registers the user of the viewer terminal who has sent the request as a viewing user (step S42), and registers the viewing character 6 of the viewing user. Arrange in a virtual three-dimensional space (step S44).

If the viewing user wants to make a change during viewing, he / she inputs an action operation associated with the change on the viewer terminal. When the viewer terminal detects the action operation, the viewer terminal sends an action request corresponding to the action operation to the server system 1100. In the present embodiment, the throwing money request is transmitted together with the item type information of the item 8 used as the throwing money.

When the server system 1100 receives the request for throwing money from the viewer terminal (YES in step S50), the item 8 to be used as money throwing is additionally arranged and appeared in the virtual three-dimensional space (step S52). ), The movement control of the spawned item 8 is started (step S54).

When the server system 1100 detects the input of the special action operation on the poster terminal (YES in step S60), the server system 1100 starts the operation control so that the poster character 4 performs the operation according to the special action operation (step S62). (See FIGS. 9, 10, and 11), the behavioral influence control of the item 8 that has already appeared is started (step S64).

Further, if the server system 1100 includes an item 8 that satisfies the activation requirement 572 (see FIG. 18) among the items 8 that have already appeared (YES in step S70), the activation event definition data 570 of the activation requirement 572 is activated. Bonus points are given according to the event content data 573 (step S72).

Then, the server system 1100 deletes the item 8 that has already appeared in the virtual three-dimensional space and the predetermined time has elapsed from the appearance date and time (step S74).

Steps S14 to S74 are repeated until the live distribution is completed (NO in step S80). Then, when the live distribution is completed (YES in step S80), the server system 1100 sets the level of the posting user 2a and the posting character 4 based on the evaluation aggregate data 742 which is the viewer evaluation for the live distribution this time. The parameter value of is changed (step S82). For example, if the evaluation is high, the level of the character included in the user level 606 of the posting user 2a or the poster character parameter value 612 of the posting character 4 is raised.
Then, the server system 1100 ends a series of processes.

As described above, according to the present embodiment, it is possible to bring about a new service using throwing money in live video distribution.

That is, if an action operation for executing the tossed money is input on the viewer terminal, a display body representing the tossed money appears in the live-streamed video and is moved and displayed as if it was thrown in.

Moreover, according to the present embodiment, the viewer character 6 is additionally arranged in the virtual three-dimensional space in which the poster character 4 exists, and the item 8 (display body) of the tossed money is additionally arranged in the virtual three-dimensional space. .. Then, the position of the item 8 may change due to the influence of the behavior of the poster character 4. In other words, it is possible to bring the link between the behavior of the viewer and the behavior of the poster to the live video distribution.
Therefore, according to the present embodiment, it is possible to enhance the sympathy between the poster and the viewer as compared with the conventional case, and to provide an unprecedented new user experience (interest) through the same video.

[Modification example]
Although the embodiments to which the present invention is applied have been described above, the embodiments to which the present invention can be applied are not limited to the above-described embodiments, and constituent elements can be added, omitted, or changed as appropriate.

[Modification example 1]
For example, in the above embodiment, the posting user 2a in one live distribution has been illustrated and described as one person, but there may be a plurality of posting users 2a in one live distribution.

That is, the poster video data 710 includes data of a plurality of poster characters 4 operated by the poster terminal (user terminal 1500a), and the distribution video generation control unit 216 (see FIG. 13) is responsible for the poster video data. Based on 710, it is also possible to generate a distribution moving image 22 including images of a plurality of contributor characters 4.

Specifically, for example, if the distribution video 22 to be live-streamed is limited to a virtual space image, the server system 1100 is involved in the authentication procedure of the user of the poster terminal, and the user becomes the posting user in advance. Request the input of the unique live distribution ID obtained through the reservation procedure. Then, all the users of the poster terminal authenticated by the server system 1100 with the same live distribution ID may be treated as posting users.

Further, in the case of the configuration in which the distribution video 22 to be live-distributed is an augmented reality image, a plurality of posting users are photographed at once on the poster terminal (user terminal 1500a), and motion capture processing is executed for each of them. Then, the poster motion data 712 is generated for each person. Prior to that, the poster video data 710 includes the setting information for associating the relative positional relationship with the AR marker 5 (for example, right side / left side with respect to the AR marker 5) and the posting user. The server system 1100 identifies which poster motion data 712 is who's data based on the setting information. Then, the server system 1100 may arrange the poster character 4 for each person in the virtual three-dimensional space and control the operation based on the poster motion data 712 of each person.

Then, as shown in FIG. 24, a plurality of teams mixed with a plurality of posting users and a plurality of viewing users are set (in the example of FIG. 24, the RED teams of the posting user 2a and the viewing user 2b, and the posting user 2c). (BLUE team with the viewing user 2d), a ball throwing team battle game using throwing money may be executed, and the activation event may be activated (giving a privilege) only to the winning team.

[Modification 2]
Further, in the above embodiment, the distribution video 22 is created by synthesizing the video of the poster character 4 with the posted material data 714, but when the posted material data 714 is used as a game play video, another method is used. Can be created with.

Specifically, the server system 1100 stores and manages play data 770 as shown in FIG. 25 for each game play. The play data 770 stores data describing the progress of the game play, data for displaying the game screen, and the like. Then, the play data 770 includes the player account 771 and the original play reproduction data 772 that can reproduce all the events in the virtual three-dimensional space related to the game play. The original play reproduction data 772 includes, for example, game object control history data 773, virtual camera control history data 774, and operation input history data 775.

The original play reproduction data 772 is separately saved at the end of the game play and becomes available to the player. Specifically, the server system 1100 prepares a virtual three-dimensional space for reproduction in response to a given request from the user terminal 1500, and arranges a game object or the like in the virtual three-dimensional space based on the original play reproduction data 772. .. Then, the server system 1100 creates a play video of the original play by reproducing the movement in the original play on the arranged game object and rendering the virtual camera used in the original play as a viewpoint. Then, the server system 1100 displays the play moving image on the user terminal and shows it to the player.

FIG. 26 is a diagram showing a data configuration example of the posted material data 714 in the configuration.
By appropriately editing the play video reproduced as described above, the posted material data 714 of the game play video can be created. Specifically, the server system 1100 displays a video editing screen on the user terminal 1500, and among the reproduced play videos (videos of all game play), which time range is connected in what order to make one. Create editing information 715 as a moving image. For example, the editing information 715 stores information on a time range in which the time elapsed in the original play is adopted for each cut in the order of cutting the moving image.

Therefore, the editing information 715 and the original play reproduction data (copy) 716 copied from the play data 770 can be used as the posting material data 714 of the game play video. A virtual three-dimensional space is prepared for reproduction, information for the time range of the cut is read from the original play reproduction data (copy) 716 in the order of cuts according to the edit information 715, and the game object or the original is based on the read information. Place a virtual camera. Then, motion control and rendering are performed for the time range of the cut. By continuously executing this over all cuts, a gameplay video is generated from the posted material data 714.

It is preferable to include the material provider account 717 in the posted material data 714 as appropriate, because information on the origin of the posted material can be referred to.

As shown in FIG. 27, when the distribution video 22 is distributed, the server system 1100 displays the edit information 715 of the posted material data 714 and the edit information 715 of the posted material data 714 in the virtual three-dimensional space prepared for generating the distribution video 22. Based on the original play reproduction data (copy) 716, the game objects (character objects of the player character 40 and the enemy character 42 in the example of FIG. 27) and the original virtual camera CM0 are arranged and the operation is controlled.

At the same time, the server system 1100 sets the character object of the poster character 4 and the actual situation in the virtual three-dimensional space based on the poster video data 710 (see FIG. 4) transmitted from the user terminal 1500 of the posting user 2a. A comment object 44 for displaying the user's text comment, an additional virtual camera CM1, and other new objects (live objects) related to the live commentary are additionally arranged and controlled together with the objects related to the original game play. Further, the server system 1100 additionally arranges and controls the event area object 30 in the virtual three-dimensional space in accordance with an event area setting request or the like transmitted from the user terminal 1500 of the posting user 2a.

Then, the server system 1100 creates the distribution moving image 22 by rendering the state of the virtual three-dimensional space using the original virtual camera CM0 and the additional virtual camera CM1. As for the voice, the live voice is superimposed on the voice of the original game play.

Further, when the distribution moving image 22 is distributed, the viewer character 6 of the viewing user and the object of the item 8 may be arranged in a virtual three-dimensional space for generating the distribution moving image 22.

When the video 22 for distribution is generated and distributed with this configuration, the poster character 4 and the event area object 30 appear in the game world of the original game play, and the viewer character 6 and the item 8 of the viewing user also appear. Therefore, it is possible to show an unprecedented video as if the poster character 4 is playing a live game from the game play site, and the viewer is also playing a mini game at the game play site. It will be possible.

[Modification 3]
Assuming the second modification, the server system 1100 is involved in the storage control of the distribution management data 700, for example.
1) The poster motion data 712 is recorded in a history format in which all motion data of the posting user being distributed is saved in chronological order.
2) The poster voice data 713 is stored in a history format that saves all the voices of the posting users being delivered in chronological order.
3) The viewing character control data 737 is stored in a history format in which all control data during distribution of the viewing character is saved in chronological order.
4) Save the item control data 738 of the item used during distribution without erasing it.
5) Save the distribution management data 700 (see FIG. 20) at the end of distribution.
If it is configured, it becomes possible to analyze the influence of the distribution on the viewing user.

That is, by referring to the stored distribution management data 700, the server system 1100 refers to which original play (found from the posted material data 714), who (found from the posted user account 702), and what kind of actual situation after distribution. (Revealed from the poster motion data 712 and the audio analysis of the poster audio data 713) can be analyzed.

Then, the server system 1100 identifies the viewing user who has viewed the distribution by referring to the viewer character control data 737 and the item control data 738, and the game save data 607 of the viewing user (see FIG. 19). ), It is possible to know which viewing user has performed what kind of action after viewing the distribution video 22 (found from the play history data 608). In other words, the server system 1100 can infer the influence of viewing the distribution moving image 22 on the behavior of the viewing user.

2 ... User 2a ... Posting user 2b ... Viewing user 4 ... Poster character 6 ... Viewer character 8 ... Item 22 ... Video for distribution 30 ... Event area object 200s ... Server processing unit 210 ... Poster video data acquisition control unit 212 ... Display appearance control unit 214 ... Behavioral influence control unit 216 ... Video generation control unit for distribution 218 ... Event area setting unit 220 ... Activation event control unit 222 ... Evaluation aggregation unit 224 ... Poster character parameter value change control unit 500s ... Server storage Part 501 ... Server program 503 ... Delivery client program 510 ... Character definition data 513 ... Character attribute 520 ... Operation pattern definition data 530 ... Event area object definition data 533 ... Event area attribute 540 ... Specific event area notification object data 550 ... Item definition Data 552 ... Item attribute 553 ... Item display body data 570 ... Trigger event definition data 572 ... Trigger requirement 572a ... Positional relationship condition 572b ... Combination condition 572c ... Attribute relationship condition 572d ... 573c ... 1st grant ratio 573d ... 2nd grant ratio 582 ... Live distribution data 600 ... User management data 602 ... Owned item management data 603 ... User attributes 604 ... Cumulative privilege points 606 ... User level 610 ... Posted character setting data 612 ... Poster character parameter value 700 ... Distribution management data 702 ... Post user account 703 ... Viewing user account list 710 ... Poster video data 730 ... Image space management data 733 ... Poster character control data 734 ... Virtual camera control data 735 ... Event area Object control data 736 ... Specific event area ID
737 ... Viewer character control data 738 ... Item control data 742 ... Evaluation aggregate data 744 ... Video data for distribution 1000 ... Video distribution system 1100 ... Server system 1500 ... User terminal 1500a ... User terminal (poster terminal)
1500b ... User terminal (viewer terminal)

Claims (16)

It is a server system that distributes videos by communicating with the poster terminal and the viewer terminal.
A poster video data acquisition means for acquiring poster video data in an image space, which is a virtual space or an augmented reality space in which a poster character operated by the poster terminal can act, from the poster terminal.
A display body appearance control means that receives an action operation input from the viewer terminal and causes the display body to appear in the image space based on the action operation input.
A behavioral influence control means that controls behavioral influences that change the display position of the display body based on the behavior of the poster character in the image space.
A distribution video generation means for generating a distribution video in the image space in which an image based on the poster video data and the display body are combined.
Server system with. The display body appearance control means determines the closing direction of the display body based on the action operation input, and performs closing control to make the display body appear and move in the image space along the throwing direction.
The server system according to claim 1. An event area setting means for setting an event area in the image space and
An activation event control means that controls the activation of a given activation event based on whether or not the display body satisfies a given positional relationship condition with respect to the event area.
The server system according to claim 2. The activation event control means controls the activation as the activation event, which is a process of giving a given privilege to the poster of the poster terminal and / or the viewer who has input the action operation.
The server system according to claim 3. The activation event control means changes the privilege based on the compatibility between the attribute defined for the poster character and the attribute set for the display body or the viewer who has performed the action operation input. Grant,
The server system according to claim 4. The activation event control means grants different benefits based on whether or not the display body satisfying the positional relationship condition is a display body whose display position has been changed by the action influence control.
The server system according to claim 4 or 5. The activation event control means variably controls the ratio of the privilege given to the poster of the poster terminal and the privilege given to the viewer who has input the action operation based on the presence or absence of the action influence control. To do,
The server system according to any one of claims 4 to 6. The event area setting means controls to change the set position of the event area based on the behavior of the poster character in the image space.
The server system according to any one of claims 3 to 7. The event area setting means sets a plurality of the event areas and sets them.
The activation event control means activates different activation events according to the event area that satisfies the positional relationship condition.
The poster video data acquisition means acquires data indicating a specific event area among the plurality of event areas from the poster terminal.
The distribution moving image generation means generates the distribution moving image including an image or sound for notifying the specific event area.
The server system according to any one of claims 3 to 8. The display body appearance control means changes the flight distance of the display body based on the parameters determined for the poster character.
The server system according to any one of claims 2 to 9. A given area attribute is set in the event area.
The activation event control means variably controls the activation event to be activated based on the area attribute of the event area satisfying the positional relationship condition and the attribute related to the display body.
The server system according to any one of claims 2 to 10. When the behavior of the poster character satisfies the transport behavior condition for transporting the display body, the behavior influence control means is such that the poster character transports the display body to a given transport destination. Change the display position of
The server system according to any one of claims 1 to 11. The behavioral influence control means changes the content of the behavioral influence control based on the parameters defined for the poster character.
The server system according to any one of claims 1 to 12. Evaluation aggregation means for aggregation of viewer evaluations for the video for distribution, and
A parameter value change control means for changing the parameter value of the poster character based on the viewer evaluation, and
The server system according to any one of claims 1 to 13. The poster video data includes data of a plurality of poster characters operated by the poster terminal, and includes data of a plurality of poster characters.
The distribution video generation means generates the distribution video including images of the plurality of poster characters based on the poster video data.
The server system according to any one of claims 1 to 14. With the poster terminal
With the viewer terminal
The server system according to any one of claims 1 to 15, which is communication-connected to the poster terminal and the viewer terminal.
Video distribution system equipped with.

Images